| Name | yX6NDmMgdSunShfckohDCDFpABFKDmABFKDmagASDmABFKDmG3shin_4 |
| Workunit | 1885570 |
| Created | 3 Apr 2019, 9:32:49 UTC |
| Sent | 3 Apr 2019, 13:37:11 UTC |
| Report deadline | 10 Apr 2019, 13:37:11 UTC |
| Received | 3 Apr 2019, 15:18:41 UTC |
| Server state | Over |
| Outcome | Validate error |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 3682 |
| Run time | 1 hours 41 min 12 sec |
| CPU time | 6 hours 16 min 32 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 17.79 GFLOPS |
| Application version | ATLAS Simulation v0.61 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 1.80 GB |
| Peak swap size | 2.44 GB |
| Peak disk usage | 960.86 MB |
Stderr output
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
15:37:21 (3527991): wrapper (7.7.26015): starting
15:37:21 (3527991): wrapper: running run_atlas (--nthreads 4)
singularity image is /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img
sys.argv = ['run_atlas', '--nthreads', '4']
THREADS=4
Checking for CVMFS
CVMFS is installed
OS:CentOS Linux release 7.6.1810 (Core)
This is not SLC6, need to run with Singularity....
Checking Singularity...
Singularity is installed
copy /home/dcameron/boinc/slots/0/shared/ATLAS.root_0
copy /home/dcameron/boinc/slots/0/shared/input.tar.gz
copy /home/dcameron/boinc/slots/0/shared/RTE.tar.gz
copy /home/dcameron/boinc/slots/0/shared/start_atlas.sh
export ATHENA_PROC_NUMBER=4;start atlas job with
Testing the function of Singularity...
check singularity with cmd:singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img hostname
Singularity Works...
cmd = singularity exec --pwd /home/dcameron/boinc/slots/0 -B /cvmfs,/home /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img sh start_atlas.sh > runtime_log 2> runtime_log.err
running cmd return value is 0
Moving ./HITS.17438895._030696.pool.root.1 to shared/HITS.pool.root.1
*****************The last 100 lines of the pilot log******************
"setokens": "ATLASDATADISK",
"site": "BOINC",
"siteid": "BOINC_MCORE",
"sitershare": null,
"space": 0,
"special_par": null,
"stageinretry": 2,
"stageoutretry": 2,
"status": "brokeroff",
"statusoverride": "offline",
"sysconfig": "manual",
"system": "arc",
"tags": "arc",
"tier": "T3",
"timefloor": 0,
"tmpdir": null,
"transferringlimit": 20000,
"tspace": "2070-01-01T00:00:00",
"use_newmover": "True",
"validatedreleases": "True",
"version": null,
"wansinklimit": null,
"wansourcelimit": null,
"wnconnectivity": "full",
"wntmpdir": null,
"workflow": "push"
}
2019-04-03 13:37:34|3532916|SiteInformat| Queuedata was successfully downloaded by pilot wrapper script
2019-04-03 13:37:34|3532916|ATLASSiteInf| curl command returned valid queuedata
2019-04-03 13:37:34|3532916|ATLASSiteInf| Site BOINC_MCORE is currently in brokeroff mode
2019-04-03 13:37:34|3532916|ATLASSiteInf| Job recovery turned off
2019-04-03 13:37:34|3532916|ATLASSiteInf| Confirmed correctly formatted rucio sepath
2019-04-03 13:37:34|3532916|ATLASSiteInf| Confirmed correctly formatted rucio seprodpath
2019-04-03 13:37:34|3532916|SiteInformat| Evaluating queuedata
2019-04-03 13:37:34|3532916|SiteInformat| Setting unset pilot variables using queuedata
2019-04-03 13:37:34|3532916|SiteInformat| appdir:
2019-04-03 13:37:34|3532916|pUtil.py | File registration will be done by server
2019-04-03 13:37:34|3532916|pUtil.py | Updated stage-in retry number to 2
2019-04-03 13:37:34|3532916|pUtil.py | Updated stage-out retry number to 2
2019-04-03 13:37:34|3532916|pUtil.py | Detected unset (NULL) release/homepackage string
2019-04-03 13:37:34|3532916|ATLASExperim| Appdir not set in queuedata
2019-04-03 13:37:34|3532916|ATLASExperim| VO_ATLAS_SW_DIR=/cvmfs/atlas.cern.ch/repo/sw
2019-04-03 13:37:34|3532916|ATLASExperim| Application dir confirmed: /cvmfs/atlas.cern.ch/repo/sw/software
2019-04-03 13:37:34|3532916|pilot.py | Pilot will serve experiment: Nordugrid-ATLAS
2019-04-03 13:37:34|3532916|ATLASExperim| Architecture information:
2019-04-03 13:37:34|3532916|ATLASExperim| Excuting command: lsb_release -a
2019-04-03 13:37:34|3532916|ATLASExperim|
sh: lsb_release: command not found
2019-04-03 13:37:34|3532916|pUtil.py | getSiteInformation: got experiment=ATLAS
2019-04-03 13:37:34|3532916|ATLASExperim| appdirs = ['/cvmfs/atlas.cern.ch/repo/sw']
2019-04-03 13:37:34|3532916|ATLASExperim| head of /cvmfs/atlas.cern.ch/repo/sw/ChangeLog:
--------------------------------------------------------------------------------
2019-04-03 15:00:18 Alessandro De Salvo
* + AGISData 20190403150018
2019-04-03 14:00:17 Alessandro De Salvo
* + AGISData 20190403140017
2019-04-03 13:02:11 Alessandro De Salvo
* + AGISData 20190403130211
2019-04-03 13:01:17 Alessandro De Salvo
--------------------------------------------------------------------------------
2019-04-03 13:37:34|3532916|ATLASExperim| ATLAS_PYTHON_PILOT set to /usr/bin/python
2019-04-03 13:37:34|3532916|pUtil.py | getSiteInformation: got experiment=ATLAS
2019-04-03 13:37:34|3532916|ATLASExperim| Executing command: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase;$ATLAS_LOCAL_ROOT_BASE/utilities/checkValidity.sh (time-out: 300)
2019-04-03 13:37:34|3532916|pUtil.py | Executing command: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase;$ATLAS_LOCAL_ROOT_BASE/utilities/checkValidity.sh (protected by timed_command, timeout: 300 s)
2019-04-03 13:37:34|3532916|pUtil.py | Elapsed time: 0
2019-04-03 13:37:34|3532916|ATLASExperim| Diagnostics tool has verified CVMFS
2019-04-03 13:37:34|3532916|Node.py | Collecting machine features
2019-04-03 13:37:34|3532916|Node.py | $MACHINEFEATURES not defined locally
2019-04-03 13:37:34|3532916|Node.py | $JOBFEATURES not defined locally
2019-04-03 13:37:34|3532916|Node.py | Executing command: hostname -i
2019-04-03 13:37:34|3532916|Node.py | IP number of worker node: 128.141.229.191
2019-04-03 13:37:34|3532916|pUtil.py | getSiteInformation: got experiment=Nordugrid-ATLAS
2019-04-03 13:37:34|3532916|pilot.py | Using site information for experiment: Nordugrid-ATLAS
2019-04-03 13:37:34|3532916|pilot.py | Will attempt to create workdir: /home/dcameron/boinc/slots/0/Panda_Pilot_3532916_1554298654
2019-04-03 13:37:34|3532916|pilot.py | Creating file: /home/dcameron/boinc/slots/0/CURRENT_SITEWORKDIR
2019-04-03 13:37:34|3532916|pUtil.py | Wrote string "/home/dcameron/boinc/slots/0/Panda_Pilot_3532916_1554298654" to file: /home/dcameron/boinc/slots/0/CURRENT_SITEWORKDIR
2019-04-03 13:37:34|3532916|ATLASExperim| ATLAS_POOLCOND_PATH = /cvmfs/atlas.cern.ch/repo/conditions
2019-04-03 13:37:34|3532916|pilot.py | Preparing to execute Cleaner
2019-04-03 13:37:34|3532916|pilot.py | Cleaning /home/dcameron/boinc/slots/0
2019-04-03 13:37:34|3532916|Cleaner.py | Cleaner initialized with clean-up limit: 2 hours
2019-04-03 13:37:34|3532916|Cleaner.py | Cleaner will scan for lost directories in verified path: /home/dcameron/boinc/slots/0
2019-04-03 13:37:34|3532916|Cleaner.py | Executing empty dirs clean-up, stage 1/5
2019-04-03 13:37:34|3532916|Cleaner.py | Purged 0 empty directories
2019-04-03 13:37:34|3532916|Cleaner.py | Executing work dir clean-up, stage 2/5
2019-04-03 13:37:34|3532916|Cleaner.py | Purged 0 single workDirs directories
2019-04-03 13:37:34|3532916|Cleaner.py | Executing maxed-out dirs clean-up, stage 3/5
2019-04-03 13:37:34|3532916|Cleaner.py | Purged 0 empty directories
2019-04-03 13:37:34|3532916|Cleaner.py | Executing AthenaMP clean-up, stage 4/5 <SKIPPED>
2019-04-03 13:37:34|3532916|Cleaner.py | Executing PanDA Pilot dir clean-up, stage 5/5
2019-04-03 13:37:34|3532916|Cleaner.py | Number of found job state files: 0
2019-04-03 13:37:34|3532916|Cleaner.py | No job state files were found, aborting clean-up
2019-04-03 13:37:34|3532916|pilot.py | Update frequencies:
2019-04-03 13:37:34|3532916|pilot.py | ...Processes: 300 s
2019-04-03 13:37:34|3532916|pilot.py | .......Space: 600 s
2019-04-03 13:37:34|3532916|pilot.py | ......Server: 1800 s
2019-04-03 13:37:34|3532916|pUtil.py | Timefloor set to zero in queuedata (multi-jobs disabled)
***************diag file************
runtimeenvironments=APPS/HEP/ATLAS-SITE;
Processors=1
WallTime=6064.37s
KernelTime=114.40s
UserTime=22591.87s
CPUUsage=374%
MaxResidentMemory=1944764kB
AverageResidentMemory=0kB
AverageTotalMemory=0kB
AverageUnsharedMemory=0kB
AverageUnsharedStack=0kB
AverageSharedMemory=0kB
PageSize=4096B
MajorPageFaults=19908
MinorPageFaults=9278219
Swaps=0
ForcedSwitches=388285
WaitSwitches=1724098
Inputs=7114832
Outputs=545360
SocketReceived=0
SocketSent=0
Signals=0
nodename=David_Cameron@pcoslo5.cern.ch
exitcode=0
******************************WorkDir***********************
total 379776
drwxrwx--x. 7 dcameron zp 4096 Apr 3 17:18 .
drwxrwx--x. 6 dcameron zp 42 Mar 15 11:53 ..
-rw-------. 1 dcameron zp 7210770 Apr 3 15:37 agis_ddmendpoints.cvmfs.json
-rw-------. 1 dcameron zp 4897550 Apr 3 15:37 agis_schedconf.cvmfs.json
drwx------. 2 dcameron zp 6 Apr 3 15:37 .alrb
drwxr-xr-x. 3 dcameron zp 17 Apr 3 15:37 APPS
-rw-------. 1 dcameron zp 548 Apr 3 15:37 .asetup
-rw-r--r--. 1 dcameron zp 0 Apr 3 15:37 boinc_lockfile
-rw-r--r--. 1 dcameron zp 8192 Apr 3 17:18 boinc_mmap_file
-rw-r--r--. 1 dcameron zp 536 Apr 3 17:14 boinc_task_state.xml
-rw-------. 1 dcameron zp 59 Apr 3 15:37 CURRENT_SITEWORKDIR
-rw-r--r--. 1 dcameron zp 372795993 Apr 3 15:37 EVNT.16926424._000610.pool.root.1
-rw-r--r--. 1 dcameron zp 6215 Apr 3 15:37 init_data.xml
-rw-r--r--. 1 dcameron zp 1097578 Apr 3 15:37 input.tar.gz
-rw-------. 1 dcameron zp 7960 Apr 3 17:18 jobSmallFiles.tgz
-rw-r--r--. 1 dcameron zp 112 Apr 3 15:37 job.xml
-rw-------. 1 dcameron zp 689381 Apr 3 17:18 log.17438895._030696.job.log.1
-rw-------. 1 dcameron zp 834448 Apr 3 17:17 log.17438895._030696.job.log.tgz.1
-rw-------. 1 dcameron zp 312 Apr 3 17:16 memory_monitor_summary.json
-rw-------. 1 dcameron zp 1024 Apr 3 17:17 metadata-surl.xml
-rw-------. 1 dcameron zp 922 Apr 3 17:17 OutputFiles-4284345714.xml
-rw-------. 1 dcameron zp 463 Apr 3 17:18 output.list
-rw-------. 1 dcameron zp 11 Apr 3 15:37 pandaIDs.out
-rw-------. 1 dcameron zp 2884 Apr 3 15:37 pandaJobData_1.out
-rw-------. 1 dcameron zp 2884 Mar 25 13:14 pandaJobData.out
-rw-------. 1 dcameron zp 61990 Apr 3 17:17 panda_node_struct.pickle
drwx------. 6 dcameron zp 8192 Apr 3 17:16 pilot3
-rw-r--r--. 1 dcameron zp 1089368 Feb 7 15:23 pilotcode.tar.gz
-rw-------. 1 dcameron zp 28 Apr 3 15:37 PILOT_INITDIR
-rw-------. 1 dcameron zp 143 Apr 3 17:18 pilotlog-last.txt
-rw-------. 1 dcameron zp 11499 Apr 3 15:37 pilotlog.txt
lrwxrwxrwx. 1 dcameron zp 15 Apr 3 15:37 pilot.py -> pilot3/pilot.py
lrwxrwxrwx. 1 dcameron zp 19 Apr 3 15:37 PILOTVERSION -> pilot3/PILOTVERSION
drwx------. 3 dcameron zp 19 Apr 3 15:37 .pki
-rw-r--r--. 1 dcameron zp 3803 Apr 3 15:37 queuedata.json
-rw-r--r--. 1 dcameron zp 610 Apr 3 15:37 RTE.tar.gz
-rwxr-xr-x. 1 dcameron zp 8501 Apr 3 15:37 run_atlas
lrwxrwxrwx. 1 dcameron zp 21 Apr 3 15:37 RunJobEvent.py -> pilot3/RunJobEvent.py
lrwxrwxrwx. 1 dcameron zp 16 Apr 3 15:37 RunJob.py -> pilot3/RunJob.py
-rwx------. 1 dcameron zp 15214 Mar 25 13:14 runpilot3-wrapper.sh
-rw-r--r--. 1 dcameron zp 712 Apr 3 17:18 runtime_log
-rw-r--r--. 1 dcameron zp 8004 Apr 3 17:18 runtime_log.err
drwxrwx--x. 2 dcameron zp 131 Apr 3 17:18 shared
-rw-r--r--. 1 dcameron zp 8738 Apr 3 15:37 start_atlas.sh
-rw-------. 1 dcameron zp 19 Apr 3 15:37 START_TIME_4284345714
-rw-------. 1 dcameron zp 1 Apr 3 15:37 STATUSCODE
-rw-r--r--. 1 dcameron zp 8110 Apr 3 17:18 stderr.txt
lrwxrwxrwx. 1 dcameron zp 16 Apr 3 15:37 VmPeak.py -> pilot3/VmPeak.py
-rw-------. 1 dcameron zp 227 Apr 3 17:17 workdir_size-4284345714.json
-rw-r--r--. 1 dcameron zp 107 Apr 3 15:37 wrapper_26015_x86_64-pc-linux-gnu
-rw-r--r--. 1 dcameron zp 27 Apr 3 17:18 wrapper_checkpoint.txt
-rw-------. 1 dcameron zp 509 Apr 3 17:18 yX6NDmMgdSunShfckohDCDFpABFKDmABFKDmagASDmABFKDmG3shin.diag
running start_atlas return value is 0
Parent exit 0
child process exit 0
17:18:31 (3527991): run_atlas exited; CPU time 22592.131997
17:18:31 (3527991): called boinc_finish(0)
</stderr_txt>
]]>
©2024 CERN