| Name | jZmLDmsrMOtnShfckohDCDFpABFKDmABFKDmvz6ODmABFKDmgThWKm_0 |
| Workunit | 1690081 |
| Created | 23 Sep 2018, 16:57:00 UTC |
| Sent | 24 Sep 2018, 1:58:50 UTC |
| Report deadline | 1 Oct 2018, 1:58:50 UTC |
| Received | 24 Sep 2018, 14:40:40 UTC |
| Server state | Over |
| Outcome | Validate error |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 2676 |
| Run time | 1 hours 10 min 33 sec |
| CPU time | 11 hours 36 min 24 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 38.87 GFLOPS |
| Application version | ATLAS Simulation v0.60 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 1.78 GB |
| Peak swap size | 2.55 GB |
| Peak disk usage | 766.31 MB |
Stderr output
<core_client_version>7.8.4</core_client_version>
<![CDATA[
<stderr_txt>
14:25:01 (63706): wrapper (7.7.26015): starting
14:25:01 (63706): wrapper: running run_atlas (--nthreads 12)
singularity image is /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img
sys.argv = ['run_atlas', '--nthreads', '12']
THREADS=12
Checking for CVMFS
CVMFS is installed
OS:CentOS Linux release 7.5.1804 (Core)
This is not SLC6, need to run with Singularity....
Checking Singularity...
Singularity is installed
copy /root/slots/1/shared/ATLAS.root_0
copy /root/slots/1/shared/input.tar.gz
copy /root/slots/1/shared/RTE.tar.gz
copy /root/slots/1/shared/start_atlas.sh
export ATHENA_PROC_NUMBER=12;start atlas job with PandaID=4068297083
Testing the function of Singularity...
check singularity with cmd:singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img hostname
Singularity Works...
cmd = singularity exec --pwd /root/slots/1 -B /cvmfs,/root /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img sh start_atlas.sh > runtime_log 2> runtime_log.err
running cmd return value is 0
*****************The last 100 lines of the pilot log******************
"seopt": "token:ATLASDATADISK:srm://srm.ndgf.org:8443/srm/managerv2?SFN=",
"sepath": "/atlas/disk/atlasdatadisk/rucio",
"seprodpath": "/atlas/disk/atlasdatadisk/rucio",
"setokens": "ATLASDATADISK",
"site": "BOINC",
"siteid": "BOINC_MCORE",
"sitershare": null,
"space": 0,
"special_par": null,
"stageinretry": 2,
"stageoutretry": 2,
"status": "brokeroff",
"statusoverride": "offline",
"sysconfig": "manual",
"system": "arc",
"tags": "arc",
"tier": "T3",
"timefloor": 0,
"tmpdir": null,
"transferringlimit": 20000,
"tspace": "2070-01-01T00:00:00",
"use_newmover": "True",
"validatedreleases": "True",
"version": null,
"wansinklimit": null,
"wansourcelimit": null,
"wnconnectivity": "full",
"wntmpdir": null
}
2018-09-24 12:25:03|64085|SiteInformat| Queuedata was successfully downloaded by pilot wrapper script
2018-09-24 12:25:03|64085|ATLASSiteInf| curl command returned valid queuedata
2018-09-24 12:25:03|64085|ATLASSiteInf| Site BOINC_MCORE is currently in brokeroff mode
2018-09-24 12:25:03|64085|ATLASSiteInf| Job recovery turned off
2018-09-24 12:25:03|64085|ATLASSiteInf| Confirmed correctly formatted rucio sepath
2018-09-24 12:25:03|64085|ATLASSiteInf| Confirmed correctly formatted rucio seprodpath
2018-09-24 12:25:03|64085|SiteInformat| Evaluating queuedata
2018-09-24 12:25:03|64085|SiteInformat| Setting unset pilot variables using queuedata
2018-09-24 12:25:03|64085|SiteInformat| appdir:
2018-09-24 12:25:03|64085|pUtil.py | File registration will be done by server
2018-09-24 12:25:03|64085|pUtil.py | Updated stage-in retry number to 2
2018-09-24 12:25:03|64085|pUtil.py | Updated stage-out retry number to 2
2018-09-24 12:25:03|64085|pUtil.py | Detected unset (NULL) release/homepackage string
2018-09-24 12:25:03|64085|ATLASExperim| Application dir confirmed: /root/slots/1/
2018-09-24 12:25:03|64085|pilot.py | Pilot will serve experiment: Nordugrid-ATLAS
2018-09-24 12:25:03|64085|ATLASExperim| Architecture information:
2018-09-24 12:25:03|64085|ATLASExperim| Excuting command: lsb_release -a
2018-09-24 12:25:03|64085|ATLASExperim|
sh: lsb_release: command not found
2018-09-24 12:25:03|64085|pUtil.py | getSiteInformation: got experiment=ATLAS
2018-09-24 12:25:03|64085|ATLASExperim| appdirs = ['/cvmfs/atlas.cern.ch/repo/sw']
2018-09-24 12:25:03|64085|ATLASExperim| head of /cvmfs/atlas.cern.ch/repo/sw/ChangeLog:
--------------------------------------------------------------------------------
2018-09-24 14:00:17 Alessandro De Salvo
* + AGISData 20180924140016
2018-09-24 13:00:28 Alessandro De Salvo
* + AGISData 20180924130028
2018-09-24 12:13:40 Alessandro De Salvo
* + GroupData lxplus.cern.ch:/eos/atlas/atlascerngroupdisk/asg-calib/ 201809241213
2018-09-24 12:00:17 Alessandro De Salvo
--------------------------------------------------------------------------------
2018-09-24 12:25:03|64085|ATLASExperim| ATLAS_PYTHON_PILOT set to /usr/bin/python
2018-09-24 12:25:03|64085|pUtil.py | getSiteInformation: got experiment=ATLAS
2018-09-24 12:25:03|64085|ATLASExperim| Executing command: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase;$ATLAS_LOCAL_ROOT_BASE/utilities/checkValidity.sh (time-out: 300)
2018-09-24 12:25:03|64085|pUtil.py | Executing command: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase;$ATLAS_LOCAL_ROOT_BASE/utilities/checkValidity.sh (protected by timed_command, timeout: 300 s)
2018-09-24 12:25:04|64085|pUtil.py | Elapsed time: 0
2018-09-24 12:25:04|64085|ATLASExperim| Diagnostics tool has verified CVMFS
2018-09-24 12:25:04|64085|Node.py | Collecting machine features
2018-09-24 12:25:04|64085|Node.py | $MACHINEFEATURES not defined locally
2018-09-24 12:25:04|64085|Node.py | $JOBFEATURES not defined locally
2018-09-24 12:25:04|64085|Node.py | Executing command: hostname -i
2018-09-24 12:25:04|64085|Node.py | IP number of worker node: 10.43.20.51
2018-09-24 12:25:04|64085|pUtil.py | getSiteInformation: got experiment=Nordugrid-ATLAS
2018-09-24 12:25:04|64085|pilot.py | Using site information for experiment: Nordugrid-ATLAS
2018-09-24 12:25:04|64085|pilot.py | Will attempt to create workdir: /root/slots/1/Panda_Pilot_64085_1537791903
2018-09-24 12:25:04|64085|pilot.py | Creating file: /root/slots/1/CURRENT_SITEWORKDIR
2018-09-24 12:25:04|64085|pUtil.py | Wrote string "/root/slots/1/Panda_Pilot_64085_1537791903" to file: /root/slots/1/CURRENT_SITEWORKDIR
2018-09-24 12:25:04|64085|ATLASExperim| ATLAS_POOLCOND_PATH not set by wrapper
2018-09-24 12:25:04|64085|pilot.py | Preparing to execute Cleaner
2018-09-24 12:25:04|64085|pilot.py | Cleaning /root/slots/1
2018-09-24 12:25:04|64085|Cleaner.py | Cleaner initialized with clean-up limit: 2 hours
2018-09-24 12:25:04|64085|Cleaner.py | Cleaner will scan for lost directories in verified path: /root/slots/1
2018-09-24 12:25:04|64085|Cleaner.py | Executing empty dirs clean-up, stage 1/5
2018-09-24 12:25:04|64085|Cleaner.py | Purged 0 empty directories
2018-09-24 12:25:04|64085|Cleaner.py | Executing work dir clean-up, stage 2/5
2018-09-24 12:25:04|64085|Cleaner.py | Purged 0 single workDirs directories
2018-09-24 12:25:04|64085|Cleaner.py | Executing maxed-out dirs clean-up, stage 3/5
2018-09-24 12:25:04|64085|Cleaner.py | Purged 0 empty directories
2018-09-24 12:25:04|64085|Cleaner.py | Executing AthenaMP clean-up, stage 4/5 <SKIPPED>
2018-09-24 12:25:04|64085|Cleaner.py | Executing PanDA Pilot dir clean-up, stage 5/5
2018-09-24 12:25:04|64085|Cleaner.py | Number of found job state files: 0
2018-09-24 12:25:04|64085|Cleaner.py | No job state files were found, aborting clean-up
2018-09-24 12:25:04|64085|pilot.py | Update frequencies:
2018-09-24 12:25:04|64085|pilot.py | ...Processes: 300 s
2018-09-24 12:25:04|64085|pilot.py | .......Space: 600 s
2018-09-24 12:25:04|64085|pilot.py | ......Server: 1800 s
2018-09-24 12:25:04|64085|pUtil.py | Timefloor set to zero in queuedata (multi-jobs disabled)
***************diag file************
runtimeenvironments=APPS/HEP/ATLAS-SITE;
Processors=1
WallTime=4229.69s
KernelTime=348.69s
UserTime=41783.93s
CPUUsage=996%
MaxResidentMemory=1957072kB
AverageResidentMemory=0kB
AverageTotalMemory=0kB
AverageUnsharedMemory=0kB
AverageUnsharedStack=0kB
AverageSharedMemory=0kB
PageSize=4096B
MajorPageFaults=31000
MinorPageFaults=78649545
Swaps=0
ForcedSwitches=389696
WaitSwitches=1816182
Inputs=6946328
Outputs=631520
SocketReceived=0
SocketSent=0
Signals=0
nodename=Agile_Boincers@i69231633317314.cern.ch
exitcode=0
******************************WorkDir***********************
total 391368
drwxrwx--x. 6 root root 4096 Sep 24 15:35 .
drwxrwx--x. 52 root root 4096 Jun 20 18:55 ..
-rw-------. 1 root root 7029548 Sep 24 14:25 agis_ddmendpoints.cvmfs.json
-rw-------. 1 root root 5486314 Sep 24 14:25 agis_schedconf.cvmfs.json
drwx------. 2 root root 6 Sep 24 14:25 .alrb
drwxr-xr-x. 3 root root 17 Sep 24 14:25 APPS
-rwx------. 1 lhcathom c3 2441 Sep 23 18:56 ARCpilot
-rw-------. 1 root root 533 Sep 24 14:25 .asetup
-rw-------. 1 root root 11504 Sep 24 14:25 .asetup.save
-rw-r--r--. 1 root root 0 Sep 24 14:25 boinc_lockfile
-rw-r--r--. 1 root root 8192 Sep 24 14:25 boinc_mmap_file
-rw-------. 1 root root 42 Sep 24 14:25 CURRENT_SITEWORKDIR
-rw-r--r--. 1 root root 250878938 Sep 24 14:25 EVNT.15252537._000976.pool.root.1
-rw-------. 1 root root 133727365 Sep 24 15:32 HITS.15385155._045064.pool.root.1
-rw-r--r--. 1 root root 6176 Sep 24 14:25 init_data.xml
-rw-r--r--. 1 root root 1060814 Sep 24 14:25 input.tar.gz
-rw-------. 1 root root 9108 Sep 24 15:35 jobSmallFiles.tgz
-rw-r--r--. 1 root root 112 Sep 24 14:25 job.xml
-rw-------. 1 root root 519 Sep 24 15:35 jZmLDmsrMOtnShfckohDCDFpABFKDmABFKDmvz6ODmABFKDmgThWKm.diag
-rw-------. 1 root root 554206 Sep 24 15:35 log.15385155._045064.job.log.1
-rw-------. 1 root root 1723272 Sep 24 15:33 log.15385155._045064.job.log.tgz.1
-rw-------. 1 root root 314 Sep 24 15:32 memory_monitor_summary.json
-rw-------. 1 root root 1025 Sep 24 15:34 metadata-surl.xml
-rw-------. 1 root root 949 Sep 24 15:33 OutputFiles-4068297083.xml
-rw-------. 1 root root 480 Sep 24 15:34 output.list
-rw-------. 1 root root 11 Sep 24 14:25 pandaIDs.out
-rw-------. 1 root root 2931 Sep 24 14:25 pandaJobData_1.out
-rw-------. 1 root root 2930 Sep 24 14:25 pandaJobData.out
-rw-------. 1 root root 79341 Sep 24 15:34 panda_node_struct.pickle
-rw-------. 1 root root 13 Sep 24 14:25 PILOT_INITDIR
-rw-------. 1 root root 139 Sep 24 15:35 pilotlog-last.txt
-rw-------. 1 root root 11311 Sep 24 14:25 pilotlog.txt
drwx------. 3 root root 19 Sep 24 14:25 .pki
-rw-------. 1 root root 3751 Sep 24 14:25 queuedata.json
-rw-r--r--. 1 root root 4376 Sep 23 18:55 queuedata.pilot.json
-rw-r--r--. 1 root root 607 Sep 24 14:25 RTE.tar.gz
-rwxr-xr-x. 1 root root 8356 Sep 24 14:25 run_atlas
-rw-r--r--. 1 root root 638 Sep 24 15:35 runtime_log
-rw-r--r--. 1 root root 10865 Sep 24 15:35 runtime_log.err
drwxrwx--x. 2 root root 107 Sep 24 15:35 shared
-rw-r--r--. 1 root root 14384 Sep 24 14:25 start_atlas.sh
-rw-------. 1 root root 19 Sep 24 14:25 START_TIME_4068297083
-rw-------. 1 root root 1 Sep 24 14:25 STATUSCODE
-rw-r--r--. 1 root root 7796 Sep 24 15:35 stderr.txt
-rw-------. 1 root root 167 Sep 24 15:33 workdir_size-4068297083.json
-rw-r--r--. 1 root root 107 Sep 24 14:25 wrapper_26015_x86_64-pc-linux-gnu
running start_atlas return value is 0
Parent exit 0
child process exit 0
15:35:33 (63706): run_atlas exited; CPU time 41784.250055
15:35:33 (63706): called boinc_finish(0)
</stderr_txt>
]]>
©2024 CERN