Name | nYXNDmD14qzn7Olcko1bjSoqABFKDmABFKDmZr2WDm5UFKDmWci76m_0 |
Workunit | 2132696 |
Created | 3 Oct 2021, 0:58:55 UTC |
Sent | 3 Oct 2021, 0:59:07 UTC |
Report deadline | 10 Oct 2021, 0:59:07 UTC |
Received | 3 Oct 2021, 2:45:22 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 4357 |
Run time | 1 hours 17 min 18 sec |
CPU time | 19 min 18 sec |
Validate state | Valid |
Credit | 25.01 |
Device peak FLOPS | 6.11 GFLOPS |
Application version | ATLAS Simulation v1.04 (native_mt) x86_64-pc-linux-gnu |
Peak working set size | 1.39 GB |
Peak swap size | 27.53 GB |
Peak disk usage | 81.26 MB |
<core_client_version>7.9.3</core_client_version> <![CDATA[ <stderr_txt> 21:18:47 (79475): wrapper (7.7.26015): starting 21:18:47 (79475): wrapper: running run_atlas (--nthreads 2) [2021-10-02 21:18:47] Arguments: --nthreads 2 [2021-10-02 21:18:47] Threads: 2 [2021-10-02 21:18:47] Checking for CVMFS [2021-10-02 21:18:48] Probing /cvmfs/atlas.cern.ch... OK [2021-10-02 21:18:48] Probing /cvmfs/atlas-condb.cern.ch... OK [2021-10-02 21:18:48] Running cvmfs_config stat atlas.cern.ch [2021-10-02 21:18:50] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE [2021-10-02 21:18:50] 2.9.0.0 147949 17237 68588 93259 1 62 3620207 4194304 5260 130560 0 151568414 99.994 1187675 914 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch DIRECT 0 [2021-10-02 21:18:50] CVMFS is ok [2021-10-02 21:18:50] Efficiency of ATLAS tasks can be improved by the following measure(s): [2021-10-02 21:18:50] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io. [2021-10-02 21:18:50] Small home clusters do not require a local http proxy but it is suggested if [2021-10-02 21:18:50] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. [2021-10-02 21:18:50] Further information can be found at the LHC@home message board. [2021-10-02 21:18:50] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 [2021-10-02 21:18:50] Checking for singularity binary... [2021-10-02 21:18:50] Using singularity found in PATH at /usr/local/bin/singularity [2021-10-02 21:18:50] Running /usr/local/bin/singularity --version [2021-10-02 21:18:50] singularity version 3.7.2+10-ga969f0f8c [2021-10-02 21:18:50] Checking singularity works with /usr/local/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname [2021-10-02 21:18:51] E5-2670 [2021-10-02 21:18:51] Singularity works [2021-10-02 21:18:52] Set ATHENA_PROC_NUMBER=2 [2021-10-02 21:18:52] Starting ATLAS job with PandaID=5209418810 [2021-10-02 21:18:52] Running command: /usr/local/bin/singularity exec --pwd /var/lib/boinc-client/slots/1 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh [2021-10-02 22:36:02] *** The last 200 lines of the pilot log: *** [2021-10-02 22:36:02] domain= [2021-10-02 22:36:02] filesize=1269198 [2021-10-02 22:36:02] filetype=output [2021-10-02 22:36:02] guid=20C2BF3D-F58D-2940-A45F-30EC8D90C9D7 [2021-10-02 22:36:02] inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK'] [2021-10-02 22:36:02] is_tar=False [2021-10-02 22:36:02] lfn=output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root [2021-10-02 22:36:02] mtime=0 [2021-10-02 22:36:02] protocol_id=None [2021-10-02 22:36:02] protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}, {'endpoint': 'srm://srm.ndgf.org:8443/srm/managerv2?SFN=', 'flavour': ' [2021-10-02 22:36:02] replicas=None [2021-10-02 22:36:02] scope=hc_test [2021-10-02 22:36:02] status=None [2021-10-02 22:36:02] status_code=0 [2021-10-02 22:36:02] storage_token= [2021-10-02 22:36:02] surl=/var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root [2021-10-02 22:36:02] turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/hc_test/2d/7b/output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root [2021-10-02 22:36:02] workdir=None [2021-10-02 22:36:02] ] [2021-10-02 22:36:02] 2021-10-03 02:34:52,123 | INFO | transferring file output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root from /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/output.1.d163ce5a-a260-40 [2021-10-02 22:36:02] 2021-10-03 02:34:52,124 | INFO | executing command: /usr/bin/env mv /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root /var/lib/boin [2021-10-02 22:36:02] 2021-10-03 02:34:52,700 | INFO | Adding to output.list: output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root davs://dav.ndgf.org:443;autodir=no;spacetoken=ATLASDATADISK/atlas/disk/atlasda [2021-10-02 22:36:02] 2021-10-03 02:34:52,725 | INFO | executing command: ps aux -q 93360 [2021-10-02 22:36:02] 2021-10-03 02:34:53,417 | INFO | summary of transferred files: [2021-10-02 22:36:02] 2021-10-03 02:34:53,417 | INFO | -- lfn=output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root, status_code=0, status=transferred [2021-10-02 22:36:02] 2021-10-03 02:34:53,418 | INFO | executing command: ls -lF /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810 [2021-10-02 22:36:02] 2021-10-03 02:34:53,913 | WARNING | failed to remove directory: /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root_001 (2, No such file [2021-10-02 22:36:02] 2021-10-03 02:34:53,913 | WARNING | failed to remove directory: /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root_002 (2, No such file [2021-10-02 22:36:02] 2021-10-03 02:34:53,915 | INFO | executing command: ls -lF /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810 [2021-10-02 22:36:02] 2021-10-03 02:34:54,228 | INFO | will create archive /var/lib/boinc-client/slots/1/tarball_PandaJob_5209418810_BOINC-TEST/d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz [2021-10-02 22:36:02] 2021-10-03 02:34:54,228 | INFO | executing command: pwd;tar cvfz /var/lib/boinc-client/slots/1/tarball_PandaJob_5209418810_BOINC-TEST/d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz tarba [2021-10-02 22:36:02] 2021-10-03 02:34:55,001 | INFO | prepare to stage-out 1 log file(s) [2021-10-02 22:36:02] 2021-10-03 02:34:55,001 | INFO | stage-out will not be done in a container [2021-10-02 22:36:02] 2021-10-03 02:34:55,002 | INFO | configured copytools per activity: acopytools={'pr': ['mv'], 'pw': ['mv'], 'read_lan': ['mv'], 'write_lan': ['mv'], 'default': ['rucio']} [2021-10-02 22:36:02] 2021-10-03 02:34:55,002 | INFO | [prepare_destinations][pl]: allowed (local) destinations: ['NDGF-T1_DATADISK'] [2021-10-02 22:36:02] 2021-10-03 02:34:55,003 | INFO | [prepare_destinations][pl]: resolved default destination ddm=NDGF-T1_DATADISK [2021-10-02 22:36:02] 2021-10-03 02:34:55,003 | INFO | trying to use copytool=mv for activity=['pl', 'pw', 'w', 'default'] [2021-10-02 22:36:02] 2021-10-03 02:34:55,109 | INFO | monitor loop #51: job 0:5209418810 is in state 'stageout' [2021-10-02 22:36:02] 2021-10-03 02:34:55,109 | INFO | payload log (log.HITSMergeAthenaMP0) within allowed size limit (2147483648 B): 144102 B [2021-10-02 22:36:02] 2021-10-03 02:34:55,110 | INFO | payload log (log.EVNTtoHITS) within allowed size limit (2147483648 B): 1397291 B [2021-10-02 22:36:02] 2021-10-03 02:34:55,110 | INFO | payload log (payload.stdout) within allowed size limit (2147483648 B): 13119 B [2021-10-02 22:36:02] 2021-10-03 02:34:55,477 | INFO | sufficient remaining disk space (43713036288 B) [2021-10-02 22:36:02] 2021-10-03 02:34:55,477 | INFO | work directory size check will use 61362667520 B as a max limit (10% grace limit added) [2021-10-02 22:36:02] 2021-10-03 02:34:55,480 | INFO | size of work directory /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810: 3032690 B (within 61362667520 B limit) [2021-10-02 22:36:02] 2021-10-03 02:34:55,480 | INFO | pfn file=/var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/EVNT.04972714._000033.pool.root.1 does not exist (skip from workdir size calculation) [2021-10-02 22:36:02] 2021-10-03 02:34:55,480 | INFO | pfn file=/var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root does not exist (skip from workdir size [2021-10-02 22:36:02] 2021-10-03 02:34:55,480 | INFO | total size of present input+output files: 0 B (workdir size: 3032690 B) [2021-10-02 22:36:02] 2021-10-03 02:34:55,480 | INFO | output file size check: skipping output file /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root sin [2021-10-02 22:36:02] 2021-10-03 02:34:55,685 | INFO | Resolved protocol to be used for transfer: '{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}': l [2021-10-02 22:36:02] 2021-10-03 02:34:55,686 | INFO | ready to transfer (stage-out) files: [ accessmode= [2021-10-02 22:36:02] activity=['pl', 'pw', 'w', 'default'] [2021-10-02 22:36:02] allow_lan=True [2021-10-02 22:36:02] allow_wan=False [2021-10-02 22:36:02] checksum={'adler32': 'd08b7d71'} [2021-10-02 22:36:02] dataset=hc_test.gangarbt.hc20217333.tid1028.BOINC-TEST.148 [2021-10-02 22:36:02] ddm_activity=<filter object at 0x7f6ab581bd50> [2021-10-02 22:36:02] ddmendpoint=NDGF-T1_DATADISK [2021-10-02 22:36:02] direct_access_lan=False [2021-10-02 22:36:02] direct_access_wan=False [2021-10-02 22:36:02] domain= [2021-10-02 22:36:02] filesize=459889 [2021-10-02 22:36:02] filetype=log [2021-10-02 22:36:02] guid=aef6f8a4-37d3-49e2-a861-bc90116eba9a [2021-10-02 22:36:02] inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK'] [2021-10-02 22:36:02] is_tar=False [2021-10-02 22:36:02] lfn=d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz [2021-10-02 22:36:02] mtime=0 [2021-10-02 22:36:02] protocol_id=None [2021-10-02 22:36:02] protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}, {'endpoint': 'srm://srm.ndgf.org:8443/srm/managerv2?SFN=', 'flavour': ' [2021-10-02 22:36:02] replicas=None [2021-10-02 22:36:02] scope=hc_test [2021-10-02 22:36:02] status=None [2021-10-02 22:36:02] status_code=0 [2021-10-02 22:36:02] storage_token= [2021-10-02 22:36:02] surl=/var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz [2021-10-02 22:36:02] turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/hc_test/c0/fe/d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz [2021-10-02 22:36:02] workdir=None [2021-10-02 22:36:02] ] [2021-10-02 22:36:02] 2021-10-03 02:34:55,864 | INFO | transferring file d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz from /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/d163ce5a-a260-4067-9988-4f6361 [2021-10-02 22:36:02] 2021-10-03 02:34:55,864 | INFO | executing command: /usr/bin/env mv /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz /var/lib/boinc-cli [2021-10-02 22:36:02] 2021-10-03 02:34:56,029 | INFO | number of running child processes to parent process 104640: 1 [2021-10-02 22:36:02] 2021-10-03 02:34:56,030 | INFO | maximum number of monitored processes: 10 [2021-10-02 22:36:02] 2021-10-03 02:34:56,354 | INFO | Adding to output.list: d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz davs://dav.ndgf.org:443;autodir=no;spacetoken=ATLASDATADISK/atlas/disk/atlasdatadis [2021-10-02 22:36:02] 2021-10-03 02:34:56,354 | INFO | executing command: ps aux -q 93360 [2021-10-02 22:36:02] 2021-10-03 02:34:56,925 | INFO | summary of transferred files: [2021-10-02 22:36:02] 2021-10-03 02:34:56,925 | INFO | -- lfn=d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz, status_code=0, status=transferred [2021-10-02 22:36:02] 2021-10-03 02:34:56,926 | INFO | stage-out finished correctly [2021-10-02 22:36:02] 2021-10-03 02:34:57,384 | INFO | finished stage-out for finished payload, adding job to finished_jobs queue [2021-10-02 22:36:02] 2021-10-03 02:34:57,679 | INFO | job 5209418810 has state=finished [2021-10-02 22:36:02] 2021-10-03 02:34:57,679 | INFO | preparing for final server update for job 5209418810 in state='finished' [2021-10-02 22:36:02] 2021-10-03 02:34:57,680 | INFO | pilot will not update the server (heartbeat message will be written to file) [2021-10-02 22:36:02] 2021-10-03 02:34:57,680 | INFO | job 5209418810 has finished - writing final server update [2021-10-02 22:36:02] 2021-10-03 02:34:57,682 | INFO | fitting pss+swap vs Time [2021-10-02 22:36:02] 2021-10-03 02:34:57,701 | INFO | current memory leak: -15.93 B/s (using 56 data points, chi2=14915833) [2021-10-02 22:36:02] 2021-10-03 02:34:57,701 | INFO | mean actualcorecount: 4.562500 [2021-10-02 22:36:02] 2021-10-03 02:34:57,701 | INFO | total number of processed events: 2 (read) [2021-10-02 22:36:02] 2021-10-03 02:34:57,722 | INFO | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo [2021-10-02 22:36:02] 2021-10-03 02:34:58,121 | INFO | using path: /var/lib/boinc-client/slots/1/PanDA_Pilot-5209418810/memory_monitor_summary.json (trf name=prmon) [2021-10-02 22:36:02] 2021-10-03 02:34:58,126 | INFO | extracted standard info from prmon json [2021-10-02 22:36:02] 2021-10-03 02:34:58,127 | INFO | extracted standard memory fields from prmon json [2021-10-02 22:36:02] 2021-10-03 02:34:58,127 | INFO | .............................. [2021-10-02 22:36:02] 2021-10-03 02:34:58,127 | INFO | . Timing measurements: [2021-10-02 22:36:02] 2021-10-03 02:34:58,127 | INFO | . get job = 0 s [2021-10-02 22:36:02] 2021-10-03 02:34:58,127 | INFO | . initial setup = 4 s [2021-10-02 22:36:02] 2021-10-03 02:34:58,127 | INFO | . payload setup = 232 s [2021-10-02 22:36:02] 2021-10-03 02:34:58,127 | INFO | . total setup = 236 s [2021-10-02 22:36:02] 2021-10-03 02:34:58,128 | INFO | . stage-in = 2 s [2021-10-02 22:36:02] 2021-10-03 02:34:58,128 | INFO | . payload execution = 3992 s [2021-10-02 22:36:02] 2021-10-03 02:34:58,128 | INFO | . stage-out = 5 s [2021-10-02 22:36:02] 2021-10-03 02:34:58,128 | INFO | .............................. [2021-10-02 22:36:02] 2021-10-03 02:34:58,657 | INFO | [2021-10-02 22:36:02] 2021-10-03 02:34:58,657 | INFO | job summary report [2021-10-02 22:36:02] 2021-10-03 02:34:58,657 | INFO | -------------------------------------------------- [2021-10-02 22:36:02] 2021-10-03 02:34:58,657 | INFO | PanDA job id: 5209418810 [2021-10-02 22:36:02] 2021-10-03 02:34:58,657 | INFO | task id: NULL [2021-10-02 22:36:02] 2021-10-03 02:34:58,658 | INFO | errors: (none) [2021-10-02 22:36:02] 2021-10-03 02:34:58,658 | INFO | status: LOG_TRANSFER = DONE [2021-10-02 22:36:02] 2021-10-03 02:34:58,658 | INFO | pilot state: finished [2021-10-02 22:36:02] 2021-10-03 02:34:58,658 | INFO | transexitcode: 0 [2021-10-02 22:36:02] 2021-10-03 02:34:58,658 | INFO | exeerrorcode: 0 [2021-10-02 22:36:02] 2021-10-03 02:34:58,658 | INFO | exeerrordiag: [2021-10-02 22:36:02] 2021-10-03 02:34:58,658 | INFO | exitcode: 0 [2021-10-02 22:36:02] 2021-10-03 02:34:58,659 | INFO | exitmsg: OK [2021-10-02 22:36:02] 2021-10-03 02:34:58,659 | INFO | cpuconsumptiontime: 1332 s [2021-10-02 22:36:02] 2021-10-03 02:34:58,659 | INFO | nevents: 2 [2021-10-02 22:36:02] 2021-10-03 02:34:58,659 | INFO | neventsw: 0 [2021-10-02 22:36:02] 2021-10-03 02:34:58,659 | INFO | pid: 104640 [2021-10-02 22:36:02] 2021-10-03 02:34:58,659 | INFO | pgrp: 104640 [2021-10-02 22:36:02] 2021-10-03 02:34:58,659 | INFO | corecount: 2 [2021-10-02 22:36:02] 2021-10-03 02:34:58,660 | INFO | event service: False [2021-10-02 22:36:02] 2021-10-03 02:34:58,660 | INFO | sizes: {18617467: 3901887, 18617468: 3902056, 18617469: 3902056, 18617470: 3899237, 18617471: 3902220, 18617480: 3902276, 18621711: 3928265, 18621712: 3928264, 186 [2021-10-02 22:36:02] 2021-10-03 02:34:58,660 | INFO | -------------------------------------------------- [2021-10-02 22:36:02] 2021-10-03 02:34:58,660 | INFO | [2021-10-02 22:36:02] 2021-10-03 02:34:58,660 | INFO | executing command: ls -lF /var/lib/boinc-client/slots/1 [2021-10-02 22:36:02] 2021-10-03 02:34:58,985 | INFO | queue jobs has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,985 | INFO | queue payloads has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,986 | INFO | queue data_in has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,986 | INFO | queue data_out has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,986 | INFO | queue current_data_in has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,986 | INFO | queue validated_jobs has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,986 | INFO | queue validated_payloads has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,986 | INFO | queue monitored_payloads has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,986 | INFO | queue finished_jobs has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,986 | INFO | queue finished_payloads has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,987 | INFO | queue finished_data_in has 1 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,987 | INFO | queue finished_data_out has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,987 | INFO | queue failed_jobs has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,987 | INFO | queue failed_payloads has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,987 | INFO | queue failed_data_in has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,987 | INFO | queue failed_data_out has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,987 | INFO | queue completed_jobs has 0 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,988 | INFO | queue completed_jobids has 1 job(s) [2021-10-02 22:36:02] 2021-10-03 02:34:58,988 | INFO | job 5209418810 has completed (purged errors) [2021-10-02 22:36:02] 2021-10-03 02:34:58,988 | INFO | overall cleanup function is called [2021-10-02 22:36:02] 2021-10-03 02:35:00,005 | INFO | --- collectZombieJob: --- 10, [104640] [2021-10-02 22:36:02] 2021-10-03 02:35:00,005 | INFO | zombie collector trying to kill pid 104640 [2021-10-02 22:36:02] 2021-10-03 02:35:00,005 | INFO | harmless exception when collecting zombies: [Errno 10] No child processes [2021-10-02 22:36:02] 2021-10-03 02:35:01,013 | INFO | collected zombie processes [2021-10-02 22:36:02] 2021-10-03 02:35:01,013 | INFO | will now attempt to kill all subprocesses of pid=104640 [2021-10-02 22:36:02] 2021-10-03 02:35:01,349 | INFO | process IDs to be killed: [104640] (in reverse order) [2021-10-02 22:36:02] 2021-10-03 02:35:01,855 | WARNING | found no corresponding commands to process id(s) [2021-10-02 22:36:02] 2021-10-03 02:35:01,855 | INFO | Do not look for orphan processes in BOINC jobs [2021-10-02 22:36:02] 2021-10-03 02:35:01,856 | INFO | ready for new job [2021-10-02 22:36:02] 2021-10-03 02:35:01,856 | INFO | pilot has finished for previous job - re-establishing logging [2021-10-02 22:36:02] 2021-10-03 02:35:01,857 | INFO | **************************************** [2021-10-02 22:36:02] 2021-10-03 02:35:01,857 | INFO | *** PanDA Pilot version 2.12.6 (1) *** [2021-10-02 22:36:02] 2021-10-03 02:35:01,857 | INFO | **************************************** [2021-10-02 22:36:02] 2021-10-03 02:35:01,857 | INFO | [2021-10-02 22:36:02] 2021-10-03 02:35:01,882 | INFO | architecture information: [2021-10-02 22:36:02] 2021-10-03 02:35:03,880 | INFO | [2021-10-02 22:36:02] LSB Version: :core-4.1-amd64:core-4.1-noarch [2021-10-02 22:36:02] Distributor ID: CentOS [2021-10-02 22:36:02] Description: CentOS Linux release 7.8.2003 (Core) [2021-10-02 22:36:02] Release: 7.8.2003 [2021-10-02 22:36:02] Codename: Core [2021-10-02 22:36:02] 2021-10-03 02:35:03,880 | INFO | **************************************** [2021-10-02 22:36:02] 2021-10-03 02:35:04,709 | INFO | sufficient remaining disk space (43715133440 B) [2021-10-02 22:36:02] 2021-10-03 02:35:04,709 | WARNING | since timefloor is set to 0, pilot was only allowed to run one job [2021-10-02 22:36:02] 2021-10-03 02:35:05,325 | INFO | [monitor] control thread has ended [2021-10-02 22:36:02] 2021-10-03 02:35:05,425 | WARNING | data:copytool_out:received graceful stop - abort after this iteration [2021-10-02 22:36:02] 2021-10-03 02:35:05,541 | INFO | [payload] failed_post thread has finished [2021-10-02 22:36:02] 2021-10-03 02:35:05,861 | INFO | [payload] execute_payloads thread has finished [2021-10-02 22:36:02] 2021-10-03 02:35:05,897 | INFO | [payload] validate_pre thread has finished [2021-10-02 22:36:02] 2021-10-03 02:35:06,241 | INFO | [payload] validate_post thread has finished [2021-10-02 22:36:02] 2021-10-03 02:35:07,585 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration [2021-10-02 22:36:02] 2021-10-03 02:35:08,221 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration [2021-10-02 22:36:02] 2021-10-03 02:35:57,649 | WARNING | no jobs in monitored_payloads queue (waited for 62 s) [2021-10-02 22:36:02] 2021-10-03 02:35:58,153 | INFO | end of generic workflow (traces error code: 0) [2021-10-02 22:36:02] 2021-10-03 02:35:58,153 | INFO | traces error code: 0 [2021-10-02 22:36:02] 2021-10-03 02:35:58,161 | INFO | pilot has finished [2021-10-02 22:36:02] 2021-10-03 02:35:58,379 [wrapper] ==== pilot stdout END ==== [2021-10-02 22:36:02] 2021-10-03 02:35:58,509 [wrapper] ==== wrapper stdout RESUME ==== [2021-10-02 22:36:02] 2021-10-03 02:35:58,725 [wrapper] Pilot exit status: 0 [2021-10-02 22:36:02] 2021-10-03 02:35:59,188 [wrapper] pandaids: 5209418810 [2021-10-02 22:36:02] 2021-10-03 02:35:59,301 [wrapper] apfmon messages muted [2021-10-02 22:36:02] 2021-10-03 02:35:59,469 [wrapper] Test setup, not cleaning [2021-10-02 22:36:02] 2021-10-03 02:35:59,697 [wrapper] ==== wrapper stdout END ==== [2021-10-02 22:36:02] 2021-10-03 02:35:59,908 [wrapper] ==== wrapper stderr END ==== [2021-10-02 22:36:02] 2021-10-03 02:36:00,189 [wrapper] wrapperexiting ec=0, duration=4625 [2021-10-02 22:36:02] 2021-10-03 02:36:00,545 [wrapper] apfmon messages muted [2021-10-02 22:36:02] *** Error codes and diagnostics *** [2021-10-02 22:36:02] "exeErrorCode": 0, [2021-10-02 22:36:02] "exeErrorDiag": "", [2021-10-02 22:36:02] "pilotErrorCode": 0, [2021-10-02 22:36:02] "pilotErrorDiag": "", [2021-10-02 22:36:02] *** Listing of results directory *** [2021-10-02 22:36:02] total 44168 [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 344681 Oct 2 20:37 pilot2.tar.gz [2021-10-02 22:36:02] -rwx------ 1 boinc boinc 20816 Oct 2 20:58 runpilot2-wrapper.sh [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 3214 Oct 2 20:58 queuedata.json [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 107 Oct 2 21:18 wrapper_26015_x86_64-pc-linux-gnu [2021-10-02 22:36:02] -rwxr-xr-x 1 boinc boinc 6966 Oct 2 21:18 run_atlas [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 112 Oct 2 21:18 job.xml [2021-10-02 22:36:02] drwxrwx--x 2 boinc boinc 4096 Oct 2 21:18 shared [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 6167 Oct 2 21:18 init_data.xml [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 0 Oct 2 21:18 boinc_lockfile [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 16545 Oct 2 21:18 start_atlas.sh [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 354522 Oct 2 21:18 input.tar.gz [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 37438704 Oct 2 21:18 EVNT.04972714._000033.pool.root.1 [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 2589 Oct 2 21:18 pandaJob.out [2021-10-02 22:36:02] -rw------- 1 boinc boinc 1081995 Oct 2 21:24 agis_schedconf.cvmfs.json [2021-10-02 22:36:02] -rw------- 1 boinc boinc 1966446 Oct 2 21:24 cric_ddmendpoints.json [2021-10-02 22:36:02] drwx------ 4 boinc boinc 4096 Oct 2 21:24 pilot2 [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 534 Oct 2 22:22 boinc_task_state.xml [2021-10-02 22:36:02] -rw------- 1 boinc boinc 1269198 Oct 2 22:34 output.1.d163ce5a-a260-4067-9988-4f6361fc9233_69614.pool.root [2021-10-02 22:36:02] -rw------- 1 boinc boinc 1018 Oct 2 22:34 memory_monitor_summary.json [2021-10-02 22:36:02] -rw------- 1 boinc boinc 459889 Oct 2 22:34 d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log.tgz [2021-10-02 22:36:02] -rw------- 1 boinc boinc 7912 Oct 2 22:34 heartbeat.json [2021-10-02 22:36:02] -rw------- 1 boinc boinc 1801 Oct 2 22:35 pilotlog.txt [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 25 Oct 2 22:35 wrapper_checkpoint.txt [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 8192 Oct 2 22:35 boinc_mmap_file [2021-10-02 22:36:02] -rw------- 1 boinc boinc 180823 Oct 2 22:36 d163ce5a-a260-4067-9988-4f6361fc9233_69614.1.job.log [2021-10-02 22:36:02] -rw------- 1 boinc boinc 536 Oct 2 22:36 output.list [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 748 Oct 2 22:36 runtime_log [2021-10-02 22:36:02] -rw------- 1 boinc boinc 1935360 Oct 2 22:36 result.tar.gz [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 9543 Oct 2 22:36 runtime_log.err [2021-10-02 22:36:02] -rw------- 1 boinc boinc 565 Oct 2 22:36 nYXNDmD14qzn7Olcko1bjSoqABFKDmABFKDmZr2WDm5UFKDmWci76m.diag [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 22411 Oct 2 22:36 stderr.txt [2021-10-02 22:36:02] HITS file was successfully produced: [2021-10-02 22:36:02] -rw------- 1 boinc boinc 1269198 Oct 2 22:34 shared/HITS.pool.root.1 [2021-10-02 22:36:02] *** Contents of shared directory: *** [2021-10-02 22:36:02] total 40064 [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 37438704 Oct 2 21:18 ATLAS.root_0 [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 16545 Oct 2 21:18 start_atlas.sh [2021-10-02 22:36:02] -rw-r--r-- 1 boinc boinc 354522 Oct 2 21:18 input.tar.gz [2021-10-02 22:36:02] -rw------- 1 boinc boinc 1269198 Oct 2 22:34 HITS.pool.root.1 [2021-10-02 22:36:02] -rw------- 1 boinc boinc 1935360 Oct 2 22:36 result.tar.gz 22:36:04 (79475): run_atlas exited; CPU time 1158.382499 22:36:04 (79475): called boinc_finish(0) </stderr_txt> ]]>
©2024 CERN