Name P7vMDml3Fpzn7Olcko1bjSoqABFKDmABFKDmZr2WDmBOFKDmONxrWo_0
Workunit 2131641
Created 28 Sep 2021, 0:21:59 UTC
Sent 28 Sep 2021, 0:58:04 UTC
Report deadline 5 Oct 2021, 0:58:04 UTC
Received 28 Sep 2021, 3:08:43 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4357
Run time 49 min 0 sec
CPU time 7 min 19 sec
Validate state Valid
Credit 19.23
Device peak FLOPS 6.11 GFLOPS
Application version ATLAS Simulation v1.04 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.50 GB
Peak swap size 28.10 GB
Peak disk usage 84.89 MB

Stderr output

<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
21:37:33 (61576): wrapper (7.7.26015): starting
21:37:33 (61576): wrapper: running run_atlas (--nthreads 2)
[2021-09-27 21:37:33] Arguments: --nthreads 2
[2021-09-27 21:37:33] Threads: 2
[2021-09-27 21:37:33] Checking for CVMFS
[2021-09-27 21:37:34] Probing /cvmfs/atlas.cern.ch... OK
[2021-09-27 21:37:35] Probing /cvmfs/atlas-condb.cern.ch... OK
[2021-09-27 21:37:35] Running cvmfs_config stat atlas.cern.ch
[2021-09-27 21:37:37] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2021-09-27 21:37:37] 2.9.0.0 147949 10056 68988 92948 3 62 2195562 4194304 7046 130560 0 88275261 99.994 664761 847 http://cvmfs-s1bnl.opensciencegrid.org:8000/cvmfs/atlas.cern.ch DIRECT 0
[2021-09-27 21:37:37] CVMFS is ok
[2021-09-27 21:37:37] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2021-09-27 21:37:37] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2021-09-27 21:37:37] Small home clusters do not require a local http proxy but it is suggested if
[2021-09-27 21:37:37] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2021-09-27 21:37:37] Further information can be found at the LHC@home message board.
[2021-09-27 21:37:37] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2021-09-27 21:37:37] Checking for singularity binary...
[2021-09-27 21:37:37] Using singularity found in PATH at /usr/local/bin/singularity
[2021-09-27 21:37:37] Running /usr/local/bin/singularity --version
[2021-09-27 21:37:37] singularity version 3.7.2+10-ga969f0f8c
[2021-09-27 21:37:37] Checking singularity works with /usr/local/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2021-09-27 21:37:38] E5-2670
[2021-09-27 21:37:38] Singularity works
[2021-09-27 21:37:38] Set ATHENA_PROC_NUMBER=2
[2021-09-27 21:37:38] Starting ATLAS job with PandaID=5204050971
[2021-09-27 21:37:38] Running command: /usr/local/bin/singularity exec --pwd /var/lib/boinc-client/slots/11 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2021-09-27 22:26:30]  *** The last 200 lines of the pilot log: ***
[2021-09-27 22:26:30]  domain=
[2021-09-27 22:26:30]  filesize=1659380
[2021-09-27 22:26:30]  filetype=output
[2021-09-27 22:26:30]  guid=0763B766-B402-574F-8482-E26F41306491
[2021-09-27 22:26:30]  inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK']
[2021-09-27 22:26:30]  is_tar=False
[2021-09-27 22:26:30]  lfn=output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root
[2021-09-27 22:26:30]  mtime=0
[2021-09-27 22:26:30]  protocol_id=None
[2021-09-27 22:26:30]  protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}, {'endpoint': 'srm://srm.ndgf.org:8443/srm/managerv2?SFN=', 'flavour': '
[2021-09-27 22:26:30]  replicas=None
[2021-09-27 22:26:30]  scope=hc_test
[2021-09-27 22:26:30]  status=None
[2021-09-27 22:26:30]  status_code=0
[2021-09-27 22:26:30]  storage_token=
[2021-09-27 22:26:30]  surl=/var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root
[2021-09-27 22:26:30]  turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/hc_test/42/16/output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root
[2021-09-27 22:26:30]  workdir=None
[2021-09-27 22:26:30] ]
[2021-09-27 22:26:30] 2021-09-28 02:25:18,869 | INFO     | transferring file output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root from /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/output.1.6514fb8e-2d0e-4
[2021-09-27 22:26:30] 2021-09-28 02:25:18,869 | INFO     | executing command: /usr/bin/env mv /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root /var/lib/boi
[2021-09-27 22:26:30] 2021-09-28 02:25:19,498 | INFO     | Adding to output.list: output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root davs://dav.ndgf.org:443;autodir=no;spacetoken=ATLASDATADISK/atlas/disk/atlasda
[2021-09-27 22:26:30] 2021-09-28 02:25:19,498 | INFO     | executing command: ps aux -q 74604
[2021-09-27 22:26:30] 2021-09-28 02:25:20,391 | INFO     | summary of transferred files:
[2021-09-27 22:26:30] 2021-09-28 02:25:20,391 | INFO     |  -- lfn=output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root, status_code=0, status=transferred
[2021-09-27 22:26:30] 2021-09-28 02:25:20,391 | INFO     | executing command: ls -lF /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971
[2021-09-27 22:26:30] 2021-09-28 02:25:20,917 | WARNING  | failed to remove directory: /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root_001 (2, No such fil
[2021-09-27 22:26:30] 2021-09-28 02:25:20,918 | WARNING  | failed to remove directory: /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root_002 (2, No such fil
[2021-09-27 22:26:30] 2021-09-28 02:25:20,930 | INFO     | executing command: ls -lF /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971
[2021-09-27 22:26:30] 2021-09-28 02:25:21,570 | INFO     | will create archive /var/lib/boinc-client/slots/11/tarball_PandaJob_5204050971_BOINC-TEST/6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz
[2021-09-27 22:26:30] 2021-09-28 02:25:21,571 | INFO     | executing command: pwd;tar cvfz /var/lib/boinc-client/slots/11/tarball_PandaJob_5204050971_BOINC-TEST/6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz tarb
[2021-09-27 22:26:30] 2021-09-28 02:25:22,326 | INFO     | prepare to stage-out 1 log file(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:22,326 | INFO     | stage-out will not be done in a container
[2021-09-27 22:26:30] 2021-09-28 02:25:22,327 | INFO     | configured copytools per activity: acopytools={'pr': ['mv'], 'pw': ['mv'], 'read_lan': ['mv'], 'write_lan': ['mv'], 'default': ['rucio']}
[2021-09-27 22:26:30] 2021-09-28 02:25:22,327 | INFO     | [prepare_destinations][pl]: allowed (local) destinations: ['NDGF-T1_DATADISK']
[2021-09-27 22:26:30] 2021-09-28 02:25:22,327 | INFO     | [prepare_destinations][pl]: resolved default destination ddm=NDGF-T1_DATADISK
[2021-09-27 22:26:30] 2021-09-28 02:25:22,327 | INFO     | trying to use copytool=mv for activity=['pl', 'pw', 'w', 'default']
[2021-09-27 22:26:30] 2021-09-28 02:25:22,787 | INFO     | Resolved protocol to be used for transfer: '{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}': l
[2021-09-27 22:26:30] 2021-09-28 02:25:22,787 | INFO     | ready to transfer (stage-out) files: [ accessmode=
[2021-09-27 22:26:30]  activity=['pl', 'pw', 'w', 'default']
[2021-09-27 22:26:30]  allow_lan=True
[2021-09-27 22:26:30]  allow_wan=False
[2021-09-27 22:26:30]  checksum={'adler32': 'fe1589ab'}
[2021-09-27 22:26:30]  dataset=hc_test.gangarbt.hc20216215.tid1109.BOINC-TEST.101
[2021-09-27 22:26:30]  ddm_activity=<filter object at 0x7f7d0da7cfd0>
[2021-09-27 22:26:30]  ddmendpoint=NDGF-T1_DATADISK
[2021-09-27 22:26:30]  direct_access_lan=False
[2021-09-27 22:26:30]  direct_access_wan=False
[2021-09-27 22:26:30]  domain=
[2021-09-27 22:26:30]  filesize=542137
[2021-09-27 22:26:30]  filetype=log
[2021-09-27 22:26:30]  guid=99344a7d-a4f9-4775-afa0-1b3a7faa3740
[2021-09-27 22:26:30]  inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK']
[2021-09-27 22:26:30]  is_tar=False
[2021-09-27 22:26:30]  lfn=6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz
[2021-09-27 22:26:30]  mtime=0
[2021-09-27 22:26:30]  protocol_id=None
[2021-09-27 22:26:30]  protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}, {'endpoint': 'srm://srm.ndgf.org:8443/srm/managerv2?SFN=', 'flavour': '
[2021-09-27 22:26:30]  replicas=None
[2021-09-27 22:26:30]  scope=hc_test
[2021-09-27 22:26:30]  status=None
[2021-09-27 22:26:30]  status_code=0
[2021-09-27 22:26:30]  storage_token=
[2021-09-27 22:26:30]  surl=/var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz
[2021-09-27 22:26:30]  turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/hc_test/53/af/6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz
[2021-09-27 22:26:30]  workdir=None
[2021-09-27 22:26:30] ]
[2021-09-27 22:26:30] 2021-09-28 02:25:23,047 | INFO     | transferring file 6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz from /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/6514fb8e-2d0e-4f95-b496-c5089
[2021-09-27 22:26:30] 2021-09-28 02:25:23,048 | INFO     | executing command: /usr/bin/env mv /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz /var/lib/boinc-cl
[2021-09-27 22:26:30] 2021-09-28 02:25:23,838 | INFO     | Adding to output.list: 6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz davs://dav.ndgf.org:443;autodir=no;spacetoken=ATLASDATADISK/atlas/disk/atlasdatadis
[2021-09-27 22:26:30] 2021-09-28 02:25:23,839 | INFO     | executing command: ps aux -q 74604
[2021-09-27 22:26:30] 2021-09-28 02:25:23,877 | INFO     | monitor loop #30: job 0:5204050971 is in state 'stageout'
[2021-09-27 22:26:30] 2021-09-28 02:25:23,878 | INFO     | payload log (log.HITSMergeAthenaMP0) within allowed size limit (2147483648 B): 144637 B
[2021-09-27 22:26:30] 2021-09-28 02:25:23,879 | INFO     | payload log (log.EVNTtoHITS) within allowed size limit (2147483648 B): 1504370 B
[2021-09-27 22:26:30] 2021-09-28 02:25:23,879 | INFO     | payload log (payload.stdout) within allowed size limit (2147483648 B): 13082 B
[2021-09-27 22:26:30] 2021-09-28 02:25:24,202 | INFO     | sufficient remaining disk space (41732276224 B)
[2021-09-27 22:26:30] 2021-09-28 02:25:24,233 | INFO     | work directory size check will use 61362667520 B as a max limit (10% grace limit added)
[2021-09-27 22:26:30] 2021-09-28 02:25:24,241 | INFO     | size of work directory /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971: 2888040 B (within 61362667520 B limit)
[2021-09-27 22:26:30] 2021-09-28 02:25:24,241 | INFO     | pfn file=/var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/EVNT.04972714._000035.pool.root.1 does not exist (skip from workdir size calculation)
[2021-09-27 22:26:30] 2021-09-28 02:25:24,241 | INFO     | pfn file=/var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root does not exist (skip from workdir size
[2021-09-27 22:26:30] 2021-09-28 02:25:24,241 | INFO     | total size of present input+output files: 0 B (workdir size: 2888040 B)
[2021-09-27 22:26:30] 2021-09-28 02:25:24,242 | INFO     | output file size check: skipping output file /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root si
[2021-09-27 22:26:30] 2021-09-28 02:25:24,564 | INFO     | summary of transferred files:
[2021-09-27 22:26:30] 2021-09-28 02:25:24,565 | INFO     |  -- lfn=6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz, status_code=0, status=transferred
[2021-09-27 22:26:30] 2021-09-28 02:25:24,565 | INFO     | stage-out finished correctly
[2021-09-27 22:26:30] 2021-09-28 02:25:24,903 | INFO     | number of running child processes to parent process 80997: 1
[2021-09-27 22:26:30] 2021-09-28 02:25:24,903 | INFO     | maximum number of monitored processes: 7
[2021-09-27 22:26:30] 2021-09-28 02:25:25,011 | INFO     | finished stage-out for finished payload, adding job to finished_jobs queue
[2021-09-27 22:26:30] 2021-09-28 02:25:25,478 | INFO     | job 5204050971 has state=finished
[2021-09-27 22:26:30] 2021-09-28 02:25:25,478 | INFO     | preparing for final server update for job 5204050971 in state='finished'
[2021-09-27 22:26:30] 2021-09-28 02:25:25,478 | INFO     | pilot will not update the server (heartbeat message will be written to file)
[2021-09-27 22:26:30] 2021-09-28 02:25:25,479 | INFO     | job 5204050971 has finished - writing final server update
[2021-09-27 22:26:30] 2021-09-28 02:25:25,480 | INFO     | fitting pss+swap vs Time
[2021-09-27 22:26:30] 2021-09-28 02:25:25,481 | INFO     | current memory leak: 101.92 B/s (using 28 data points, chi2=17164825)
[2021-09-27 22:26:30] 2021-09-28 02:25:25,485 | INFO     | mean actualcorecount: 4.555556
[2021-09-27 22:26:30] 2021-09-28 02:25:25,485 | INFO     | total number of processed events: 2 (read)
[2021-09-27 22:26:30] 2021-09-28 02:25:25,537 | INFO     | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2021-09-27 22:26:30] 2021-09-28 02:25:26,309 | INFO     | using path: /var/lib/boinc-client/slots/11/PanDA_Pilot-5204050971/memory_monitor_summary.json (trf name=prmon)
[2021-09-27 22:26:30] 2021-09-28 02:25:26,311 | INFO     | extracted standard info from prmon json
[2021-09-27 22:26:30] 2021-09-28 02:25:26,312 | INFO     | extracted standard memory fields from prmon json
[2021-09-27 22:26:30] 2021-09-28 02:25:26,312 | INFO     | ..............................
[2021-09-27 22:26:30] 2021-09-28 02:25:26,312 | INFO     | . Timing measurements:
[2021-09-27 22:26:30] 2021-09-28 02:25:26,312 | INFO     | . get job = 0 s
[2021-09-27 22:26:30] 2021-09-28 02:25:26,312 | INFO     | . initial setup = 5 s
[2021-09-27 22:26:30] 2021-09-28 02:25:26,312 | INFO     | . payload setup = 200 s
[2021-09-27 22:26:30] 2021-09-28 02:25:26,312 | INFO     | . total setup = 205 s
[2021-09-27 22:26:30] 2021-09-28 02:25:26,313 | INFO     | . stage-in = 2 s
[2021-09-27 22:26:30] 2021-09-28 02:25:26,313 | INFO     | . payload execution = 2269 s
[2021-09-27 22:26:30] 2021-09-28 02:25:26,313 | INFO     | . stage-out = 6 s
[2021-09-27 22:26:30] 2021-09-28 02:25:26,313 | INFO     | ..............................
[2021-09-27 22:26:30] 2021-09-28 02:25:26,845 | INFO     | 
[2021-09-27 22:26:30] 2021-09-28 02:25:26,845 | INFO     | job summary report
[2021-09-27 22:26:30] 2021-09-28 02:25:26,845 | INFO     | --------------------------------------------------
[2021-09-27 22:26:30] 2021-09-28 02:25:26,845 | INFO     | PanDA job id: 5204050971
[2021-09-27 22:26:30] 2021-09-28 02:25:26,845 | INFO     | task id: NULL
[2021-09-27 22:26:30] 2021-09-28 02:25:26,846 | INFO     | errors: (none)
[2021-09-27 22:26:30] 2021-09-28 02:25:26,846 | INFO     | status: LOG_TRANSFER = DONE 
[2021-09-27 22:26:30] 2021-09-28 02:25:26,846 | INFO     | pilot state: finished 
[2021-09-27 22:26:30] 2021-09-28 02:25:26,846 | INFO     | transexitcode: 0
[2021-09-27 22:26:30] 2021-09-28 02:25:26,846 | INFO     | exeerrorcode: 0
[2021-09-27 22:26:30] 2021-09-28 02:25:26,846 | INFO     | exeerrordiag: 
[2021-09-27 22:26:30] 2021-09-28 02:25:26,846 | INFO     | exitcode: 0
[2021-09-27 22:26:30] 2021-09-28 02:25:26,846 | INFO     | exitmsg: OK
[2021-09-27 22:26:30] 2021-09-28 02:25:26,847 | INFO     | cpuconsumptiontime: 560 s
[2021-09-27 22:26:30] 2021-09-28 02:25:26,847 | INFO     | nevents: 2
[2021-09-27 22:26:30] 2021-09-28 02:25:26,847 | INFO     | neventsw: 0
[2021-09-27 22:26:30] 2021-09-28 02:25:26,847 | INFO     | pid: 80997
[2021-09-27 22:26:30] 2021-09-28 02:25:26,847 | INFO     | pgrp: 80997
[2021-09-27 22:26:30] 2021-09-28 02:25:26,847 | INFO     | corecount: 2
[2021-09-27 22:26:30] 2021-09-28 02:25:26,847 | INFO     | event service: False
[2021-09-27 22:26:30] 2021-09-28 02:25:26,847 | INFO     | sizes: {18186648: 3887909, 18186649: 3888021, 18186650: 3888078, 18186651: 3888240, 18186653: 3888242, 18186662: 3888298, 18189138: 3915366, 18189145: 3924892, 181
[2021-09-27 22:26:30] 2021-09-28 02:25:26,848 | INFO     | --------------------------------------------------
[2021-09-27 22:26:30] 2021-09-28 02:25:26,848 | INFO     | 
[2021-09-27 22:26:30] 2021-09-28 02:25:26,848 | INFO     | executing command: ls -lF /var/lib/boinc-client/slots/11
[2021-09-27 22:26:30] 2021-09-28 02:25:27,493 | INFO     | queue jobs has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,493 | INFO     | queue payloads has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,494 | INFO     | queue data_in has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,494 | INFO     | queue data_out has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,494 | INFO     | queue current_data_in has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,494 | INFO     | queue validated_jobs has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,494 | INFO     | queue validated_payloads has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,494 | INFO     | queue monitored_payloads has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,494 | INFO     | queue finished_jobs has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,495 | INFO     | queue finished_payloads has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,495 | INFO     | queue finished_data_in has 1 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,495 | INFO     | queue finished_data_out has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,495 | INFO     | queue failed_jobs has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,495 | INFO     | queue failed_payloads has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,495 | INFO     | queue failed_data_in has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,495 | INFO     | queue failed_data_out has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,496 | INFO     | queue completed_jobs has 0 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,496 | INFO     | queue completed_jobids has 1 job(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,496 | INFO     | job 5204050971 has completed (purged errors)
[2021-09-27 22:26:30] 2021-09-28 02:25:27,496 | INFO     | overall cleanup function is called
[2021-09-27 22:26:30] 2021-09-28 02:25:28,525 | INFO     | --- collectZombieJob: --- 10, [80997]
[2021-09-27 22:26:30] 2021-09-28 02:25:28,525 | INFO     | zombie collector trying to kill pid 80997
[2021-09-27 22:26:30] 2021-09-28 02:25:28,525 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2021-09-27 22:26:30] 2021-09-28 02:25:29,529 | INFO     | collected zombie processes
[2021-09-27 22:26:30] 2021-09-28 02:25:29,529 | INFO     | will now attempt to kill all subprocesses of pid=80997
[2021-09-27 22:26:30] 2021-09-28 02:25:30,257 | INFO     | process IDs to be killed: [80997] (in reverse order)
[2021-09-27 22:26:30] 2021-09-28 02:25:31,018 | WARNING  | found no corresponding commands to process id(s)
[2021-09-27 22:26:30] 2021-09-28 02:25:31,018 | INFO     | Do not look for orphan processes in BOINC jobs
[2021-09-27 22:26:30] 2021-09-28 02:25:31,019 | INFO     | ready for new job
[2021-09-27 22:26:30] 2021-09-28 02:25:31,019 | INFO     | pilot has finished for previous job - re-establishing logging
[2021-09-27 22:26:30] 2021-09-28 02:25:31,020 | INFO     | ****************************************
[2021-09-27 22:26:30] 2021-09-28 02:25:31,020 | INFO     | ***  PanDA Pilot version 2.12.6 (1)  ***
[2021-09-27 22:26:30] 2021-09-28 02:25:31,020 | INFO     | ****************************************
[2021-09-27 22:26:30] 2021-09-28 02:25:31,020 | INFO     | 
[2021-09-27 22:26:30] 2021-09-28 02:25:31,046 | INFO     | architecture information:
[2021-09-27 22:26:30] 2021-09-28 02:25:33,112 | INFO     | 
[2021-09-27 22:26:30] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2021-09-27 22:26:30] Distributor ID:	CentOS
[2021-09-27 22:26:30] Description:	CentOS Linux release 7.8.2003 (Core)
[2021-09-27 22:26:30] Release:	7.8.2003
[2021-09-27 22:26:30] Codename:	Core
[2021-09-27 22:26:30] 2021-09-28 02:25:33,112 | INFO     | ****************************************
[2021-09-27 22:26:30] 2021-09-28 02:25:33,894 | INFO     | sufficient remaining disk space (41734373376 B)
[2021-09-27 22:26:30] 2021-09-28 02:25:33,894 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2021-09-27 22:26:30] 2021-09-28 02:25:33,895 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2021-09-27 22:26:30] 2021-09-28 02:25:34,053 | INFO     | [payload] execute_payloads thread has finished
[2021-09-27 22:26:30] 2021-09-28 02:25:34,185 | INFO     | [monitor] control thread has ended
[2021-09-27 22:26:30] 2021-09-28 02:25:34,205 | INFO     | [payload] failed_post thread has finished
[2021-09-27 22:26:30] 2021-09-28 02:25:34,313 | INFO     | [payload] validate_post thread has finished
[2021-09-27 22:26:30] 2021-09-28 02:25:34,549 | INFO     | [payload] validate_pre thread has finished
[2021-09-27 22:26:30] 2021-09-28 02:25:35,877 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2021-09-27 22:26:30] 2021-09-28 02:25:36,029 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2021-09-27 22:26:30] 2021-09-28 02:26:26,526 | WARNING  | no jobs in monitored_payloads queue (waited for 63 s)
[2021-09-27 22:26:30] 2021-09-28 02:26:26,641 | INFO     | end of generic workflow (traces error code: 0)
[2021-09-27 22:26:30] 2021-09-28 02:26:26,641 | INFO     | traces error code: 0
[2021-09-27 22:26:30] 2021-09-28 02:26:26,641 | INFO     | pilot has finished
[2021-09-27 22:26:30] 2021-09-28 02:26:26,924 [wrapper] ==== pilot stdout END ====
[2021-09-27 22:26:30] 2021-09-28 02:26:27,093 [wrapper] ==== wrapper stdout RESUME ====
[2021-09-27 22:26:30] 2021-09-28 02:26:27,158 [wrapper] Pilot exit status: 0
[2021-09-27 22:26:30] 2021-09-28 02:26:27,576 [wrapper] pandaids: 5204050971
[2021-09-27 22:26:30] 2021-09-28 02:26:27,889 [wrapper] apfmon messages muted
[2021-09-27 22:26:30] 2021-09-28 02:26:27,960 [wrapper] Test setup, not cleaning
[2021-09-27 22:26:30] 2021-09-28 02:26:28,121 [wrapper] ==== wrapper stdout END ====
[2021-09-27 22:26:30] 2021-09-28 02:26:28,309 [wrapper] ==== wrapper stderr END ====
[2021-09-27 22:26:30] 2021-09-28 02:26:28,573 [wrapper] wrapperexiting ec=0, duration=2926
[2021-09-27 22:26:30] 2021-09-28 02:26:28,689 [wrapper] apfmon messages muted
[2021-09-27 22:26:30]  *** Error codes and diagnostics ***
[2021-09-27 22:26:30]     "exeErrorCode": 0,
[2021-09-27 22:26:30]     "exeErrorDiag": "",
[2021-09-27 22:26:30]     "pilotErrorCode": 0,
[2021-09-27 22:26:30]     "pilotErrorDiag": "",
[2021-09-27 22:26:30]  *** Listing of results directory ***
[2021-09-27 22:26:30] total 46464
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc   344681 Sep 27 19:22 pilot2.tar.gz
[2021-09-27 22:26:30] -rwx------ 1 boinc boinc    20816 Sep 27 20:21 runpilot2-wrapper.sh
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc     3214 Sep 27 20:21 queuedata.json
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc      107 Sep 27 21:37 wrapper_26015_x86_64-pc-linux-gnu
[2021-09-27 22:26:30] -rwxr-xr-x 1 boinc boinc     6966 Sep 27 21:37 run_atlas
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc      112 Sep 27 21:37 job.xml
[2021-09-27 22:26:30] drwxrwx--x 2 boinc boinc     4096 Sep 27 21:37 shared
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc     6168 Sep 27 21:37 init_data.xml
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc        0 Sep 27 21:37 boinc_lockfile
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc    16541 Sep 27 21:37 start_atlas.sh
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc   354550 Sep 27 21:37 input.tar.gz
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc 38971704 Sep 27 21:37 EVNT.04972714._000035.pool.root.1
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc     2617 Sep 27 21:37 pandaJob.out
[2021-09-27 22:26:30] -rw------- 1 boinc boinc  1080616 Sep 27 21:43 agis_schedconf.cvmfs.json
[2021-09-27 22:26:30] -rw------- 1 boinc boinc  1944996 Sep 27 21:43 cric_ddmendpoints.json
[2021-09-27 22:26:30] drwx------ 4 boinc boinc     4096 Sep 27 21:43 pilot2
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc      534 Sep 27 22:13 boinc_task_state.xml
[2021-09-27 22:26:30] -rw------- 1 boinc boinc  1659380 Sep 27 22:24 output.1.6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.pool.root
[2021-09-27 22:26:30] -rw------- 1 boinc boinc     1020 Sep 27 22:25 memory_monitor_summary.json
[2021-09-27 22:26:30] -rw------- 1 boinc boinc   542137 Sep 27 22:25 6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log.tgz
[2021-09-27 22:26:30] -rw------- 1 boinc boinc     8361 Sep 27 22:25 heartbeat.json
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc       25 Sep 27 22:26 wrapper_checkpoint.txt
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc     8192 Sep 27 22:26 boinc_mmap_file
[2021-09-27 22:26:30] -rw------- 1 boinc boinc     1801 Sep 27 22:26 pilotlog.txt
[2021-09-27 22:26:30] -rw------- 1 boinc boinc   131596 Sep 27 22:26 6514fb8e-2d0e-4f95-b496-c5089ebff9ab_75037.1.job.log
[2021-09-27 22:26:30] -rw------- 1 boinc boinc      536 Sep 27 22:26 output.list
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc      748 Sep 27 22:26 runtime_log
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc     9557 Sep 27 22:26 runtime_log.err
[2021-09-27 22:26:30] -rw------- 1 boinc boinc  2355200 Sep 27 22:26 result.tar.gz
[2021-09-27 22:26:30] -rw------- 1 boinc boinc      564 Sep 27 22:26 P7vMDml3Fpzn7Olcko1bjSoqABFKDmABFKDmZr2WDmBOFKDmONxrWo.diag
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc    22409 Sep 27 22:26 stderr.txt
[2021-09-27 22:26:30] HITS file was successfully produced:
[2021-09-27 22:26:30] -rw------- 1 boinc boinc 1659380 Sep 27 22:24 shared/HITS.pool.root.1
[2021-09-27 22:26:30]  *** Contents of shared directory: ***
[2021-09-27 22:26:30] total 42352
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc    16541 Sep 27 21:37 start_atlas.sh
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc   354550 Sep 27 21:37 input.tar.gz
[2021-09-27 22:26:30] -rw-r--r-- 1 boinc boinc 38971704 Sep 27 21:37 ATLAS.root_0
[2021-09-27 22:26:30] -rw------- 1 boinc boinc  1659380 Sep 27 22:24 HITS.pool.root.1
[2021-09-27 22:26:30] -rw------- 1 boinc boinc  2355200 Sep 27 22:26 result.tar.gz
22:26:32 (61576): run_atlas exited; CPU time 439.814759
22:26:32 (61576): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN