Name | unJLDmwvAG2n7Olcko1bjSoqABFKDmABFKDmFymXDmLpNKDmV5Ik2m_0 |
Workunit | 2244923 |
Created | 18 Nov 2022, 7:25:39 UTC |
Sent | 18 Nov 2022, 10:51:03 UTC |
Report deadline | 25 Nov 2022, 10:51:03 UTC |
Received | 18 Nov 2022, 12:08:47 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 3765 |
Run time | 15 min 34 sec |
CPU time | 12 min 30 sec |
Validate state | Valid |
Credit | 4.00 |
Device peak FLOPS | 1.85 GFLOPS |
Application version | ATLAS Simulation v1.25 (native_mt) x86_64-pc-linux-gnu |
Peak working set size | 1.42 GB |
Peak swap size | 2.13 GB |
Peak disk usage | 79.90 MB |
<core_client_version>7.14.2</core_client_version> <![CDATA[ <stderr_txt> 12:53:06 (19873): wrapper (7.7.26015): starting 12:53:06 (19873): wrapper: running run_atlas (--nthreads 1) [2022-11-18 12:53:06] Arguments: --nthreads 1 [2022-11-18 12:53:06] Threads: 1 [2022-11-18 12:53:06] Checking for CVMFS [2022-11-18 12:53:07] Probing /cvmfs/atlas.cern.ch... OK [2022-11-18 12:53:07] Probing /cvmfs/atlas-condb.cern.ch... OK [2022-11-18 12:53:07] Running cvmfs_config stat atlas.cern.ch [2022-11-18 12:53:07] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE [2022-11-18 12:53:07] 2.6.0.0 2515 62 45156 112271 3 64 3830567 4096001 0 65024 0 70487 97.7514 421238 155 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://10.116.178.201:3128 1 [2022-11-18 12:53:07] CVMFS is ok [2022-11-18 12:53:07] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 [2022-11-18 12:53:07] Checking for apptainer binary... [2022-11-18 12:53:07] which: no apptainer in (/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin:/root/bin) [2022-11-18 12:53:07] apptainer is not installed, using version from CVMFS [2022-11-18 12:53:07] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname [2022-11-18 12:53:07] apu10r [2022-11-18 12:53:07] apptainer works [2022-11-18 12:53:07] Starting ATLAS job with PandaID=5515971838 [2022-11-18 12:53:07] Try creating a directory in /tmp [2022-11-18 12:53:07] /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/root/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 mktemp /tmp/tmp.XXXXX [2022-11-18 12:53:07] /tmp/tmp.1j2wJ [2022-11-18 12:53:07] Try creating a directory in /var/tmp [2022-11-18 12:53:07] /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/root/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 mktemp /var/tmp/tmp.XXXXX [2022-11-18 12:53:08] /var/tmp/tmp.p5Lwm [2022-11-18 12:53:08] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/root/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh [2022-11-18 13:08:38] *** The last 200 lines of the pilot log: *** [2022-11-18 13:08:38] inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK'] [2022-11-18 13:08:38] is_tar=False [2022-11-18 13:08:38] lfn=output.1.8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.pool.root [2022-11-18 13:08:38] mtime=0 [2022-11-18 13:08:38] protocol_id=None [2022-11-18 13:08:38] protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}] [2022-11-18 13:08:38] replicas=None [2022-11-18 13:08:38] scope=hc_test [2022-11-18 13:08:38] status=None [2022-11-18 13:08:38] status_code=0 [2022-11-18 13:08:38] storage_token= [2022-11-18 13:08:38] surl=/root/slots/0/PanDA_Pilot-5515971838/output.1.8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.pool.root [2022-11-18 13:08:38] turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/hc_test/92/e3/output.1.8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.pool.root [2022-11-18 13:08:38] workdir=None [2022-11-18 13:08:38] ] [2022-11-18 13:08:38] 2022-11-18 12:08:16,584 | INFO | transferring file output.1.8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.pool.root from /root/slots/0/PanDA_Pilot-5515971838/output.1.8a6e718d-c92a-4ece-9 [2022-11-18 13:08:38] 2022-11-18 12:08:16,585 | INFO | executing command: /usr/bin/env mv /root/slots/0/PanDA_Pilot-5515971838/output.1.8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.pool.root /root/slots/0/out [2022-11-18 13:08:38] 2022-11-18 12:08:16,629 | INFO | Adding to output.list: output.1.8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.pool.root davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/hc_test/92/ [2022-11-18 13:08:38] 2022-11-18 12:08:16,631 | INFO | executing command: ps aux -q 25092 [2022-11-18 13:08:38] 2022-11-18 12:08:16,683 | INFO | summary of transferred files: [2022-11-18 13:08:38] 2022-11-18 12:08:16,683 | INFO | -- lfn=output.1.8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.pool.root, status_code=0, status=transferred [2022-11-18 13:08:38] 2022-11-18 12:08:16,684 | INFO | executing command: ls -lF /root/slots/0/PanDA_Pilot-5515971838 [2022-11-18 13:08:38] 2022-11-18 12:08:16,744 | INFO | executing command: ls -lF /root/slots/0/PanDA_Pilot-5515971838 [2022-11-18 13:08:38] 2022-11-18 12:08:16,781 | INFO | will create archive /root/slots/0/8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz [2022-11-18 13:08:38] 2022-11-18 12:08:16,782 | INFO | executing command: pwd;tar cvfz /root/slots/0/8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz tarball_PandaJob_5515971838_BOINC-TEST --derefer [2022-11-18 13:08:38] 2022-11-18 12:08:16,856 | INFO | copied /root/slots/0/8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz to /root/slots/0/PanDA_Pilot-5515971838 [2022-11-18 13:08:38] 2022-11-18 12:08:16,857 | INFO | prepare to stage-out 1 log file(s) [2022-11-18 13:08:38] 2022-11-18 12:08:16,857 | INFO | stage-out will not be done in a container [2022-11-18 13:08:38] 2022-11-18 12:08:16,866 | INFO | configured copytools per activity: acopytools={'pr': ['mv'], 'pw': ['mv'], 'read_lan': ['mv'], 'write_lan': ['mv'], 'default': ['rucio']} [2022-11-18 13:08:38] 2022-11-18 12:08:16,866 | INFO | [prepare_destinations][pl]: allowed (local) destinations: ['NDGF-T1_DATADISK'] [2022-11-18 13:08:38] 2022-11-18 12:08:16,867 | INFO | [prepare_destinations][pl]: resolved default destination ddm=NDGF-T1_DATADISK [2022-11-18 13:08:38] 2022-11-18 12:08:16,867 | INFO | trying to use copytool=mv for activity=['pl', 'pw', 'w', 'default'] [2022-11-18 13:08:38] 2022-11-18 12:08:17,066 | INFO | Resolved protocol to be used for transfer: '{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}': l [2022-11-18 13:08:38] 2022-11-18 12:08:17,066 | INFO | ready to transfer (stage-out) files: [ accessmode= [2022-11-18 13:08:38] activity=['pl', 'pw', 'w', 'default'] [2022-11-18 13:08:38] allow_lan=True [2022-11-18 13:08:38] allow_wan=False [2022-11-18 13:08:38] checkinputsize=True [2022-11-18 13:08:38] checksum={'adler32': '47034109'} [2022-11-18 13:08:38] dataset=hc_test.gangarbt.hc20247452.tid1184.BOINC-TEST.23 [2022-11-18 13:08:38] ddm_activity=['write_lan', 'write_wan'] [2022-11-18 13:08:38] ddmendpoint=NDGF-T1_DATADISK [2022-11-18 13:08:38] direct_access_lan=False [2022-11-18 13:08:38] direct_access_wan=False [2022-11-18 13:08:38] domain= [2022-11-18 13:08:38] filesize=156940 [2022-11-18 13:08:38] filetype=log [2022-11-18 13:08:38] guid=e5faf5be-08d3-42e1-a1bb-2b7a1e3c51c3 [2022-11-18 13:08:38] inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK'] [2022-11-18 13:08:38] is_tar=False [2022-11-18 13:08:38] lfn=8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz [2022-11-18 13:08:38] mtime=0 [2022-11-18 13:08:38] protocol_id=None [2022-11-18 13:08:38] protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}] [2022-11-18 13:08:38] replicas=None [2022-11-18 13:08:38] scope=hc_test [2022-11-18 13:08:38] status=None [2022-11-18 13:08:38] status_code=0 [2022-11-18 13:08:38] storage_token= [2022-11-18 13:08:38] surl=/root/slots/0/PanDA_Pilot-5515971838/8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz [2022-11-18 13:08:38] turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/hc_test/bc/41/8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz [2022-11-18 13:08:38] workdir=None [2022-11-18 13:08:38] ] [2022-11-18 13:08:38] 2022-11-18 12:08:17,145 | INFO | transferring file 8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz from /root/slots/0/PanDA_Pilot-5515971838/8a6e718d-c92a-4ece-9644-0006491221 [2022-11-18 13:08:38] 2022-11-18 12:08:17,145 | INFO | executing command: /usr/bin/env mv /root/slots/0/PanDA_Pilot-5515971838/8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz /root/slots/0/8a6e718d [2022-11-18 13:08:38] 2022-11-18 12:08:17,182 | INFO | Adding to output.list: 8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/hc_test/bc/41/8a [2022-11-18 13:08:38] 2022-11-18 12:08:17,183 | INFO | executing command: ps aux -q 25092 [2022-11-18 13:08:38] 2022-11-18 12:08:17,225 | INFO | summary of transferred files: [2022-11-18 13:08:38] 2022-11-18 12:08:17,225 | INFO | -- lfn=8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz, status_code=0, status=transferred [2022-11-18 13:08:38] 2022-11-18 12:08:17,225 | INFO | stage-out finished correctly [2022-11-18 13:08:38] 2022-11-18 12:08:19,106 | INFO | finished stage-out for finished payload, adding job to finished_jobs queue [2022-11-18 13:08:38] 2022-11-18 12:08:19,227 | INFO | job 5515971838 has state=finished [2022-11-18 13:08:38] 2022-11-18 12:08:19,227 | INFO | preparing for final server update for job 5515971838 in state='finished' [2022-11-18 13:08:38] 2022-11-18 12:08:19,228 | INFO | pilot will not update the server (heartbeat message will be written to file) [2022-11-18 13:08:38] 2022-11-18 12:08:19,228 | INFO | job 5515971838 has finished - writing final server update [2022-11-18 13:08:38] 2022-11-18 12:08:19,229 | WARNING | wrong length of table data, x=[1668772763.0, 1668772824.0, 1668772885.0, 1668772946.0, 1668773007.0, 1668773068.0, 1668773129.0], y=[1558754.0, 1566170.0, 1572676. [2022-11-18 13:08:38] 2022-11-18 12:08:19,230 | INFO | total number of processed events: 2 (read) [2022-11-18 13:08:38] 2022-11-18 12:08:19,230 | INFO | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo [2022-11-18 13:08:38] 2022-11-18 12:08:19,285 | INFO | using path: /root/slots/0/PanDA_Pilot-5515971838/memory_monitor_summary.json (trf name=prmon) [2022-11-18 13:08:38] 2022-11-18 12:08:19,287 | INFO | extracted standard info from prmon json [2022-11-18 13:08:38] 2022-11-18 12:08:19,287 | INFO | extracted standard memory fields from prmon json [2022-11-18 13:08:38] 2022-11-18 12:08:19,287 | INFO | .............................. [2022-11-18 13:08:38] 2022-11-18 12:08:19,287 | INFO | . Timing measurements: [2022-11-18 13:08:38] 2022-11-18 12:08:19,287 | INFO | . get job = 0 s [2022-11-18 13:08:38] 2022-11-18 12:08:19,287 | INFO | . initial setup = 2 s [2022-11-18 13:08:38] 2022-11-18 12:08:19,287 | INFO | . payload setup = 14 s [2022-11-18 13:08:38] 2022-11-18 12:08:19,287 | INFO | . stage-in = 0 s [2022-11-18 13:08:38] 2022-11-18 12:08:19,287 | INFO | . payload execution = 850 s [2022-11-18 13:08:38] 2022-11-18 12:08:19,288 | INFO | . stage-out = 0 s [2022-11-18 13:08:38] 2022-11-18 12:08:19,288 | INFO | .............................. [2022-11-18 13:08:38] 2022-11-18 12:08:19,332 | WARNING | no jobs in monitored_payloads queue (waited for 73 s) [2022-11-18 13:08:38] 2022-11-18 12:08:19,421 | INFO | [2022-11-18 13:08:38] 2022-11-18 12:08:19,421 | INFO | job summary report [2022-11-18 13:08:38] 2022-11-18 12:08:19,421 | INFO | -------------------------------------------------- [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | PanDA job id: 5515971838 [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | task id: NULL [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | errors: (none) [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | status: LOG_TRANSFER = DONE [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | pilot state: finished [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | transexitcode: 0 [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | exeerrorcode: 0 [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | exeerrordiag: [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | exitcode: 0 [2022-11-18 13:08:38] 2022-11-18 12:08:19,422 | INFO | exitmsg: OK [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | cpuconsumptiontime: 770 s [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | nevents: 2 [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | neventsw: 0 [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | pid: 28104 [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | pgrp: 28104 [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | corecount: 1 [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | event service: False [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | sizes: {0: 2573227, 1: 2573461, 12: 2573461, 868: 2594379, 870: 2603459, 872: 2604545} [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | -------------------------------------------------- [2022-11-18 13:08:38] 2022-11-18 12:08:19,423 | INFO | [2022-11-18 13:08:38] 2022-11-18 12:08:19,424 | INFO | executing command: ls -lF /root/slots/0 [2022-11-18 13:08:38] 2022-11-18 12:08:19,472 | INFO | queue jobs had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,472 | INFO | queue payloads had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue data_in had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue data_out had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue current_data_in had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue validated_jobs had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue validated_payloads had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue monitored_payloads had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue finished_jobs had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue finished_payloads had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue finished_data_in had 1 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,473 | INFO | queue finished_data_out had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,474 | INFO | queue failed_jobs had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,474 | INFO | queue failed_payloads had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,474 | INFO | queue failed_data_in had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,474 | INFO | queue failed_data_out had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,474 | INFO | queue completed_jobs had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,474 | INFO | queue completed_jobids has 1 job(s) [2022-11-18 13:08:38] 2022-11-18 12:08:19,474 | INFO | queue realtimelog_payloads had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,474 | INFO | queue messages had 0 job(s) [purged] [2022-11-18 13:08:38] 2022-11-18 12:08:19,474 | INFO | job 5515971838 has completed (purged errors) [2022-11-18 13:08:38] 2022-11-18 12:08:19,475 | INFO | overall cleanup function is called [2022-11-18 13:08:38] 2022-11-18 12:08:20,480 | INFO | --- collectZombieJob: --- 10, [28104] [2022-11-18 13:08:38] 2022-11-18 12:08:20,480 | INFO | zombie collector trying to kill pid 28104 [2022-11-18 13:08:38] 2022-11-18 12:08:20,480 | INFO | harmless exception when collecting zombies: [Errno 10] No child processes [2022-11-18 13:08:38] 2022-11-18 12:08:21,481 | INFO | collected zombie processes [2022-11-18 13:08:38] 2022-11-18 12:08:21,481 | INFO | will now attempt to kill all subprocesses of pid=28104 [2022-11-18 13:08:38] 2022-11-18 12:08:21,562 | INFO | process IDs to be killed: [28104] (in reverse order) [2022-11-18 13:08:38] 2022-11-18 12:08:21,638 | WARNING | found no corresponding commands to process id(s) [2022-11-18 13:08:38] 2022-11-18 12:08:21,638 | INFO | Do not look for orphan processes in BOINC jobs [2022-11-18 13:08:38] 2022-11-18 12:08:21,639 | INFO | ready for new job [2022-11-18 13:08:38] 2022-11-18 12:08:21,639 | INFO | pilot has finished with previous job - re-establishing logging [2022-11-18 13:08:38] 2022-11-18 12:08:21,640 | INFO | ***************************************** [2022-11-18 13:08:38] 2022-11-18 12:08:21,640 | INFO | *** PanDA Pilot version 3.4.0 (118) *** [2022-11-18 13:08:38] 2022-11-18 12:08:21,640 | INFO | ***************************************** [2022-11-18 13:08:38] 2022-11-18 12:08:21,640 | INFO | [2022-11-18 13:08:38] 2022-11-18 12:08:21,640 | INFO | pilot is running in a VM [2022-11-18 13:08:38] 2022-11-18 12:08:21,641 | INFO | architecture information: [2022-11-18 13:08:38] 2022-11-18 12:08:21,782 | INFO | [2022-11-18 13:08:38] LSB Version: :core-4.1-amd64:core-4.1-noarch [2022-11-18 13:08:38] Distributor ID: CentOS [2022-11-18 13:08:38] Description: CentOS Linux release 7.9.2009 (Core) [2022-11-18 13:08:38] Release: 7.9.2009 [2022-11-18 13:08:38] Codename: Core [2022-11-18 13:08:38] 2022-11-18 12:08:21,783 | INFO | ***************************************** [2022-11-18 13:08:38] 2022-11-18 12:08:22,284 | INFO | executing command: df -mP /root/slots/0 [2022-11-18 13:08:38] 2022-11-18 12:08:22,313 | INFO | sufficient remaining disk space (9622781952 B) [2022-11-18 13:08:38] 2022-11-18 12:08:22,314 | WARNING | since timefloor is set to 0, pilot was only allowed to run one job [2022-11-18 13:08:38] 2022-11-18 12:08:22,314 | INFO | [job] retrieve thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:22,314 | WARNING | aborting monitor loop since graceful_stop has been set [2022-11-18 13:08:38] 2022-11-18 12:08:22,315 | INFO | [monitor] control thread has ended [2022-11-18 13:08:38] 2022-11-18 12:08:22,343 | WARNING | job:job_monitor:received graceful stop - abort after this iteration [2022-11-18 13:08:38] 2022-11-18 12:08:22,461 | INFO | [job] create_data_payload thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:22,610 | INFO | [job] control thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:22,890 | WARNING | data:copytool_out:received graceful stop - abort after this iteration [2022-11-18 13:08:38] 2022-11-18 12:08:22,997 | INFO | [data] control thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:23,064 | INFO | [payload] execute_payloads thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:23,182 | INFO | [job] validate thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:23,207 | INFO | [payload] validate_pre thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:23,350 | INFO | [job] job monitor thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:23,484 | INFO | [data] copytool_in thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:23,717 | INFO | [payload] control thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:23,720 | INFO | [payload] validate_post thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:23,780 | INFO | [payload] failed_post thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:23,891 | INFO | [data] copytool_out thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:24,434 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration [2022-11-18 13:08:38] 2022-11-18 12:08:24,434 | INFO | [job] queue monitor thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:25,236 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration [2022-11-18 13:08:38] 2022-11-18 12:08:28,239 | INFO | [data] queue_monitor thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:37,254 | INFO | job.realtimelogging is not enabled [2022-11-18 13:08:38] 2022-11-18 12:08:37,254 | INFO | [payload] run_realtimelog thread has finished [2022-11-18 13:08:38] 2022-11-18 12:08:37,854 | INFO | end of generic workflow (traces error code: 0) [2022-11-18 13:08:38] 2022-11-18 12:08:37,855 | INFO | traces error code: 0 [2022-11-18 13:08:38] 2022-11-18 12:08:37,855 | INFO | pilot has finished [2022-11-18 13:08:38] 2022-11-18 12:08:37,986 [wrapper] ==== pilot stdout END ==== [2022-11-18 13:08:38] 2022-11-18 12:08:37,993 [wrapper] ==== wrapper stdout RESUME ==== [2022-11-18 13:08:38] 2022-11-18 12:08:38,001 [wrapper] pilotpid: 25092 [2022-11-18 13:08:38] 2022-11-18 12:08:38,009 [wrapper] Pilot exit status: 0 [2022-11-18 13:08:38] 2022-11-18 12:08:38,040 [wrapper] pandaids: 5515971838 [2022-11-18 13:08:38] 2022-11-18 12:08:38,055 [wrapper] apfmon messages muted [2022-11-18 13:08:38] 2022-11-18 12:08:38,062 [wrapper] Test setup, not cleaning [2022-11-18 13:08:38] 2022-11-18 12:08:38,069 [wrapper] ==== wrapper stdout END ==== [2022-11-18 13:08:38] 2022-11-18 12:08:38,076 [wrapper] ==== wrapper stderr END ==== [2022-11-18 13:08:38] 2022-11-18 12:08:38,092 [wrapper] wrapperexiting ec=0, duration=930 [2022-11-18 13:08:38] 2022-11-18 12:08:38,099 [wrapper] apfmon messages muted [2022-11-18 13:08:38] *** Error codes and diagnostics *** [2022-11-18 13:08:38] "exeErrorCode": 0, [2022-11-18 13:08:38] "exeErrorDiag": "", [2022-11-18 13:08:38] "pilotErrorCode": 0, [2022-11-18 13:08:38] "pilotErrorDiag": "", [2022-11-18 13:08:38] *** Listing of results directory *** [2022-11-18 13:08:38] insgesamt 43692 [2022-11-18 13:08:38] -rw-r--r--. 1 root root 379728 18. Nov 08:22 pilot3.tar.gz [2022-11-18 13:08:38] -rw-r--r--. 1 root root 4540 18. Nov 08:25 queuedata.json [2022-11-18 13:08:38] -rwx------. 1 4871 1028 26318 18. Nov 08:25 runpilot2-wrapper.sh [2022-11-18 13:08:38] -rw-r--r--. 1 root root 107 18. Nov 12:53 wrapper_26015_x86_64-pc-linux-gnu [2022-11-18 13:08:38] -rwxr-xr-x. 1 root root 8273 18. Nov 12:53 run_atlas [2022-11-18 13:08:38] -rw-r--r--. 1 root root 112 18. Nov 12:53 job.xml [2022-11-18 13:08:38] -rw-r--r--. 2 root root 37960264 18. Nov 12:53 EVNT.04972714._000040.pool.root.1 [2022-11-18 13:08:38] -rw-r--r--. 2 root root 391220 18. Nov 12:53 input.tar.gz [2022-11-18 13:08:38] -rw-r--r--. 1 root root 5986 18. Nov 12:53 init_data.xml [2022-11-18 13:08:38] -rw-r--r--. 2 root root 17913 18. Nov 12:53 start_atlas.sh [2022-11-18 13:08:38] drwxrwx--x. 2 root root 68 18. Nov 12:53 shared [2022-11-18 13:08:38] -rw-r--r--. 1 root root 0 18. Nov 12:53 boinc_lockfile [2022-11-18 13:08:38] -rw-r--r--. 1 root root 2802 18. Nov 12:53 pandaJob.out [2022-11-18 13:08:38] -rw-------. 1 root root 464 18. Nov 12:53 setup.sh.local [2022-11-18 13:08:38] -rw-------. 1 root root 1030626 18. Nov 12:53 agis_schedconf.cvmfs.json [2022-11-18 13:08:38] -rw-------. 1 root root 1729417 18. Nov 12:53 agis_ddmendpoints.agis.ALL.json [2022-11-18 13:08:38] drwxr-xr-x. 4 320 320 245 18. Nov 12:53 pilot3 [2022-11-18 13:08:38] -rw-------. 1 root root 1276059 18. Nov 13:08 output.1.8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.pool.root [2022-11-18 13:08:38] -rw-r--r--. 1 root root 8192 18. Nov 13:08 boinc_mmap_file [2022-11-18 13:08:38] -rw-r--r--. 1 root root 24 18. Nov 13:08 wrapper_checkpoint.txt [2022-11-18 13:08:38] -rw-------. 1 root root 1024 18. Nov 13:08 memory_monitor_summary.json [2022-11-18 13:08:38] -rw-r--r--. 1 root root 532 18. Nov 13:08 boinc_task_state.xml [2022-11-18 13:08:38] -rw-------. 1 root root 156940 18. Nov 13:08 8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log.tgz [2022-11-18 13:08:38] -rw-------. 1 root root 7387 18. Nov 13:08 heartbeat.json [2022-11-18 13:08:38] -rw-------. 1 root root 3032 18. Nov 13:08 pilotlog.txt [2022-11-18 13:08:38] -rw-------. 1 root root 88496 18. Nov 13:08 8a6e718d-c92a-4ece-9644-0006491221351-1668756335_98767.1.job.log [2022-11-18 13:08:38] -rw-------. 1 root root 512 18. Nov 13:08 output.list [2022-11-18 13:08:38] -rw-r--r--. 1 root root 796 18. Nov 13:08 runtime_log [2022-11-18 13:08:38] -rw-------. 1 root root 1536000 18. Nov 13:08 result.tar.gz [2022-11-18 13:08:38] -rw-------. 1 root root 629 18. Nov 13:08 unJLDmwvAG2n7Olcko1bjSoqABFKDmABFKDmFymXDmLpNKDmV5Ik2m.diag [2022-11-18 13:08:38] -rw-r--r--. 1 root root 11150 18. Nov 13:08 runtime_log.err [2022-11-18 13:08:38] -rw-r--r--. 1 root root 21897 18. Nov 13:08 stderr.txt [2022-11-18 13:08:38] HITS file was successfully produced: [2022-11-18 13:08:38] -rw-------. 1 root root 1276059 18. Nov 13:08 shared/HITS.pool.root.1 [2022-11-18 13:08:38] *** Contents of shared directory: *** [2022-11-18 13:08:38] insgesamt 40224 [2022-11-18 13:08:38] -rw-r--r--. 2 root root 37960264 18. Nov 12:53 ATLAS.root_0 [2022-11-18 13:08:38] -rw-r--r--. 2 root root 391220 18. Nov 12:53 input.tar.gz [2022-11-18 13:08:38] -rw-r--r--. 2 root root 17913 18. Nov 12:53 start_atlas.sh [2022-11-18 13:08:38] -rw-------. 1 root root 1276059 18. Nov 13:08 HITS.pool.root.1 [2022-11-18 13:08:38] -rw-------. 1 root root 1536000 18. Nov 13:08 result.tar.gz 13:08:39 (19873): run_atlas exited; CPU time 750.834932 13:08:39 (19873): called boinc_finish(0) </stderr_txt> ]]>
©2025 CERN