Name FgcKDmefJz2n7Olcko1bjSoqABFKDmABFKDm7AsVDmGbGKDmJTQzlm_0
Workunit 2289337
Created 22 Mar 2023, 19:51:37 UTC
Sent 23 Mar 2023, 9:06:00 UTC
Report deadline 30 Mar 2023, 9:06:00 UTC
Received 23 Mar 2023, 9:51:31 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1498
Run time 32 min 43 sec
CPU time 1 hours 3 min 21 sec
Validate state Valid
Credit 44.44
Device peak FLOPS 9.78 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.47 GB
Peak swap size 2.89 GB
Peak disk usage 847.08 MB

Stderr output

<core_client_version>7.4.25</core_client_version>
<![CDATA[
<stderr_txt>
09:16:50 (19180): wrapper (7.7.26015): starting
09:16:50 (19180): wrapper: running run_atlas (--nthreads 3)
[2023-03-23 09:16:50] Arguments: --nthreads 3
[2023-03-23 09:16:50] Threads: 3
[2023-03-23 09:16:50] Checking for CVMFS
[2023-03-23 09:16:52] Probing /cvmfs/atlas.cern.ch... OK
[2023-03-23 09:16:55] Probing /cvmfs/atlas-condb.cern.ch... OK
[2023-03-23 09:16:55] Running cvmfs_config stat atlas.cern.ch
[2023-03-23 09:16:55] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2023-03-23 09:16:55] 2.9.0.0 19402 0 24580 117076 3 1 3534980 4194304 0 130560 0 0 0.000 821 1332 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.100.152:3128 1
[2023-03-23 09:16:55] CVMFS is ok
[2023-03-23 09:16:55] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2023-03-23 09:16:55] Checking for apptainer binary...
[2023-03-23 09:16:55] Using apptainer found in PATH at /usr/bin/apptainer
[2023-03-23 09:16:55] Running /usr/bin/apptainer --version
[2023-03-23 09:16:55] apptainer version 1.0.3
[2023-03-23 09:16:55] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2023-03-23 09:16:55] TeeC16
[2023-03-23 09:16:55] apptainer works
[2023-03-23 09:16:55] Set ATHENA_PROC_NUMBER=3
[2023-03-23 09:16:55] Set ATHENA_CORE_NUMBER=3
[2023-03-23 09:16:56] Starting ATLAS job with PandaID=5753961892
[2023-03-23 09:16:56] Running command: /usr/bin/apptainer exec -B /cvmfs,/home/m/BOINC/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2023-03-23 09:49:30]  *** The last 200 lines of the pilot log: ***
[2023-03-23 09:49:30]  lfn=HITS.32413688._000229-2698281-1679514681.pool.root.1
[2023-03-23 09:49:30]  mtime=0
[2023-03-23 09:49:30]  protocol_id=None
[2023-03-23 09:49:30]  protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}]
[2023-03-23 09:49:30]  replicas=None
[2023-03-23 09:49:30]  scope=valid1
[2023-03-23 09:49:30]  status=None
[2023-03-23 09:49:30]  status_code=0
[2023-03-23 09:49:30]  storage_token=
[2023-03-23 09:49:30]  surl=/home/m/BOINC/slots/0/PanDA_Pilot-5753961892/HITS.32413688._000229-2698281-1679514681.pool.root.1
[2023-03-23 09:49:30]  turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid1/ac/39/HITS.32413688._000229-2698281-1679514681.pool.root.1
[2023-03-23 09:49:30]  workdir=None
[2023-03-23 09:49:30] ]
[2023-03-23 09:49:30] 2023-03-23 09:49:10,510 | INFO     | transferring file HITS.32413688._000229-2698281-1679514681.pool.root.1 from /home/m/BOINC/slots/0/PanDA_Pilot-5753961892/HITS.32413688._000229-2698281-1679514681.p
[2023-03-23 09:49:30] 2023-03-23 09:49:10,510 | INFO     | executing command: /usr/bin/env mv /home/m/BOINC/slots/0/PanDA_Pilot-5753961892/HITS.32413688._000229-2698281-1679514681.pool.root.1 /home/m/BOINC/slots/0/HITS.324
[2023-03-23 09:49:30] 2023-03-23 09:49:10,524 | INFO     | Adding to output.list: HITS.32413688._000229-2698281-1679514681.pool.root.1 davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid1/ac/39/HITS.32413688._0002
[2023-03-23 09:49:30] 2023-03-23 09:49:10,525 | INFO     | executing command: ps aux -q 22933
[2023-03-23 09:49:30] 2023-03-23 09:49:10,541 | INFO     | summary of transferred files:
[2023-03-23 09:49:30] 2023-03-23 09:49:10,541 | INFO     |  -- lfn=HITS.32413688._000229-2698281-1679514681.pool.root.1, status_code=0, status=transferred
[2023-03-23 09:49:30] 2023-03-23 09:49:10,541 | INFO     | executing command: ls -lF /home/m/BOINC/slots/0/PanDA_Pilot-5753961892
[2023-03-23 09:49:30] 2023-03-23 09:49:10,566 | INFO     | executing command: ls -lF /home/m/BOINC/slots/0/PanDA_Pilot-5753961892
[2023-03-23 09:49:30] 2023-03-23 09:49:10,579 | INFO     | will create archive /home/m/BOINC/slots/0/log.32413688._000229-2698281-1679514681.job.log.tgz.1
[2023-03-23 09:49:30] 2023-03-23 09:49:10,579 | INFO     | executing command: pwd;tar cvfz /home/m/BOINC/slots/0/log.32413688._000229-2698281-1679514681.job.log.tgz.1 tarball_PandaJob_5753961892_BOINC-TEST --dereference --
[2023-03-23 09:49:30] 2023-03-23 09:49:10,627 | INFO     | copied /home/m/BOINC/slots/0/log.32413688._000229-2698281-1679514681.job.log.tgz.1 to /home/m/BOINC/slots/0/PanDA_Pilot-5753961892
[2023-03-23 09:49:30] 2023-03-23 09:49:10,627 | INFO     | prepare to stage-out 1 log file(s)
[2023-03-23 09:49:30] 2023-03-23 09:49:10,628 | INFO     | stage-out will not be done in a container
[2023-03-23 09:49:30] 2023-03-23 09:49:10,628 | INFO     | configured copytools per activity: acopytools={'pr': ['mv'], 'pw': ['mv'], 'read_lan': ['mv'], 'write_lan': ['mv'], 'default': ['rucio']}
[2023-03-23 09:49:30] 2023-03-23 09:49:10,628 | INFO     | [prepare_destinations][pl]: allowed (local) destinations: ['NDGF-T1_DATADISK']
[2023-03-23 09:49:30] 2023-03-23 09:49:10,628 | INFO     | [prepare_destinations][pl]: resolved default destination ddm=NDGF-T1_DATADISK
[2023-03-23 09:49:30] 2023-03-23 09:49:10,629 | INFO     | [prepare_destinations][pl]: Requested fspec.ddmendpoint=LRZ-LMU_DATADISK is not in the list of allowed (local) destinations .. will consider default ddm=NDGF-T1_DA
[2023-03-23 09:49:30] 2023-03-23 09:49:10,629 | INFO     | trying to use copytool=mv for activity=['pl', 'pw', 'w', 'default']
[2023-03-23 09:49:30] 2023-03-23 09:49:10,759 | INFO     | Resolved protocol to be used for transfer: '{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}': l
[2023-03-23 09:49:30] 2023-03-23 09:49:10,760 | INFO     | ready to transfer (stage-out) files: [ accessmode=
[2023-03-23 09:49:30]  activity=['pl', 'pw', 'w', 'default']
[2023-03-23 09:49:30]  allow_lan=True
[2023-03-23 09:49:30]  allow_wan=False
[2023-03-23 09:49:30]  checkinputsize=True
[2023-03-23 09:49:30]  checksum={'adler32': 'c1ec058f'}
[2023-03-23 09:49:30]  dataset=valid1.601229.PhPy8EG_A14_ttbar_hdamp258p75_SingleLep.simul.log.e8472_s4066_tid32413688_00
[2023-03-23 09:49:30]  ddm_activity=['write_lan', 'write_wan']
[2023-03-23 09:49:30]  ddmendpoint=NDGF-T1_DATADISK
[2023-03-23 09:49:30]  ddmendpoint_alt=NDGF-T1_DATADISK
[2023-03-23 09:49:30]  direct_access_lan=False
[2023-03-23 09:49:30]  direct_access_wan=False
[2023-03-23 09:49:30]  domain=
[2023-03-23 09:49:30]  filesize=181502
[2023-03-23 09:49:30]  filetype=log
[2023-03-23 09:49:30]  guid=8b3367ba-6de4-4efb-ae3e-fcc5584d8c92
[2023-03-23 09:49:30]  inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK']
[2023-03-23 09:49:30]  is_tar=False
[2023-03-23 09:49:30]  lfn=log.32413688._000229-2698281-1679514681.job.log.tgz.1
[2023-03-23 09:49:30]  mtime=0
[2023-03-23 09:49:30]  protocol_id=None
[2023-03-23 09:49:30]  protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}]
[2023-03-23 09:49:30]  replicas=None
[2023-03-23 09:49:30]  scope=valid1
[2023-03-23 09:49:30]  status=None
[2023-03-23 09:49:30]  status_code=0
[2023-03-23 09:49:30]  storage_token=
[2023-03-23 09:49:30]  surl=/home/m/BOINC/slots/0/PanDA_Pilot-5753961892/log.32413688._000229-2698281-1679514681.job.log.tgz.1
[2023-03-23 09:49:30]  turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid1/b5/56/log.32413688._000229-2698281-1679514681.job.log.tgz.1
[2023-03-23 09:49:30]  workdir=None
[2023-03-23 09:49:30] ]
[2023-03-23 09:49:30] 2023-03-23 09:49:10,802 | INFO     | transferring file log.32413688._000229-2698281-1679514681.job.log.tgz.1 from /home/m/BOINC/slots/0/PanDA_Pilot-5753961892/log.32413688._000229-2698281-1679514681.j
[2023-03-23 09:49:30] 2023-03-23 09:49:10,802 | INFO     | executing command: /usr/bin/env mv /home/m/BOINC/slots/0/PanDA_Pilot-5753961892/log.32413688._000229-2698281-1679514681.job.log.tgz.1 /home/m/BOINC/slots/0/log.324
[2023-03-23 09:49:30] 2023-03-23 09:49:10,817 | INFO     | Adding to output.list: log.32413688._000229-2698281-1679514681.job.log.tgz.1 davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid1/b5/56/log.32413688._0002
[2023-03-23 09:49:30] 2023-03-23 09:49:10,817 | INFO     | executing command: ps aux -q 22933
[2023-03-23 09:49:30] 2023-03-23 09:49:10,833 | INFO     | summary of transferred files:
[2023-03-23 09:49:30] 2023-03-23 09:49:10,834 | INFO     |  -- lfn=log.32413688._000229-2698281-1679514681.job.log.tgz.1, status_code=0, status=transferred
[2023-03-23 09:49:30] 2023-03-23 09:49:10,834 | INFO     | stage-out finished correctly
[2023-03-23 09:49:30] 2023-03-23 09:49:10,944 | INFO     | finished stage-out for finished payload, adding job to finished_jobs queue
[2023-03-23 09:49:30] 2023-03-23 09:49:11,760 | INFO     | job 5753961892 has state=finished
[2023-03-23 09:49:30] 2023-03-23 09:49:11,760 | INFO     | preparing for final server update for job 5753961892 in state='finished'
[2023-03-23 09:49:30] 2023-03-23 09:49:11,760 | INFO     | pilot will not update the server (heartbeat message will be written to file)
[2023-03-23 09:49:30] 2023-03-23 09:49:11,760 | INFO     | job 5753961892 has finished - writing final server update
[2023-03-23 09:49:30] 2023-03-23 09:49:11,760 | WARNING  | format EVNTtoHITS has no such key: dbData
[2023-03-23 09:49:30] 2023-03-23 09:49:11,760 | WARNING  | format EVNTtoHITS has no such key: dbTime
[2023-03-23 09:49:30] 2023-03-23 09:49:11,761 | INFO     | fitting pss+swap vs Time
[2023-03-23 09:49:30] 2023-03-23 09:49:11,761 | INFO     | current memory leak: 789.06 B/s (using 25 data points, chi2=0.62)
[2023-03-23 09:49:30] 2023-03-23 09:49:11,761 | INFO     | total number of processed events: 20 (read)
[2023-03-23 09:49:30] 2023-03-23 09:49:11,779 | INFO     | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2023-03-23 09:49:30] 2023-03-23 09:49:11,799 | INFO     | using path: /home/m/BOINC/slots/0/PanDA_Pilot-5753961892/memory_monitor_summary.json (trf name=prmon)
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | extracted standard info from prmon json
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | extracted standard memory fields from prmon json
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | ..............................
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | . Timing measurements:
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | . get job = 0 s
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | . initial setup = 1 s
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | . payload setup = 5 s
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | . stage-in = 0 s
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | . payload execution = 1907 s
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | . stage-out = 0 s
[2023-03-23 09:49:30] 2023-03-23 09:49:11,800 | INFO     | ..............................
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | 
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | job summary report
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | --------------------------------------------------
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | PanDA job id: 5753961892
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | task id: 32413688
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | errors: (none)
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | status: LOG_TRANSFER = DONE 
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | pilot state: finished 
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | transexitcode: 0
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | exeerrorcode: 0
[2023-03-23 09:49:30] 2023-03-23 09:49:12,284 | INFO     | exeerrordiag: 
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | exitcode: 0
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | exitmsg: OK
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | cpuconsumptiontime: 3810 s
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | nevents: 20
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | neventsw: 0
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | pid: 25370
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | pgrp: 25370
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | corecount: 3
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | event service: False
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | sizes: {0: 2539004, 1: 2539181, 1917: 2563744, 1918: 2563743, 1919: 2572811, 1920: 2573605}
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | --------------------------------------------------
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | 
[2023-03-23 09:49:30] 2023-03-23 09:49:12,285 | INFO     | executing command: ls -lF /home/m/BOINC/slots/0
[2023-03-23 09:49:30] 2023-03-23 09:49:12,299 | INFO     | queue jobs had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,299 | INFO     | queue payloads had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,299 | INFO     | queue data_in had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,299 | INFO     | queue data_out had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,299 | INFO     | queue current_data_in had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,299 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue completed_jobids has 1 job(s)
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,300 | INFO     | queue messages had 0 job(s) [purged]
[2023-03-23 09:49:30] 2023-03-23 09:49:12,301 | INFO     | job 5753961892 has completed (purged errors)
[2023-03-23 09:49:30] 2023-03-23 09:49:12,301 | INFO     | overall cleanup function is called
[2023-03-23 09:49:30] 2023-03-23 09:49:13,307 | INFO     | --- collectZombieJob: --- 10, [25370]
[2023-03-23 09:49:30] 2023-03-23 09:49:13,307 | INFO     | zombie collector trying to kill pid 25370
[2023-03-23 09:49:30] 2023-03-23 09:49:13,307 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2023-03-23 09:49:30] 2023-03-23 09:49:14,310 | INFO     | collected zombie processes
[2023-03-23 09:49:30] 2023-03-23 09:49:14,311 | INFO     | will now attempt to kill all subprocesses of pid=25370
[2023-03-23 09:49:30] 2023-03-23 09:49:14,342 | INFO     | process IDs to be killed: [25370] (in reverse order)
[2023-03-23 09:49:30] 2023-03-23 09:49:14,370 | WARNING  | found no corresponding commands to process id(s)
[2023-03-23 09:49:30] 2023-03-23 09:49:14,371 | INFO     | Do not look for orphan processes in BOINC jobs
[2023-03-23 09:49:30] 2023-03-23 09:49:14,371 | INFO     | ready for new job
[2023-03-23 09:49:30] 2023-03-23 09:49:14,371 | INFO     | pilot has finished with previous job - re-establishing logging
[2023-03-23 09:49:30] 2023-03-23 09:49:14,372 | INFO     | ***************************************
[2023-03-23 09:49:30] 2023-03-23 09:49:14,372 | INFO     | ***  PanDA Pilot version 3.4.8 (5)  ***
[2023-03-23 09:49:30] 2023-03-23 09:49:14,372 | INFO     | ***************************************
[2023-03-23 09:49:30] 2023-03-23 09:49:14,372 | INFO     | 
[2023-03-23 09:49:30] 2023-03-23 09:49:14,391 | INFO     | architecture information:
[2023-03-23 09:49:30] 2023-03-23 09:49:14,446 | INFO     | 
[2023-03-23 09:49:30] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2023-03-23 09:49:30] Distributor ID:	CentOS
[2023-03-23 09:49:30] Description:	CentOS Linux release 7.9.2009 (Core)
[2023-03-23 09:49:30] Release:	7.9.2009
[2023-03-23 09:49:30] Codename:	Core
[2023-03-23 09:49:30] 2023-03-23 09:49:14,446 | INFO     | ***************************************
[2023-03-23 09:49:30] 2023-03-23 09:49:14,949 | INFO     | executing command: df -mP /home/m/BOINC/slots/0
[2023-03-23 09:49:30] 2023-03-23 09:49:14,960 | INFO     | sufficient remaining disk space (425150382080 B)
[2023-03-23 09:49:30] 2023-03-23 09:49:14,960 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2023-03-23 09:49:30] 2023-03-23 09:49:14,960 | INFO     | [job] retrieve thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:15,118 | INFO     | [payload] control thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:15,148 | INFO     | [job] control thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:15,221 | INFO     | [monitor] control thread has ended
[2023-03-23 09:49:30] 2023-03-23 09:49:15,338 | INFO     | [payload] failed_post thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:15,435 | WARNING  | no jobs in monitored_payloads queue (waited for 78 s)
[2023-03-23 09:49:30] 2023-03-23 09:49:15,435 | INFO     | [job] job monitor thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:15,447 | INFO     | [data] control thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:15,718 | INFO     | [job] create_data_payload thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:15,821 | INFO     | [job] validate thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:15,869 | INFO     | [payload] validate_post thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:16,023 | INFO     | [payload] validate_pre thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:16,314 | INFO     | [payload] execute_payloads thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:16,376 | INFO     | [data] copytool_in thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:16,453 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2023-03-23 09:49:30] 2023-03-23 09:49:16,868 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2023-03-23 09:49:30] 2023-03-23 09:49:16,868 | INFO     | [job] queue monitor thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:17,007 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2023-03-23 09:49:30] 2023-03-23 09:49:17,454 | INFO     | [data] copytool_out thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:20,007 | INFO     | [data] queue_monitor thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:29,756 | INFO     | job.realtimelogging is not enabled
[2023-03-23 09:49:30] 2023-03-23 09:49:29,756 | INFO     | [payload] run_realtimelog thread has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:29,875 | INFO     | end of generic workflow (traces error code: 0)
[2023-03-23 09:49:30] 2023-03-23 09:49:29,875 | INFO     | traces error code: 0
[2023-03-23 09:49:30] 2023-03-23 09:49:29,875 | INFO     | pilot has finished
[2023-03-23 09:49:30] 2023-03-23 09:49:29,931 [wrapper] ==== pilot stdout END ====
[2023-03-23 09:49:30] 2023-03-23 09:49:29,934 [wrapper] ==== wrapper stdout RESUME ====
[2023-03-23 09:49:30] 2023-03-23 09:49:29,938 [wrapper] pilotpid: 22933
[2023-03-23 09:49:30] 2023-03-23 09:49:29,941 [wrapper] Pilot exit status: 0
[2023-03-23 09:49:30] 2023-03-23 09:49:29,951 [wrapper] pandaids: 5753961892
[2023-03-23 09:49:30] 2023-03-23 09:49:29,958 [wrapper] apfmon messages muted
[2023-03-23 09:49:30] 2023-03-23 09:49:29,961 [wrapper] Test setup, not cleaning
[2023-03-23 09:49:30] 2023-03-23 09:49:29,964 [wrapper] ==== wrapper stdout END ====
[2023-03-23 09:49:30] 2023-03-23 09:49:29,967 [wrapper] ==== wrapper stderr END ====
[2023-03-23 09:49:30] 2023-03-23 09:49:29,973 [wrapper] wrapperexiting ec=0, duration=1953
[2023-03-23 09:49:30] 2023-03-23 09:49:29,976 [wrapper] apfmon messages muted
[2023-03-23 09:49:30]  *** Error codes and diagnostics ***
[2023-03-23 09:49:30]     "exeErrorCode": 0,
[2023-03-23 09:49:30]     "exeErrorDiag": "",
[2023-03-23 09:49:30]     "pilotErrorCode": 0,
[2023-03-23 09:49:30]     "pilotErrorDiag": "",
[2023-03-23 09:49:30]  *** Listing of results directory ***
[2023-03-23 09:49:30] total 442680
[2023-03-23 09:49:30] -rw-r--r-- 1 m m    386707 Mar 22 19:29 pilot3.tar.gz
[2023-03-23 09:49:30] -rw-r--r-- 1 m m      4336 Mar 22 19:49 queuedata.json
[2023-03-23 09:49:30] -rwx------ 1 m m     27542 Mar 22 19:51 runpilot2-wrapper.sh
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m       107 Mar 23 09:16 wrapper_26015_x86_64-pc-linux-gnu
[2023-03-23 09:49:30] -rwxr-xr-x 1 m m      7986 Mar 23 09:16 run_atlas
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m       112 Mar 23 09:16 job.xml
[2023-03-23 09:49:30] -rw-r--r-- 2 m m     17789 Mar 23 09:16 start_atlas.sh
[2023-03-23 09:49:30] drwxrwx--x 2 m m      4096 Mar 23 09:16 shared
[2023-03-23 09:49:30] -rw-r--r-- 2 m m    398721 Mar 23 09:16 input.tar.gz
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m      5705 Mar 23 09:16 init_data.xml
[2023-03-23 09:49:30] -rw-r--r-- 2 m m 436382292 Mar 23 09:16 EVNT.29838250._000010.pool.root.1
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m         0 Mar 23 09:16 boinc_lockfile
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m      2553 Mar 23 09:16 pandaJob.out
[2023-03-23 09:49:30] -rw------- 1 m m       424 Mar 23 09:16 setup.sh.local
[2023-03-23 09:49:30] -rw------- 1 m m    987529 Mar 23 09:17 agis_schedconf.cvmfs.json
[2023-03-23 09:49:30] -rw------- 1 m m   1426500 Mar 23 09:17 agis_ddmendpoints.agis.ALL.json
[2023-03-23 09:49:30] drwx------ 4 m m      4096 Mar 23 09:17 pilot3
[2023-03-23 09:49:30] -rw------- 1 m m  12897196 Mar 23 09:48 HITS.32413688._000229-2698281-1679514681.pool.root.1
[2023-03-23 09:49:30] -rw------- 1 m m      1024 Mar 23 09:49 memory_monitor_summary.json
[2023-03-23 09:49:30] -rw------- 1 m m    181502 Mar 23 09:49 log.32413688._000229-2698281-1679514681.job.log.tgz.1
[2023-03-23 09:49:30] -rw------- 1 m m      7663 Mar 23 09:49 heartbeat.json
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m      8192 Mar 23 09:49 boinc_mmap_file
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m        26 Mar 23 09:49 wrapper_checkpoint.txt
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m       535 Mar 23 09:49 boinc_task_state.xml
[2023-03-23 09:49:30] -rw------- 1 m m      2866 Mar 23 09:49 pilotlog.txt
[2023-03-23 09:49:30] -rw------- 1 m m    119383 Mar 23 09:49 log.32413688._000229-2698281-1679514681.job.log.1
[2023-03-23 09:49:30] -rw------- 1 m m       402 Mar 23 09:49 output.list
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m       677 Mar 23 09:49 runtime_log
[2023-03-23 09:49:30] -rw------- 1 m m    317440 Mar 23 09:49 result.tar.gz
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m     11670 Mar 23 09:49 runtime_log.err
[2023-03-23 09:49:30] -rw------- 1 m m       628 Mar 23 09:49 FgcKDmefJz2n7Olcko1bjSoqABFKDmABFKDm7AsVDmGbGKDmJTQzlm.diag
[2023-03-23 09:49:30] -rw-rw-r-- 1 m m     21163 Mar 23 09:49 stderr.txt
[2023-03-23 09:49:30] HITS file was successfully produced:
[2023-03-23 09:49:30] -rw------- 1 m m 12897196 Mar 23 09:48 shared/HITS.pool.root.1
[2023-03-23 09:49:30]  *** Contents of shared directory: ***
[2023-03-23 09:49:30] total 439476
[2023-03-23 09:49:30] -rw-r--r-- 2 m m     17789 Mar 23 09:16 start_atlas.sh
[2023-03-23 09:49:30] -rw-r--r-- 2 m m    398721 Mar 23 09:16 input.tar.gz
[2023-03-23 09:49:30] -rw-r--r-- 2 m m 436382292 Mar 23 09:16 ATLAS.root_0
[2023-03-23 09:49:30] -rw------- 1 m m  12897196 Mar 23 09:48 HITS.pool.root.1
[2023-03-23 09:49:30] -rw------- 1 m m    317440 Mar 23 09:49 result.tar.gz
09:49:31 (19180): run_atlas exited; CPU time 3801.313986
09:49:31 (19180): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN