Name X9JNDmJAtw2n7Olcko1bjSoqABFKDmABFKDm7AsVDm3QGKDmgaEm8n_1
Workunit 2287684
Created 16 Mar 2023, 15:02:51 UTC
Sent 17 Mar 2023, 7:14:12 UTC
Report deadline 24 Mar 2023, 7:14:12 UTC
Received 17 Mar 2023, 10:16:54 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4704
Run time 2 hours 46 min 39 sec
CPU time 9 hours 2 min 33 sec
Validate state Valid
Credit 13.24
Device peak FLOPS 20.06 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.57 GB
Peak swap size 2.97 GB
Peak disk usage 1.11 GB

Stderr output

<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
08:25:58 (957152): wrapper (7.7.26015): starting
08:25:58 (957152): wrapper: running run_atlas (--nthreads 4)
[2023-03-17 08:25:58] Arguments: --nthreads 4
[2023-03-17 08:25:58] Threads: 4
[2023-03-17 08:25:58] Checking for CVMFS
[2023-03-17 08:25:58] Probing /cvmfs/atlas.cern.ch... OK
[2023-03-17 08:25:58] Probing /cvmfs/atlas-condb.cern.ch... OK
[2023-03-17 08:25:58] Running cvmfs_config stat atlas.cern.ch
[2023-03-17 08:25:59] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2023-03-17 08:25:59] 2.10.0.0 523537 995 62888 116844 2 64 5814943 10240001 0 130560 0 2882862 99.994 90257 5698 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.101.101:3128 1
[2023-03-17 08:25:59] CVMFS is ok
[2023-03-17 08:25:59] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2023-03-17 08:25:59] Checking for apptainer binary...
[2023-03-17 08:25:59] Using apptainer found in PATH at /usr/bin/apptainer
[2023-03-17 08:25:59] Running /usr/bin/apptainer --version
[2023-03-17 08:25:59] apptainer version 1.1.0-rc.2
[2023-03-17 08:25:59] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2023-03-17 08:25:59] atlas6l2
[2023-03-17 08:25:59] apptainer works
[2023-03-17 08:25:59] Set ATHENA_PROC_NUMBER=4
[2023-03-17 08:25:59] Set ATHENA_CORE_NUMBER=4
[2023-03-17 08:25:59] Starting ATLAS job with PandaID=5785058964
[2023-03-17 08:25:59] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc_data/boinc-01/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2023-03-17 11:12:34]  *** The last 200 lines of the pilot log: ***
[2023-03-17 11:12:34] 2023-03-17 10:10:45,067 | INFO     | Resolved protocol to be used for transfer: '{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}': l
[2023-03-17 11:12:34] 2023-03-17 10:10:45,067 | INFO     | ready to transfer (stage-out) files: [ accessmode=
[2023-03-17 11:12:34]  activity=['pl', 'pw', 'w', 'default']
[2023-03-17 11:12:34]  allow_lan=True
[2023-03-17 11:12:34]  allow_wan=False
[2023-03-17 11:12:34]  checkinputsize=True
[2023-03-17 11:12:34]  checksum={'adler32': 'e489c24c'}
[2023-03-17 11:12:34]  dataset=valid2.601229.PhPy8EG_A14_ttbar_hdamp258p75_SingleLep.simul.log.e8472_s4111_tid32777692_00
[2023-03-17 11:12:34]  ddm_activity=['write_lan', 'write_wan']
[2023-03-17 11:12:34]  ddmendpoint=NDGF-T1_DATADISK
[2023-03-17 11:12:34]  direct_access_lan=False
[2023-03-17 11:12:34]  direct_access_wan=False
[2023-03-17 11:12:34]  domain=
[2023-03-17 11:12:34]  filesize=258340
[2023-03-17 11:12:34]  filetype=log
[2023-03-17 11:12:34]  guid=cbd5f932-083e-4286-9bc2-9da54a84b142
[2023-03-17 11:12:34]  inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK']
[2023-03-17 11:12:34]  is_tar=False
[2023-03-17 11:12:34]  lfn=log.32777692._000068.job.log.tgz.1
[2023-03-17 11:12:34]  mtime=0
[2023-03-17 11:12:34]  protocol_id=None
[2023-03-17 11:12:34]  protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}]
[2023-03-17 11:12:34]  replicas=None
[2023-03-17 11:12:34]  scope=valid2
[2023-03-17 11:12:34]  status=None
[2023-03-17 11:12:34]  status_code=0
[2023-03-17 11:12:34]  storage_token=
[2023-03-17 11:12:34]  surl=/var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5785058964/log.32777692._000068.job.log.tgz.1
[2023-03-17 11:12:34]  turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid2/16/cd/log.32777692._000068.job.log.tgz.1
[2023-03-17 11:12:34]  workdir=None
[2023-03-17 11:12:34] ]
[2023-03-17 11:12:34] 2023-03-17 10:10:45,069 | INFO     | [attempt=1/3] loading data from url=https://atlas-cric.cern.ch/cache/ddmendpoints.json
[2023-03-17 11:12:34] 2023-03-17 10:10:45,152 | WARNING  | failed to load data from url=https://atlas-cric.cern.ch/cache/ddmendpoints.json, error: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: 
[2023-03-17 11:12:34] 2023-03-17 10:10:45,152 | INFO     | will try again after 41s..
[2023-03-17 11:12:34] 2023-03-17 10:11:26,204 | INFO     | [attempt=2/3] loading data from url=https://atlas-cric.cern.ch/cache/ddmendpoints.json
[2023-03-17 11:12:34] 2023-03-17 10:11:26,325 | WARNING  | failed to load data from url=https://atlas-cric.cern.ch/cache/ddmendpoints.json, error: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: 
[2023-03-17 11:12:34] 2023-03-17 10:11:26,326 | INFO     | will try again after 34s..
[2023-03-17 11:12:34] 2023-03-17 10:11:31,446 | INFO     | monitor loop #135: job 0:5785058964 is in state 'stageout'
[2023-03-17 11:12:34] 2023-03-17 10:11:31,447 | INFO     | payload log (log.EVNTtoHITS) within allowed size limit (2147483648 B): 2382185 B
[2023-03-17 11:12:34] 2023-03-17 10:11:31,447 | INFO     | skipping file size check of file (/var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5785058964/log.32777692._000068.job.log.tgz.1) since it is a special log file
[2023-03-17 11:12:34] 2023-03-17 10:11:31,447 | INFO     | payload log (payload.stdout) within allowed size limit (2147483648 B): 15859 B
[2023-03-17 11:12:34] 2023-03-17 10:11:31,447 | INFO     | executing command: df -mP /var/lib/boinc_data/boinc-01/slots/0
[2023-03-17 11:12:34] 2023-03-17 10:11:31,463 | INFO     | sufficient remaining disk space (38632685568 B)
[2023-03-17 11:12:34] 2023-03-17 10:11:31,463 | INFO     | work directory size check will use 61362667520 B as a max limit (10% grace limit added)
[2023-03-17 11:12:34] 2023-03-17 10:11:31,464 | INFO     | size of work directory /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5785058964: 2972438 B (within 61362667520 B limit)
[2023-03-17 11:12:34] 2023-03-17 10:11:31,464 | INFO     | pfn file=/var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5785058964/HITS.32777692._000068.pool.root.1 does not exist (skip from workdir size calculation)
[2023-03-17 11:12:34] 2023-03-17 10:11:31,465 | INFO     | total size of present files: 0 B (workdir size: 2972438 B)
[2023-03-17 11:12:34] 2023-03-17 10:11:31,465 | INFO     | output file size check: skipping output file /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5785058964/HITS.32777692._000068.pool.root.1 since it does not exist
[2023-03-17 11:12:34] 2023-03-17 10:11:31,502 | INFO     | number of running child processes to parent process 981258: 1
[2023-03-17 11:12:34] 2023-03-17 10:11:31,503 | INFO     | maximum number of monitored processes: 6
[2023-03-17 11:12:34] 2023-03-17 10:11:54,816 | INFO     | 9947.86091041565s have passed since pilot start
[2023-03-17 11:12:34] 2023-03-17 10:12:00,399 | INFO     | [attempt=3/3] loading data from url=https://atlas-cric.cern.ch/cache/ddmendpoints.json
[2023-03-17 11:12:34] 2023-03-17 10:12:00,488 | WARNING  | failed to load data from url=https://atlas-cric.cern.ch/cache/ddmendpoints.json, error: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: 
[2023-03-17 11:12:34] 2023-03-17 10:12:00,488 | WARNING  | cache file=/var/lib/boinc_data/boinc-01/slots/0/agis_ddmendpoints.agis.ALL.json is not available: [Errno 2] No such file or directory: '/var/lib/boinc_data/boinc-0
[2023-03-17 11:12:34] 2023-03-17 10:12:00,522 | INFO     | transferring file log.32777692._000068.job.log.tgz.1 from /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5785058964/log.32777692._000068.job.log.tgz.1 to /var/li
[2023-03-17 11:12:34] 2023-03-17 10:12:00,522 | INFO     | executing command: /usr/bin/env mv /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5785058964/log.32777692._000068.job.log.tgz.1 /var/lib/boinc_data/boinc-01/slot
[2023-03-17 11:12:34] 2023-03-17 10:12:00,541 | INFO     | Adding to output.list: log.32777692._000068.job.log.tgz.1 davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid2/16/cd/log.32777692._000068.job.log.tgz.1:ch
[2023-03-17 11:12:34] 2023-03-17 10:12:00,541 | INFO     | executing command: ps aux -q 960613
[2023-03-17 11:12:34] 2023-03-17 10:12:00,553 | INFO     | summary of transferred files:
[2023-03-17 11:12:34] 2023-03-17 10:12:00,553 | INFO     |  -- lfn=log.32777692._000068.job.log.tgz.1, status_code=0, status=transferred
[2023-03-17 11:12:34] 2023-03-17 10:12:00,553 | INFO     | stage-out finished correctly
[2023-03-17 11:12:34] 2023-03-17 10:12:02,197 | INFO     | finished stage-out for finished payload, adding job to finished_jobs queue
[2023-03-17 11:12:34] 2023-03-17 10:12:02,260 | INFO     | job 5785058964 has state=finished
[2023-03-17 11:12:34] 2023-03-17 10:12:02,260 | INFO     | preparing for final server update for job 5785058964 in state='finished'
[2023-03-17 11:12:34] 2023-03-17 10:12:02,261 | INFO     | pilot will not update the server (heartbeat message will be written to file)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,261 | INFO     | job 5785058964 has finished - writing final server update
[2023-03-17 11:12:34] 2023-03-17 10:12:02,262 | WARNING  | format EVNTtoHITS has no such key: dbData
[2023-03-17 11:12:34] 2023-03-17 10:12:02,262 | WARNING  | format EVNTtoHITS has no such key: dbTime
[2023-03-17 11:12:34] 2023-03-17 10:12:02,266 | INFO     | fitting pss+swap vs Time
[2023-03-17 11:12:34] 2023-03-17 10:12:02,267 | INFO     | current chi2=6.215618292949639 (change=9.283220326072437 %)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,267 | INFO     | right removable region: 148
[2023-03-17 11:12:34] 2023-03-17 10:12:02,267 | INFO     | current chi2=4.440998978442403 (change=35.18374088118074 %)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,268 | INFO     | current chi2=3.0278739252640596 (change=31.819981496009497 %)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,268 | INFO     | current chi2=1.6132396394170574 (change=46.72038270958169 %)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,268 | INFO     | current chi2=0.9259131833525028 (change=42.60535380304189 %)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,268 | INFO     | current chi2=0.9196866767061393 (change=0.6724719723526175 %)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,268 | INFO     | left removable region: 50
[2023-03-17 11:12:34] 2023-03-17 10:12:02,268 | INFO     | current memory leak: -2.34 B/s (using 98 data points, chi2=0.00)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,269 | INFO     | total number of processed events: 500 (read)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,269 | INFO     | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2023-03-17 11:12:34] 2023-03-17 10:12:02,288 | INFO     | using path: /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5785058964/memory_monitor_summary.json (trf name=prmon)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,291 | INFO     | extracted standard info from prmon json
[2023-03-17 11:12:34] 2023-03-17 10:12:02,291 | INFO     | extracted standard memory fields from prmon json
[2023-03-17 11:12:34] 2023-03-17 10:12:02,291 | INFO     | ..............................
[2023-03-17 11:12:34] 2023-03-17 10:12:02,291 | INFO     | . Timing measurements:
[2023-03-17 11:12:34] 2023-03-17 10:12:02,292 | INFO     | . get job = 64 s
[2023-03-17 11:12:34] 2023-03-17 10:12:02,292 | INFO     | . initial setup = 55 s
[2023-03-17 11:12:34] 2023-03-17 10:12:02,292 | INFO     | . payload setup = 4 s
[2023-03-17 11:12:34] 2023-03-17 10:12:02,292 | INFO     | . stage-in = 61 s
[2023-03-17 11:12:34] 2023-03-17 10:12:02,292 | INFO     | . payload execution = 9346 s
[2023-03-17 11:12:34] 2023-03-17 10:12:02,292 | INFO     | . stage-out = 414 s
[2023-03-17 11:12:34] 2023-03-17 10:12:02,292 | INFO     | ..............................
[2023-03-17 11:12:34] 2023-03-17 10:12:02,349 | INFO     | 
[2023-03-17 11:12:34] 2023-03-17 10:12:02,349 | INFO     | job summary report
[2023-03-17 11:12:34] 2023-03-17 10:12:02,349 | INFO     | --------------------------------------------------
[2023-03-17 11:12:34] 2023-03-17 10:12:02,349 | INFO     | PanDA job id: 5785058964
[2023-03-17 11:12:34] 2023-03-17 10:12:02,349 | INFO     | task id: 32777692
[2023-03-17 11:12:34] 2023-03-17 10:12:02,349 | INFO     | errors: (none)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,349 | INFO     | status: LOG_TRANSFER = DONE 
[2023-03-17 11:12:34] 2023-03-17 10:12:02,349 | INFO     | pilot state: finished 
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | transexitcode: 0
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | exeerrorcode: 0
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | exeerrordiag: 
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | exitcode: 0
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | exitmsg: OK
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | cpuconsumptiontime: 32594 s
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | nevents: 500
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | neventsw: 0
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | pid: 981258
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | pgrp: 981258
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | corecount: 4
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | event service: False
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | sizes: {0: 2538451, 11: 2538597, 21: 2538625, 32: 2538653, 42: 2538681, 53: 2538709, 62: 2538925, 64: 2538981, 9353: 2567477, 9769: 2576677, 9771: 2577863}
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | --------------------------------------------------
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | 
[2023-03-17 11:12:34] 2023-03-17 10:12:02,350 | INFO     | executing command: ls -lF /var/lib/boinc_data/boinc-01/slots/0
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue jobs had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue payloads had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue data_in had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue data_out had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue current_data_in had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,363 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,364 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,364 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,364 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,364 | INFO     | queue completed_jobids has 1 job(s)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,364 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,364 | INFO     | queue messages had 0 job(s) [purged]
[2023-03-17 11:12:34] 2023-03-17 10:12:02,364 | INFO     | job 5785058964 has completed (purged errors)
[2023-03-17 11:12:34] 2023-03-17 10:12:02,364 | INFO     | overall cleanup function is called
[2023-03-17 11:12:34] 2023-03-17 10:12:03,366 | INFO     | --- collectZombieJob: --- 10, [981258]
[2023-03-17 11:12:34] 2023-03-17 10:12:03,367 | INFO     | zombie collector trying to kill pid 981258
[2023-03-17 11:12:34] 2023-03-17 10:12:03,367 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2023-03-17 11:12:34] 2023-03-17 10:12:04,372 | INFO     | collected zombie processes
[2023-03-17 11:12:34] 2023-03-17 10:12:04,372 | INFO     | will now attempt to kill all subprocesses of pid=981258
[2023-03-17 11:12:34] 2023-03-17 10:12:04,412 | INFO     | process IDs to be killed: [981258] (in reverse order)
[2023-03-17 11:12:34] 2023-03-17 10:12:04,458 | WARNING  | found no corresponding commands to process id(s)
[2023-03-17 11:12:34] 2023-03-17 10:12:04,459 | INFO     | Do not look for orphan processes in BOINC jobs
[2023-03-17 11:12:34] 2023-03-17 10:12:04,459 | INFO     | ready for new job
[2023-03-17 11:12:34] 2023-03-17 10:12:04,459 | INFO     | pilot has finished with previous job - re-establishing logging
[2023-03-17 11:12:34] 2023-03-17 10:12:04,461 | INFO     | ***************************************
[2023-03-17 11:12:34] 2023-03-17 10:12:04,461 | INFO     | ***  PanDA Pilot version 3.4.8 (5)  ***
[2023-03-17 11:12:34] 2023-03-17 10:12:04,462 | INFO     | ***************************************
[2023-03-17 11:12:34] 2023-03-17 10:12:04,462 | INFO     | 
[2023-03-17 11:12:34] 2023-03-17 10:12:04,463 | INFO     | pilot is running in a VM
[2023-03-17 11:12:34] 2023-03-17 10:12:04,463 | INFO     | architecture information:
[2023-03-17 11:12:34] 2023-03-17 10:12:04,532 | INFO     | 
[2023-03-17 11:12:34] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2023-03-17 11:12:34] Distributor ID:	CentOS
[2023-03-17 11:12:34] Description:	CentOS Linux release 7.9.2009 (Core)
[2023-03-17 11:12:34] Release:	7.9.2009
[2023-03-17 11:12:34] Codename:	Core
[2023-03-17 11:12:34] 2023-03-17 10:12:04,533 | INFO     | ***************************************
[2023-03-17 11:12:34] 2023-03-17 10:12:05,034 | INFO     | executing command: df -mP /var/lib/boinc_data/boinc-01/slots/0
[2023-03-17 11:12:34] 2023-03-17 10:12:05,052 | INFO     | sufficient remaining disk space (38632685568 B)
[2023-03-17 11:12:34] 2023-03-17 10:12:05,052 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2023-03-17 11:12:34] 2023-03-17 10:12:05,053 | INFO     | [job] retrieve thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:05,143 | INFO     | [data] copytool_in thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:05,321 | INFO     | [job] create_data_payload thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:05,467 | INFO     | [data] control thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:05,569 | INFO     | [payload] execute_payloads thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:05,590 | INFO     | [job] validate thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:05,591 | INFO     | [payload] validate_pre thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:05,834 | INFO     | [monitor] control thread has ended
[2023-03-17 11:12:34] 2023-03-17 10:12:05,871 | INFO     | [payload] control thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:06,112 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2023-03-17 11:12:34] 2023-03-17 10:12:06,460 | INFO     | [job] control thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:06,490 | INFO     | [payload] validate_post thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:06,574 | INFO     | [payload] failed_post thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:07,113 | INFO     | [data] copytool_out thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:07,360 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2023-03-17 11:12:34] 2023-03-17 10:12:07,361 | INFO     | [job] queue monitor thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:08,266 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2023-03-17 11:12:34] 2023-03-17 10:12:11,267 | INFO     | [data] queue_monitor thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:17,375 | INFO     | job.realtimelogging is not enabled
[2023-03-17 11:12:34] 2023-03-17 10:12:17,375 | INFO     | [payload] run_realtimelog thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:33,052 | WARNING  | no jobs in monitored_payloads queue (waited for 62 s)
[2023-03-17 11:12:34] 2023-03-17 10:12:33,053 | INFO     | [job] job monitor thread has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:33,968 | INFO     | end of generic workflow (traces error code: 0)
[2023-03-17 11:12:34] 2023-03-17 10:12:33,969 | INFO     | traces error code: 0
[2023-03-17 11:12:34] 2023-03-17 10:12:33,969 | INFO     | pilot has finished
[2023-03-17 11:12:34] 2023-03-17 10:12:34,017 [wrapper] ==== pilot stdout END ====
[2023-03-17 11:12:34] 2023-03-17 10:12:34,020 [wrapper] ==== wrapper stdout RESUME ====
[2023-03-17 11:12:34] 2023-03-17 10:12:34,022 [wrapper] pilotpid: 960613
[2023-03-17 11:12:34] 2023-03-17 10:12:34,025 [wrapper] Pilot exit status: 0
[2023-03-17 11:12:34] 2023-03-17 10:12:34,040 [wrapper] pandaids: 5785058964
[2023-03-17 11:12:34] 2023-03-17 10:12:34,047 [wrapper] apfmon messages muted
[2023-03-17 11:12:34] 2023-03-17 10:12:34,051 [wrapper] Test setup, not cleaning
[2023-03-17 11:12:34] 2023-03-17 10:12:34,054 [wrapper] ==== wrapper stdout END ====
[2023-03-17 11:12:34] 2023-03-17 10:12:34,056 [wrapper] ==== wrapper stderr END ====
[2023-03-17 11:12:34] 2023-03-17 10:12:34,063 [wrapper] wrapperexiting ec=0, duration=9995
[2023-03-17 11:12:34] 2023-03-17 10:12:34,066 [wrapper] apfmon messages muted
[2023-03-17 11:12:34]  *** Error codes and diagnostics ***
[2023-03-17 11:12:34]     "exeErrorCode": 0,
[2023-03-17 11:12:34]     "exeErrorDiag": "",
[2023-03-17 11:12:34]     "pilotErrorCode": 0,
[2023-03-17 11:12:34]     "pilotErrorDiag": "",
[2023-03-17 11:12:34]  *** Listing of results directory ***
[2023-03-17 11:12:34] insgesamt 735180
[2023-03-17 11:12:34] -rw-r--r-- 1 yeti yeti    386707 M&#195;&#164;r 16 03:23 pilot3.tar.gz
[2023-03-17 11:12:34] -rw-r--r-- 1 yeti yeti      4336 M&#195;&#164;r 16 04:05 queuedata.json
[2023-03-17 11:12:34] -rwx------ 1 yeti yeti     26447 M&#195;&#164;r 16 04:09 runpilot2-wrapper.sh
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti       107 M&#195;&#164;r 17 08:25 wrapper_26015_x86_64-pc-linux-gnu
[2023-03-17 11:12:34] -rwxr-xr-x 1 yeti yeti      7986 M&#195;&#164;r 17 08:25 run_atlas
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti       112 M&#195;&#164;r 17 08:25 job.xml
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti      6440 M&#195;&#164;r 17 08:25 init_data.xml
[2023-03-17 11:12:34] -rw-r--r-- 2 yeti yeti 437872866 M&#195;&#164;r 17 08:25 EVNT.29838250._000004.pool.root.1
[2023-03-17 11:12:34] -rw-r--r-- 2 yeti yeti     17076 M&#195;&#164;r 17 08:25 start_atlas.sh
[2023-03-17 11:12:34] drwxrwx--x 2 yeti yeti      4096 M&#195;&#164;r 17 08:25 shared
[2023-03-17 11:12:34] -rw-r--r-- 2 yeti yeti    398324 M&#195;&#164;r 17 08:25 input.tar.gz
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti         0 M&#195;&#164;r 17 08:25 boinc_lockfile
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti      2463 M&#195;&#164;r 17 08:25 pandaJob.out
[2023-03-17 11:12:34] -rw------- 1 yeti yeti       450 M&#195;&#164;r 17 08:25 setup.sh.local
[2023-03-17 11:12:34] -rw------- 1 yeti yeti    975566 M&#195;&#164;r 17 08:26 agis_schedconf.cvmfs.json
[2023-03-17 11:12:34] -rw------- 1 yeti yeti   1426563 M&#195;&#164;r 17 08:27 cric_ddmendpoints.json
[2023-03-17 11:12:34] drwx------ 4 yeti yeti      4096 M&#195;&#164;r 17 08:28 pilot3
[2023-03-17 11:12:34] -rw------- 1 yeti yeti 310153542 M&#195;&#164;r 17 11:04 HITS.32777692._000068.pool.root.1
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti       537 M&#195;&#164;r 17 11:04 boinc_task_state.xml
[2023-03-17 11:12:34] -rw------- 1 yeti yeti      1036 M&#195;&#164;r 17 11:05 memory_monitor_summary.json
[2023-03-17 11:12:34] -rw------- 1 yeti yeti    258340 M&#195;&#164;r 17 11:08 log.32777692._000068.job.log.tgz.1
[2023-03-17 11:12:34] -rw------- 1 yeti yeti      7590 M&#195;&#164;r 17 11:12 heartbeat.json
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti        28 M&#195;&#164;r 17 11:12 wrapper_checkpoint.txt
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti      8192 M&#195;&#164;r 17 11:12 boinc_mmap_file
[2023-03-17 11:12:34] -rw------- 1 yeti yeti      2942 M&#195;&#164;r 17 11:12 pilotlog.txt
[2023-03-17 11:12:34] -rw------- 1 yeti yeti    429356 M&#195;&#164;r 17 11:12 log.32777692._000068.job.log.1
[2023-03-17 11:12:34] -rw------- 1 yeti yeti       345 M&#195;&#164;r 17 11:12 output.list
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti       620 M&#195;&#164;r 17 11:12 runtime_log
[2023-03-17 11:12:34] -rw------- 1 yeti yeti    706560 M&#195;&#164;r 17 11:12 result.tar.gz
[2023-03-17 11:12:34] -rw------- 1 yeti yeti       633 M&#195;&#164;r 17 11:12 X9JNDmJAtw2n7Olcko1bjSoqABFKDmABFKDm7AsVDm3QGKDmgaEm8n.diag
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti     10557 M&#195;&#164;r 17 11:12 runtime_log.err
[2023-03-17 11:12:34] -rw-rw-r-- 1 yeti yeti     22071 M&#195;&#164;r 17 11:12 stderr.txt
[2023-03-17 11:12:34] HITS file was successfully produced:
[2023-03-17 11:12:34] -rw------- 1 yeti yeti 310153542 M&#195;&#164;r 17 11:04 shared/HITS.pool.root.1
[2023-03-17 11:12:34]  *** Contents of shared directory: ***
[2023-03-17 11:12:34] insgesamt 731612
[2023-03-17 11:12:34] -rw-r--r-- 2 yeti yeti 437872866 M&#195;&#164;r 17 08:25 ATLAS.root_0
[2023-03-17 11:12:34] -rw-r--r-- 2 yeti yeti     17076 M&#195;&#164;r 17 08:25 start_atlas.sh
[2023-03-17 11:12:34] -rw-r--r-- 2 yeti yeti    398324 M&#195;&#164;r 17 08:25 input.tar.gz
[2023-03-17 11:12:34] -rw------- 1 yeti yeti 310153542 M&#195;&#164;r 17 11:04 HITS.pool.root.1
[2023-03-17 11:12:34] -rw------- 1 yeti yeti    706560 M&#195;&#164;r 17 11:12 result.tar.gz
11:12:35 (957152): run_atlas exited; CPU time 32553.913153
11:12:35 (957152): called boinc_finish(0)

</stderr_txt>
]]>


©2025 CERN