Name aFXLDmXWRPzn7Olcko1bjSoqABFKDmABFKDmumdXDmB8FKDmwGbB1n_0
Workunit 2106508
Created 18 Jul 2021, 19:24:26 UTC
Sent 18 Jul 2021, 19:30:21 UTC
Report deadline 25 Jul 2021, 19:30:21 UTC
Received 18 Jul 2021, 20:29:47 UTC
Server state Over
Outcome Validate error
Client state Done
Exit status 0 (0x00000000)
Computer ID 4055
Run time 17 min 58 sec
CPU time 11 min 39 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 6.55 GFLOPS
Application version ATLAS Simulation v1.04 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 1.43 GB
Peak swap size 2.13 GB
Peak disk usage 81.39 MB

Stderr output

<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
22:11:36 (7876): wrapper (7.7.26015): starting
22:11:36 (7876): wrapper: running run_atlas (--nthreads 2)
[2021-07-18 22:11:36] Arguments: --nthreads 2
[2021-07-18 22:11:36] Threads: 2
[2021-07-18 22:11:36] Checking for CVMFS
[2021-07-18 22:11:36] Probing /cvmfs/atlas.cern.ch... OK
[2021-07-18 22:11:36] Probing /cvmfs/atlas-condb.cern.ch... OK
[2021-07-18 22:11:36] Running cvmfs_config stat atlas.cern.ch
[2021-07-18 22:11:36] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2021-07-18 22:11:36] 2.5.1.0 13013 76804 81276 88615 1 74 4088227 4096001 1 65024 0 147961902 99.9492 7639308 17416 http://cvmfs-stratum-one.cern.ch/cvmfs/atlas.cern.ch http://137.138.123.72:3128 1
[2021-07-18 22:11:36] CVMFS is ok
[2021-07-18 22:11:36] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2021-07-18 22:11:36] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2021-07-18 22:11:36] Further information can be found at the LHC@home message board.
[2021-07-18 22:11:36] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2021-07-18 22:11:36] Checking for singularity binary...
[2021-07-18 22:11:36] which: no singularity in (/usr/sue/sbin:/usr/sue/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/opt/puppetlabs/bin:/root/bin)
[2021-07-18 22:11:36] Singularity is not installed, using version from CVMFS
[2021-07-18 22:11:36] Checking singularity works with /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/current/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2021-07-18 22:11:36] dcameron04.cern.ch
[2021-07-18 22:11:36] Singularity works
[2021-07-18 22:11:36] Set ATHENA_PROC_NUMBER=2
[2021-07-18 22:11:36] Starting ATLAS job with PandaID=5123870169
[2021-07-18 22:11:36] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/current/bin/singularity exec --pwd /root/boinc/slots/0 -B /cvmfs,/root /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2021-07-18 22:29:30]  *** The last 200 lines of the pilot log: ***
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . initial setup = 0 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . payload setup = 12 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . total setup = 12 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . stage-in = 0 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . payload execution = 905 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . stage-out = 0 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.user.atlas.diagnose        | get_log_extracts          | building log extracts (sent to the server as 'pilotLog')
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | DEBUG    | pilot.user.atlas.diagnose        | get_panda_tracer_log      | PanDA tracer log does not exist: /root/boinc/slots/0/PanDA_Pilot-5123870169/pandatracerlog.txt (igno
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.container             | execute                   | executing command: tail -n 20 /root/boinc/slots/0/PanDA_Pilot-5123870169/pilotlog.txt
[2021-07-18 22:29:30] 2021-07-18 20:29:21,502 | WARNING  | pilot.control.job                | add_timing_and_extracts   | 
[2021-07-18 22:29:30] XXXXXXXXXXXXXXXXXXXXX[begin log extracts]
[2021-07-18 22:29:30] - Log from pilotlog.txt -
[2021-07-18 22:29:30] 2021-07-18 20:29:21,393 | INFO     | pilot.control.job                | get_data_structure        | mean actualcorecount: 3.250000
[2021-07-18 22:29:30] 2021-07-18 20:29:21,393 | INFO     | pilot.control.job                | get_data_structure        | total number of processed events: 2 (read)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,394 | INFO     | pilot.util.container             | execute                   | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2021-07-18 22:29:30] 2021-07-18 20:29:21,471 | INFO     | pilot.user.atlas.utilities       | get_memory_values         | using path: /root/boinc/slots/0/PanDA_Pilot-5123870169/memory_monitor_summary.json (trf name=prmon)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,472 | DEBUG    | pilot.user.atlas.utilities       | get_memory_monitor_info   | summary_dictionary={'Avg': {'nprocs': 5.733, 'nthreads': 6.599, 'pss': 1049488.0, 'rchar': 1095062.0
[2021-07-18 22:29:30] 2021-07-18 20:29:21,472 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard info from prmon json
[2021-07-18 22:29:30] 2021-07-18 20:29:21,472 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard memory fields from prmon json
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . Timing measurements:
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . get job = 0 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . initial setup = 0 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . payload setup = 12 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . total setup = 12 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . stage-in = 0 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . payload execution = 905 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | . stage-out = 0 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.user.atlas.diagnose        | get_log_extracts          | building log extracts (sent to the server as 'pilotLog')
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | DEBUG    | pilot.user.atlas.diagnose        | get_panda_tracer_log      | PanDA tracer log does not exist: /root/boinc/slots/0/PanDA_Pilot-5123870169/pandatracerlog.txt (igno
[2021-07-18 22:29:30] 2021-07-18 20:29:21,473 | INFO     | pilot.util.container             | execute                   | executing command: tail -n 20 /root/boinc/slots/0/PanDA_Pilot-5123870169/pilotlog.txt
[2021-07-18 22:29:30] XXXXXXXXXXXXXXXXXXXXX[end log extracts]
[2021-07-18 22:29:30] 2021-07-18 20:29:21,502 | WARNING  | pilot.control.job                | add_error_codes           | pilotErrorCodes = [1305] (will report primary/first error code)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,502 | WARNING  | pilot.control.job                | add_error_codes           | pilotErrorDiags = ['Failed to execute payload'] (will report primary/first error diag)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,503 | DEBUG    | pilot.control.job                | send_state                | is_harvester_mode(args) : False
[2021-07-18 22:29:30] 2021-07-18 20:29:21,504 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | heartbeat dictionary: {'jobId': '5123870169', 'state': 'failed', 'timestamp': '2021-07-18T22:29:21+0
[2021-07-18 22:29:30] 2021-07-18 20:29:21,504 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | wrote heartbeat to file /root/boinc/slots/0/heartbeat.json
[2021-07-18 22:29:30] 2021-07-18 20:29:21,504 | DEBUG    | pilot.control.job                | queue_monitor             | job 5123870169 was dequeued from the monitored payloads queue
[2021-07-18 22:29:30] 2021-07-18 20:29:21,598 | DEBUG    | pilot.control.job                | queue_monitor             | tmp job object deleted
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | 
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | job summary report
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | PanDA job id: 5123870169
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | task id: NULL
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | error 1/1: 1305: Failed to execute payload
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | status: LOG_TRANSFER = DONE 
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | pilot state: failed 
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | transexitcode: 0
[2021-07-18 22:29:30] 2021-07-18 20:29:21,599 | INFO     | pilot.control.job                | make_job_report           | exeerrorcode: 0
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | exeerrordiag: 
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | exitcode: 0
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | exitmsg: OK
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | cpuconsumptiontime: 743 s
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | nevents: 2
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | neventsw: 0
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | pid: 15161
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | pgrp: 15161
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | corecount: 2
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | event service: False
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | sizes: {54768555: 3866243, 54768556: 3866522, 54768566: 3866408, 54769484: 3890540, 54769485: 389497
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.control.job                | make_job_report           | 
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | DEBUG    | pilot.control.job                | has_job_completed         | ls -lF /root/boinc/slots/0:
[2021-07-18 22:29:30] 
[2021-07-18 22:29:30] 2021-07-18 20:29:21,600 | INFO     | pilot.util.container             | execute                   | executing command: ls -lF /root/boinc/slots/0
[2021-07-18 22:29:30] 2021-07-18 20:29:21,653 | DEBUG    | pilot.control.job                | has_job_completed         | total 42680
[2021-07-18 22:29:30] -rw-------. 1 root root    191181 Jul 18 22:29 95f93662-fc16-4e70-977f-ebbec59715e3_42620.1.job.log
[2021-07-18 22:29:30] -rw-------. 1 root root    853433 Jul 18 22:27 95f93662-fc16-4e70-977f-ebbec59715e3_42620.1.job.log.tgz
[2021-07-18 22:29:30] -rw-------. 1 root root       141 Jul 18 22:11 aFXLDmXWRPzn7Olcko1bjSoqABFKDmABFKDmumdXDmB8FKDmwGbB1n.diag
[2021-07-18 22:29:30] -rw-------. 1 root root   1068707 Jul 18 22:11 agis_schedconf.cvmfs.json
[2021-07-18 22:29:30] -rw-r--r--. 1 root root         0 Jul 18 22:11 boinc_lockfile
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      8192 Jul 18 22:28 boinc_mmap_file
[2021-07-18 22:29:30] -rw-r--r--. 1 root root       532 Jul 18 22:22 boinc_task_state.xml
[2021-07-18 22:29:30] -rw-------. 1 root root   1967101 Jul 18 22:11 cric_ddmendpoints.json
[2021-07-18 22:29:30] -rw-r--r--. 1 root root  37658468 Jul 18 22:11 EVNT.04972714._000029.pool.root.1
[2021-07-18 22:29:30] -rw-------. 1 root root      8638 Jul 18 22:29 heartbeat.json
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      5910 Jul 18 22:11 init_data.xml
[2021-07-18 22:29:30] -rw-r--r--. 1 root root    352958 Jul 18 22:11 input.tar.gz
[2021-07-18 22:29:30] -rw-r--r--. 1 root root       112 Jul 18 22:11 job.xml
[2021-07-18 22:29:30] -rw-------. 1 root root      1010 Jul 18 22:26 memory_monitor_summary.json
[2021-07-18 22:29:30] -rw-------. 1 root root       263 Jul 18 22:27 output.list
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      2599 Jul 18 22:11 pandaJob.out
[2021-07-18 22:29:30] drwxrwx---. 3 root root      4096 Jul 18 22:27 PanDA_Pilot-5123870169/
[2021-07-18 22:29:30] drwxr-xr-x. 4  501 games      280 Jul 18 22:11 pilot2/
[2021-07-18 22:29:30] -rw-r--r--. 1 root root    343058 Jul 18 21:24 pilot2.tar.gz
[2021-07-18 22:29:30] -rw-------. 1 root root    168156 Jul 18 22:29 pilotlog.txt
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      3214 Jul 18 21:24 queuedata.json
[2021-07-18 22:29:30] -rwxr-xr-x. 1 root root      6966 Jul 18 22:11 run_atlas*
[2021-07-18 22:29:30] -rwx------. 1 4871  1028    20589 Jul 18 21:20 runpilot2-wrapper.sh*
[2021-07-18 22:29:30] -rw-r--r--. 1 root root       407 Jul 18 22:11 runtime_log
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      6396 Jul 18 22:11 runtime_log.err
[2021-07-18 22:29:30] -rw-------. 1 root root       414 Jul 18 22:11 setup.sh.local
[2021-07-18 22:29:30] drwxrwx--x. 2 root root        68 Jul 18 22:11 shared/
[2021-07-18 22:29:30] -rw-r--r--. 1 root root     16569 Jul 18 22:11 start_atlas.sh
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      2198 Jul 18 22:11 stderr.txt
[2021-07-18 22:29:30] -rw-r--r--. 1 root root       107 Jul 18 22:11 wrapper_26015_x86_64-pc-linux-gnu
[2021-07-18 22:29:30] -rw-r--r--. 1 root root        25 Jul 18 22:28 wrapper_checkpoint.txt
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue jobs has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue payloads has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_in has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_out has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue current_data_in has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_jobs has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_payloads has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue monitored_payloads has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_jobs has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_payloads has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_in has 1 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_out has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_jobs has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_payloads has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_in has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,654 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_out has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,655 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobs has 0 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,655 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobids has 1 job(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,655 | INFO     | pilot.control.job                | has_job_completed         | job 5123870169 has completed (purged errors)
[2021-07-18 22:29:30] 2021-07-18 20:29:21,655 | INFO     | pilot.util.processes             | cleanup                   | overall cleanup function is called
[2021-07-18 22:29:30] 2021-07-18 20:29:21,664 | DEBUG    | pilot.util.processes             | cleanup                   | work directory was removed: /root/boinc/slots/0/PanDA_Pilot-5123870169
[2021-07-18 22:29:30] 2021-07-18 20:29:22,669 | INFO     | pilot.info.jobdata               | collect_zombies           | --- collectZombieJob: --- 10, [15161]
[2021-07-18 22:29:30] 2021-07-18 20:29:22,669 | INFO     | pilot.info.jobdata               | collect_zombies           | zombie collector trying to kill pid 15161
[2021-07-18 22:29:30] 2021-07-18 20:29:22,669 | INFO     | pilot.info.jobdata               | collect_zombies           | harmless exception when collecting zombies: [Errno 10] No child processes
[2021-07-18 22:29:30] 2021-07-18 20:29:23,675 | INFO     | pilot.util.processes             | cleanup                   | collected zombie processes
[2021-07-18 22:29:30] 2021-07-18 20:29:23,675 | INFO     | pilot.util.processes             | cleanup                   | will now attempt to kill all subprocesses of pid=15161
[2021-07-18 22:29:30] 2021-07-18 20:29:23,762 | INFO     | pilot.util.processes             | kill_processes            | process IDs to be killed: [15161] (in reverse order)
[2021-07-18 22:29:30] 2021-07-18 20:29:23,842 | WARNING  | pilot.util.processes             | kill_processes            | found no corresponding commands to process id(s)
[2021-07-18 22:29:30] 2021-07-18 20:29:23,842 | INFO     | pilot.util.processes             | kill_orphans              | Do not look for orphan processes in BOINC jobs
[2021-07-18 22:29:30] 2021-07-18 20:29:23,843 | DEBUG    | pilot.util.queuehandling         | purge_queue               | queue purged
[2021-07-18 22:29:30] 2021-07-18 20:29:23,843 | INFO     | pilot.control.job                | retrieve                  | ready for new job
[2021-07-18 22:29:30] 2021-07-18 20:29:23,843 | INFO     | root                             | retrieve                  | pilot has finished for previous job - re-establishing logging
[2021-07-18 22:29:30] 2021-07-18 20:29:23,844 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2021-07-18 22:29:30] 2021-07-18 20:29:23,844 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***  PanDA Pilot version 2.12.3 (9)  ***
[2021-07-18 22:29:30] 2021-07-18 20:29:23,844 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2021-07-18 22:29:30] 2021-07-18 20:29:23,844 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | 
[2021-07-18 22:29:30] 2021-07-18 20:29:23,845 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | pilot is running in a VM
[2021-07-18 22:29:30] 2021-07-18 20:29:23,845 | INFO     | pilot.util.auxiliary             | display_architecture_info | architecture information:
[2021-07-18 22:29:30] 2021-07-18 20:29:23,984 | INFO     | pilot.util.auxiliary             | display_architecture_info | 
[2021-07-18 22:29:30] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2021-07-18 22:29:30] Distributor ID:	CentOS
[2021-07-18 22:29:30] Description:	CentOS Linux release 7.8.2003 (Core)
[2021-07-18 22:29:30] Release:	7.8.2003
[2021-07-18 22:29:30] Codename:	Core
[2021-07-18 22:29:30] 2021-07-18 20:29:23,985 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2021-07-18 22:29:30] 2021-07-18 20:29:24,487 | DEBUG    | pilot.util.monitoring            | check_local_space         | checking local space on /root/boinc/slots/0
[2021-07-18 22:29:30] 2021-07-18 20:29:24,515 | INFO     | pilot.util.monitoring            | check_local_space         | sufficient remaining disk space (29178724352 B)
[2021-07-18 22:29:30] 2021-07-18 20:29:24,515 | WARNING  | pilot.control.job                | proceed_with_getjob       | since timefloor is set to 0, pilot was only allowed to run one job
[2021-07-18 22:29:30] 2021-07-18 20:29:24,515 | DEBUG    | pilot.control.job                | retrieve                  | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:24,516 | WARNING  | pilot.util.common                | should_abort              | data:copytool_out:received graceful stop - abort after this iteration
[2021-07-18 22:29:30] 2021-07-18 20:29:24,516 | DEBUG    | pilot.control.job                | retrieve                  | [job] retrieve thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:24,516 | WARNING  | pilot.control.monitor            | control                   | aborting monitor loop since graceful_stop has been set
[2021-07-18 22:29:30] 2021-07-18 20:29:24,516 | INFO     | pilot.control.monitor            | control                   | [monitor] control thread has ended
[2021-07-18 22:29:30] 2021-07-18 20:29:24,927 | DEBUG    | pilot.control.payload            | control                   | payload control ending since graceful_stop has been set
[2021-07-18 22:29:30] 2021-07-18 20:29:24,927 | DEBUG    | pilot.control.payload            | control                   | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:24,927 | DEBUG    | pilot.control.payload            | control                   | [payload] control thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:25,447 | DEBUG    | pilot.control.job                | create_data_payload       | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:25,447 | DEBUG    | pilot.control.job                | create_data_payload       | [job] create_data_payload thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:25,450 | DEBUG    | pilot.control.job                | validate                  | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:25,450 | DEBUG    | pilot.control.job                | validate                  | [job] validate thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:25,505 | DEBUG    | pilot.control.data               | control                   | data control ending since graceful_stop has been set
[2021-07-18 22:29:30] 2021-07-18 20:29:25,505 | DEBUG    | pilot.control.data               | control                   | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:25,505 | DEBUG    | pilot.control.data               | control                   | [data] control thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:25,516 | DEBUG    | pilot.control.data               | copytool_out              | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:25,516 | DEBUG    | pilot.control.data               | copytool_out              | [data] copytool_out thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:25,584 | DEBUG    | pilot.control.payload            | validate_pre              | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:25,584 | INFO     | pilot.control.payload            | validate_pre              | [payload] validate_pre thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:25,591 | DEBUG    | pilot.control.payload            | execute_payloads          | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:25,591 | INFO     | pilot.control.payload            | execute_payloads          | [payload] execute_payloads thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:25,630 | DEBUG    | pilot.control.job                | control                   | job control ending since graceful_stop has been set
[2021-07-18 22:29:30] 2021-07-18 20:29:25,630 | DEBUG    | pilot.control.job                | control                   | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:25,630 | DEBUG    | pilot.control.job                | control                   | [job] control thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:25,907 | DEBUG    | pilot.control.payload            | failed_post               | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:25,907 | INFO     | pilot.control.payload            | failed_post               | [payload] failed_post thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:26,003 | DEBUG    | pilot.control.data               | copytool_in               | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:26,003 | DEBUG    | pilot.control.data               | copytool_in               | [data] copytool_in thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:26,007 | DEBUG    | pilot.control.payload            | validate_post             | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:26,007 | INFO     | pilot.control.payload            | validate_post             | [payload] validate_post thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:26,470 | WARNING  | pilot.control.job                | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 62 s)
[2021-07-18 22:29:30] 2021-07-18 20:29:26,470 | WARNING  | pilot.util.common                | should_abort              | data:queue_monitoring:received graceful stop - abort after this iteration
[2021-07-18 22:29:30] 2021-07-18 20:29:26,470 | DEBUG    | pilot.control.job                | job_monitor               | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:26,471 | DEBUG    | pilot.control.job                | job_monitor               | [job] job monitor thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:26,610 | WARNING  | pilot.util.common                | should_abort              | job:queue_monitor:received graceful stop - abort after this iteration
[2021-07-18 22:29:30] 2021-07-18 20:29:26,611 | DEBUG    | pilot.control.job                | queue_monitor             | will not set job_aborted yet
[2021-07-18 22:29:30] 2021-07-18 20:29:26,611 | DEBUG    | pilot.control.job                | queue_monitor             | [job] queue monitor thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:29,472 | DEBUG    | pilot.util.processes             | threads_aborted           | aborting since the last relevant thread is about to finish
[2021-07-18 22:29:30] 2021-07-18 20:29:29,472 | DEBUG    | pilot.control.data               | queue_monitoring          | will proceed to set job_aborted
[2021-07-18 22:29:30] 2021-07-18 20:29:29,472 | DEBUG    | pilot.control.data               | queue_monitoring          | [data] queue_monitor thread has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:30,383 | INFO     | pilot.workflow.generic           | run                       | end of generic workflow (traces error code: 0)
[2021-07-18 22:29:30] 2021-07-18 20:29:30,383 | INFO     | root                             | wrap_up                   | traces error code: 0
[2021-07-18 22:29:30] 2021-07-18 20:29:30,383 | INFO     | root                             | wrap_up                   | pilot has finished
[2021-07-18 22:29:30] 2021-07-18 20:29:30,464 [wrapper] ==== pilot stdout END ====
[2021-07-18 22:29:30] 2021-07-18 20:29:30,475 [wrapper] ==== wrapper stdout RESUME ====
[2021-07-18 22:29:30] 2021-07-18 20:29:30,484 [wrapper] Pilot exit status: 0
[2021-07-18 22:29:30] 2021-07-18 20:29:30,516 [wrapper] pandaids: 5123870169
[2021-07-18 22:29:30] 2021-07-18 20:29:30,534 [wrapper] apfmon messages muted
[2021-07-18 22:29:30] 2021-07-18 20:29:30,542 [wrapper] Test setup, not cleaning
[2021-07-18 22:29:30] 2021-07-18 20:29:30,551 [wrapper] ==== wrapper stdout END ====
[2021-07-18 22:29:30] 2021-07-18 20:29:30,559 [wrapper] ==== wrapper stderr END ====
[2021-07-18 22:29:30] 2021-07-18 20:29:30,577 [wrapper] wrapperexiting ec=0, duration=1073
[2021-07-18 22:29:30] 2021-07-18 20:29:30,585 [wrapper] apfmon messages muted
[2021-07-18 22:29:30]  *** Error codes and diagnostics ***
[2021-07-18 22:29:30]     "exeErrorCode": 0,
[2021-07-18 22:29:30]     "exeErrorDiag": "",
[2021-07-18 22:29:30]     "pilotErrorCode": 1305,
[2021-07-18 22:29:30]     "pilotErrorDiag": "Failed to execute payload",
[2021-07-18 22:29:30]  *** Listing of results directory ***
[2021-07-18 22:29:30] total 43588
[2021-07-18 22:29:30] -rwx------. 1 4871  1028    20589 Jul 18 21:20 runpilot2-wrapper.sh
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      3214 Jul 18 21:24 queuedata.json
[2021-07-18 22:29:30] -rw-r--r--. 1 root root    343058 Jul 18 21:24 pilot2.tar.gz
[2021-07-18 22:29:30] -rw-r--r--. 1 root root       107 Jul 18 22:11 wrapper_26015_x86_64-pc-linux-gnu
[2021-07-18 22:29:30] -rwxr-xr-x. 1 root root      6966 Jul 18 22:11 run_atlas
[2021-07-18 22:29:30] -rw-r--r--. 1 root root       112 Jul 18 22:11 job.xml
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      5910 Jul 18 22:11 init_data.xml
[2021-07-18 22:29:30] drwxrwx--x. 2 root root        68 Jul 18 22:11 shared
[2021-07-18 22:29:30] -rw-r--r--. 1 root root         0 Jul 18 22:11 boinc_lockfile
[2021-07-18 22:29:30] -rw-r--r--. 1 root root  37658468 Jul 18 22:11 EVNT.04972714._000029.pool.root.1
[2021-07-18 22:29:30] -rw-r--r--. 1 root root     16569 Jul 18 22:11 start_atlas.sh
[2021-07-18 22:29:30] -rw-r--r--. 1 root root    352958 Jul 18 22:11 input.tar.gz
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      2599 Jul 18 22:11 pandaJob.out
[2021-07-18 22:29:30] -rw-------. 1 root root       414 Jul 18 22:11 setup.sh.local
[2021-07-18 22:29:30] -rw-------. 1 root root   1068707 Jul 18 22:11 agis_schedconf.cvmfs.json
[2021-07-18 22:29:30] -rw-------. 1 root root   1967101 Jul 18 22:11 cric_ddmendpoints.json
[2021-07-18 22:29:30] drwxr-xr-x. 4  501 games      280 Jul 18 22:11 pilot2
[2021-07-18 22:29:30] -rw-r--r--. 1 root root       532 Jul 18 22:22 boinc_task_state.xml
[2021-07-18 22:29:30] -rw-------. 1 root root      1010 Jul 18 22:26 memory_monitor_summary.json
[2021-07-18 22:29:30] -rw-------. 1 root root    853433 Jul 18 22:27 95f93662-fc16-4e70-977f-ebbec59715e3_42620.1.job.log.tgz
[2021-07-18 22:29:30] -rw-------. 1 root root      8638 Jul 18 22:29 heartbeat.json
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      8192 Jul 18 22:29 boinc_mmap_file
[2021-07-18 22:29:30] -rw-------. 1 root root      7632 Jul 18 22:29 pilotlog.txt
[2021-07-18 22:29:30] -rw-r--r--. 1 root root        25 Jul 18 22:29 wrapper_checkpoint.txt
[2021-07-18 22:29:30] -rw-------. 1 root root    206063 Jul 18 22:29 95f93662-fc16-4e70-977f-ebbec59715e3_42620.1.job.log
[2021-07-18 22:29:30] -rw-------. 1 root root       263 Jul 18 22:29 output.list
[2021-07-18 22:29:30] -rw-r--r--. 1 root root       686 Jul 18 22:29 runtime_log
[2021-07-18 22:29:30] -rw-------. 1 root root   1075200 Jul 18 22:29 result.tar.gz
[2021-07-18 22:29:30] -rw-r--r--. 1 root root      9830 Jul 18 22:29 runtime_log.err
[2021-07-18 22:29:30] -rw-------. 1 root root       577 Jul 18 22:29 aFXLDmXWRPzn7Olcko1bjSoqABFKDmABFKDmumdXDmB8FKDmwGbB1n.diag
[2021-07-18 22:29:30] -rw-r--r--. 1 root root     30633 Jul 18 22:29 stderr.txt
[2021-07-18 22:29:30] No HITS result produced
[2021-07-18 22:29:30]  *** Contents of shared directory: ***
[2021-07-18 22:29:30] total 38196
[2021-07-18 22:29:30] -rw-r--r--. 1 root root 37658468 Jul 18 22:11 ATLAS.root_0
[2021-07-18 22:29:30] -rw-r--r--. 1 root root    16569 Jul 18 22:11 start_atlas.sh
[2021-07-18 22:29:30] -rw-r--r--. 1 root root   352958 Jul 18 22:11 input.tar.gz
[2021-07-18 22:29:30] -rw-------. 1 root root  1075200 Jul 18 22:29 result.tar.gz
22:29:32 (7876): run_atlas exited; CPU time 699.478566
22:29:32 (7876): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN