Name RqiKDmOMGIzn7Olcko1bjSoqABFKDmABFKDmumdXDmNTFKDmBiKUGm_0
Workunit 2097682
Created 29 Jun 2021, 0:00:48 UTC
Sent 29 Jun 2021, 0:00:58 UTC
Report deadline 6 Jul 2021, 0:00:58 UTC
Received 29 Jun 2021, 1:29:11 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4125
Run time 30 min 37 sec
CPU time 13 min 32 sec
Validate state Valid
Credit 148.68
Device peak FLOPS 34.96 GFLOPS
Application version ATLAS Simulation v1.04 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 1.71 GB
Peak swap size 2.37 GB
Peak disk usage 79.71 MB

Stderr output

<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
20:36:10 (2182343): wrapper (7.7.26015): starting
20:36:10 (2182343): wrapper: running run_atlas (--nthreads 12)
[2021-06-28 20:36:10] Arguments: --nthreads 12
[2021-06-28 20:36:10] Threads: 12
[2021-06-28 20:36:10] Checking for CVMFS
[2021-06-28 20:36:11] Probing /cvmfs/atlas.cern.ch... OK
[2021-06-28 20:36:12] Probing /cvmfs/atlas-condb.cern.ch... OK
[2021-06-28 20:36:12] Running cvmfs_config stat atlas.cern.ch
[2021-06-28 20:36:12] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2021-06-28 20:36:12] 2.8.1.0 2182672 0 24612 87398 3 1 4020039 4194305 0 130560 0 0 0.000 529 1216 http://s1fnal-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
[2021-06-28 20:36:12] CVMFS is ok
[2021-06-28 20:36:12] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2021-06-28 20:36:12] Small home clusters do not require a local http proxy but it is suggested if
[2021-06-28 20:36:12] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2021-06-28 20:36:12] Further information can be found at the LHC@home message board.
[2021-06-28 20:36:12] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2021-06-28 20:36:12] Checking for singularity binary...
[2021-06-28 20:36:12] Using singularity found in PATH at /usr/local/bin/singularity
[2021-06-28 20:36:12] Running /usr/local/bin/singularity --version
[2021-06-28 20:36:12] singularity-ce version 3.8.0-rc.1+104-g3b2942395
[2021-06-28 20:36:12] Checking singularity works with /usr/local/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2021-06-28 20:36:14] e5-2683
[2021-06-28 20:36:14] Singularity works
[2021-06-28 20:36:14] Set ATHENA_PROC_NUMBER=12
[2021-06-28 20:36:14] Starting ATLAS job with PandaID=5102870887
[2021-06-28 20:36:14] Running command: /usr/local/bin/singularity exec --pwd /var/lib/boinc-client/slots/33 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2021-06-28 21:06:44]  *** The last 200 lines of the pilot log: ***
[2021-06-28 21:06:44]       "platform": "Linux-5.4.0-71-generic-x86_64-with-centos-7.8.2003-Core"
[2021-06-28 21:06:44]     }, 
[2021-06-28 21:06:44]     "transform": {
[2021-06-28 21:06:44]       "cpuTime": 8, 
[2021-06-28 21:06:44]       "externalCpuTime": 33, 
[2021-06-28 21:06:44]       "wallTime": 1544
[2021-06-28 21:06:44]     }
[2021-06-28 21:06:44]   }
[2021-06-28 21:06:44] }
[2021-06-28 21:06:44] 2021-06-29 01:06:19,082 | DEBUG    | queue_monitor       | pilot.user.atlas.common          | update_server             | no need to update logstash for this job
[2021-06-28 21:06:44] 2021-06-29 01:06:19,082 | DEBUG    | queue_monitor       | pilot.control.job                | get_proper_state          | state=finished
[2021-06-28 21:06:44] 2021-06-29 01:06:19,082 | DEBUG    | queue_monitor       | pilot.control.job                | get_proper_state          | serverstate=running
[2021-06-28 21:06:44] 2021-06-29 01:06:19,083 | DEBUG    | queue_monitor       | pilot.control.job                | get_proper_state          | serverstate=finished
[2021-06-28 21:06:44] 2021-06-29 01:06:19,083 | INFO     | queue_monitor       | pilot.control.job                | send_state                | pilot will not update the server (heartbeat message will be written to file)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,083 | INFO     | queue_monitor       | pilot.control.job                | send_state                | job 5102870887 has finished - writing final server update
[2021-06-28 21:06:44] 2021-06-29 01:06:19,083 | DEBUG    | queue_monitor       | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | job definition core count: 12
[2021-06-28 21:06:44] 2021-06-29 01:06:19,084 | INFO     | queue_monitor       | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | will not add max space = -36626327 B to job metrics
[2021-06-28 21:06:44] 2021-06-29 01:06:19,085 | DEBUG    | queue_monitor       | pilot.api.analytics              | get_fitted_data           | removing tails from data to be fitted
[2021-06-28 21:06:44] 2021-06-29 01:06:19,085 | INFO     | queue_monitor       | pilot.api.analytics              | get_fitted_data           | fitting pss+swap vs Time
[2021-06-28 21:06:44] 2021-06-29 01:06:19,086 | INFO     | queue_monitor       | pilot.api.analytics              | get_fitted_data           | current memory leak: 1299.33 B/s (using 20 data points, chi2=239026)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,086 | DEBUG    | queue_monitor       | pilot.user.atlas.jobmetrics      | get_job_metrics           | job metrics="actualCoreCount=1 nEvents=2 dbTime=117.87 dbData=4211388 leak=129
[2021-06-28 21:06:44] 2021-06-29 01:06:19,086 | INFO     | queue_monitor       | pilot.control.job                | get_data_structure        | mean actualcorecount: 4.863636
[2021-06-28 21:06:44] 2021-06-29 01:06:19,087 | INFO     | queue_monitor       | pilot.control.job                | get_data_structure        | total number of processed events: 2 (read)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,106 | INFO     | queue_monitor       | pilot.util.container             | execute                   | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2021-06-28 21:06:44] 2021-06-29 01:06:19,163 | INFO     | queue_monitor       | pilot.user.atlas.utilities       | get_memory_values         | using path: /var/lib/boinc-client/slots/33/PanDA_Pilot-5102870887/memory_monit
[2021-06-28 21:06:44] 2021-06-29 01:06:19,166 | DEBUG    | queue_monitor       | pilot.user.atlas.utilities       | get_memory_monitor_info   | summary_dictionary={'Avg': {'nprocs': 4.888, 'nthreads': 5.666, 'pss': 1146878
[2021-06-28 21:06:44] 2021-06-29 01:06:19,166 | INFO     | queue_monitor       | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard info from prmon json
[2021-06-28 21:06:44] 2021-06-29 01:06:19,166 | INFO     | queue_monitor       | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard memory fields from prmon json
[2021-06-28 21:06:44] 2021-06-29 01:06:19,166 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | ..............................
[2021-06-28 21:06:44] 2021-06-29 01:06:19,167 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | . Timing measurements:
[2021-06-28 21:06:44] 2021-06-29 01:06:19,167 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | . get job = 0 s
[2021-06-28 21:06:44] 2021-06-29 01:06:19,167 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | . initial setup = 2 s
[2021-06-28 21:06:44] 2021-06-29 01:06:19,167 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | . payload setup = 64 s
[2021-06-28 21:06:44] 2021-06-29 01:06:19,167 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | . total setup = 66 s
[2021-06-28 21:06:44] 2021-06-29 01:06:19,168 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | . stage-in = 1 s
[2021-06-28 21:06:44] 2021-06-29 01:06:19,168 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | . payload execution = 1629 s
[2021-06-28 21:06:44] 2021-06-29 01:06:19,168 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | . stage-out = 0 s
[2021-06-28 21:06:44] 2021-06-29 01:06:19,168 | INFO     | queue_monitor       | pilot.util.timing                | timing_report             | ..............................
[2021-06-28 21:06:44] 2021-06-29 01:06:19,169 | DEBUG    | queue_monitor       | pilot.control.job                | send_state                | is_harvester_mode(args) : False
[2021-06-28 21:06:44] 2021-06-29 01:06:19,170 | DEBUG    | queue_monitor       | pilot.control.job                | write_heartbeat_to_file   | heartbeat dictionary: {'jobId': '5102870887', 'state': 'finished', 'timestamp'
[2021-06-28 21:06:44] 2021-06-29 01:06:19,170 | DEBUG    | queue_monitor       | pilot.control.job                | write_heartbeat_to_file   | wrote heartbeat to file /var/lib/boinc-client/slots/33/heartbeat.json
[2021-06-28 21:06:44] 2021-06-29 01:06:19,171 | DEBUG    | queue_monitor       | pilot.control.job                | queue_monitor             | job 5102870887 was dequeued from the monitored payloads queue
[2021-06-28 21:06:44] 2021-06-29 01:06:19,314 | DEBUG    | queue_monitor       | pilot.control.job                | queue_monitor             | tmp job object deleted
[2021-06-28 21:06:44] 2021-06-29 01:06:19,314 | INFO     | retrieve            | pilot.control.job                | make_job_report           | 
[2021-06-28 21:06:44] 2021-06-29 01:06:19,315 | INFO     | retrieve            | pilot.control.job                | make_job_report           | job summary report
[2021-06-28 21:06:44] 2021-06-29 01:06:19,315 | INFO     | retrieve            | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-06-28 21:06:44] 2021-06-29 01:06:19,315 | INFO     | retrieve            | pilot.control.job                | make_job_report           | PanDA job id: 5102870887
[2021-06-28 21:06:44] 2021-06-29 01:06:19,315 | INFO     | retrieve            | pilot.control.job                | make_job_report           | task id: NULL
[2021-06-28 21:06:44] 2021-06-29 01:06:19,315 | INFO     | retrieve            | pilot.control.job                | make_job_report           | errors: (none)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,316 | INFO     | retrieve            | pilot.control.job                | make_job_report           | status: LOG_TRANSFER = DONE 
[2021-06-28 21:06:44] 2021-06-29 01:06:19,316 | INFO     | retrieve            | pilot.control.job                | make_job_report           | pilot state: finished 
[2021-06-28 21:06:44] 2021-06-29 01:06:19,316 | INFO     | retrieve            | pilot.control.job                | make_job_report           | transexitcode: 0
[2021-06-28 21:06:44] 2021-06-29 01:06:19,316 | INFO     | retrieve            | pilot.control.job                | make_job_report           | exeerrorcode: 0
[2021-06-28 21:06:44] 2021-06-29 01:06:19,316 | INFO     | retrieve            | pilot.control.job                | make_job_report           | exeerrordiag: 
[2021-06-28 21:06:44] 2021-06-29 01:06:19,317 | INFO     | retrieve            | pilot.control.job                | make_job_report           | exitcode: 0
[2021-06-28 21:06:44] 2021-06-29 01:06:19,317 | INFO     | retrieve            | pilot.control.job                | make_job_report           | exitmsg: OK
[2021-06-28 21:06:44] 2021-06-29 01:06:19,317 | INFO     | retrieve            | pilot.control.job                | make_job_report           | cpuconsumptiontime: 879 s
[2021-06-28 21:06:44] 2021-06-29 01:06:19,317 | INFO     | retrieve            | pilot.control.job                | make_job_report           | nevents: 2
[2021-06-28 21:06:44] 2021-06-29 01:06:19,317 | INFO     | retrieve            | pilot.control.job                | make_job_report           | neventsw: 0
[2021-06-28 21:06:44] 2021-06-29 01:06:19,317 | INFO     | retrieve            | pilot.control.job                | make_job_report           | pid: 2211633
[2021-06-28 21:06:44] 2021-06-29 01:06:19,318 | INFO     | retrieve            | pilot.control.job                | make_job_report           | pgrp: 2211633
[2021-06-28 21:06:44] 2021-06-29 01:06:19,318 | INFO     | retrieve            | pilot.control.job                | make_job_report           | corecount: 12
[2021-06-28 21:06:44] 2021-06-29 01:06:19,318 | INFO     | retrieve            | pilot.control.job                | make_job_report           | event service: False
[2021-06-28 21:06:44] 2021-06-29 01:06:19,318 | INFO     | retrieve            | pilot.control.job                | make_job_report           | sizes: {19864670: 3856115, 19864671: 3856334, 19864672: 3856336, 19864682: 385
[2021-06-28 21:06:44] 2021-06-29 01:06:19,318 | INFO     | retrieve            | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-06-28 21:06:44] 2021-06-29 01:06:19,318 | INFO     | retrieve            | pilot.control.job                | make_job_report           | 
[2021-06-28 21:06:44] 2021-06-29 01:06:19,319 | DEBUG    | retrieve            | pilot.control.job                | has_job_completed         | ls -lF /var/lib/boinc-client/slots/33:
[2021-06-28 21:06:44] 
[2021-06-28 21:06:44] 2021-06-29 01:06:19,319 | INFO     | retrieve            | pilot.util.container             | execute                   | executing command: ls -lF /var/lib/boinc-client/slots/33
[2021-06-28 21:06:44] 2021-06-29 01:06:19,374 | DEBUG    | retrieve            | pilot.control.job                | has_job_completed         | total 42192
[2021-06-28 21:06:44] -rw------- 1 boinc boinc  1060249 Jun 28 20:37 agis_schedconf.cvmfs.json
[2021-06-28 21:06:44] -rw------- 1 boinc boinc   215682 Jun 28 21:06 b2029d89-490a-434a-a79e-6b3ab636c721_17420.1.job.log
[2021-06-28 21:06:44] -rw------- 1 boinc boinc   177810 Jun 28 21:06 b2029d89-490a-434a-a79e-6b3ab636c721_17420.1.job.log.tgz
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc        0 Jun 28 20:36 boinc_lockfile
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     8192 Jun 28 21:06 boinc_mmap_file
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc      533 Jun 28 21:05 boinc_task_state.xml
[2021-06-28 21:06:44] -rw------- 1 boinc boinc  1962838 Jun 28 20:37 cric_ddmendpoints.json
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc 37738636 Jun 28 20:36 EVNT.04972714._000024.pool.root.1
[2021-06-28 21:06:44] -rw------- 1 boinc boinc     7770 Jun 28 21:06 heartbeat.json
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     8864 Jun 28 20:36 init_data.xml
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc   330737 Jun 28 20:36 input.tar.gz
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc      112 Jun 28 20:36 job.xml
[2021-06-28 21:06:44] -rw------- 1 boinc boinc     1011 Jun 28 21:06 memory_monitor_summary.json
[2021-06-28 21:06:44] -rw------- 1 boinc boinc  1036728 Jun 28 21:04 output.1.b2029d89-490a-434a-a79e-6b3ab636c721_17420.pool.root
[2021-06-28 21:06:44] -rw------- 1 boinc boinc      536 Jun 28 21:06 output.list
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     2579 Jun 28 20:36 pandaJob.out
[2021-06-28 21:06:44] drwxrwx--- 2 boinc boinc     4096 Jun 28 21:06 PanDA_Pilot-5102870887/
[2021-06-28 21:06:44] drwx------ 4 boinc boinc     4096 Jun 28 20:37 pilot2/
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc   320775 Jun 28 19:31 pilot2.tar.gz
[2021-06-28 21:06:44] -rw------- 1 boinc boinc   195458 Jun 28 21:06 pilotlog.txt
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     3209 Jun 28 20:00 queuedata.json
[2021-06-28 21:06:44] -rw------- 1 boinc boinc      130 Jun 28 20:36 RqiKDmOMGIzn7Olcko1bjSoqABFKDmABFKDmumdXDmNTFKDmBiKUGm.diag
[2021-06-28 21:06:44] -rwxr-xr-x 1 boinc boinc     6966 Jun 28 20:36 run_atlas*
[2021-06-28 21:06:44] -rwx------ 1 boinc boinc    20456 Jun 28 20:00 runpilot2-wrapper.sh*
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc      407 Jun 28 20:36 runtime_log
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     5574 Jun 28 20:36 runtime_log.err
[2021-06-28 21:06:44] drwxrwx--x 2 boinc boinc     4096 Jun 28 20:36 shared/
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc    16551 Jun 28 20:36 start_atlas.sh
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     2140 Jun 28 20:36 stderr.txt
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc      107 Jun 28 20:36 wrapper_26015_x86_64-pc-linux-gnu
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc       25 Jun 28 21:06 wrapper_checkpoint.txt
[2021-06-28 21:06:44] 2021-06-29 01:06:19,374 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue jobs has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,375 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue payloads has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,375 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue data_in has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,375 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue data_out has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,375 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue current_data_in has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,375 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue validated_jobs has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,376 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue validated_payloads has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,376 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue monitored_payloads has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,376 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue finished_jobs has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,376 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue finished_payloads has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,376 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue finished_data_in has 1 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,377 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue finished_data_out has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,377 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue failed_jobs has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,377 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue failed_payloads has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,377 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue failed_data_in has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,377 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue failed_data_out has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,377 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue completed_jobs has 0 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,378 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue completed_jobids has 1 job(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,378 | INFO     | retrieve            | pilot.control.job                | has_job_completed         | job 5102870887 has completed (purged errors)
[2021-06-28 21:06:44] 2021-06-29 01:06:19,378 | INFO     | retrieve            | pilot.util.processes             | cleanup                   | overall cleanup function is called
[2021-06-28 21:06:44] 2021-06-29 01:06:19,382 | DEBUG    | retrieve            | pilot.util.processes             | cleanup                   | work directory was removed: /var/lib/boinc-client/slots/33/PanDA_Pilot-5102870
[2021-06-28 21:06:44] 2021-06-29 01:06:20,388 | INFO     | retrieve            | pilot.info.jobdata               | collect_zombies           | --- collectZombieJob: --- 10, [2211633]
[2021-06-28 21:06:44] 2021-06-29 01:06:20,388 | INFO     | retrieve            | pilot.info.jobdata               | collect_zombies           | zombie collector trying to kill pid 2211633
[2021-06-28 21:06:44] 2021-06-29 01:06:20,388 | INFO     | retrieve            | pilot.info.jobdata               | collect_zombies           | harmless exception when collecting zombies: [Errno 10] No child processes
[2021-06-28 21:06:44] 2021-06-29 01:06:21,392 | INFO     | retrieve            | pilot.util.processes             | cleanup                   | collected zombie processes
[2021-06-28 21:06:44] 2021-06-29 01:06:21,392 | INFO     | retrieve            | pilot.util.processes             | cleanup                   | will now attempt to kill all subprocesses of pid=2211633
[2021-06-28 21:06:44] 2021-06-29 01:06:21,548 | INFO     | retrieve            | pilot.util.processes             | kill_processes            | process IDs to be killed: [2211633] (in reverse order)
[2021-06-28 21:06:44] 2021-06-29 01:06:21,736 | WARNING  | retrieve            | pilot.util.processes             | kill_processes            | found no corresponding commands to process id(s)
[2021-06-28 21:06:44] 2021-06-29 01:06:21,736 | INFO     | retrieve            | pilot.util.processes             | kill_orphans              | Do not look for orphan processes in BOINC jobs
[2021-06-28 21:06:44] 2021-06-29 01:06:21,736 | DEBUG    | retrieve            | pilot.util.queuehandling         | purge_queue               | queue purged
[2021-06-28 21:06:44] 2021-06-29 01:06:21,736 | INFO     | retrieve            | pilot.control.job                | retrieve                  | ready for new job
[2021-06-28 21:06:44] 2021-06-29 01:06:21,737 | INFO     | retrieve            | root                             | retrieve                  | pilot has finished for previous job - re-establishing logging
[2021-06-28 21:06:44] 2021-06-29 01:06:21,738 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | *****************************************
[2021-06-28 21:06:44] 2021-06-29 01:06:21,738 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | ***  PanDA Pilot version 2.11.2 (22)  ***
[2021-06-28 21:06:44] 2021-06-29 01:06:21,738 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | *****************************************
[2021-06-28 21:06:44] 2021-06-29 01:06:21,738 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | 
[2021-06-28 21:06:44] 2021-06-29 01:06:21,759 | INFO     | retrieve            | pilot.util.auxiliary             | display_architecture_info | architecture information:
[2021-06-28 21:06:44] 2021-06-29 01:06:21,963 | INFO     | retrieve            | pilot.util.auxiliary             | display_architecture_info | 
[2021-06-28 21:06:44] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2021-06-28 21:06:44] Distributor ID:	CentOS
[2021-06-28 21:06:44] Description:	CentOS Linux release 7.8.2003 (Core)
[2021-06-28 21:06:44] Release:	7.8.2003
[2021-06-28 21:06:44] Codename:	Core
[2021-06-28 21:06:44] 2021-06-29 01:06:21,963 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | *****************************************
[2021-06-28 21:06:44] 2021-06-29 01:06:22,466 | DEBUG    | retrieve            | pilot.util.monitoring            | check_local_space         | checking local space on /var/lib/boinc-client/slots/33
[2021-06-28 21:06:44] 2021-06-29 01:06:22,498 | INFO     | retrieve            | pilot.util.monitoring            | check_local_space         | sufficient remaining disk space (162617360384 B)
[2021-06-28 21:06:44] 2021-06-29 01:06:22,498 | WARNING  | retrieve            | pilot.control.job                | proceed_with_getjob       | since timefloor is set to 0, pilot was only allowed to run one job
[2021-06-28 21:06:44] 2021-06-29 01:06:22,499 | DEBUG    | retrieve            | pilot.control.job                | retrieve                  | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:22,499 | DEBUG    | retrieve            | pilot.control.job                | retrieve                  | [job] retrieve thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:22,500 | DEBUG    | data                | pilot.control.data               | control                   | data control ending since graceful_stop has been set
[2021-06-28 21:06:44] 2021-06-29 01:06:22,500 | DEBUG    | data                | pilot.control.data               | control                   | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:22,500 | DEBUG    | data                | pilot.control.data               | control                   | [data] control thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:22,516 | INFO     | monitor             | pilot.control.monitor            | control                   | [monitor] control thread has ended
[2021-06-28 21:06:44] 2021-06-29 01:06:22,553 | DEBUG    | copytool_in         | pilot.control.data               | copytool_in               | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:22,553 | DEBUG    | copytool_in         | pilot.control.data               | copytool_in               | [data] copytool_in thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:22,797 | DEBUG    | job                 | pilot.control.job                | control                   | job control ending since graceful_stop has been set
[2021-06-28 21:06:44] 2021-06-29 01:06:22,797 | DEBUG    | job                 | pilot.control.job                | control                   | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:22,797 | DEBUG    | job                 | pilot.control.job                | control                   | [job] control thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:22,800 | DEBUG    | validate_post       | pilot.control.payload            | validate_post             | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:22,801 | INFO     | validate_post       | pilot.control.payload            | validate_post             | [payload] validate_post thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:23,003 | WARNING  | copytool_out        | pilot.util.common                | should_abort              | data:copytool_out:received graceful stop - abort after this iteration
[2021-06-28 21:06:44] 2021-06-29 01:06:23,059 | DEBUG    | validate_pre        | pilot.control.payload            | validate_pre              | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:23,059 | INFO     | validate_pre        | pilot.control.payload            | validate_pre              | [payload] validate_pre thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:23,456 | DEBUG    | failed_post         | pilot.control.payload            | failed_post               | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:23,456 | INFO     | failed_post         | pilot.control.payload            | failed_post               | [payload] failed_post thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:23,470 | DEBUG    | validate            | pilot.control.job                | validate                  | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:23,470 | DEBUG    | validate            | pilot.control.job                | validate                  | [job] validate thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:23,604 | DEBUG    | payload             | pilot.control.payload            | control                   | payload control ending since graceful_stop has been set
[2021-06-28 21:06:44] 2021-06-29 01:06:23,604 | DEBUG    | payload             | pilot.control.payload            | control                   | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:23,604 | DEBUG    | payload             | pilot.control.payload            | control                   | [payload] control thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:23,715 | DEBUG    | execute_payloads    | pilot.control.payload            | execute_payloads          | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:23,715 | INFO     | execute_payloads    | pilot.control.payload            | execute_payloads          | [payload] execute_payloads thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:23,964 | DEBUG    | create_data_payload | pilot.control.job                | create_data_payload       | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:23,964 | DEBUG    | create_data_payload | pilot.control.job                | create_data_payload       | [job] create_data_payload thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:24,003 | DEBUG    | copytool_out        | pilot.control.data               | copytool_out              | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:24,003 | DEBUG    | copytool_out        | pilot.control.data               | copytool_out              | [data] copytool_out thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:24,320 | WARNING  | queue_monitor       | pilot.util.common                | should_abort              | job:queue_monitor:received graceful stop - abort after this iteration
[2021-06-28 21:06:44] 2021-06-29 01:06:24,320 | DEBUG    | queue_monitor       | pilot.control.job                | queue_monitor             | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:24,320 | DEBUG    | queue_monitor       | pilot.control.job                | queue_monitor             | [job] queue monitor thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:25,086 | WARNING  | queue_monitoring    | pilot.util.common                | should_abort              | data:queue_monitoring:received graceful stop - abort after this iteration
[2021-06-28 21:06:44] 2021-06-29 01:06:28,087 | DEBUG    | queue_monitoring    | pilot.control.data               | queue_monitoring          | will not set job_aborted yet
[2021-06-28 21:06:44] 2021-06-29 01:06:28,088 | DEBUG    | queue_monitoring    | pilot.control.data               | queue_monitoring          | [data] queue_monitor thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:43,604 | WARNING  | job_monitor         | pilot.control.job                | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 72 s)
[2021-06-28 21:06:44] 2021-06-29 01:06:43,604 | DEBUG    | job_monitor         | pilot.util.processes             | threads_aborted           | aborting since the last relevant thread is about to finish
[2021-06-28 21:06:44] 2021-06-29 01:06:43,604 | DEBUG    | job_monitor         | pilot.control.job                | job_monitor               | will proceed to set job_aborted
[2021-06-28 21:06:44] 2021-06-29 01:06:43,604 | DEBUG    | job_monitor         | pilot.control.job                | job_monitor               | [job] job monitor thread has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:44,096 | INFO     | MainThread          | pilot.workflow.generic           | run                       | end of generic workflow (traces error code: 0)
[2021-06-28 21:06:44] 2021-06-29 01:06:44,096 | INFO     | MainThread          | root                             | wrap_up                   | traces error code: 0
[2021-06-28 21:06:44] 2021-06-29 01:06:44,096 | INFO     | MainThread          | root                             | wrap_up                   | pilot has finished
[2021-06-28 21:06:44] 2021-06-29 01:06:44,172 [wrapper] ==== pilot stdout END ====
[2021-06-28 21:06:44] 2021-06-29 01:06:44,182 [wrapper] ==== wrapper stdout RESUME ====
[2021-06-28 21:06:44] 2021-06-29 01:06:44,194 [wrapper] Pilot exit status: 0
[2021-06-28 21:06:44] 2021-06-29 01:06:44,436 [wrapper] pandaids: 5102870887
[2021-06-28 21:06:44] 2021-06-29 01:06:44,459 [wrapper] apfmon messages muted
[2021-06-28 21:06:44] 2021-06-29 01:06:44,469 [wrapper] Test setup, not cleaning
[2021-06-28 21:06:44] 2021-06-29 01:06:44,480 [wrapper] ==== wrapper stdout END ====
[2021-06-28 21:06:44] 2021-06-29 01:06:44,493 [wrapper] ==== wrapper stderr END ====
[2021-06-28 21:06:44] 2021-06-29 01:06:44,519 [wrapper] wrapperexiting ec=0, duration=1826
[2021-06-28 21:06:44] 2021-06-29 01:06:44,529 [wrapper] apfmon messages muted
[2021-06-28 21:06:44]  *** Error codes and diagnostics ***
[2021-06-28 21:06:44]     "exeErrorCode": 0,
[2021-06-28 21:06:44]     "exeErrorDiag": "",
[2021-06-28 21:06:44]     "pilotErrorCode": 0,
[2021-06-28 21:06:44]     "pilotErrorDiag": "",
[2021-06-28 21:06:44]  *** Listing of results directory ***
[2021-06-28 21:06:44] total 43488
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc   320775 Jun 28 19:31 pilot2.tar.gz
[2021-06-28 21:06:44] -rwx------ 1 boinc boinc    20456 Jun 28 20:00 runpilot2-wrapper.sh
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     3209 Jun 28 20:00 queuedata.json
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc      107 Jun 28 20:36 wrapper_26015_x86_64-pc-linux-gnu
[2021-06-28 21:06:44] -rwxr-xr-x 1 boinc boinc     6966 Jun 28 20:36 run_atlas
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc      112 Jun 28 20:36 job.xml
[2021-06-28 21:06:44] drwxrwx--x 2 boinc boinc     4096 Jun 28 20:36 shared
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     8864 Jun 28 20:36 init_data.xml
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc        0 Jun 28 20:36 boinc_lockfile
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc    16551 Jun 28 20:36 start_atlas.sh
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc   330737 Jun 28 20:36 input.tar.gz
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc 37738636 Jun 28 20:36 EVNT.04972714._000024.pool.root.1
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     2579 Jun 28 20:36 pandaJob.out
[2021-06-28 21:06:44] -rw------- 1 boinc boinc  1060249 Jun 28 20:37 agis_schedconf.cvmfs.json
[2021-06-28 21:06:44] -rw------- 1 boinc boinc  1962838 Jun 28 20:37 cric_ddmendpoints.json
[2021-06-28 21:06:44] drwx------ 4 boinc boinc     4096 Jun 28 20:37 pilot2
[2021-06-28 21:06:44] -rw------- 1 boinc boinc  1036728 Jun 28 21:04 output.1.b2029d89-490a-434a-a79e-6b3ab636c721_17420.pool.root
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc      533 Jun 28 21:05 boinc_task_state.xml
[2021-06-28 21:06:44] -rw------- 1 boinc boinc     1011 Jun 28 21:06 memory_monitor_summary.json
[2021-06-28 21:06:44] -rw------- 1 boinc boinc   177810 Jun 28 21:06 b2029d89-490a-434a-a79e-6b3ab636c721_17420.1.job.log.tgz
[2021-06-28 21:06:44] -rw------- 1 boinc boinc     7770 Jun 28 21:06 heartbeat.json
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc       25 Jun 28 21:06 wrapper_checkpoint.txt
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     8192 Jun 28 21:06 boinc_mmap_file
[2021-06-28 21:06:44] -rw------- 1 boinc boinc     8512 Jun 28 21:06 pilotlog.txt
[2021-06-28 21:06:44] -rw------- 1 boinc boinc   232236 Jun 28 21:06 b2029d89-490a-434a-a79e-6b3ab636c721_17420.1.job.log
[2021-06-28 21:06:44] -rw------- 1 boinc boinc      536 Jun 28 21:06 output.list
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc     9559 Jun 28 21:06 runtime_log.err
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc      748 Jun 28 21:06 runtime_log
[2021-06-28 21:06:44] -rw------- 1 boinc boinc      562 Jun 28 21:06 RqiKDmOMGIzn7Olcko1bjSoqABFKDmABFKDmumdXDmNTFKDmBiKUGm.diag
[2021-06-28 21:06:44] -rw------- 1 boinc boinc  1464320 Jun 28 21:06 result.tar.gz
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc    32845 Jun 28 21:06 stderr.txt
[2021-06-28 21:06:44] HITS file was successfully produced:
[2021-06-28 21:06:44] -rw------- 1 boinc boinc 1036728 Jun 28 21:04 shared/HITS.pool.root.1
[2021-06-28 21:06:44]  *** Contents of shared directory: ***
[2021-06-28 21:06:44] total 39648
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc 37738636 Jun 28 20:36 ATLAS.root_0
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc    16551 Jun 28 20:36 start_atlas.sh
[2021-06-28 21:06:44] -rw-r--r-- 1 boinc boinc   330737 Jun 28 20:36 input.tar.gz
[2021-06-28 21:06:44] -rw------- 1 boinc boinc  1036728 Jun 28 21:04 HITS.pool.root.1
[2021-06-28 21:06:44] -rw------- 1 boinc boinc  1464320 Jun 28 21:06 result.tar.gz
21:06:45 (2182343): run_atlas exited; CPU time 812.034397
21:06:45 (2182343): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN