Name 9zWMDmFSxMzn7Olcko1bjSoqABFKDmABFKDmumdXDmbsFKDmS1YRjm_0
Workunit 2102906
Created 11 Jul 2021, 22:52:23 UTC
Sent 11 Jul 2021, 23:05:34 UTC
Report deadline 18 Jul 2021, 23:05:34 UTC
Received 11 Jul 2021, 23:58:59 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4357
Run time 48 min 59 sec
CPU time 17 min 31 sec
Validate state Valid
Credit 12.48
Device peak FLOPS 3.04 GFLOPS
Application version ATLAS Simulation v1.04 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 1.66 GB
Peak swap size 34.31 GB
Peak disk usage 80.15 MB

Stderr output

<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
19:09:48 (57745): wrapper (7.7.26015): starting
19:09:48 (57745): wrapper: running run_atlas (--nthreads 1)
[2021-07-11 19:09:48] Arguments: --nthreads 1
[2021-07-11 19:09:48] Threads: 1
[2021-07-11 19:09:48] Checking for CVMFS
[2021-07-11 19:09:54] Probing /cvmfs/atlas.cern.ch... OK
[2021-07-11 19:09:55] Probing /cvmfs/atlas-condb.cern.ch... OK
[2021-07-11 19:09:55] Running cvmfs_config stat atlas.cern.ch
[2021-07-11 19:09:56] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2021-07-11 19:09:56] 2.9.0.0 58445 0 24660 88195 3 1 3654037 4194305 0 130560 0 0 0.000 529 203 http://cvmfs-s1bnl.opensciencegrid.org:8000/cvmfs/atlas.cern.ch DIRECT 0
[2021-07-11 19:09:56] CVMFS is ok
[2021-07-11 19:09:56] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2021-07-11 19:09:56] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2021-07-11 19:09:56] Small home clusters do not require a local http proxy but it is suggested if
[2021-07-11 19:09:56] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2021-07-11 19:09:56] Further information can be found at the LHC@home message board.
[2021-07-11 19:09:56] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2021-07-11 19:09:56] Checking for singularity binary...
[2021-07-11 19:09:56] Using singularity found in PATH at /usr/local/bin/singularity
[2021-07-11 19:09:56] Running /usr/local/bin/singularity --version
[2021-07-11 19:09:56] singularity version 3.7.2+10-ga969f0f8c
[2021-07-11 19:09:56] Checking singularity works with /usr/local/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2021-07-11 19:09:58] E5-2670
[2021-07-11 19:09:58] Singularity works
[2021-07-11 19:09:58] Starting ATLAS job with PandaID=5117614881
[2021-07-11 19:09:58] Running command: /usr/local/bin/singularity exec --pwd /var/lib/boinc-client/slots/39 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2021-07-11 19:58:44]  *** The last 200 lines of the pilot log: ***
[2021-07-11 19:58:44] }
[2021-07-11 19:58:44] 2021-07-11 23:57:43,451 | DEBUG    | pilot.user.atlas.utilities       | get_metadata_dict_from_txt | writing prmon dictionary to: /var/lib/boinc-client/slots/39/PanDA_Pilot-5117614881/memory_monitor_o
[2021-07-11 19:58:44] 2021-07-11 23:57:43,453 | INFO     | pilot.util.container             | execute                   | executing command: curl --connect-timeout 20 --max-time 120 -H "Content-Type: application/json" -X P
[2021-07-11 19:58:44] 2021-07-11 23:57:44,774 | DEBUG    | pilot.user.atlas.common          | update_server             | sent prmon JSON dictionary to logstash server
[2021-07-11 19:58:44] 2021-07-11 23:57:44,774 | DEBUG    | pilot.user.atlas.common          | update_server             | stdout: ok
[2021-07-11 19:58:44] 2021-07-11 23:57:44,775 | DEBUG    | pilot.user.atlas.common          | update_server             | stderr:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
[2021-07-11 19:58:44]                                  Dload  Upload   Total   Spent    Left  Speed
[2021-07-11 19:58:44] 
[2021-07-11 19:58:44]   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
[2021-07-11 19:58:44]   0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
[2021-07-11 19:58:44] 100 12698  100     2  100 12696      1  10379  0:00:02  0:00:01  0:00:01 10389
[2021-07-11 19:58:44] 
[2021-07-11 19:58:44] 2021-07-11 23:57:44,775 | INFO     | pilot.control.job                | send_state                | pilot will not update the server (heartbeat message will be written to file)
[2021-07-11 19:58:44] 2021-07-11 23:57:44,775 | INFO     | pilot.control.job                | send_state                | job 5117614881 has finished - writing final server update
[2021-07-11 19:58:44] 2021-07-11 23:57:44,776 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | job definition core count: 1
[2021-07-11 19:58:44] 2021-07-11 23:57:44,776 | INFO     | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | will not add max space = -36525375 B to job metrics
[2021-07-11 19:58:44] 2021-07-11 23:57:44,777 | DEBUG    | pilot.api.analytics              | get_fitted_data           | removing tails from data to be fitted
[2021-07-11 19:58:44] 2021-07-11 23:57:44,777 | INFO     | pilot.api.analytics              | get_fitted_data           | fitting pss+swap vs Time
[2021-07-11 19:58:44] 2021-07-11 23:57:44,778 | INFO     | pilot.api.analytics              | get_fitted_data           | current memory leak: 574.30 B/s (using 37 data points, chi2=840015)
[2021-07-11 19:58:44] 2021-07-11 23:57:44,778 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics           | job metrics="actualCoreCount=7 nEvents=2 dbTime=257.32 dbData=4211388 leak=574.30 chi2=840015 eventn
[2021-07-11 19:58:44] 2021-07-11 23:57:44,778 | INFO     | pilot.control.job                | get_data_structure        | mean actualcorecount: 7.189189
[2021-07-11 19:58:44] 2021-07-11 23:57:44,778 | INFO     | pilot.control.job                | get_data_structure        | total number of processed events: 2 (read)
[2021-07-11 19:58:44] 2021-07-11 23:57:44,797 | INFO     | pilot.util.container             | execute                   | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2021-07-11 19:58:44] 2021-07-11 23:57:44,895 | INFO     | pilot.user.atlas.utilities       | get_memory_values         | using path: /var/lib/boinc-client/slots/39/PanDA_Pilot-5117614881/memory_monitor_summary.json (trf n
[2021-07-11 19:58:44] 2021-07-11 23:57:44,896 | DEBUG    | pilot.user.atlas.utilities       | get_memory_monitor_info   | summary_dictionary={'Avg': {'nprocs': 4.977, 'nthreads': 5.886, 'pss': 1151802.0, 'rchar': 160110.0,
[2021-07-11 19:58:44] 2021-07-11 23:57:44,897 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard info from prmon json
[2021-07-11 19:58:44] 2021-07-11 23:57:44,897 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard memory fields from prmon json
[2021-07-11 19:58:44] 2021-07-11 23:57:44,897 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2021-07-11 19:58:44] 2021-07-11 23:57:44,897 | INFO     | pilot.util.timing                | timing_report             | . Timing measurements:
[2021-07-11 19:58:44] 2021-07-11 23:57:44,897 | INFO     | pilot.util.timing                | timing_report             | . get job = 0 s
[2021-07-11 19:58:44] 2021-07-11 23:57:44,897 | INFO     | pilot.util.timing                | timing_report             | . initial setup = 2 s
[2021-07-11 19:58:44] 2021-07-11 23:57:44,897 | INFO     | pilot.util.timing                | timing_report             | . payload setup = 57 s
[2021-07-11 19:58:44] 2021-07-11 23:57:44,898 | INFO     | pilot.util.timing                | timing_report             | . total setup = 59 s
[2021-07-11 19:58:44] 2021-07-11 23:57:44,898 | INFO     | pilot.util.timing                | timing_report             | . stage-in = 0 s
[2021-07-11 19:58:44] 2021-07-11 23:57:44,898 | INFO     | pilot.util.timing                | timing_report             | . payload execution = 2715 s
[2021-07-11 19:58:44] 2021-07-11 23:57:44,898 | INFO     | pilot.util.timing                | timing_report             | . stage-out = 1 s
[2021-07-11 19:58:44] 2021-07-11 23:57:44,898 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2021-07-11 19:58:44] 2021-07-11 23:57:44,898 | DEBUG    | pilot.control.job                | send_state                | is_harvester_mode(args) : False
[2021-07-11 19:58:44] 2021-07-11 23:57:44,899 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | heartbeat dictionary: {'jobId': '5117614881', 'state': 'finished', 'timestamp': '2021-07-11T19:57:44
[2021-07-11 19:58:44] 2021-07-11 23:57:44,899 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | wrote heartbeat to file /var/lib/boinc-client/slots/39/heartbeat.json
[2021-07-11 19:58:44] 2021-07-11 23:57:44,900 | DEBUG    | pilot.control.job                | queue_monitor             | job 5117614881 was dequeued from the monitored payloads queue
[2021-07-11 19:58:44] 2021-07-11 23:57:45,060 | DEBUG    | pilot.control.job                | queue_monitor             | tmp job object deleted
[2021-07-11 19:58:44] 2021-07-11 23:57:45,132 | INFO     | pilot.control.job                | make_job_report           | 
[2021-07-11 19:58:44] 2021-07-11 23:57:45,132 | INFO     | pilot.control.job                | make_job_report           | job summary report
[2021-07-11 19:58:44] 2021-07-11 23:57:45,133 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-07-11 19:58:44] 2021-07-11 23:57:45,133 | INFO     | pilot.control.job                | make_job_report           | PanDA job id: 5117614881
[2021-07-11 19:58:44] 2021-07-11 23:57:45,133 | INFO     | pilot.control.job                | make_job_report           | task id: NULL
[2021-07-11 19:58:44] 2021-07-11 23:57:45,133 | INFO     | pilot.control.job                | make_job_report           | errors: (none)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,133 | INFO     | pilot.control.job                | make_job_report           | status: LOG_TRANSFER = DONE 
[2021-07-11 19:58:44] 2021-07-11 23:57:45,133 | INFO     | pilot.control.job                | make_job_report           | pilot state: finished 
[2021-07-11 19:58:44] 2021-07-11 23:57:45,133 | INFO     | pilot.control.job                | make_job_report           | transexitcode: 0
[2021-07-11 19:58:44] 2021-07-11 23:57:45,134 | INFO     | pilot.control.job                | make_job_report           | exeerrorcode: 0
[2021-07-11 19:58:44] 2021-07-11 23:57:45,134 | INFO     | pilot.control.job                | make_job_report           | exeerrordiag: 
[2021-07-11 19:58:44] 2021-07-11 23:57:45,134 | INFO     | pilot.control.job                | make_job_report           | exitcode: 0
[2021-07-11 19:58:44] 2021-07-11 23:57:45,134 | INFO     | pilot.control.job                | make_job_report           | exitmsg: OK
[2021-07-11 19:58:44] 2021-07-11 23:57:45,134 | INFO     | pilot.control.job                | make_job_report           | cpuconsumptiontime: 1091 s
[2021-07-11 19:58:44] 2021-07-11 23:57:45,134 | INFO     | pilot.control.job                | make_job_report           | nevents: 2
[2021-07-11 19:58:44] 2021-07-11 23:57:45,134 | INFO     | pilot.control.job                | make_job_report           | neventsw: 0
[2021-07-11 19:58:44] 2021-07-11 23:57:45,135 | INFO     | pilot.control.job                | make_job_report           | pid: 79622
[2021-07-11 19:58:44] 2021-07-11 23:57:45,135 | INFO     | pilot.control.job                | make_job_report           | pgrp: 79622
[2021-07-11 19:58:44] 2021-07-11 23:57:45,135 | INFO     | pilot.control.job                | make_job_report           | corecount: 1
[2021-07-11 19:58:44] 2021-07-11 23:57:45,135 | INFO     | pilot.control.job                | make_job_report           | event service: False
[2021-07-11 19:58:44] 2021-07-11 23:57:45,135 | INFO     | pilot.control.job                | make_job_report           | sizes: {23778175: 3856921, 23778176: 3857090, 23778177: 3857198, 23780953: 3884886, 23780954: 389435
[2021-07-11 19:58:44] 2021-07-11 23:57:45,135 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-07-11 19:58:44] 2021-07-11 23:57:45,135 | INFO     | pilot.control.job                | make_job_report           | 
[2021-07-11 19:58:44] 2021-07-11 23:57:45,136 | DEBUG    | pilot.control.job                | has_job_completed         | ls -lF /var/lib/boinc-client/slots/39:
[2021-07-11 19:58:44] 
[2021-07-11 19:58:44] 2021-07-11 23:57:45,136 | INFO     | pilot.util.container             | execute                   | executing command: ls -lF /var/lib/boinc-client/slots/39
[2021-07-11 19:58:44] 2021-07-11 23:57:45,187 | DEBUG    | pilot.control.job                | has_job_completed         | total 42824
[2021-07-11 19:58:44] -rw------- 1 boinc boinc   250360 Jul 11 19:57 0efc786f-701e-4c0d-96f4-73c7dc3c647e_79969.1.job.log
[2021-07-11 19:58:44] -rw------- 1 boinc boinc   187725 Jul 11 19:57 0efc786f-701e-4c0d-96f4-73c7dc3c647e_79969.1.job.log.tgz
[2021-07-11 19:58:44] -rw------- 1 boinc boinc      130 Jul 11 19:10 9zWMDmFSxMzn7Olcko1bjSoqABFKDmABFKDmumdXDmbsFKDmS1YRjm.diag
[2021-07-11 19:58:44] -rw------- 1 boinc boinc  1068195 Jul 11 19:11 agis_schedconf.cvmfs.json
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc        0 Jul 11 19:09 boinc_lockfile
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc     8192 Jul 11 19:57 boinc_mmap_file
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc      534 Jul 11 19:55 boinc_task_state.xml
[2021-07-11 19:58:44] -rw------- 1 boinc boinc  1962599 Jul 11 19:11 cric_ddmendpoints.json
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc 37708683 Jul 11 19:09 EVNT.04972714._000031.pool.root.1
[2021-07-11 19:58:44] -rw------- 1 boinc boinc     9205 Jul 11 19:57 heartbeat.json
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc     6188 Jul 11 19:09 init_data.xml
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc   344113 Jul 11 19:09 input.tar.gz
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc      112 Jul 11 19:09 job.xml
[2021-07-11 19:58:44] -rw------- 1 boinc boinc     1013 Jul 11 19:57 memory_monitor_summary.json
[2021-07-11 19:58:44] -rw------- 1 boinc boinc  1592297 Jul 11 19:55 output.1.0efc786f-701e-4c0d-96f4-73c7dc3c647e_79969.pool.root
[2021-07-11 19:58:44] -rw------- 1 boinc boinc      536 Jul 11 19:57 output.list
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc     2579 Jul 11 19:09 pandaJob.out
[2021-07-11 19:58:44] drwxrwx--- 2 boinc boinc     4096 Jul 11 19:57 PanDA_Pilot-5117614881/
[2021-07-11 19:58:44] drwx------ 4 boinc boinc     4096 Jul 11 19:11 pilot2/
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc   334707 Jul 11 18:30 pilot2.tar.gz
[2021-07-11 19:58:44] -rw------- 1 boinc boinc   231390 Jul 11 19:57 pilotlog.txt
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc     3214 Jul 11 18:52 queuedata.json
[2021-07-11 19:58:44] -rwxr-xr-x 1 boinc boinc     6966 Jul 11 19:09 run_atlas*
[2021-07-11 19:58:44] -rwx------ 1 boinc boinc    20591 Jul 11 18:50 runpilot2-wrapper.sh*
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc      407 Jul 11 19:10 runtime_log
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc     5574 Jul 11 19:10 runtime_log.err
[2021-07-11 19:58:44] drwxrwx--x 2 boinc boinc     4096 Jul 11 19:09 shared/
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc    16551 Jul 11 19:09 start_atlas.sh
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc     2195 Jul 11 19:09 stderr.txt
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc      107 Jul 11 19:09 wrapper_26015_x86_64-pc-linux-gnu
[2021-07-11 19:58:44] -rw-r--r-- 1 boinc boinc       25 Jul 11 19:57 wrapper_checkpoint.txt
[2021-07-11 19:58:44] 2021-07-11 23:57:45,187 | INFO     | pilot.util.queuehandling         | queue_report              | queue jobs has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,187 | INFO     | pilot.util.queuehandling         | queue_report              | queue payloads has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_in has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_out has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue current_data_in has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_jobs has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_payloads has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue monitored_payloads has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_jobs has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_payloads has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_in has 1 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_out has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_jobs has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,188 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_payloads has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,189 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_in has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,189 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_out has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,189 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobs has 0 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,189 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobids has 1 job(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,189 | INFO     | pilot.control.job                | has_job_completed         | job 5117614881 has completed (purged errors)
[2021-07-11 19:58:44] 2021-07-11 23:57:45,189 | INFO     | pilot.util.processes             | cleanup                   | overall cleanup function is called
[2021-07-11 19:58:44] 2021-07-11 23:57:45,191 | DEBUG    | pilot.util.processes             | cleanup                   | work directory was removed: /var/lib/boinc-client/slots/39/PanDA_Pilot-5117614881
[2021-07-11 19:58:44] 2021-07-11 23:57:46,196 | INFO     | pilot.info.jobdata               | collect_zombies           | --- collectZombieJob: --- 10, [79622]
[2021-07-11 19:58:44] 2021-07-11 23:57:46,196 | INFO     | pilot.info.jobdata               | collect_zombies           | zombie collector trying to kill pid 79622
[2021-07-11 19:58:44] 2021-07-11 23:57:46,197 | INFO     | pilot.info.jobdata               | collect_zombies           | harmless exception when collecting zombies: [Errno 10] No child processes
[2021-07-11 19:58:44] 2021-07-11 23:57:47,200 | INFO     | pilot.util.processes             | cleanup                   | collected zombie processes
[2021-07-11 19:58:44] 2021-07-11 23:57:47,200 | INFO     | pilot.util.processes             | cleanup                   | will now attempt to kill all subprocesses of pid=79622
[2021-07-11 19:58:44] 2021-07-11 23:57:47,370 | INFO     | pilot.util.processes             | kill_processes            | process IDs to be killed: [79622] (in reverse order)
[2021-07-11 19:58:44] 2021-07-11 23:57:47,485 | WARNING  | pilot.util.processes             | kill_processes            | found no corresponding commands to process id(s)
[2021-07-11 19:58:44] 2021-07-11 23:57:47,485 | INFO     | pilot.util.processes             | kill_orphans              | Do not look for orphan processes in BOINC jobs
[2021-07-11 19:58:44] 2021-07-11 23:57:47,486 | DEBUG    | pilot.util.queuehandling         | purge_queue               | queue purged
[2021-07-11 19:58:44] 2021-07-11 23:57:47,486 | INFO     | pilot.control.job                | retrieve                  | ready for new job
[2021-07-11 19:58:44] 2021-07-11 23:57:47,486 | INFO     | root                             | retrieve                  | pilot has finished for previous job - re-establishing logging
[2021-07-11 19:58:44] 2021-07-11 23:57:47,487 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2021-07-11 19:58:44] 2021-07-11 23:57:47,487 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***  PanDA Pilot version 2.12.2 (1)  ***
[2021-07-11 19:58:44] 2021-07-11 23:57:47,487 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2021-07-11 19:58:44] 2021-07-11 23:57:47,488 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | 
[2021-07-11 19:58:44] 2021-07-11 23:57:47,506 | INFO     | pilot.util.auxiliary             | display_architecture_info | architecture information:
[2021-07-11 19:58:44] 2021-07-11 23:57:48,043 | INFO     | pilot.util.auxiliary             | display_architecture_info | 
[2021-07-11 19:58:44] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2021-07-11 19:58:44] Distributor ID:	CentOS
[2021-07-11 19:58:44] Description:	CentOS Linux release 7.8.2003 (Core)
[2021-07-11 19:58:44] Release:	7.8.2003
[2021-07-11 19:58:44] Codename:	Core
[2021-07-11 19:58:44] 2021-07-11 23:57:48,043 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2021-07-11 19:58:44] 2021-07-11 23:57:48,545 | DEBUG    | pilot.util.monitoring            | check_local_space         | checking local space on /var/lib/boinc-client/slots/39
[2021-07-11 19:58:44] 2021-07-11 23:57:48,596 | INFO     | pilot.util.monitoring            | check_local_space         | sufficient remaining disk space (46956281856 B)
[2021-07-11 19:58:44] 2021-07-11 23:57:48,596 | WARNING  | pilot.control.job                | proceed_with_getjob       | since timefloor is set to 0, pilot was only allowed to run one job
[2021-07-11 19:58:44] 2021-07-11 23:57:48,596 | DEBUG    | pilot.control.job                | retrieve                  | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:48,597 | WARNING  | pilot.util.common                | should_abort              | data:queue_monitoring:received graceful stop - abort after this iteration
[2021-07-11 19:58:44] 2021-07-11 23:57:48,597 | WARNING  | pilot.control.monitor            | control                   | aborting monitor loop since graceful_stop has been set
[2021-07-11 19:58:44] 2021-07-11 23:57:48,597 | DEBUG    | pilot.control.job                | retrieve                  | [job] retrieve thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:48,597 | INFO     | pilot.control.monitor            | control                   | [monitor] control thread has ended
[2021-07-11 19:58:44] 2021-07-11 23:57:48,708 | DEBUG    | pilot.control.job                | create_data_payload       | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:48,709 | DEBUG    | pilot.control.job                | create_data_payload       | [job] create_data_payload thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:48,972 | DEBUG    | pilot.control.data               | control                   | data control ending since graceful_stop has been set
[2021-07-11 19:58:44] 2021-07-11 23:57:48,972 | DEBUG    | pilot.control.data               | control                   | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:48,973 | DEBUG    | pilot.control.data               | control                   | [data] control thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:49,088 | WARNING  | pilot.util.common                | should_abort              | data:copytool_out:received graceful stop - abort after this iteration
[2021-07-11 19:58:44] 2021-07-11 23:57:49,091 | DEBUG    | pilot.control.payload            | validate_post             | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:49,091 | INFO     | pilot.control.payload            | validate_post             | [payload] validate_post thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:49,217 | DEBUG    | pilot.control.payload            | failed_post               | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:49,217 | INFO     | pilot.control.payload            | failed_post               | [payload] failed_post thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:49,467 | DEBUG    | pilot.control.payload            | validate_pre              | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:49,467 | INFO     | pilot.control.payload            | validate_pre              | [payload] validate_pre thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:49,572 | DEBUG    | pilot.control.job                | control                   | job control ending since graceful_stop has been set
[2021-07-11 19:58:44] 2021-07-11 23:57:49,572 | DEBUG    | pilot.control.job                | control                   | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:49,573 | DEBUG    | pilot.control.job                | control                   | [job] control thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:49,593 | DEBUG    | pilot.control.data               | copytool_in               | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:49,593 | DEBUG    | pilot.control.data               | copytool_in               | [data] copytool_in thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:49,815 | DEBUG    | pilot.control.payload            | control                   | payload control ending since graceful_stop has been set
[2021-07-11 19:58:44] 2021-07-11 23:57:49,815 | DEBUG    | pilot.control.payload            | control                   | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:49,815 | DEBUG    | pilot.control.payload            | control                   | [payload] control thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:49,852 | DEBUG    | pilot.control.payload            | execute_payloads          | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:49,853 | INFO     | pilot.control.payload            | execute_payloads          | [payload] execute_payloads thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:49,854 | DEBUG    | pilot.control.job                | validate                  | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:49,854 | DEBUG    | pilot.control.job                | validate                  | [job] validate thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:50,069 | WARNING  | pilot.util.common                | should_abort              | job:queue_monitor:received graceful stop - abort after this iteration
[2021-07-11 19:58:44] 2021-07-11 23:57:50,069 | DEBUG    | pilot.control.job                | queue_monitor             | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:50,069 | DEBUG    | pilot.control.job                | queue_monitor             | [job] queue monitor thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:50,089 | DEBUG    | pilot.control.data               | copytool_out              | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:50,089 | DEBUG    | pilot.control.data               | copytool_out              | [data] copytool_out thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:57:51,598 | DEBUG    | pilot.control.data               | queue_monitoring          | will not set job_aborted yet
[2021-07-11 19:58:44] 2021-07-11 23:57:51,598 | DEBUG    | pilot.control.data               | queue_monitoring          | [data] queue_monitor thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:58:43,084 | WARNING  | pilot.control.job                | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 62 s)
[2021-07-11 19:58:44] 2021-07-11 23:58:43,084 | DEBUG    | pilot.util.processes             | threads_aborted           | aborting since the last relevant thread is about to finish
[2021-07-11 19:58:44] 2021-07-11 23:58:43,085 | DEBUG    | pilot.control.job                | job_monitor               | will proceed to set job_aborted
[2021-07-11 19:58:44] 2021-07-11 23:58:43,085 | DEBUG    | pilot.control.job                | job_monitor               | [job] job monitor thread has finished
[2021-07-11 19:58:44] 2021-07-11 23:58:43,908 | INFO     | pilot.workflow.generic           | run                       | end of generic workflow (traces error code: 0)
[2021-07-11 19:58:44] 2021-07-11 23:58:43,909 | INFO     | root                             | wrap_up                   | traces error code: 0
[2021-07-11 19:58:44] 2021-07-11 23:58:43,909 | INFO     | root                             | wrap_up                   | pilot has finished
[2021-07-11 19:58:44] 2021-07-11 23:58:44,040 [wrapper] ==== pilot stdout END ====
[2021-07-11 19:58:44] 2021-07-11 23:58:44,065 [wrapper] ==== wrapper stdout RESUME ====
[2021-07-11 19:58:44] 2021-07-11 23:58:44,089 [wrapper] Pilot exit status: 0
[2021-07-11 19:58:44] 2021-07-11 23:58:44,265 [wrapper] pandaids: 5117614881
[2021-07-11 19:58:44] 2021-07-11 23:58:44,313 [wrapper] apfmon messages muted
[2021-07-11 19:58:44] 2021-07-11 23:58:44,337 [wrapper] Test setup, not cleaning
[2021-07-11 19:58:44] 2021-07-11 23:58:44,361 [wrapper] ==== wrapper stdout END ====
[2021-07-11 19:58:44] 2021-07-11 23:58:44,385 [wrapper] ==== wrapper stderr END ====
[2021-07-11 19:58:44] 2021-07-11 23:58:44,421 [wrapper] wrapperexiting ec=0, duration=2924
[2021-07-11 19:58:44] 2021-07-11 23:58:44,445 [wrapper] apfmon messages muted
[2021-07-11 19:58:44]  *** Error codes and diagnostics ***
[2021-07-11 19:58:44]     "exeErrorCode": 0,
[2021-07-11 19:58:44]     "exeErrorDiag": "",
[2021-07-11 19:58:44]     "pilotErrorCode": 0,
[2021-07-11 19:58:44]     "pilotErrorDiag": "",
[2021-07-11 19:58:44]  *** Listing of results directory ***
[2021-07-11 19:58:45] total 44660
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc   334707 Jul 11 18:30 pilot2.tar.gz
[2021-07-11 19:58:45] -rwx------ 1 boinc boinc    20591 Jul 11 18:50 runpilot2-wrapper.sh
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc     3214 Jul 11 18:52 queuedata.json
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc      107 Jul 11 19:09 wrapper_26015_x86_64-pc-linux-gnu
[2021-07-11 19:58:45] -rwxr-xr-x 1 boinc boinc     6966 Jul 11 19:09 run_atlas
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc      112 Jul 11 19:09 job.xml
[2021-07-11 19:58:45] drwxrwx--x 2 boinc boinc     4096 Jul 11 19:09 shared
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc     6188 Jul 11 19:09 init_data.xml
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc        0 Jul 11 19:09 boinc_lockfile
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc    16551 Jul 11 19:09 start_atlas.sh
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc   344113 Jul 11 19:09 input.tar.gz
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc 37708683 Jul 11 19:09 EVNT.04972714._000031.pool.root.1
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc     2579 Jul 11 19:09 pandaJob.out
[2021-07-11 19:58:45] -rw------- 1 boinc boinc  1068195 Jul 11 19:11 agis_schedconf.cvmfs.json
[2021-07-11 19:58:45] -rw------- 1 boinc boinc  1962599 Jul 11 19:11 cric_ddmendpoints.json
[2021-07-11 19:58:45] drwx------ 4 boinc boinc     4096 Jul 11 19:11 pilot2
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc      534 Jul 11 19:55 boinc_task_state.xml
[2021-07-11 19:58:45] -rw------- 1 boinc boinc  1592297 Jul 11 19:55 output.1.0efc786f-701e-4c0d-96f4-73c7dc3c647e_79969.pool.root
[2021-07-11 19:58:45] -rw------- 1 boinc boinc     1013 Jul 11 19:57 memory_monitor_summary.json
[2021-07-11 19:58:45] -rw------- 1 boinc boinc   187725 Jul 11 19:57 0efc786f-701e-4c0d-96f4-73c7dc3c647e_79969.1.job.log.tgz
[2021-07-11 19:58:45] -rw------- 1 boinc boinc     9205 Jul 11 19:57 heartbeat.json
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc     8192 Jul 11 19:58 boinc_mmap_file
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc       25 Jul 11 19:58 wrapper_checkpoint.txt
[2021-07-11 19:58:45] -rw------- 1 boinc boinc     7518 Jul 11 19:58 pilotlog.txt
[2021-07-11 19:58:45] -rw------- 1 boinc boinc   265186 Jul 11 19:58 0efc786f-701e-4c0d-96f4-73c7dc3c647e_79969.1.job.log
[2021-07-11 19:58:45] -rw------- 1 boinc boinc      536 Jul 11 19:58 output.list
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc      748 Jul 11 19:58 runtime_log
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc     9429 Jul 11 19:58 runtime_log.err
[2021-07-11 19:58:45] -rw------- 1 boinc boinc  2068480 Jul 11 19:58 result.tar.gz
[2021-07-11 19:58:45] -rw------- 1 boinc boinc      563 Jul 11 19:58 9zWMDmFSxMzn7Olcko1bjSoqABFKDmABFKDmumdXDmbsFKDmS1YRjm.diag
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc    30462 Jul 11 19:58 stderr.txt
[2021-07-11 19:58:45] HITS file was successfully produced:
[2021-07-11 19:58:45] -rw------- 1 boinc boinc 1592297 Jul 11 19:55 shared/HITS.pool.root.1
[2021-07-11 19:58:45]  *** Contents of shared directory: ***
[2021-07-11 19:58:45] total 40764
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc    16551 Jul 11 19:09 start_atlas.sh
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc   344113 Jul 11 19:09 input.tar.gz
[2021-07-11 19:58:45] -rw-r--r-- 1 boinc boinc 37708683 Jul 11 19:09 ATLAS.root_0
[2021-07-11 19:58:45] -rw------- 1 boinc boinc  1592297 Jul 11 19:55 HITS.pool.root.1
[2021-07-11 19:58:45] -rw------- 1 boinc boinc  2068480 Jul 11 19:58 result.tar.gz
19:58:46 (57745): run_atlas exited; CPU time 1051.900985
19:58:46 (57745): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN