Name sgiKDmWKGozn7Olcko1bjSoqABFKDmABFKDmZr2WDmxKFKDmncXicn_0
Workunit 2131228
Created 25 Sep 2021, 6:27:09 UTC
Sent 25 Sep 2021, 6:37:18 UTC
Report deadline 2 Oct 2021, 6:37:18 UTC
Received 25 Sep 2021, 9:31:31 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4357
Run time 53 min 10 sec
CPU time 27 min 19 sec
Validate state Valid
Credit 25.54
Device peak FLOPS 6.11 GFLOPS
Application version ATLAS Simulation v1.04 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 1.38 GB
Peak swap size 28.48 GB
Peak disk usage 84.44 MB

Stderr output

<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
03:42:59 (131597): wrapper (7.7.26015): starting
03:42:59 (131597): wrapper: running run_atlas (--nthreads 2)
[2021-09-25 03:42:59] Arguments: --nthreads 2
[2021-09-25 03:42:59] Threads: 2
[2021-09-25 03:42:59] Checking for CVMFS
[2021-09-25 03:43:00] Probing /cvmfs/atlas.cern.ch... OK
[2021-09-25 03:43:01] Probing /cvmfs/atlas-condb.cern.ch... OK
[2021-09-25 03:43:01] Running cvmfs_config stat atlas.cern.ch
[2021-09-25 03:43:02] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2021-09-25 03:43:02] 2.9.0.0 147949 6101 65936 92784 3 89 3304949 4194304 6266 130560 0 52032295 99.991 556180 910 http://cvmfs-s1bnl.opensciencegrid.org:8000/cvmfs/atlas.cern.ch DIRECT 0
[2021-09-25 03:43:02] CVMFS is ok
[2021-09-25 03:43:02] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2021-09-25 03:43:02] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2021-09-25 03:43:02] Small home clusters do not require a local http proxy but it is suggested if
[2021-09-25 03:43:02] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2021-09-25 03:43:02] Further information can be found at the LHC@home message board.
[2021-09-25 03:43:02] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2021-09-25 03:43:02] Checking for singularity binary...
[2021-09-25 03:43:02] Using singularity found in PATH at /usr/local/bin/singularity
[2021-09-25 03:43:02] Running /usr/local/bin/singularity --version
[2021-09-25 03:43:03] singularity version 3.7.2+10-ga969f0f8c
[2021-09-25 03:43:03] Checking singularity works with /usr/local/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2021-09-25 03:43:04] E5-2670
[2021-09-25 03:43:04] Singularity works
[2021-09-25 03:43:04] Set ATHENA_PROC_NUMBER=2
[2021-09-25 03:43:05] Starting ATLAS job with PandaID=5201518930
[2021-09-25 03:43:05] Running command: /usr/local/bin/singularity exec --pwd /var/lib/boinc-client/slots/8 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2021-09-25 04:36:06]  *** The last 200 lines of the pilot log: ***
[2021-09-25 04:36:06] 2021-09-25 08:35:43,195 | DEBUG    | pilot.user.atlas.utilities       | get_metadata_dict_from_txt | writing prmon dictionary to: /var/lib/boinc-client/slots/8/PanDA_Pilot-5201518930/memory_monitor_ou
[2021-09-25 04:36:06] 2021-09-25 08:35:43,201 | INFO     | pilot.util.container             | execute                   | executing command: curl --connect-timeout 20 --max-time 120 -H "Content-Type: application/json" -X P
[2021-09-25 04:36:06] 2021-09-25 08:35:43,389 | INFO     | pilot.control.monitor            | control                   | 2900 s have passed since pilot start
[2021-09-25 04:36:06] 2021-09-25 08:35:48,915 | DEBUG    | pilot.user.atlas.common          | update_server             | sent prmon JSON dictionary to logstash server
[2021-09-25 04:36:06] 2021-09-25 08:35:48,915 | DEBUG    | pilot.user.atlas.common          | update_server             | stdout: ok
[2021-09-25 04:36:06] 2021-09-25 08:35:48,915 | DEBUG    | pilot.user.atlas.common          | update_server             | stderr:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
[2021-09-25 04:36:06]                                  Dload  Upload   Total   Spent    Left  Speed
[2021-09-25 04:36:06] 
[2021-09-25 04:36:06]   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
[2021-09-25 04:36:06]   0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0
[2021-09-25 04:36:06] 100 12633    0     2  100 12631      0   2708  0:00:04  0:00:04 --:--:--  2709
[2021-09-25 04:36:06] 
[2021-09-25 04:36:06] 2021-09-25 08:35:48,915 | INFO     | pilot.control.job                | send_state                | pilot will not update the server (heartbeat message will be written to file)
[2021-09-25 04:36:06] 2021-09-25 08:35:48,916 | INFO     | pilot.control.job                | send_state                | job 5201518930 has finished - writing final server update
[2021-09-25 04:36:06] 2021-09-25 08:35:48,916 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | job definition core count: 2
[2021-09-25 04:36:06] 2021-09-25 08:35:48,916 | INFO     | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | will not add max space = -34229606 B to job metrics
[2021-09-25 04:36:06] 2021-09-25 08:35:48,922 | DEBUG    | pilot.api.analytics              | get_fitted_data           | removing tails from data to be fitted
[2021-09-25 04:36:06] 2021-09-25 08:35:48,922 | INFO     | pilot.api.analytics              | get_fitted_data           | fitting pss+swap vs Time
[2021-09-25 04:36:06] 2021-09-25 08:35:48,923 | INFO     | pilot.api.analytics              | get_fitted_data           | current memory leak: -351.09 B/s (using 36 data points, chi2=8883363)
[2021-09-25 04:36:06] 2021-09-25 08:35:48,923 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics           | job metrics="actualCoreCount=4 nEvents=2 dbTime=132.43 dbData=4308190 leak=-351.09 chi2=8883363 even
[2021-09-25 04:36:06] 2021-09-25 08:35:48,923 | INFO     | pilot.control.job                | get_data_structure        | mean actualcorecount: 4.030303
[2021-09-25 04:36:06] 2021-09-25 08:35:48,923 | INFO     | pilot.control.job                | get_data_structure        | total number of processed events: 2 (read)
[2021-09-25 04:36:06] 2021-09-25 08:35:48,947 | INFO     | pilot.util.container             | execute                   | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2021-09-25 04:36:06] 2021-09-25 08:35:49,557 | INFO     | pilot.user.atlas.utilities       | get_memory_values         | using path: /var/lib/boinc-client/slots/8/PanDA_Pilot-5201518930/memory_monitor_summary.json (trf na
[2021-09-25 04:36:06] 2021-09-25 08:35:49,559 | DEBUG    | pilot.user.atlas.utilities       | get_memory_monitor_info   | summary_dictionary={'Avg': {'nprocs': 6.069, 'nthreads': 6.86, 'pss': 1062667.0, 'rchar': 395395.0, 
[2021-09-25 04:36:06] 2021-09-25 08:35:49,559 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard info from prmon json
[2021-09-25 04:36:06] 2021-09-25 08:35:49,560 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard memory fields from prmon json
[2021-09-25 04:36:06] 2021-09-25 08:35:49,560 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2021-09-25 04:36:06] 2021-09-25 08:35:49,560 | INFO     | pilot.util.timing                | timing_report             | . Timing measurements:
[2021-09-25 04:36:06] 2021-09-25 08:35:49,560 | INFO     | pilot.util.timing                | timing_report             | . get job = 0 s
[2021-09-25 04:36:06] 2021-09-25 08:35:49,560 | INFO     | pilot.util.timing                | timing_report             | . initial setup = 4 s
[2021-09-25 04:36:06] 2021-09-25 08:35:49,560 | INFO     | pilot.util.timing                | timing_report             | . payload setup = 165 s
[2021-09-25 04:36:06] 2021-09-25 08:35:49,565 | INFO     | pilot.util.timing                | timing_report             | . total setup = 169 s
[2021-09-25 04:36:06] 2021-09-25 08:35:49,565 | INFO     | pilot.util.timing                | timing_report             | . stage-in = 0 s
[2021-09-25 04:36:06] 2021-09-25 08:35:49,565 | INFO     | pilot.util.timing                | timing_report             | . payload execution = 2702 s
[2021-09-25 04:36:06] 2021-09-25 08:35:49,565 | INFO     | pilot.util.timing                | timing_report             | . stage-out = 4 s
[2021-09-25 04:36:06] 2021-09-25 08:35:49,565 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2021-09-25 04:36:06] 2021-09-25 08:35:49,566 | DEBUG    | pilot.control.job                | send_state                | is_harvester_mode(args) : False
[2021-09-25 04:36:06] 2021-09-25 08:35:49,567 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | heartbeat dictionary: {'jobId': '5201518930', 'state': 'finished', 'timestamp': '2021-09-25T04:35:48
[2021-09-25 04:36:06] 2021-09-25 08:35:49,567 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | wrote heartbeat to file /var/lib/boinc-client/slots/8/heartbeat.json
[2021-09-25 04:36:06] 2021-09-25 08:35:49,567 | DEBUG    | pilot.control.job                | queue_monitor             | job 5201518930 was dequeued from the monitored payloads queue
[2021-09-25 04:36:06] 2021-09-25 08:35:49,946 | DEBUG    | pilot.control.job                | queue_monitor             | tmp job object deleted
[2021-09-25 04:36:06] 2021-09-25 08:35:49,946 | INFO     | pilot.control.job                | make_job_report           | 
[2021-09-25 04:36:06] 2021-09-25 08:35:49,946 | INFO     | pilot.control.job                | make_job_report           | job summary report
[2021-09-25 04:36:06] 2021-09-25 08:35:49,947 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-09-25 04:36:06] 2021-09-25 08:35:49,947 | INFO     | pilot.control.job                | make_job_report           | PanDA job id: 5201518930
[2021-09-25 04:36:06] 2021-09-25 08:35:49,947 | INFO     | pilot.control.job                | make_job_report           | task id: NULL
[2021-09-25 04:36:06] 2021-09-25 08:35:49,947 | INFO     | pilot.control.job                | make_job_report           | errors: (none)
[2021-09-25 04:36:06] 2021-09-25 08:35:49,947 | INFO     | pilot.control.job                | make_job_report           | status: LOG_TRANSFER = DONE 
[2021-09-25 04:36:06] 2021-09-25 08:35:49,947 | INFO     | pilot.control.job                | make_job_report           | pilot state: finished 
[2021-09-25 04:36:06] 2021-09-25 08:35:49,947 | INFO     | pilot.control.job                | make_job_report           | transexitcode: 0
[2021-09-25 04:36:06] 2021-09-25 08:35:49,947 | INFO     | pilot.control.job                | make_job_report           | exeerrorcode: 0
[2021-09-25 04:36:06] 2021-09-25 08:35:49,948 | INFO     | pilot.control.job                | make_job_report           | exeerrordiag: 
[2021-09-25 04:36:06] 2021-09-25 08:35:49,948 | INFO     | pilot.control.job                | make_job_report           | exitcode: 0
[2021-09-25 04:36:06] 2021-09-25 08:35:49,948 | INFO     | pilot.control.job                | make_job_report           | exitmsg: OK
[2021-09-25 04:36:06] 2021-09-25 08:35:49,948 | INFO     | pilot.control.job                | make_job_report           | cpuconsumptiontime: 1785 s
[2021-09-25 04:36:06] 2021-09-25 08:35:49,948 | INFO     | pilot.control.job                | make_job_report           | nevents: 2
[2021-09-25 04:36:06] 2021-09-25 08:35:49,948 | INFO     | pilot.control.job                | make_job_report           | neventsw: 0
[2021-09-25 04:36:06] 2021-09-25 08:35:49,948 | INFO     | pilot.control.job                | make_job_report           | pid: 153251
[2021-09-25 04:36:06] 2021-09-25 08:35:49,949 | INFO     | pilot.control.job                | make_job_report           | pgrp: 153251
[2021-09-25 04:36:06] 2021-09-25 08:35:49,949 | INFO     | pilot.control.job                | make_job_report           | corecount: 2
[2021-09-25 04:36:06] 2021-09-25 08:35:49,949 | INFO     | pilot.control.job                | make_job_report           | event service: False
[2021-09-25 04:36:06] 2021-09-25 08:35:49,949 | INFO     | pilot.control.job                | make_job_report           | sizes: {17949268: 3885675, 17949269: 3885788, 17949270: 3885954, 17949280: 3885896, 17952152: 391292
[2021-09-25 04:36:06] 2021-09-25 08:35:49,949 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-09-25 04:36:06] 2021-09-25 08:35:49,949 | INFO     | pilot.control.job                | make_job_report           | 
[2021-09-25 04:36:06] 2021-09-25 08:35:49,949 | DEBUG    | pilot.control.job                | has_job_completed         | ls -lF /var/lib/boinc-client/slots/8:
[2021-09-25 04:36:06] 
[2021-09-25 04:36:06] 2021-09-25 08:35:49,950 | INFO     | pilot.util.container             | execute                   | executing command: ls -lF /var/lib/boinc-client/slots/8
[2021-09-25 04:36:06] 2021-09-25 08:35:50,421 | DEBUG    | pilot.control.job                | has_job_completed         | total 44512
[2021-09-25 04:36:06] -rw------- 1 boinc boinc   317882 Sep 25 04:35 33e2ca31-9880-4559-b4cc-21741987e3aa_21526.1.job.log
[2021-09-25 04:36:06] -rw------- 1 boinc boinc   467443 Sep 25 04:35 33e2ca31-9880-4559-b4cc-21741987e3aa_21526.1.job.log.tgz
[2021-09-25 04:36:06] -rw------- 1 boinc boinc  1082148 Sep 25 03:47 agis_schedconf.cvmfs.json
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc        0 Sep 25 03:42 boinc_lockfile
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     8192 Sep 25 04:35 boinc_mmap_file
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc      535 Sep 25 04:22 boinc_task_state.xml
[2021-09-25 04:36:06] -rw------- 1 boinc boinc  1944005 Sep 25 03:47 cric_ddmendpoints.json
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc 38705932 Sep 25 03:43 EVNT.04972714._000036.pool.root.1
[2021-09-25 04:36:06] -rw------- 1 boinc boinc     9309 Sep 25 04:35 heartbeat.json
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     6166 Sep 25 03:42 init_data.xml
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc   356650 Sep 25 03:43 input.tar.gz
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc      112 Sep 25 03:42 job.xml
[2021-09-25 04:36:06] -rw------- 1 boinc boinc     1022 Sep 25 04:35 memory_monitor_summary.json
[2021-09-25 04:36:06] -rw------- 1 boinc boinc  1887848 Sep 25 04:35 output.1.33e2ca31-9880-4559-b4cc-21741987e3aa_21526.pool.root
[2021-09-25 04:36:06] -rw------- 1 boinc boinc      536 Sep 25 04:35 output.list
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     2595 Sep 25 03:43 pandaJob.out
[2021-09-25 04:36:06] drwxrwx--- 3 boinc boinc     4096 Sep 25 04:35 PanDA_Pilot-5201518930/
[2021-09-25 04:36:06] drwx------ 4 boinc boinc     4096 Sep 25 03:47 pilot2/
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc   346717 Sep 23 07:39 pilot2.tar.gz
[2021-09-25 04:36:06] -rw------- 1 boinc boinc   298736 Sep 25 04:35 pilotlog.txt
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     4534 Sep 25 02:27 queuedata.json
[2021-09-25 04:36:06] -rwxr-xr-x 1 boinc boinc     6966 Sep 25 03:42 run_atlas*
[2021-09-25 04:36:06] -rwx------ 1 boinc boinc    20631 Sep 25 02:27 runpilot2-wrapper.sh*
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc      407 Sep 25 03:43 runtime_log
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     5565 Sep 25 03:43 runtime_log.err
[2021-09-25 04:36:06] -rw------- 1 boinc boinc      130 Sep 25 03:43 sgiKDmWKGozn7Olcko1bjSoqABFKDmABFKDmZr2WDmxKFKDmncXicn.diag
[2021-09-25 04:36:06] drwxrwx--x 2 boinc boinc     4096 Sep 25 03:42 shared/
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc    16569 Sep 25 03:43 start_atlas.sh
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     2262 Sep 25 03:43 stderr.txt
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc      107 Sep 25 03:42 wrapper_26015_x86_64-pc-linux-gnu
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc       26 Sep 25 04:35 wrapper_checkpoint.txt
[2021-09-25 04:36:06] 2021-09-25 08:35:50,422 | INFO     | pilot.util.queuehandling         | queue_report              | queue jobs has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,425 | INFO     | pilot.util.queuehandling         | queue_report              | queue payloads has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,425 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_in has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,425 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_out has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,425 | INFO     | pilot.util.queuehandling         | queue_report              | queue current_data_in has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,425 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_jobs has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,425 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_payloads has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,426 | INFO     | pilot.util.queuehandling         | queue_report              | queue monitored_payloads has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,426 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_jobs has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,426 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_payloads has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,426 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_in has 1 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,426 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_out has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,426 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_jobs has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,426 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_payloads has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,427 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_in has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,427 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_out has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,427 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobs has 0 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,427 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobids has 1 job(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,427 | INFO     | pilot.control.job                | has_job_completed         | job 5201518930 has completed (purged errors)
[2021-09-25 04:36:06] 2021-09-25 08:35:50,427 | INFO     | pilot.util.processes             | cleanup                   | overall cleanup function is called
[2021-09-25 04:36:06] 2021-09-25 08:35:50,441 | DEBUG    | pilot.util.processes             | cleanup                   | work directory was removed: /var/lib/boinc-client/slots/8/PanDA_Pilot-5201518930
[2021-09-25 04:36:06] 2021-09-25 08:35:51,445 | INFO     | pilot.info.jobdata               | collect_zombies           | --- collectZombieJob: --- 10, [153251]
[2021-09-25 04:36:06] 2021-09-25 08:35:51,445 | INFO     | pilot.info.jobdata               | collect_zombies           | zombie collector trying to kill pid 153251
[2021-09-25 04:36:06] 2021-09-25 08:35:51,445 | INFO     | pilot.info.jobdata               | collect_zombies           | harmless exception when collecting zombies: [Errno 10] No child processes
[2021-09-25 04:36:06] 2021-09-25 08:35:52,449 | INFO     | pilot.util.processes             | cleanup                   | collected zombie processes
[2021-09-25 04:36:06] 2021-09-25 08:35:52,449 | INFO     | pilot.util.processes             | cleanup                   | will now attempt to kill all subprocesses of pid=153251
[2021-09-25 04:36:06] 2021-09-25 08:35:53,373 | INFO     | pilot.util.processes             | kill_processes            | process IDs to be killed: [153251] (in reverse order)
[2021-09-25 04:36:06] 2021-09-25 08:35:54,183 | WARNING  | pilot.util.processes             | kill_processes            | found no corresponding commands to process id(s)
[2021-09-25 04:36:06] 2021-09-25 08:35:54,184 | INFO     | pilot.util.processes             | kill_orphans              | Do not look for orphan processes in BOINC jobs
[2021-09-25 04:36:06] 2021-09-25 08:35:54,184 | DEBUG    | pilot.util.queuehandling         | purge_queue               | queue purged
[2021-09-25 04:36:06] 2021-09-25 08:35:54,185 | INFO     | pilot.control.job                | retrieve                  | ready for new job
[2021-09-25 04:36:06] 2021-09-25 08:35:54,185 | INFO     | root                             | retrieve                  | pilot has finished for previous job - re-establishing logging
[2021-09-25 04:36:06] 2021-09-25 08:35:54,187 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2021-09-25 04:36:06] 2021-09-25 08:35:54,187 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***  PanDA Pilot version 2.12.6 (1)  ***
[2021-09-25 04:36:06] 2021-09-25 08:35:54,187 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2021-09-25 04:36:06] 2021-09-25 08:35:54,187 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | 
[2021-09-25 04:36:06] 2021-09-25 08:35:54,212 | INFO     | pilot.util.auxiliary             | display_architecture_info | architecture information:
[2021-09-25 04:36:06] 2021-09-25 08:35:54,369 | WARNING  | pilot.control.job                | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 81 s)
[2021-09-25 04:36:06] 2021-09-25 08:35:56,842 | INFO     | pilot.util.auxiliary             | display_architecture_info | 
[2021-09-25 04:36:06] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2021-09-25 04:36:06] Distributor ID:	CentOS
[2021-09-25 04:36:06] Description:	CentOS Linux release 7.8.2003 (Core)
[2021-09-25 04:36:06] Release:	7.8.2003
[2021-09-25 04:36:06] Codename:	Core
[2021-09-25 04:36:06] 2021-09-25 08:35:56,843 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2021-09-25 04:36:06] 2021-09-25 08:35:57,345 | DEBUG    | pilot.util.monitoring            | check_local_space         | checking local space on /var/lib/boinc-client/slots/8
[2021-09-25 04:36:06] 2021-09-25 08:35:57,661 | INFO     | pilot.util.monitoring            | check_local_space         | sufficient remaining disk space (39363543040 B)
[2021-09-25 04:36:06] 2021-09-25 08:35:57,661 | WARNING  | pilot.control.job                | proceed_with_getjob       | since timefloor is set to 0, pilot was only allowed to run one job
[2021-09-25 04:36:06] 2021-09-25 08:35:57,662 | DEBUG    | pilot.control.job                | retrieve                  | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:57,662 | DEBUG    | pilot.control.job                | retrieve                  | [job] retrieve thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:57,662 | WARNING  | pilot.util.common                | should_abort              | data:copytool_out:received graceful stop - abort after this iteration
[2021-09-25 04:36:06] 2021-09-25 08:35:57,665 | WARNING  | pilot.util.common                | should_abort              | job:job_monitor:received graceful stop - abort after this iteration
[2021-09-25 04:36:06] 2021-09-25 08:35:57,665 | WARNING  | pilot.util.common                | should_abort              | data:queue_monitoring:received graceful stop - abort after this iteration
[2021-09-25 04:36:06] 2021-09-25 08:35:57,765 | DEBUG    | pilot.control.job                | create_data_payload       | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:57,769 | DEBUG    | pilot.control.job                | create_data_payload       | [job] create_data_payload thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:57,853 | DEBUG    | pilot.control.data               | control                   | data control ending since graceful_stop has been set
[2021-09-25 04:36:06] 2021-09-25 08:35:57,857 | DEBUG    | pilot.control.data               | control                   | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:57,857 | DEBUG    | pilot.control.data               | control                   | [data] control thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:57,909 | DEBUG    | pilot.control.payload            | execute_payloads          | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:57,909 | INFO     | pilot.control.payload            | execute_payloads          | [payload] execute_payloads thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,209 | DEBUG    | pilot.control.job                | control                   | job control ending since graceful_stop has been set
[2021-09-25 04:36:06] 2021-09-25 08:35:58,213 | DEBUG    | pilot.control.job                | control                   | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:58,213 | DEBUG    | pilot.control.job                | control                   | [job] control thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,413 | DEBUG    | pilot.control.payload            | failed_post               | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:58,416 | INFO     | pilot.control.payload            | failed_post               | [payload] failed_post thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,465 | INFO     | pilot.control.monitor            | control                   | [monitor] control thread has ended
[2021-09-25 04:36:06] 2021-09-25 08:35:58,477 | DEBUG    | pilot.control.payload            | validate_pre              | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:58,477 | INFO     | pilot.control.payload            | validate_pre              | [payload] validate_pre thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,505 | DEBUG    | pilot.control.data               | copytool_in               | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:58,510 | DEBUG    | pilot.control.data               | copytool_in               | [data] copytool_in thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,665 | DEBUG    | pilot.control.data               | copytool_out              | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:58,681 | DEBUG    | pilot.control.data               | copytool_out              | [data] copytool_out thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,677 | DEBUG    | pilot.control.job                | job_monitor               | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:58,681 | DEBUG    | pilot.control.job                | job_monitor               | [job] job monitor thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,709 | DEBUG    | pilot.control.payload            | control                   | payload control ending since graceful_stop has been set
[2021-09-25 04:36:06] 2021-09-25 08:35:58,709 | DEBUG    | pilot.control.payload            | control                   | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:58,709 | DEBUG    | pilot.control.payload            | control                   | [payload] control thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,789 | DEBUG    | pilot.control.job                | validate                  | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:58,789 | DEBUG    | pilot.control.job                | validate                  | [job] validate thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,877 | DEBUG    | pilot.control.payload            | validate_post             | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:58,877 | INFO     | pilot.control.payload            | validate_post             | [payload] validate_post thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:35:58,985 | WARNING  | pilot.util.common                | should_abort              | job:queue_monitor:received graceful stop - abort after this iteration
[2021-09-25 04:36:06] 2021-09-25 08:35:59,021 | DEBUG    | pilot.control.job                | queue_monitor             | will not set job_aborted yet
[2021-09-25 04:36:06] 2021-09-25 08:35:59,021 | DEBUG    | pilot.control.job                | queue_monitor             | [job] queue monitor thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:36:00,701 | DEBUG    | pilot.util.processes             | threads_aborted           | aborting since the last relevant thread is about to finish
[2021-09-25 04:36:06] 2021-09-25 08:36:00,701 | DEBUG    | pilot.control.data               | queue_monitoring          | will proceed to set job_aborted
[2021-09-25 04:36:06] 2021-09-25 08:36:00,701 | DEBUG    | pilot.control.data               | queue_monitoring          | [data] queue_monitor thread has finished
[2021-09-25 04:36:06] 2021-09-25 08:36:01,633 | INFO     | pilot.workflow.generic           | run                       | end of generic workflow (traces error code: 0)
[2021-09-25 04:36:06] 2021-09-25 08:36:01,633 | INFO     | root                             | wrap_up                   | traces error code: 0
[2021-09-25 04:36:06] 2021-09-25 08:36:01,633 | INFO     | root                             | wrap_up                   | pilot has finished
[2021-09-25 04:36:06] 2021-09-25 08:36:01,965 [wrapper] ==== pilot stdout END ====
[2021-09-25 04:36:06] 2021-09-25 08:36:02,126 [wrapper] ==== wrapper stdout RESUME ====
[2021-09-25 04:36:06] 2021-09-25 08:36:02,301 [wrapper] Pilot exit status: 0
[2021-09-25 04:36:06] 2021-09-25 08:36:02,877 [wrapper] pandaids: 5201518930
[2021-09-25 04:36:06] 2021-09-25 08:36:03,366 [wrapper] apfmon messages muted
[2021-09-25 04:36:06] 2021-09-25 08:36:03,469 [wrapper] Test setup, not cleaning
[2021-09-25 04:36:06] 2021-09-25 08:36:03,821 [wrapper] ==== wrapper stdout END ====
[2021-09-25 04:36:06] 2021-09-25 08:36:03,973 [wrapper] ==== wrapper stderr END ====
[2021-09-25 04:36:06] 2021-09-25 08:36:04,346 [wrapper] wrapperexiting ec=0, duration=3176
[2021-09-25 04:36:06] 2021-09-25 08:36:04,568 [wrapper] apfmon messages muted
[2021-09-25 04:36:06]  *** Error codes and diagnostics ***
[2021-09-25 04:36:06]     "exeErrorCode": 0,
[2021-09-25 04:36:06]     "exeErrorDiag": "",
[2021-09-25 04:36:06]     "pilotErrorCode": 0,
[2021-09-25 04:36:06]     "pilotErrorDiag": "",
[2021-09-25 04:36:06]  *** Listing of results directory ***
[2021-09-25 04:36:06] total 46920
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc   346717 Sep 23 07:39 pilot2.tar.gz
[2021-09-25 04:36:06] -rwx------ 1 boinc boinc    20631 Sep 25 02:27 runpilot2-wrapper.sh
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     4534 Sep 25 02:27 queuedata.json
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc      107 Sep 25 03:42 wrapper_26015_x86_64-pc-linux-gnu
[2021-09-25 04:36:06] -rwxr-xr-x 1 boinc boinc     6966 Sep 25 03:42 run_atlas
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc      112 Sep 25 03:42 job.xml
[2021-09-25 04:36:06] drwxrwx--x 2 boinc boinc     4096 Sep 25 03:42 shared
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     6166 Sep 25 03:42 init_data.xml
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc        0 Sep 25 03:42 boinc_lockfile
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc    16569 Sep 25 03:43 start_atlas.sh
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc   356650 Sep 25 03:43 input.tar.gz
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc 38705932 Sep 25 03:43 EVNT.04972714._000036.pool.root.1
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     2595 Sep 25 03:43 pandaJob.out
[2021-09-25 04:36:06] -rw------- 1 boinc boinc  1082148 Sep 25 03:47 agis_schedconf.cvmfs.json
[2021-09-25 04:36:06] -rw------- 1 boinc boinc  1944005 Sep 25 03:47 cric_ddmendpoints.json
[2021-09-25 04:36:06] drwx------ 4 boinc boinc     4096 Sep 25 03:47 pilot2
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc      535 Sep 25 04:22 boinc_task_state.xml
[2021-09-25 04:36:06] -rw------- 1 boinc boinc  1887848 Sep 25 04:35 output.1.33e2ca31-9880-4559-b4cc-21741987e3aa_21526.pool.root
[2021-09-25 04:36:06] -rw------- 1 boinc boinc     1022 Sep 25 04:35 memory_monitor_summary.json
[2021-09-25 04:36:06] -rw------- 1 boinc boinc   467443 Sep 25 04:35 33e2ca31-9880-4559-b4cc-21741987e3aa_21526.1.job.log.tgz
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     8192 Sep 25 04:35 boinc_mmap_file
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc       26 Sep 25 04:35 wrapper_checkpoint.txt
[2021-09-25 04:36:06] -rw------- 1 boinc boinc     9309 Sep 25 04:35 heartbeat.json
[2021-09-25 04:36:06] -rw------- 1 boinc boinc     7530 Sep 25 04:36 pilotlog.txt
[2021-09-25 04:36:06] -rw------- 1 boinc boinc   332723 Sep 25 04:36 33e2ca31-9880-4559-b4cc-21741987e3aa_21526.1.job.log
[2021-09-25 04:36:06] -rw------- 1 boinc boinc      536 Sep 25 04:36 output.list
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc      748 Sep 25 04:36 runtime_log
[2021-09-25 04:36:06] -rw------- 1 boinc boinc  2713600 Sep 25 04:36 result.tar.gz
[2021-09-25 04:36:06] -rw------- 1 boinc boinc      565 Sep 25 04:36 sgiKDmWKGozn7Olcko1bjSoqABFKDmABFKDmZr2WDmxKFKDmncXicn.diag
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc     9549 Sep 25 04:36 runtime_log.err
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc    30682 Sep 25 04:36 stderr.txt
[2021-09-25 04:36:06] HITS file was successfully produced:
[2021-09-25 04:36:06] -rw------- 1 boinc boinc 1887848 Sep 25 04:35 shared/HITS.pool.root.1
[2021-09-25 04:36:06]  *** Contents of shared directory: ***
[2021-09-25 04:36:06] total 42668
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc    16569 Sep 25 03:42 start_atlas.sh
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc   356650 Sep 25 03:42 input.tar.gz
[2021-09-25 04:36:06] -rw-r--r-- 1 boinc boinc 38705932 Sep 25 03:42 ATLAS.root_0
[2021-09-25 04:36:06] -rw------- 1 boinc boinc  1887848 Sep 25 04:35 HITS.pool.root.1
[2021-09-25 04:36:06] -rw------- 1 boinc boinc  2713600 Sep 25 04:36 result.tar.gz
04:36:08 (131597): run_atlas exited; CPU time 1639.530655
04:36:08 (131597): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN