Name Fw7MDmr26bzn7Olcko1bjSoqABFKDmABFKDmumdXDmUwGKDmz2tKPo_0
Workunit 2121706
Created 22 Aug 2021, 18:06:44 UTC
Sent 22 Aug 2021, 18:07:34 UTC
Report deadline 29 Aug 2021, 18:07:34 UTC
Received 23 Aug 2021, 13:55:45 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4454
Run time 8 min 41 sec
CPU time 7 min 7 sec
Validate state Valid
Credit 57.25
Device peak FLOPS 47.46 GFLOPS
Application version ATLAS Simulation v1.04 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 1.45 GB
Peak swap size 11.19 GB
Peak disk usage 79.48 MB

Stderr output

<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
09:46:50 (956897): wrapper (7.7.26015): starting
09:46:50 (956897): wrapper: running run_atlas (--nthreads 8)
[2021-08-23 09:46:50] Arguments: --nthreads 8
[2021-08-23 09:46:50] Threads: 8
[2021-08-23 09:46:50] Checking for CVMFS
[2021-08-23 09:46:50] Probing /cvmfs/atlas.cern.ch... OK
[2021-08-23 09:46:50] Probing /cvmfs/atlas-condb.cern.ch... OK
[2021-08-23 09:46:50] Running cvmfs_config stat atlas.cern.ch
[2021-08-23 09:46:51] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2021-08-23 09:46:51] 2.9.0.0 2534 972 93056 90790 1 77 4258590 6144001 1506 130560 0 1183096 99.980 22476 141 http://s1fnal-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.1.100:3128 1
[2021-08-23 09:46:51] CVMFS is ok
[2021-08-23 09:46:51] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2021-08-23 09:46:51] Checking for singularity binary...
[2021-08-23 09:46:51] Using singularity found in PATH at /usr/local/bin/singularity
[2021-08-23 09:46:51] Running /usr/local/bin/singularity --version
[2021-08-23 09:46:51] singularity version 3.8.1
[2021-08-23 09:46:51] Checking singularity works with /usr/local/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2021-08-23 09:46:51] WARNING: While bind mounting '/cvmfs:/cvmfs': destination is already in the mount point list NUMENOR
[2021-08-23 09:46:51] Singularity works
[2021-08-23 09:46:51] Set ATHENA_PROC_NUMBER=8
[2021-08-23 09:46:51] Starting ATLAS job with PandaID=5162455720
[2021-08-23 09:46:51] Running command: /usr/local/bin/singularity exec --pwd /var/lib/boinc-client/slots/3 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2021-08-23 09:55:28]  *** The last 200 lines of the pilot log: ***
[2021-08-23 09:55:28] }
[2021-08-23 09:55:28] 2021-08-23 13:55:17,121 | DEBUG    | pilot.user.atlas.utilities       | get_metadata_dict_from_txt | writing prmon dictionary to: /var/lib/boinc-client/slots/3/PanDA_Pilot-5162455720/memory_monitor_ou
[2021-08-23 09:55:28] 2021-08-23 13:55:17,122 | INFO     | pilot.util.container             | execute                   | executing command: curl --connect-timeout 20 --max-time 120 -H "Content-Type: application/json" -X P
[2021-08-23 09:55:28] 2021-08-23 13:55:18,197 | DEBUG    | pilot.user.atlas.common          | update_server             | sent prmon JSON dictionary to logstash server
[2021-08-23 09:55:28] 2021-08-23 13:55:18,198 | DEBUG    | pilot.user.atlas.common          | update_server             | stdout: ok
[2021-08-23 09:55:28] 2021-08-23 13:55:18,198 | DEBUG    | pilot.user.atlas.common          | update_server             | stderr:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
[2021-08-23 09:55:28]                                  Dload  Upload   Total   Spent    Left  Speed
[2021-08-23 09:55:28] 
[2021-08-23 09:55:28]   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
[2021-08-23 09:55:28]   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
[2021-08-23 09:55:28] 100  2626  100     2  100  2624      2   3247  0:00:01 --:--:--  0:00:01  3247
[2021-08-23 09:55:28] 
[2021-08-23 09:55:28] 2021-08-23 13:55:18,198 | INFO     | pilot.control.job                | send_state                | pilot will not update the server (heartbeat message will be written to file)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,198 | INFO     | pilot.control.job                | send_state                | job 5162455720 has finished - writing final server update
[2021-08-23 09:55:28] 2021-08-23 13:55:18,198 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | job definition core count: 8
[2021-08-23 09:55:28] 2021-08-23 13:55:18,199 | INFO     | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | will not add max space = -37172498 B to job metrics
[2021-08-23 09:55:28] 2021-08-23 13:55:18,199 | DEBUG    | pilot.api.analytics              | get_fitted_data           | removing tails from data to be fitted
[2021-08-23 09:55:28] 2021-08-23 13:55:18,199 | WARNING  | pilot.api.analytics              | get_fitted_data           | wrong length of table data, x=[1629726758.0], y=[1574887.0] (must be same and length>=4)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,200 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics           | job metrics="actualCoreCount=5 nEvents=2 dbTime=11.98 dbData=4274626 eventnumber=2002"
[2021-08-23 09:55:28] 2021-08-23 13:55:18,200 | INFO     | pilot.control.job                | get_data_structure        | mean actualcorecount: 5.000000
[2021-08-23 09:55:28] 2021-08-23 13:55:18,200 | INFO     | pilot.control.job                | get_data_structure        | total number of processed events: 2 (read)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,221 | INFO     | pilot.util.container             | execute                   | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2021-08-23 09:55:28] 2021-08-23 13:55:18,281 | INFO     | pilot.user.atlas.utilities       | get_memory_values         | using path: /var/lib/boinc-client/slots/3/PanDA_Pilot-5162455720/memory_monitor_summary.json (trf na
[2021-08-23 09:55:28] 2021-08-23 13:55:18,282 | DEBUG    | pilot.user.atlas.utilities       | get_memory_monitor_info   | summary_dictionary={'Avg': {'nprocs': 4.75, 'nthreads': 5.625, 'pss': 1219460.0, 'rchar': 1345743.0,
[2021-08-23 09:55:28] 2021-08-23 13:55:18,282 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard info from prmon json
[2021-08-23 09:55:28] 2021-08-23 13:55:18,282 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard memory fields from prmon json
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | . Timing measurements:
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | . get job = 0 s
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | . initial setup = 0 s
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | . payload setup = 9 s
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | . total setup = 9 s
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | . stage-in = 0 s
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | . payload execution = 460 s
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | . stage-out = 0 s
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2021-08-23 09:55:28] 2021-08-23 13:55:18,283 | DEBUG    | pilot.control.job                | send_state                | is_harvester_mode(args) : False
[2021-08-23 09:55:28] 2021-08-23 13:55:18,284 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | heartbeat dictionary: {'jobId': '5162455720', 'state': 'finished', 'timestamp': '2021-08-23T09:55:18
[2021-08-23 09:55:28] 2021-08-23 13:55:18,284 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | wrote heartbeat to file /var/lib/boinc-client/slots/3/heartbeat.json
[2021-08-23 09:55:28] 2021-08-23 13:55:18,284 | DEBUG    | pilot.control.job                | queue_monitor             | job 5162455720 was dequeued from the monitored payloads queue
[2021-08-23 09:55:28] 2021-08-23 13:55:18,390 | DEBUG    | pilot.control.job                | queue_monitor             | tmp job object deleted
[2021-08-23 09:55:28] 2021-08-23 13:55:18,811 | INFO     | pilot.control.job                | make_job_report           | 
[2021-08-23 09:55:28] 2021-08-23 13:55:18,811 | INFO     | pilot.control.job                | make_job_report           | job summary report
[2021-08-23 09:55:28] 2021-08-23 13:55:18,811 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-08-23 09:55:28] 2021-08-23 13:55:18,811 | INFO     | pilot.control.job                | make_job_report           | PanDA job id: 5162455720
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | task id: NULL
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | errors: (none)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | status: LOG_TRANSFER = DONE 
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | pilot state: finished 
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | transexitcode: 0
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | exeerrorcode: 0
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | exeerrordiag: 
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | exitcode: 0
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | exitmsg: OK
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | cpuconsumptiontime: 437 s
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | nevents: 2
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | neventsw: 0
[2021-08-23 09:55:28] 2021-08-23 13:55:18,812 | INFO     | pilot.control.job                | make_job_report           | pid: 971477
[2021-08-23 09:55:28] 2021-08-23 13:55:18,813 | INFO     | pilot.control.job                | make_job_report           | pgrp: 971477
[2021-08-23 09:55:28] 2021-08-23 13:55:18,813 | INFO     | pilot.control.job                | make_job_report           | corecount: 8
[2021-08-23 09:55:28] 2021-08-23 13:55:18,813 | INFO     | pilot.control.job                | make_job_report           | event service: False
[2021-08-23 09:55:28] 2021-08-23 13:55:18,813 | INFO     | pilot.control.job                | make_job_report           | sizes: {17237962: 3889235, 17237963: 3889457, 17237973: 3889343, 17238447: 3909692, 17238449: 391915
[2021-08-23 09:55:28] 2021-08-23 13:55:18,813 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2021-08-23 09:55:28] 2021-08-23 13:55:18,813 | INFO     | pilot.control.job                | make_job_report           | 
[2021-08-23 09:55:28] 2021-08-23 13:55:18,813 | DEBUG    | pilot.control.job                | has_job_completed         | ls -lF /var/lib/boinc-client/slots/3:
[2021-08-23 09:55:28] 
[2021-08-23 09:55:28] 2021-08-23 13:55:18,813 | INFO     | pilot.util.container             | execute                   | executing command: ls -lF /var/lib/boinc-client/slots/3
[2021-08-23 09:55:28] 2021-08-23 13:55:18,839 | DEBUG    | pilot.control.job                | has_job_completed         | total 43132
[2021-08-23 09:55:28] -rw------- 1 boinc boinc   140524 Aug 23 09:55 0859c24d-d012-46a8-8b8c-c1ac8273feab_1023.1.job.log
[2021-08-23 09:55:28] -rw------- 1 boinc boinc   154569 Aug 23 09:55 0859c24d-d012-46a8-8b8c-c1ac8273feab_1023.1.job.log.tgz
[2021-08-23 09:55:28] -rw------- 1 boinc boinc  1079188 Aug 23 09:47 agis_schedconf.cvmfs.json
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc        0 Aug 23 09:46 boinc_lockfile
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     8192 Aug 23 09:55 boinc_mmap_file
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc      533 Aug 23 09:55 boinc_task_state.xml
[2021-08-23 09:55:28] -rw------- 1 boinc boinc  1949854 Aug 23 09:47 cric_ddmendpoints.json
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc 38019645 Aug 23 09:46 EVNT.04972714._000023.pool.root.1
[2021-08-23 09:55:28] -rw------- 1 boinc boinc      130 Aug 23 09:46 Fw7MDmr26bzn7Olcko1bjSoqABFKDmABFKDmumdXDmUwGKDmz2tKPo.diag
[2021-08-23 09:55:28] -rw------- 1 boinc boinc     6545 Aug 23 09:55 heartbeat.json
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     9175 Aug 23 09:46 init_data.xml
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc   354327 Aug 23 09:46 input.tar.gz
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc      112 Aug 23 09:46 job.xml
[2021-08-23 09:55:28] -rw------- 1 boinc boinc     1009 Aug 23 09:55 memory_monitor_summary.json
[2021-08-23 09:55:28] -rw------- 1 boinc boinc  1815657 Aug 23 09:55 output.1.0859c24d-d012-46a8-8b8c-c1ac8273feab_1023.pool.root
[2021-08-23 09:55:28] -rw------- 1 boinc boinc      532 Aug 23 09:55 output.list
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     2590 Aug 23 09:46 pandaJob.out
[2021-08-23 09:55:28] drwxrwx--- 2 boinc boinc     4096 Aug 23 09:55 PanDA_Pilot-5162455720/
[2021-08-23 09:55:28] drwx------ 4 boinc boinc     4096 Aug 23 09:47 pilot2/
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc   344503 Aug 13 08:13 pilot2.tar.gz
[2021-08-23 09:55:28] -rw------- 1 boinc boinc   121259 Aug 23 09:55 pilotlog.txt
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     3214 Aug 22 14:06 queuedata.json
[2021-08-23 09:55:28] -rwxr-xr-x 1 boinc boinc     6966 Aug 23 09:46 run_atlas*
[2021-08-23 09:55:28] -rwx------ 1 boinc boinc    20631 Aug 22 14:06 runpilot2-wrapper.sh*
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc      407 Aug 23 09:46 runtime_log
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     6942 Aug 23 09:46 runtime_log.err
[2021-08-23 09:55:28] -rw------- 1 boinc boinc      463 Aug 23 09:46 setup.sh.local
[2021-08-23 09:55:28] drwxrwx--x 2 boinc boinc     4096 Aug 23 09:46 shared/
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc    16565 Aug 23 09:46 start_atlas.sh
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     1842 Aug 23 09:46 stderr.txt
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc      107 Aug 23 09:46 wrapper_26015_x86_64-pc-linux-gnu
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc       24 Aug 23 09:55 wrapper_checkpoint.txt
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue jobs has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue payloads has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_in has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_out has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue current_data_in has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_jobs has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_payloads has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue monitored_payloads has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_jobs has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,840 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_payloads has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_in has 1 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_out has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_jobs has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_payloads has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_in has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_out has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobs has 0 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobids has 1 job(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.control.job                | has_job_completed         | job 5162455720 has completed (purged errors)
[2021-08-23 09:55:28] 2021-08-23 13:55:18,841 | INFO     | pilot.util.processes             | cleanup                   | overall cleanup function is called
[2021-08-23 09:55:28] 2021-08-23 13:55:18,843 | DEBUG    | pilot.util.processes             | cleanup                   | work directory was removed: /var/lib/boinc-client/slots/3/PanDA_Pilot-5162455720
[2021-08-23 09:55:28] 2021-08-23 13:55:19,848 | INFO     | pilot.info.jobdata               | collect_zombies           | --- collectZombieJob: --- 10, [971477]
[2021-08-23 09:55:28] 2021-08-23 13:55:19,849 | INFO     | pilot.info.jobdata               | collect_zombies           | zombie collector trying to kill pid 971477
[2021-08-23 09:55:28] 2021-08-23 13:55:19,849 | INFO     | pilot.info.jobdata               | collect_zombies           | harmless exception when collecting zombies: [Errno 10] No child processes
[2021-08-23 09:55:28] 2021-08-23 13:55:20,854 | INFO     | pilot.util.processes             | cleanup                   | collected zombie processes
[2021-08-23 09:55:28] 2021-08-23 13:55:20,854 | INFO     | pilot.util.processes             | cleanup                   | will now attempt to kill all subprocesses of pid=971477
[2021-08-23 09:55:28] 2021-08-23 13:55:20,940 | INFO     | pilot.util.processes             | kill_processes            | process IDs to be killed: [971477] (in reverse order)
[2021-08-23 09:55:28] 2021-08-23 13:55:21,006 | WARNING  | pilot.util.processes             | kill_processes            | found no corresponding commands to process id(s)
[2021-08-23 09:55:28] 2021-08-23 13:55:21,006 | INFO     | pilot.util.processes             | kill_orphans              | Do not look for orphan processes in BOINC jobs
[2021-08-23 09:55:28] 2021-08-23 13:55:21,006 | DEBUG    | pilot.util.queuehandling         | purge_queue               | queue purged
[2021-08-23 09:55:28] 2021-08-23 13:55:21,006 | INFO     | pilot.control.job                | retrieve                  | ready for new job
[2021-08-23 09:55:28] 2021-08-23 13:55:21,006 | INFO     | root                             | retrieve                  | pilot has finished for previous job - re-establishing logging
[2021-08-23 09:55:28] 2021-08-23 13:55:21,007 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | *****************************************
[2021-08-23 09:55:28] 2021-08-23 13:55:21,007 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***  PanDA Pilot version 2.12.4 (12)  ***
[2021-08-23 09:55:28] 2021-08-23 13:55:21,007 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | *****************************************
[2021-08-23 09:55:28] 2021-08-23 13:55:21,007 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | 
[2021-08-23 09:55:28] 2021-08-23 13:55:21,029 | INFO     | pilot.util.auxiliary             | display_architecture_info | architecture information:
[2021-08-23 09:55:28] 2021-08-23 13:55:21,140 | INFO     | pilot.util.auxiliary             | display_architecture_info | 
[2021-08-23 09:55:28] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2021-08-23 09:55:28] Distributor ID:	CentOS
[2021-08-23 09:55:28] Description:	CentOS Linux release 7.8.2003 (Core)
[2021-08-23 09:55:28] Release:	7.8.2003
[2021-08-23 09:55:28] Codename:	Core
[2021-08-23 09:55:28] 2021-08-23 13:55:21,141 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | *****************************************
[2021-08-23 09:55:28] 2021-08-23 13:55:21,643 | DEBUG    | pilot.util.monitoring            | check_local_space         | checking local space on /var/lib/boinc-client/slots/3
[2021-08-23 09:55:28] 2021-08-23 13:55:21,664 | INFO     | pilot.util.monitoring            | check_local_space         | sufficient remaining disk space (147788398592 B)
[2021-08-23 09:55:28] 2021-08-23 13:55:21,665 | WARNING  | pilot.control.job                | proceed_with_getjob       | since timefloor is set to 0, pilot was only allowed to run one job
[2021-08-23 09:55:28] 2021-08-23 13:55:21,665 | DEBUG    | pilot.control.job                | retrieve                  | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:21,665 | DEBUG    | pilot.control.job                | retrieve                  | [job] retrieve thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:21,665 | WARNING  | pilot.util.common                | should_abort              | data:copytool_out:received graceful stop - abort after this iteration
[2021-08-23 09:55:28] 2021-08-23 13:55:21,665 | WARNING  | pilot.control.monitor            | control                   | aborting monitor loop since graceful_stop has been set
[2021-08-23 09:55:28] 2021-08-23 13:55:21,666 | INFO     | pilot.control.monitor            | control                   | [monitor] control thread has ended
[2021-08-23 09:55:28] 2021-08-23 13:55:21,809 | DEBUG    | pilot.control.payload            | execute_payloads          | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:21,809 | INFO     | pilot.control.payload            | execute_payloads          | [payload] execute_payloads thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,171 | DEBUG    | pilot.control.job                | control                   | job control ending since graceful_stop has been set
[2021-08-23 09:55:28] 2021-08-23 13:55:22,172 | DEBUG    | pilot.control.job                | control                   | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,172 | DEBUG    | pilot.control.job                | control                   | [job] control thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,178 | DEBUG    | pilot.control.job                | create_data_payload       | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,178 | DEBUG    | pilot.control.job                | create_data_payload       | [job] create_data_payload thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,252 | DEBUG    | pilot.control.payload            | failed_post               | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,252 | INFO     | pilot.control.payload            | failed_post               | [payload] failed_post thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,288 | DEBUG    | pilot.control.job                | validate                  | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,288 | DEBUG    | pilot.control.job                | validate                  | [job] validate thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,299 | DEBUG    | pilot.control.data               | control                   | data control ending since graceful_stop has been set
[2021-08-23 09:55:28] 2021-08-23 13:55:22,300 | DEBUG    | pilot.control.data               | control                   | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,300 | DEBUG    | pilot.control.data               | control                   | [data] control thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,314 | DEBUG    | pilot.control.payload            | validate_pre              | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,314 | INFO     | pilot.control.payload            | validate_pre              | [payload] validate_pre thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,500 | DEBUG    | pilot.control.payload            | control                   | payload control ending since graceful_stop has been set
[2021-08-23 09:55:28] 2021-08-23 13:55:22,500 | DEBUG    | pilot.control.payload            | control                   | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,501 | DEBUG    | pilot.control.payload            | control                   | [payload] control thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,666 | DEBUG    | pilot.control.data               | copytool_out              | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,666 | DEBUG    | pilot.control.data               | copytool_out              | [data] copytool_out thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,712 | DEBUG    | pilot.control.data               | copytool_in               | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,712 | DEBUG    | pilot.control.data               | copytool_in               | [data] copytool_in thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,812 | DEBUG    | pilot.control.payload            | validate_post             | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,813 | INFO     | pilot.control.payload            | validate_post             | [payload] validate_post thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:22,823 | WARNING  | pilot.control.job                | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 72 s)
[2021-08-23 09:55:28] 2021-08-23 13:55:22,824 | DEBUG    | pilot.control.job                | job_monitor               | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:22,824 | DEBUG    | pilot.control.job                | job_monitor               | [job] job monitor thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:23,401 | WARNING  | pilot.util.common                | should_abort              | job:queue_monitor:received graceful stop - abort after this iteration
[2021-08-23 09:55:28] 2021-08-23 13:55:23,401 | DEBUG    | pilot.control.job                | queue_monitor             | will not set job_aborted yet
[2021-08-23 09:55:28] 2021-08-23 13:55:23,401 | DEBUG    | pilot.control.job                | queue_monitor             | [job] queue monitor thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:24,752 | WARNING  | pilot.util.common                | should_abort              | data:queue_monitoring:received graceful stop - abort after this iteration
[2021-08-23 09:55:28] 2021-08-23 13:55:27,753 | DEBUG    | pilot.util.processes             | threads_aborted           | aborting since the last relevant thread is about to finish
[2021-08-23 09:55:28] 2021-08-23 13:55:27,753 | DEBUG    | pilot.control.data               | queue_monitoring          | will proceed to set job_aborted
[2021-08-23 09:55:28] 2021-08-23 13:55:27,753 | DEBUG    | pilot.control.data               | queue_monitoring          | [data] queue_monitor thread has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:28,702 | INFO     | pilot.workflow.generic           | run                       | end of generic workflow (traces error code: 0)
[2021-08-23 09:55:28] 2021-08-23 13:55:28,702 | INFO     | root                             | wrap_up                   | traces error code: 0
[2021-08-23 09:55:28] 2021-08-23 13:55:28,702 | INFO     | root                             | wrap_up                   | pilot has finished
[2021-08-23 09:55:28] 2021-08-23 13:55:28,756 [wrapper] ==== pilot stdout END ====
[2021-08-23 09:55:28] 2021-08-23 13:55:28,763 [wrapper] ==== wrapper stdout RESUME ====
[2021-08-23 09:55:28] 2021-08-23 13:55:28,769 [wrapper] Pilot exit status: 0
[2021-08-23 09:55:28] 2021-08-23 13:55:28,788 [wrapper] pandaids: 5162455720
[2021-08-23 09:55:28] 2021-08-23 13:55:28,801 [wrapper] apfmon messages muted
[2021-08-23 09:55:28] 2021-08-23 13:55:28,808 [wrapper] Test setup, not cleaning
[2021-08-23 09:55:28] 2021-08-23 13:55:28,814 [wrapper] ==== wrapper stdout END ====
[2021-08-23 09:55:28] 2021-08-23 13:55:28,821 [wrapper] ==== wrapper stderr END ====
[2021-08-23 09:55:28] 2021-08-23 13:55:28,835 [wrapper] wrapperexiting ec=0, duration=517
[2021-08-23 09:55:28] 2021-08-23 13:55:28,841 [wrapper] apfmon messages muted
[2021-08-23 09:55:28]  *** Error codes and diagnostics ***
[2021-08-23 09:55:28]     "exeErrorCode": 0,
[2021-08-23 09:55:28]     "exeErrorDiag": "",
[2021-08-23 09:55:28]     "pilotErrorCode": 0,
[2021-08-23 09:55:28]     "pilotErrorDiag": "",
[2021-08-23 09:55:28]  *** Listing of results directory ***
[2021-08-23 09:55:28] total 45148
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc   344503 Aug 13 08:13 pilot2.tar.gz
[2021-08-23 09:55:28] -rwx------ 1 boinc boinc    20631 Aug 22 14:06 runpilot2-wrapper.sh
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     3214 Aug 22 14:06 queuedata.json
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc      107 Aug 23 09:46 wrapper_26015_x86_64-pc-linux-gnu
[2021-08-23 09:55:28] -rwxr-xr-x 1 boinc boinc     6966 Aug 23 09:46 run_atlas
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc      112 Aug 23 09:46 job.xml
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     9175 Aug 23 09:46 init_data.xml
[2021-08-23 09:55:28] drwxrwx--x 2 boinc boinc     4096 Aug 23 09:46 shared
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc        0 Aug 23 09:46 boinc_lockfile
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc    16565 Aug 23 09:46 start_atlas.sh
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc   354327 Aug 23 09:46 input.tar.gz
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc 38019645 Aug 23 09:46 EVNT.04972714._000023.pool.root.1
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     2590 Aug 23 09:46 pandaJob.out
[2021-08-23 09:55:28] -rw------- 1 boinc boinc      463 Aug 23 09:46 setup.sh.local
[2021-08-23 09:55:28] -rw------- 1 boinc boinc  1079188 Aug 23 09:47 agis_schedconf.cvmfs.json
[2021-08-23 09:55:28] -rw------- 1 boinc boinc  1949854 Aug 23 09:47 cric_ddmendpoints.json
[2021-08-23 09:55:28] drwx------ 4 boinc boinc     4096 Aug 23 09:47 pilot2
[2021-08-23 09:55:28] -rw------- 1 boinc boinc  1815657 Aug 23 09:55 output.1.0859c24d-d012-46a8-8b8c-c1ac8273feab_1023.pool.root
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc      533 Aug 23 09:55 boinc_task_state.xml
[2021-08-23 09:55:28] -rw------- 1 boinc boinc     1009 Aug 23 09:55 memory_monitor_summary.json
[2021-08-23 09:55:28] -rw------- 1 boinc boinc   154569 Aug 23 09:55 0859c24d-d012-46a8-8b8c-c1ac8273feab_1023.1.job.log.tgz
[2021-08-23 09:55:28] -rw------- 1 boinc boinc     6545 Aug 23 09:55 heartbeat.json
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc       24 Aug 23 09:55 wrapper_checkpoint.txt
[2021-08-23 09:55:28] -rw------- 1 boinc boinc     7522 Aug 23 09:55 pilotlog.txt
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc     8192 Aug 23 09:55 boinc_mmap_file
[2021-08-23 09:55:28] -rw------- 1 boinc boinc   155415 Aug 23 09:55 0859c24d-d012-46a8-8b8c-c1ac8273feab_1023.1.job.log
[2021-08-23 09:55:28] -rw------- 1 boinc boinc      532 Aug 23 09:55 output.list
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc    10903 Aug 23 09:55 runtime_log.err
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc      744 Aug 23 09:55 runtime_log
[2021-08-23 09:55:28] -rw------- 1 boinc boinc  2140160 Aug 23 09:55 result.tar.gz
[2021-08-23 09:55:28] -rw------- 1 boinc boinc      556 Aug 23 09:55 Fw7MDmr26bzn7Olcko1bjSoqABFKDmABFKDmumdXDmUwGKDmz2tKPo.diag
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc    30051 Aug 23 09:55 stderr.txt
[2021-08-23 09:55:28] HITS file was successfully produced:
[2021-08-23 09:55:28] -rw------- 1 boinc boinc 1815657 Aug 23 09:55 shared/HITS.pool.root.1
[2021-08-23 09:55:28]  *** Contents of shared directory: ***
[2021-08-23 09:55:28] total 41368
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc 38019645 Aug 23 09:46 ATLAS.root_0
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc    16565 Aug 23 09:46 start_atlas.sh
[2021-08-23 09:55:28] -rw-r--r-- 1 boinc boinc   354327 Aug 23 09:46 input.tar.gz
[2021-08-23 09:55:28] -rw------- 1 boinc boinc  1815657 Aug 23 09:55 HITS.pool.root.1
[2021-08-23 09:55:28] -rw------- 1 boinc boinc  2140160 Aug 23 09:55 result.tar.gz
09:55:30 (956897): run_atlas exited; CPU time 427.020153
09:55:30 (956897): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN