Name 0P4LDmCOyb2n7Olcko1bjSoqABFKDmABFKDmgZyRDmEnLKDmxd1NRn_0
Workunit 2272817
Created 17 Jan 2023, 10:28:58 UTC
Sent 17 Jan 2023, 10:31:13 UTC
Report deadline 24 Jan 2023, 10:31:13 UTC
Received 17 Jan 2023, 10:51:00 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4008
Run time 19 min 18 sec
CPU time 15 min 35 sec
Validate state Valid
Credit 23.42
Device peak FLOPS 3.51 GFLOPS
Application version ATLAS Simulation v1.25 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 1.42 GB
Peak swap size 2.12 GB
Peak disk usage 80.34 MB

Stderr output

<core_client_version>7.16.1</core_client_version>
<![CDATA[
<stderr_txt>
11:31:32 (15394): wrapper (7.7.26015): starting
11:31:32 (15394): wrapper: running run_atlas (--nthreads 1)
[2023-01-17 11:31:32] Arguments: --nthreads 1
[2023-01-17 11:31:32] Threads: 1
[2023-01-17 11:31:32] Checking for CVMFS
[2023-01-17 11:31:33] Probing /cvmfs/atlas.cern.ch... OK
[2023-01-17 11:31:33] Probing /cvmfs/atlas-condb.cern.ch... OK
[2023-01-17 11:31:33] Running cvmfs_config stat atlas.cern.ch
[2023-01-17 11:31:33] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2023-01-17 11:31:33] 2.6.3.0 13181 1 28260 114652 3 10 2810805 2816001 23 65024 0 4673 99.8288 17189 1790 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://128.142.161.84:3126 1
[2023-01-17 11:31:33] CVMFS is ok
[2023-01-17 11:31:33] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2023-01-17 11:31:33] Checking for apptainer binary...
[2023-01-17 11:31:33] which: no apptainer in (/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin)
[2023-01-17 11:31:33] apptainer is not installed, using version from CVMFS
[2023-01-17 11:31:33] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2023-01-17 11:31:34] HPi7COS7
[2023-01-17 11:31:34] apptainer works
[2023-01-17 11:31:34] Starting ATLAS job with PandaID=5723505103
[2023-01-17 11:31:34] Try creating a directory in /tmp
[2023-01-17 11:31:34] /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7  mktemp /tmp/tmp.XXXXX
[2023-01-17 11:31:34] /tmp/tmp.JO0t0
[2023-01-17 11:31:34] Try creating a directory in /var/tmp
[2023-01-17 11:31:34] /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7  mktemp /var/tmp/tmp.XXXXX
[2023-01-17 11:31:35] /var/tmp/tmp.kHiBY
[2023-01-17 11:31:35] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2023-01-17 11:50:47]  *** The last 200 lines of the pilot log: ***
[2023-01-17 11:50:47] 2023-01-17 10:49:52,474 | DEBUG    | pilot.control.job                | send_state                | REACHED_MAXTIME=None
[2023-01-17 11:50:47] 2023-01-17 10:49:52,474 | INFO     | pilot.control.job                | send_state                | pilot will not update the server (heartbeat message will be written to file)
[2023-01-17 11:50:47] 2023-01-17 10:49:52,474 | INFO     | pilot.control.job                | is_final_update           | job 5723505103 has finished - writing final server update
[2023-01-17 11:50:47] 2023-01-17 10:49:52,474 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | job definition core count: 1
[2023-01-17 11:50:47] 2023-01-17 10:49:52,475 | DEBUG    | pilot.api.analytics              | get_fitted_data           | removing tails from data to be fitted
[2023-01-17 11:50:47] 2023-01-17 10:49:52,475 | INFO     | pilot.api.analytics              | get_fitted_data           | fitting pss+swap vs Time
[2023-01-17 11:50:47] 2023-01-17 10:49:52,476 | INFO     | pilot.api.analytics              | get_fitted_data           | current memory leak: 63.67 B/s (using 10 data points, chi2=0.00)
[2023-01-17 11:50:47] 2023-01-17 10:49:52,477 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics           | job metrics="actualCoreCount=0.87 nEvents=2 dbTime=6.13 dbData=4274626 workDirSize=848412 leak=63.67
[2023-01-17 11:50:47] 2023-01-17 10:49:52,477 | INFO     | pilot.control.job                | get_data_structure        | total number of processed events: 2 (read)
[2023-01-17 11:50:47] 2023-01-17 10:49:52,477 | INFO     | pilot.util.container             | print_executable          | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2023-01-17 11:50:47] 2023-01-17 10:49:52,549 | INFO     | pilot.user.atlas.utilities       | get_memory_values         | using path: /var/lib/boinc/slots/1/PanDA_Pilot-5723505103/memory_monitor_summary.json (trf name=prmo
[2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | DEBUG    | pilot.user.atlas.utilities       | get_memory_monitor_info   | summary_dictionary={'Avg': {'nprocs': 5.352, 'nthreads': 6.294, 'pss': 1287569.0, 'rchar': 59442939.
[2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard info from prmon json
[2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard memory fields from prmon json
[2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | INFO     | pilot.util.timing                | timing_report             | . Timing measurements:
[2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO     | pilot.util.timing                | timing_report             | . get job = 0 s
[2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO     | pilot.util.timing                | timing_report             | . initial setup = 3 s
[2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO     | pilot.util.timing                | timing_report             | . payload setup = 10 s
[2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO     | pilot.util.timing                | timing_report             | . stage-in = 0 s
[2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO     | pilot.util.timing                | timing_report             | . payload execution = 1039 s
[2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO     | pilot.util.timing                | timing_report             | . stage-out = 0 s
[2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | DEBUG    | pilot.control.job                | send_state                | data={'jobId': '5723505103', 'state': 'finished', 'timestamp': '2023-01-17T11:49:52+01:00', 'siteNam
[2023-01-17 11:50:47] 2023-01-17 10:49:52,552 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | heartbeat dictionary: {'jobId': '5723505103', 'state': 'finished', 'timestamp': '2023-01-17T11:49:52
[2023-01-17 11:50:47] 2023-01-17 10:49:52,552 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | wrote heartbeat to file: /var/lib/boinc/slots/1/heartbeat.json
[2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO     | pilot.control.job                | make_job_report           | 
[2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO     | pilot.control.job                | make_job_report           | job summary report
[2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO     | pilot.control.job                | make_job_report           | PanDA job id: 5723505103
[2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO     | pilot.control.job                | make_job_report           | task id: NULL
[2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO     | pilot.control.job                | make_job_report           | errors: (none)
[2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO     | pilot.control.job                | make_job_report           | status: LOG_TRANSFER = DONE 
[2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO     | pilot.control.job                | make_job_report           | pilot state: finished 
[2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO     | pilot.control.job                | make_job_report           | transexitcode: 0
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | exeerrorcode: 0
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | exeerrordiag: 
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | exitcode: 0
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | exitmsg: OK
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | cpuconsumptiontime: 959 s
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | nevents: 2
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | neventsw: 0
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | pid: 26630
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | pgrp: 26630
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | corecount: 1
[2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO     | pilot.control.job                | make_job_report           | event service: False
[2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | INFO     | pilot.control.job                | make_job_report           | sizes: {0: 2526779, 1: 2527184, 1053: 2546861, 1054: 2555911, 1056: 2555967, 1057: 2556869}
[2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | INFO     | pilot.control.job                | make_job_report           | 
[2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | DEBUG    | pilot.control.job                | has_job_completed         | ls -lF /var/lib/boinc/slots/1:
[2023-01-17 11:50:47] 
[2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | INFO     | pilot.util.container             | print_executable          | executing command: ls -lF /var/lib/boinc/slots/1
[2023-01-17 11:50:47] 2023-01-17 10:49:52,708 | DEBUG    | pilot.control.job                | has_job_completed         | total 43208
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc      131 Jan 17 11:31 0P4LDmCOyb2n7Olcko1bjSoqABFKDmABFKDmgZyRDmEnLKDmxd1NRn.diag
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc   225191 Jan 17 11:49 9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.1.job.log
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc   164246 Jan 17 11:49 9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.1.job.log.tgz
[2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 38019645 Jan 17 11:31 EVNT.04972714._000023.pool.root.1
[2023-01-17 11:50:47] drwxrwx---. 2 boinc boinc     4096 Jan 17 11:49 PanDA_Pilot-5723505103/
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc  1697825 Jan 17 11:32 agis_ddmendpoints.agis.ALL.json
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc  1038896 Jan 17 11:32 agis_schedconf.cvmfs.json
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc        0 Jan 17 11:31 boinc_lockfile
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     8192 Jan 17 11:49 boinc_mmap_file
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc      533 Jan 17 11:49 boinc_task_state.xml
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc     6604 Jan 17 11:49 heartbeat.json
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     6045 Jan 17 11:31 init_data.xml
[2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc   402661 Jan 17 11:31 input.tar.gz
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc      112 Jan 17 11:31 job.xml
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc     1017 Jan 17 11:49 memory_monitor_summary.json
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc  1769753 Jan 17 11:49 output.1.9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.pool.root
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc      464 Jan 17 11:49 output.list
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     2655 Jan 17 11:31 pandaJob.out
[2023-01-17 11:50:47] drwx------. 4 boinc boinc      245 Jan 17 11:32 pilot3/
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc   391889 Jan 17 11:28 pilot3.tar.gz
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc   206242 Jan 17 11:49 pilotlog.txt
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     4540 Jan 17 11:25 queuedata.json
[2023-01-17 11:50:47] -rwxr-xr-x. 1 boinc boinc     8273 Jan 17 11:31 run_atlas*
[2023-01-17 11:50:47] -rwx------. 1 boinc boinc    26433 Jan 17 11:28 runpilot2-wrapper.sh*
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc      407 Jan 17 11:31 runtime_log
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     6769 Jan 17 11:31 runtime_log.err
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc      464 Jan 17 11:31 setup.sh.local
[2023-01-17 11:50:47] drwxrwx--x. 2 boinc boinc       68 Jan 17 11:31 shared/
[2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc    17790 Jan 17 11:31 start_atlas.sh
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     2419 Jan 17 11:31 stderr.txt
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc      107 Jan 17 11:31 wrapper_26015_x86_64-pc-linux-gnu
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc       25 Jan 17 11:49 wrapper_checkpoint.txt
[2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO     | pilot.util.queuehandling         | queue_report              | queue jobs had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO     | pilot.util.queuehandling         | queue_report              | queue payloads had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_in had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_out had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO     | pilot.util.queuehandling         | queue_report              | queue current_data_in had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_jobs had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_payloads had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO     | pilot.util.queuehandling         | queue_report              | queue monitored_payloads had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_jobs had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_payloads had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_in had 1 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_out had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_jobs had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_payloads had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_in had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_out had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobs had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobids has 1 job(s)
[2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO     | pilot.util.queuehandling         | queue_report              | queue realtimelog_payloads had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,711 | INFO     | pilot.util.queuehandling         | queue_report              | queue messages had 0 job(s) [purged]
[2023-01-17 11:50:47] 2023-01-17 10:49:52,711 | INFO     | pilot.control.job                | has_job_completed         | job 5723505103 has completed (purged errors)
[2023-01-17 11:50:47] 2023-01-17 10:49:52,711 | DEBUG    | pilot.util.realtimelogger        | cleanup                   | attempting real-time logger cleanup
[2023-01-17 11:50:47] 2023-01-17 10:49:52,711 | INFO     | pilot.util.processes             | cleanup                   | overall cleanup function is called
[2023-01-17 11:50:47] 2023-01-17 10:49:52,713 | DEBUG    | pilot.util.processes             | cleanup                   | work directory was removed: /var/lib/boinc/slots/1/PanDA_Pilot-5723505103
[2023-01-17 11:50:47] 2023-01-17 10:49:53,715 | INFO     | pilot.info.jobdata               | collect_zombies           | --- collectZombieJob: --- 10, [26630]
[2023-01-17 11:50:47] 2023-01-17 10:49:53,715 | INFO     | pilot.info.jobdata               | collect_zombies           | zombie collector trying to kill pid 26630
[2023-01-17 11:50:47] 2023-01-17 10:49:53,716 | INFO     | pilot.info.jobdata               | collect_zombies           | harmless exception when collecting zombies: [Errno 10] No child processes
[2023-01-17 11:50:47] 2023-01-17 10:49:54,735 | INFO     | pilot.util.processes             | cleanup                   | collected zombie processes
[2023-01-17 11:50:47] 2023-01-17 10:49:54,735 | INFO     | pilot.util.processes             | cleanup                   | will now attempt to kill all subprocesses of pid=26630
[2023-01-17 11:50:47] 2023-01-17 10:49:54,809 | INFO     | pilot.util.processes             | kill_processes            | process IDs to be killed: [26630] (in reverse order)
[2023-01-17 11:50:47] 2023-01-17 10:49:54,847 | WARNING  | pilot.util.processes             | kill_processes            | found no corresponding commands to process id(s)
[2023-01-17 11:50:47] 2023-01-17 10:49:54,848 | INFO     | pilot.util.processes             | kill_orphans              | Do not look for orphan processes in BOINC jobs
[2023-01-17 11:50:47] 2023-01-17 10:49:54,848 | DEBUG    | pilot.util.queuehandling         | purge_queue               | queue purged
[2023-01-17 11:50:47] 2023-01-17 10:49:54,848 | INFO     | pilot.control.job                | retrieve                  | ready for new job
[2023-01-17 11:50:47] 2023-01-17 10:49:54,848 | INFO     | root                             | retrieve                  | pilot has finished with previous job - re-establishing logging
[2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***************************************
[2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***  PanDA Pilot version 3.4.8 (5)  ***
[2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***************************************
[2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | 
[2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | pilot is running in a VM
[2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO     | pilot.util.auxiliary             | display_architecture_info | architecture information:
[2023-01-17 11:50:47] 2023-01-17 10:49:55,009 | INFO     | pilot.util.auxiliary             | display_architecture_info | 
[2023-01-17 11:50:47] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2023-01-17 11:50:47] Distributor ID:	CentOS
[2023-01-17 11:50:47] Description:	CentOS Linux release 7.9.2009 (Core)
[2023-01-17 11:50:47] Release:	7.9.2009
[2023-01-17 11:50:47] Codename:	Core
[2023-01-17 11:50:47] 2023-01-17 10:49:55,010 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***************************************
[2023-01-17 11:50:47] 2023-01-17 10:49:55,515 | DEBUG    | pilot.util.monitoring            | check_local_space         | checking local space on /var/lib/boinc/slots/1
[2023-01-17 11:50:47] 2023-01-17 10:49:55,515 | INFO     | pilot.util.container             | print_executable          | executing command: df -mP /var/lib/boinc/slots/1
[2023-01-17 11:50:47] 2023-01-17 10:49:55,533 | DEBUG    | pilot.util.workernode            | get_local_disk_space      | stdout=Filesystem              1048576-blocks  Used Available Capacity Mounted on
[2023-01-17 11:50:47] /dev/mapper/centos-root          22002 11370     10632      52% /var/lib/boinc/slots/1
[2023-01-17 11:50:47] 2023-01-17 10:49:55,533 | DEBUG    | pilot.util.workernode            | get_local_disk_space      | stderr=
[2023-01-17 11:50:47] 2023-01-17 10:49:55,533 | INFO     | pilot.util.monitoring            | check_local_space         | sufficient remaining disk space (11148460032 B)
[2023-01-17 11:50:47] 2023-01-17 10:49:55,533 | WARNING  | pilot.control.job                | proceed_with_getjob       | since timefloor is set to 0, pilot was only allowed to run one job
[2023-01-17 11:50:47] 2023-01-17 10:49:55,534 | DEBUG    | pilot.control.job                | retrieve                  | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:55,534 | INFO     | pilot.control.job                | retrieve                  | [job] retrieve thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:55,534 | WARNING  | pilot.control.monitor            | control                   | aborting monitor loop since graceful_stop has been set
[2023-01-17 11:50:47] 2023-01-17 10:49:55,534 | INFO     | pilot.control.monitor            | control                   | [monitor] control thread has ended
[2023-01-17 11:50:47] 2023-01-17 10:49:55,595 | WARNING  | pilot.util.common                | should_abort              | data:copytool_out:received graceful stop - abort after this iteration
[2023-01-17 11:50:47] 2023-01-17 10:49:55,837 | DEBUG    | pilot.control.payload            | validate_pre              | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:55,837 | INFO     | pilot.control.payload            | validate_pre              | [payload] validate_pre thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:55,977 | DEBUG    | pilot.control.data               | copytool_in               | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:55,978 | INFO     | pilot.control.data               | copytool_in               | [data] copytool_in thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:56,367 | DEBUG    | pilot.control.data               | control                   | data control ending since graceful_stop has been set
[2023-01-17 11:50:47] 2023-01-17 10:49:56,368 | DEBUG    | pilot.control.data               | control                   | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:56,368 | INFO     | pilot.control.data               | control                   | [data] control thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:56,435 | DEBUG    | pilot.control.job                | control                   | job control ending since graceful_stop has been set
[2023-01-17 11:50:47] 2023-01-17 10:49:56,435 | DEBUG    | pilot.control.job                | control                   | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:56,435 | INFO     | pilot.control.job                | control                   | [job] control thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:56,448 | DEBUG    | pilot.control.payload            | execute_payloads          | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:56,448 | INFO     | pilot.control.payload            | execute_payloads          | [payload] execute_payloads thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:56,577 | DEBUG    | pilot.control.payload            | control                   | payload control ending since graceful_stop has been set
[2023-01-17 11:50:47] 2023-01-17 10:49:56,577 | DEBUG    | pilot.control.payload            | control                   | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:56,577 | INFO     | pilot.control.payload            | control                   | [payload] control thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:56,606 | DEBUG    | pilot.control.data               | copytool_out              | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:56,609 | INFO     | pilot.control.data               | copytool_out              | [data] copytool_out thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:56,606 | DEBUG    | pilot.control.job                | create_data_payload       | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:56,609 | INFO     | pilot.control.job                | create_data_payload       | [job] create_data_payload thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:56,811 | DEBUG    | pilot.control.job                | validate                  | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:56,811 | INFO     | pilot.control.job                | validate                  | [job] validate thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:57,012 | DEBUG    | pilot.control.payload            | failed_post               | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:57,013 | INFO     | pilot.control.payload            | failed_post               | [payload] failed_post thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:57,109 | DEBUG    | pilot.control.payload            | validate_post             | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:57,109 | INFO     | pilot.control.payload            | validate_post             | [payload] validate_post thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:57,714 | WARNING  | pilot.util.common                | should_abort              | job:queue_monitor:received graceful stop - abort after this iteration
[2023-01-17 11:50:47] 2023-01-17 10:49:57,714 | DEBUG    | pilot.control.job                | queue_monitor             | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:49:57,714 | INFO     | pilot.control.job                | queue_monitor             | [job] queue monitor thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:49:58,347 | WARNING  | pilot.util.common                | should_abort              | data:queue_monitoring:received graceful stop - abort after this iteration
[2023-01-17 11:50:47] 2023-01-17 10:50:01,351 | DEBUG    | pilot.control.data               | queue_monitoring          | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:50:01,352 | INFO     | pilot.control.data               | queue_monitoring          | [data] queue_monitor thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:50:06,343 | INFO     | pilot.control.payload            | get_logging_info          | job.realtimelogging is not enabled
[2023-01-17 11:50:47] 2023-01-17 10:50:06,343 | DEBUG    | pilot.control.payload            | run_realtimelog           | real-time logging not needed at this point
[2023-01-17 11:50:47] 2023-01-17 10:50:06,343 | DEBUG    | pilot.control.payload            | run_realtimelog           | realtime logger was not found, waiting ..
[2023-01-17 11:50:47] 2023-01-17 10:50:06,343 | DEBUG    | pilot.control.payload            | run_realtimelog           | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:50:06,344 | INFO     | pilot.control.payload            | run_realtimelog           | [payload] run_realtimelog thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:50:46,003 | WARNING  | pilot.control.job                | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 74 s)
[2023-01-17 11:50:47] 2023-01-17 10:50:46,003 | DEBUG    | pilot.control.job                | job_monitor               | will not set job_aborted yet
[2023-01-17 11:50:47] 2023-01-17 10:50:46,003 | INFO     | pilot.control.job                | job_monitor               | [job] job monitor thread has finished
[2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | DEBUG    | pilot.util.processes             | threads_aborted           | aborting since only the main Pilot thread is still running (total thread count=1 with 0 daemon threa
[2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | DEBUG    | pilot.workflow.generic           | run                       | all relevant threads have aborted (thread count=1)
[2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | INFO     | pilot.workflow.generic           | run                       | end of generic workflow (traces error code: 0)
[2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | INFO     | root                             | wrap_up                   | traces error code: 0
[2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | INFO     | root                             | wrap_up                   | pilot has finished
[2023-01-17 11:50:47] 2023-01-17 10:50:47,064 [wrapper] ==== pilot stdout END ====
[2023-01-17 11:50:47] 2023-01-17 10:50:47,068 [wrapper] ==== wrapper stdout RESUME ====
[2023-01-17 11:50:47] 2023-01-17 10:50:47,072 [wrapper] pilotpid: 23556
[2023-01-17 11:50:47] 2023-01-17 10:50:47,077 [wrapper] Pilot exit status: 0
[2023-01-17 11:50:47] 2023-01-17 10:50:47,100 [wrapper] pandaids: 5723505103
[2023-01-17 11:50:47] 2023-01-17 10:50:47,114 [wrapper] apfmon messages muted
[2023-01-17 11:50:47] 2023-01-17 10:50:47,155 [wrapper] Test setup, not cleaning
[2023-01-17 11:50:47] 2023-01-17 10:50:47,184 [wrapper] ==== wrapper stdout END ====
[2023-01-17 11:50:47] 2023-01-17 10:50:47,203 [wrapper] ==== wrapper stderr END ====
[2023-01-17 11:50:47] 2023-01-17 10:50:47,211 [wrapper] wrapperexiting ec=0, duration=1152
[2023-01-17 11:50:47] 2023-01-17 10:50:47,214 [wrapper] apfmon messages muted
[2023-01-17 11:50:47]  *** Error codes and diagnostics ***
[2023-01-17 11:50:47]     "exeErrorCode": 0,
[2023-01-17 11:50:47]     "exeErrorDiag": "",
[2023-01-17 11:50:47]     "pilotErrorCode": 0,
[2023-01-17 11:50:47]     "pilotErrorDiag": "",
[2023-01-17 11:50:47]  *** Listing of results directory ***
[2023-01-17 11:50:47] insgesamt 45052
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     4540 17. Jan 11:25 queuedata.json
[2023-01-17 11:50:47] -rwx------. 1 boinc boinc    26433 17. Jan 11:28 runpilot2-wrapper.sh
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc   391889 17. Jan 11:28 pilot3.tar.gz
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc      107 17. Jan 11:31 wrapper_26015_x86_64-pc-linux-gnu
[2023-01-17 11:50:47] -rwxr-xr-x. 1 boinc boinc     8273 17. Jan 11:31 run_atlas
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc      112 17. Jan 11:31 job.xml
[2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc    17790 17. Jan 11:31 start_atlas.sh
[2023-01-17 11:50:47] drwxrwx--x. 2 boinc boinc       68 17. Jan 11:31 shared
[2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc   402661 17. Jan 11:31 input.tar.gz
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     6045 17. Jan 11:31 init_data.xml
[2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 38019645 17. Jan 11:31 EVNT.04972714._000023.pool.root.1
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc        0 17. Jan 11:31 boinc_lockfile
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     2655 17. Jan 11:31 pandaJob.out
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc      464 17. Jan 11:31 setup.sh.local
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc  1038896 17. Jan 11:32 agis_schedconf.cvmfs.json
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc  1697825 17. Jan 11:32 agis_ddmendpoints.agis.ALL.json
[2023-01-17 11:50:47] drwx------. 4 boinc boinc      245 17. Jan 11:32 pilot3
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc  1769753 17. Jan 11:49 output.1.9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.pool.root
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc     1017 17. Jan 11:49 memory_monitor_summary.json
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc   164246 17. Jan 11:49 9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.1.job.log.tgz
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc     6604 17. Jan 11:49 heartbeat.json
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc      533 17. Jan 11:50 boinc_task_state.xml
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc     8192 17. Jan 11:50 boinc_mmap_file
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc       25 17. Jan 11:50 wrapper_checkpoint.txt
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc     9046 17. Jan 11:50 pilotlog.txt
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc   242266 17. Jan 11:50 9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.1.job.log
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc      464 17. Jan 11:50 output.list
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc      748 17. Jan 11:50 runtime_log
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc  2191360 17. Jan 11:50 result.tar.gz
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc    10880 17. Jan 11:50 runtime_log.err
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc      633 17. Jan 11:50 0P4LDmCOyb2n7Olcko1bjSoqABFKDmABFKDmgZyRDmEnLKDmxd1NRn.diag
[2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc    31230 17. Jan 11:50 stderr.txt
[2023-01-17 11:50:47] HITS file was successfully produced:
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1769753 17. Jan 11:49 shared/HITS.pool.root.1
[2023-01-17 11:50:47]  *** Contents of shared directory: ***
[2023-01-17 11:50:47] insgesamt 41420
[2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc    17790 17. Jan 11:31 start_atlas.sh
[2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc   402661 17. Jan 11:31 input.tar.gz
[2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 38019645 17. Jan 11:31 ATLAS.root_0
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc  1769753 17. Jan 11:49 HITS.pool.root.1
[2023-01-17 11:50:47] -rw-------. 1 boinc boinc  2191360 17. Jan 11:50 result.tar.gz
11:50:49 (15394): run_atlas exited; CPU time 935.515480
11:50:49 (15394): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN