Name g2hLDmH3Ma2n7Olcko1bjSoqABFKDmABFKDmgZyRDm9ILKDmB30wmn_1
Workunit 2271175
Created 13 Jan 2023, 1:36:32 UTC
Sent 13 Jan 2023, 1:38:21 UTC
Report deadline 20 Jan 2023, 1:38:21 UTC
Received 13 Jan 2023, 1:51:48 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4721
Run time 12 min 23 sec
CPU time 10 min 12 sec
Validate state Valid
Credit 32.28
Device peak FLOPS 6.86 GFLOPS
Application version ATLAS Simulation v1.25 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 1.60 GB
Peak swap size 2.12 GB
Peak disk usage 38.94 MB

Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
02:38:47 (1265257): wrapper (7.7.26015): starting
02:38:47 (1265257): wrapper: running run_atlas (--nthreads 1)
[2023-01-13 02:38:48] Arguments: --nthreads 1
[2023-01-13 02:38:48] Threads: 1
[2023-01-13 02:38:48] Checking for CVMFS
[2023-01-13 02:38:49] Probing /cvmfs/atlas.cern.ch... OK
[2023-01-13 02:38:52] Probing /cvmfs/atlas-condb.cern.ch... OK
[2023-01-13 02:38:52] Running cvmfs_config stat atlas.cern.ch
[2023-01-13 02:38:55] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2023-01-13 02:38:55] 2.10.0.0 1253114 6 38612 114492 1 91 2938789 4096000 0 130560 0 46060 99.996 881 503 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://10.116.178.201:3128 1
[2023-01-13 02:38:55] CVMFS is ok
[2023-01-13 02:38:55] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2023-01-13 02:38:55] Checking for apptainer binary...
[2023-01-13 02:38:55] Using apptainer found in PATH at /usr/bin/apptainer
[2023-01-13 02:38:55] Running /usr/bin/apptainer --version
[2023-01-13 02:38:57] apptainer version 1.1.4-2.el9
[2023-01-13 02:38:58] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2023-01-13 02:39:00] P620-CentOS9
[2023-01-13 02:39:00] apptainer works
[2023-01-13 02:39:01] Starting ATLAS job with PandaID=5717826802
[2023-01-13 02:39:01] Try creating a directory in /tmp
[2023-01-13 02:39:01] /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/57 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7  mktemp /tmp/tmp.XXXXX
[2023-01-13 02:39:01] /usr/bin/mktemp: failed to create file via template '/tmp/tmp.XXXXX': Read-only file system
[2023-01-13 02:39:01] mktemp /tmp failed
[2023-01-13 02:39:01] Try creating a directory in /var/tmp
[2023-01-13 02:39:01] /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/57 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7  mktemp /var/tmp/tmp.XXXXX
[2023-01-13 02:39:01] /usr/bin/mktemp: failed to create file via template '/var/tmp/tmp.XXXXX': Read-only file system
[2023-01-13 02:39:01] mktemp /var/tmp failed
[2023-01-13 02:39:01] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/57 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2023-01-13 02:51:07]  *** The last 200 lines of the pilot log: ***
[2023-01-13 02:51:07] 2023-01-13 01:50:52,483 | DEBUG    | pilot.control.job                | send_state                | REACHED_MAXTIME=None
[2023-01-13 02:51:07] 2023-01-13 01:50:52,483 | INFO     | pilot.control.job                | send_state                | pilot will not update the server (heartbeat message will be written to file)
[2023-01-13 02:51:07] 2023-01-13 01:50:52,483 | INFO     | pilot.control.job                | is_final_update           | job 5717826802 has finished - writing final server update
[2023-01-13 02:51:07] 2023-01-13 01:50:52,484 | DEBUG    | pilot.control.job                | get_data_structure        | state=finished
[2023-01-13 02:51:07] 2023-01-13 01:50:52,484 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics_string    | job definition core count: 1
[2023-01-13 02:51:07] 2023-01-13 01:50:52,484 | DEBUG    | pilot.api.analytics              | get_fitted_data           | removing tails from data to be fitted
[2023-01-13 02:51:07] 2023-01-13 01:50:52,484 | WARNING  | pilot.api.analytics              | get_fitted_data           | wrong length of table data, x=[1673574280.0, 1673574341.0, 1673574402.0, 1673574463.0], y=[1739815.0
[2023-01-13 02:51:07] 2023-01-13 01:50:52,484 | DEBUG    | pilot.user.atlas.jobmetrics      | get_job_metrics           | job metrics="actualCoreCount=0.89 nEvents=2 dbTime=9.43 dbData=4274626 workDirSize=849222 eventnumbe
[2023-01-13 02:51:07] 2023-01-13 01:50:52,485 | INFO     | pilot.control.job                | get_data_structure        | total number of processed events: 2 (read)
[2023-01-13 02:51:07] 2023-01-13 01:50:52,485 | INFO     | pilot.util.container             | print_executable          | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2023-01-13 02:51:07] 2023-01-13 01:50:52,497 | INFO     | pilot.user.atlas.utilities       | get_memory_values         | using path: /var/lib/boinc/slots/57/PanDA_Pilot-5717826802/memory_monitor_summary.json (trf name=prm
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | DEBUG    | pilot.user.atlas.utilities       | get_memory_monitor_info   | summary_dictionary={'Avg': {'nprocs': 4.909, 'nthreads': 5.818, 'pss': 1488223.0, 'rchar': 92503690.
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard info from prmon json
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard memory fields from prmon json
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.util.timing                | timing_report             | . Timing measurements:
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.util.timing                | timing_report             | . get job = 0 s
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.util.timing                | timing_report             | . initial setup = 7 s
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.util.timing                | timing_report             | . payload setup = 4 s
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.util.timing                | timing_report             | . stage-in = 0 s
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.util.timing                | timing_report             | . payload execution = 671 s
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.util.timing                | timing_report             | . stage-out = 5 s
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2023-01-13 02:51:07] 2023-01-13 01:50:52,498 | DEBUG    | pilot.control.job                | send_state                | data={'jobId': '5717826802', 'state': 'finished', 'timestamp': '2023-01-13T02:50:52+01:00', 'siteNam
[2023-01-13 02:51:07] 2023-01-13 01:50:52,499 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | heartbeat dictionary: {'jobId': '5717826802', 'state': 'finished', 'timestamp': '2023-01-13T02:50:52
[2023-01-13 02:51:07] 2023-01-13 01:50:52,499 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | wrote heartbeat to file: /var/lib/boinc/slots/57/heartbeat.json
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | 
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | job summary report
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | PanDA job id: 5717826802
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | task id: NULL
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | errors: (none)
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | status: LOG_TRANSFER = DONE 
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | pilot state: finished 
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | transexitcode: 0
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | exeerrorcode: 0
[2023-01-13 02:51:07] 2023-01-13 01:50:52,632 | INFO     | pilot.control.job                | make_job_report           | exeerrordiag: 
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | exitcode: 0
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | exitmsg: OK
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | cpuconsumptiontime: 615 s
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | nevents: 2
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | neventsw: 0
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | pid: 1273328
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | pgrp: 1273328
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | corecount: 1
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | event service: False
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | sizes: {0: 2537273, 1: 2537479, 11: 2537507, 680: 2558746, 685: 2567798, 686: 2568884}
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.control.job                | make_job_report           | 
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | DEBUG    | pilot.control.job                | has_job_completed         | ls -lF /var/lib/boinc/slots/57:
[2023-01-13 02:51:07] 
[2023-01-13 02:51:07] 2023-01-13 01:50:52,633 | INFO     | pilot.util.container             | print_executable          | executing command: ls -lF /var/lib/boinc/slots/57
[2023-01-13 02:51:07] 2023-01-13 01:50:52,642 | DEBUG    | pilot.control.job                | has_job_completed         | total 49192
[2023-01-13 02:51:07] -rw-r--r--. 2 boinc boinc 37595586 Jan 13 02:38 EVNT.04972714._000034.pool.root.1
[2023-01-13 02:51:07] drwxrwx---. 2 boinc boinc     4096 Jan 13 02:50 PanDA_Pilot-5717826802/
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc   189888 Jan 13 02:50 a51b0270-613a-4b1d-834a-91847c521455_92332.1.job.log
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc   157562 Jan 13 02:50 a51b0270-613a-4b1d-834a-91847c521455_92332.1.job.log.tgz
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  1704033 Jan 13 02:39 agis_ddmendpoints.agis.ALL.json
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  1036019 Jan 13 02:39 agis_schedconf.cvmfs.json
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc        0 Jan 13 02:38 boinc_lockfile
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     8192 Jan 13 02:50 boinc_mmap_file
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc      532 Jan 13 02:50 boinc_task_state.xml
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc      145 Jan 13 02:39 g2hLDmH3Ma2n7Olcko1bjSoqABFKDmABFKDmgZyRDm9ILKDmB30wmn.diag
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc     7668 Jan 13 02:50 heartbeat.json
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     6197 Jan 13 02:38 init_data.xml
[2023-01-13 02:51:07] -rw-r--r--. 2 boinc boinc  3196847 Jan 13 02:38 input.tar.gz
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc      112 Jan 13 02:38 job.xml
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc     1009 Jan 13 02:50 memory_monitor_summary.json
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  2927646 Jan 13 02:50 output.1.a51b0270-613a-4b1d-834a-91847c521455_92332.pool.root
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc      464 Jan 13 02:50 output.list
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     2651 Jan 13 02:39 pandaJob.out
[2023-01-13 02:51:07] drwx------. 5 boinc boinc     4096 Jan 13 02:39 pilot3/
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  3192978 Jan 13 01:24 pilot3.tar.gz
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc   171240 Jan 13 02:50 pilotlog.txt
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     4540 Jan 13 01:24 queuedata.json
[2023-01-13 02:51:07] -rwxr-xr-x. 1 boinc boinc     8273 Jan 13 02:38 run_atlas*
[2023-01-13 02:51:07] -rwx------. 1 boinc boinc    26316 Jan 13 01:24 runpilot2-wrapper.sh*
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc      407 Jan 13 02:39 runtime_log
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     6813 Jan 13 02:39 runtime_log.err
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc      464 Jan 13 02:39 setup.sh.local
[2023-01-13 02:51:07] drwxrwx--x. 2 boinc boinc       68 Jan 13 02:38 shared/
[2023-01-13 02:51:07] -rw-r--r--. 2 boinc boinc    17790 Jan 13 02:38 start_atlas.sh
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     2427 Jan 13 02:39 stderr.txt
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc      107 Jan 13 02:38 wrapper_26015_x86_64-pc-linux-gnu
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc       24 Jan 13 02:50 wrapper_checkpoint.txt
[2023-01-13 02:51:07] 2023-01-13 01:50:52,642 | INFO     | pilot.util.queuehandling         | queue_report              | queue jobs had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue payloads had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_in had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_out had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue current_data_in had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_jobs had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_payloads had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue monitored_payloads had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_jobs had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_payloads had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_in had 1 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_out had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_jobs had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_payloads had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_in had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_out had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobs had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobids has 1 job(s)
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue realtimelog_payloads had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.util.queuehandling         | queue_report              | queue messages had 0 job(s) [purged]
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | INFO     | pilot.control.job                | has_job_completed         | job 5717826802 has completed (purged errors)
[2023-01-13 02:51:07] 2023-01-13 01:50:52,643 | DEBUG    | pilot.util.realtimelogger        | cleanup                   | attempting real-time logger cleanup
[2023-01-13 02:51:07] 2023-01-13 01:50:52,644 | INFO     | pilot.util.processes             | cleanup                   | overall cleanup function is called
[2023-01-13 02:51:07] 2023-01-13 01:50:52,645 | DEBUG    | pilot.util.processes             | cleanup                   | work directory was removed: /var/lib/boinc/slots/57/PanDA_Pilot-5717826802
[2023-01-13 02:51:07] 2023-01-13 01:50:53,646 | INFO     | pilot.info.jobdata               | collect_zombies           | --- collectZombieJob: --- 10, [1273328]
[2023-01-13 02:51:07] 2023-01-13 01:50:53,646 | INFO     | pilot.info.jobdata               | collect_zombies           | zombie collector trying to kill pid 1273328
[2023-01-13 02:51:07] 2023-01-13 01:50:53,646 | INFO     | pilot.info.jobdata               | collect_zombies           | harmless exception when collecting zombies: [Errno 10] No child processes
[2023-01-13 02:51:07] 2023-01-13 01:50:54,652 | INFO     | pilot.util.processes             | cleanup                   | collected zombie processes
[2023-01-13 02:51:07] 2023-01-13 01:50:54,652 | INFO     | pilot.util.processes             | cleanup                   | will now attempt to kill all subprocesses of pid=1273328
[2023-01-13 02:51:07] 2023-01-13 01:50:54,682 | INFO     | pilot.util.processes             | kill_processes            | process IDs to be killed: [1273328] (in reverse order)
[2023-01-13 02:51:07] 2023-01-13 01:50:54,700 | WARNING  | pilot.util.processes             | kill_processes            | found no corresponding commands to process id(s)
[2023-01-13 02:51:07] 2023-01-13 01:50:54,700 | INFO     | pilot.util.processes             | kill_orphans              | Do not look for orphan processes in BOINC jobs
[2023-01-13 02:51:07] 2023-01-13 01:50:54,700 | DEBUG    | pilot.util.queuehandling         | purge_queue               | queue purged
[2023-01-13 02:51:07] 2023-01-13 01:50:54,701 | INFO     | pilot.control.job                | retrieve                  | ready for new job
[2023-01-13 02:51:07] 2023-01-13 01:50:54,701 | INFO     | root                             | retrieve                  | pilot has finished with previous job - re-establishing logging
[2023-01-13 02:51:07] 2023-01-13 01:50:54,701 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***************************************
[2023-01-13 02:51:07] 2023-01-13 01:50:54,701 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***  PanDA Pilot version 3.4.7 (6)  ***
[2023-01-13 02:51:07] 2023-01-13 01:50:54,701 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***************************************
[2023-01-13 02:51:07] 2023-01-13 01:50:54,701 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | 
[2023-01-13 02:51:07] 2023-01-13 01:50:54,701 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | pilot is running in a VM
[2023-01-13 02:51:07] 2023-01-13 01:50:54,701 | INFO     | pilot.util.auxiliary             | display_architecture_info | architecture information:
[2023-01-13 02:51:07] 2023-01-13 01:50:54,735 | INFO     | pilot.util.auxiliary             | display_architecture_info | 
[2023-01-13 02:51:07] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2023-01-13 02:51:07] Distributor ID:	CentOS
[2023-01-13 02:51:07] Description:	CentOS Linux release 7.9.2009 (Core)
[2023-01-13 02:51:07] Release:	7.9.2009
[2023-01-13 02:51:07] Codename:	Core
[2023-01-13 02:51:07] 2023-01-13 01:50:54,735 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***************************************
[2023-01-13 02:51:07] 2023-01-13 01:50:55,239 | DEBUG    | pilot.util.monitoring            | check_local_space         | checking local space on /var/lib/boinc/slots/57
[2023-01-13 02:51:07] 2023-01-13 01:50:55,239 | INFO     | pilot.util.container             | print_executable          | executing command: df -mP /var/lib/boinc/slots/57
[2023-01-13 02:51:07] 2023-01-13 01:50:55,247 | DEBUG    | pilot.util.workernode            | get_local_disk_space      | stdout=Filesystem          1048576-blocks  Used Available Capacity Mounted on
[2023-01-13 02:51:07] /dev/mapper/cs-root          31213 10414     20799      34% /var/lib/boinc/slots/57
[2023-01-13 02:51:07] 2023-01-13 01:50:55,247 | DEBUG    | pilot.util.workernode            | get_local_disk_space      | stderr=
[2023-01-13 02:51:07] 2023-01-13 01:50:55,247 | INFO     | pilot.util.monitoring            | check_local_space         | sufficient remaining disk space (21809332224 B)
[2023-01-13 02:51:07] 2023-01-13 01:50:55,247 | WARNING  | pilot.control.job                | proceed_with_getjob       | since timefloor is set to 0, pilot was only allowed to run one job
[2023-01-13 02:51:07] 2023-01-13 01:50:55,247 | DEBUG    | pilot.control.job                | retrieve                  | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:55,247 | INFO     | pilot.control.job                | retrieve                  | [job] retrieve thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:55,247 | WARNING  | pilot.control.monitor            | control                   | aborting monitor loop since graceful_stop has been set
[2023-01-13 02:51:07] 2023-01-13 01:50:55,247 | INFO     | pilot.control.monitor            | control                   | [monitor] control thread has ended
[2023-01-13 02:51:07] 2023-01-13 01:50:55,248 | WARNING  | pilot.util.common                | should_abort              | data:copytool_out:received graceful stop - abort after this iteration
[2023-01-13 02:51:07] 2023-01-13 01:50:55,396 | DEBUG    | pilot.control.payload            | execute_payloads          | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:55,396 | INFO     | pilot.control.payload            | execute_payloads          | [payload] execute_payloads thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:55,886 | DEBUG    | pilot.control.payload            | control                   | payload control ending since graceful_stop has been set
[2023-01-13 02:51:07] 2023-01-13 01:50:55,887 | DEBUG    | pilot.control.payload            | control                   | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:55,887 | INFO     | pilot.control.payload            | control                   | [payload] control thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:55,971 | DEBUG    | pilot.control.job                | create_data_payload       | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:55,971 | INFO     | pilot.control.job                | create_data_payload       | [job] create_data_payload thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:55,971 | DEBUG    | pilot.control.payload            | validate_pre              | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:55,971 | INFO     | pilot.control.payload            | validate_pre              | [payload] validate_pre thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:55,971 | DEBUG    | pilot.control.job                | validate                  | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:55,971 | INFO     | pilot.control.job                | validate                  | [job] validate thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:55,972 | DEBUG    | pilot.control.data               | copytool_in               | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:55,972 | INFO     | pilot.control.data               | copytool_in               | [data] copytool_in thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:56,058 | DEBUG    | pilot.control.payload            | validate_post             | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:56,059 | INFO     | pilot.control.payload            | validate_post             | [payload] validate_post thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:56,070 | DEBUG    | pilot.control.data               | control                   | data control ending since graceful_stop has been set
[2023-01-13 02:51:07] 2023-01-13 01:50:56,070 | DEBUG    | pilot.control.data               | control                   | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:56,071 | INFO     | pilot.control.data               | control                   | [data] control thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:56,143 | DEBUG    | pilot.control.payload            | failed_post               | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:56,143 | INFO     | pilot.control.payload            | failed_post               | [payload] failed_post thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:56,248 | DEBUG    | pilot.control.data               | copytool_out              | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:56,248 | INFO     | pilot.control.data               | copytool_out              | [data] copytool_out thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:56,581 | DEBUG    | pilot.control.job                | control                   | job control ending since graceful_stop has been set
[2023-01-13 02:51:07] 2023-01-13 01:50:56,581 | DEBUG    | pilot.control.job                | control                   | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:56,581 | INFO     | pilot.control.job                | control                   | [job] control thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:57,572 | WARNING  | pilot.util.common                | should_abort              | job:queue_monitor:received graceful stop - abort after this iteration
[2023-01-13 02:51:07] 2023-01-13 01:50:57,573 | DEBUG    | pilot.control.job                | queue_monitor             | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:50:57,573 | INFO     | pilot.control.job                | queue_monitor             | [job] queue monitor thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:50:58,491 | WARNING  | pilot.util.common                | should_abort              | data:queue_monitoring:received graceful stop - abort after this iteration
[2023-01-13 02:51:07] 2023-01-13 01:51:01,493 | DEBUG    | pilot.control.data               | queue_monitoring          | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:51:01,493 | INFO     | pilot.control.data               | queue_monitoring          | [data] queue_monitor thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:51:06,906 | INFO     | pilot.control.payload            | get_logging_info          | job.realtimelogging is not enabled
[2023-01-13 02:51:07] 2023-01-13 01:51:06,906 | DEBUG    | pilot.control.payload            | run_realtimelog           | real-time logging not needed at this point
[2023-01-13 02:51:07] 2023-01-13 01:51:06,906 | DEBUG    | pilot.control.payload            | run_realtimelog           | realtime logger was not found, waiting ..
[2023-01-13 02:51:07] 2023-01-13 01:51:06,906 | DEBUG    | pilot.control.payload            | run_realtimelog           | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:51:06,906 | INFO     | pilot.control.payload            | run_realtimelog           | [payload] run_realtimelog thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:51:07,419 | WARNING  | pilot.control.job                | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 73 s)
[2023-01-13 02:51:07] 2023-01-13 01:51:07,419 | DEBUG    | pilot.control.job                | job_monitor               | will not set job_aborted yet
[2023-01-13 02:51:07] 2023-01-13 01:51:07,419 | INFO     | pilot.control.job                | job_monitor               | [job] job monitor thread has finished
[2023-01-13 02:51:07] 2023-01-13 01:51:07,778 | DEBUG    | pilot.util.processes             | threads_aborted           | aborting since only the main Pilot thread is still running (total thread count=1 with 0 daemon threa
[2023-01-13 02:51:07] 2023-01-13 01:51:07,778 | DEBUG    | pilot.workflow.generic           | run                       | all relevant threads have aborted (thread count=1)
[2023-01-13 02:51:07] 2023-01-13 01:51:07,778 | INFO     | pilot.workflow.generic           | run                       | end of generic workflow (traces error code: 0)
[2023-01-13 02:51:07] 2023-01-13 01:51:07,778 | INFO     | root                             | wrap_up                   | traces error code: 0
[2023-01-13 02:51:07] 2023-01-13 01:51:07,778 | INFO     | root                             | wrap_up                   | pilot has finished
[2023-01-13 02:51:07] 2023-01-13 01:51:07,826 [wrapper] ==== pilot stdout END ====
[2023-01-13 02:51:07] 2023-01-13 01:51:07,827 [wrapper] ==== wrapper stdout RESUME ====
[2023-01-13 02:51:07] 2023-01-13 01:51:07,828 [wrapper] pilotpid: 1270314
[2023-01-13 02:51:07] 2023-01-13 01:51:07,829 [wrapper] Pilot exit status: 0
[2023-01-13 02:51:07] 2023-01-13 01:51:07,838 [wrapper] pandaids: 5717826802
[2023-01-13 02:51:07] 2023-01-13 01:51:07,840 [wrapper] apfmon messages muted
[2023-01-13 02:51:07] 2023-01-13 01:51:07,841 [wrapper] Test setup, not cleaning
[2023-01-13 02:51:07] 2023-01-13 01:51:07,842 [wrapper] ==== wrapper stdout END ====
[2023-01-13 02:51:07] 2023-01-13 01:51:07,843 [wrapper] ==== wrapper stderr END ====
[2023-01-13 02:51:07] 2023-01-13 01:51:07,845 [wrapper] wrapperexiting ec=0, duration=726
[2023-01-13 02:51:07] 2023-01-13 01:51:07,846 [wrapper] apfmon messages muted
[2023-01-13 02:51:07]  *** Error codes and diagnostics ***
[2023-01-13 02:51:07]     "exeErrorCode": 0,
[2023-01-13 02:51:07]     "exeErrorDiag": "",
[2023-01-13 02:51:07]     "pilotErrorCode": 0,
[2023-01-13 02:51:07]     "pilotErrorDiag": "",
[2023-01-13 02:51:07]  *** Listing of results directory ***
[2023-01-13 02:51:07] insgesamt 52284
[2023-01-13 02:51:07] -rwx------. 1 boinc boinc    26316 13. Jan 01:24 runpilot2-wrapper.sh
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     4540 13. Jan 01:24 queuedata.json
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  3192978 13. Jan 01:24 pilot3.tar.gz
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc      107 13. Jan 02:38 wrapper_26015_x86_64-pc-linux-gnu
[2023-01-13 02:51:07] -rwxr-xr-x. 1 boinc boinc     8273 13. Jan 02:38 run_atlas
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc      112 13. Jan 02:38 job.xml
[2023-01-13 02:51:07] -rw-r--r--. 2 boinc boinc 37595586 13. Jan 02:38 EVNT.04972714._000034.pool.root.1
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     6197 13. Jan 02:38 init_data.xml
[2023-01-13 02:51:07] -rw-r--r--. 2 boinc boinc    17790 13. Jan 02:38 start_atlas.sh
[2023-01-13 02:51:07] drwxrwx--x. 2 boinc boinc       68 13. Jan 02:38 shared
[2023-01-13 02:51:07] -rw-r--r--. 2 boinc boinc  3196847 13. Jan 02:38 input.tar.gz
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc        0 13. Jan 02:38 boinc_lockfile
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     2651 13. Jan 02:39 pandaJob.out
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc      464 13. Jan 02:39 setup.sh.local
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  1036019 13. Jan 02:39 agis_schedconf.cvmfs.json
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  1704033 13. Jan 02:39 agis_ddmendpoints.agis.ALL.json
[2023-01-13 02:51:07] drwx------. 5 boinc boinc     4096 13. Jan 02:39 pilot3
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  2927646 13. Jan 02:50 output.1.a51b0270-613a-4b1d-834a-91847c521455_92332.pool.root
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc       24 13. Jan 02:50 wrapper_checkpoint.txt
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc      532 13. Jan 02:50 boinc_task_state.xml
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc     1009 13. Jan 02:50 memory_monitor_summary.json
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc   157562 13. Jan 02:50 a51b0270-613a-4b1d-834a-91847c521455_92332.1.job.log.tgz
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc     7668 13. Jan 02:50 heartbeat.json
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc     9041 13. Jan 02:51 pilotlog.txt
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc   206968 13. Jan 02:51 a51b0270-613a-4b1d-834a-91847c521455_92332.1.job.log
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc      464 13. Jan 02:51 output.list
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc    10936 13. Jan 02:51 runtime_log.err
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc      748 13. Jan 02:51 runtime_log
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  3307520 13. Jan 02:51 result.tar.gz
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc      627 13. Jan 02:51 g2hLDmH3Ma2n7Olcko1bjSoqABFKDmABFKDmgZyRDm9ILKDmB30wmn.diag
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc    31269 13. Jan 02:51 stderr.txt
[2023-01-13 02:51:07] -rw-r--r--. 1 boinc boinc     8192 13. Jan 02:51 boinc_mmap_file
[2023-01-13 02:51:07] HITS file was successfully produced:
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc 2927646 13. Jan 02:50 shared/HITS.pool.root.1
[2023-01-13 02:51:07]  *** Contents of shared directory: ***
[2023-01-13 02:51:07] insgesamt 45952
[2023-01-13 02:51:07] -rw-r--r--. 2 boinc boinc 37595586 13. Jan 02:38 ATLAS.root_0
[2023-01-13 02:51:07] -rw-r--r--. 2 boinc boinc    17790 13. Jan 02:38 start_atlas.sh
[2023-01-13 02:51:07] -rw-r--r--. 2 boinc boinc  3196847 13. Jan 02:38 input.tar.gz
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  2927646 13. Jan 02:50 HITS.pool.root.1
[2023-01-13 02:51:07] -rw-------. 1 boinc boinc  3307520 13. Jan 02:51 result.tar.gz
02:51:09 (1265257): run_atlas exited; CPU time 612.965365
02:51:09 (1265257): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN