Name UkyKDmx3ev2n7Olcko1bjSoqABFKDmABFKDm7AsVDmoFGKDmYXZLkn_0
Workunit 2286428
Created 12 Mar 2023, 17:53:27 UTC
Sent 12 Mar 2023, 17:54:44 UTC
Report deadline 19 Mar 2023, 17:54:44 UTC
Received 12 Mar 2023, 18:30:15 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 4351
Run time 17 min 49 sec
CPU time 12 min 24 sec
Validate state Valid
Credit 12.13
Device peak FLOPS 2.95 GFLOPS
Application version ATLAS Simulation v3.00 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 1.58 GB
Peak swap size 2.12 GB
Peak disk usage 79.15 MB

Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
19:12:18 (160944): wrapper (7.7.26015): starting
19:12:18 (160944): wrapper: running run_atlas (--nthreads 1)
[2023-03-12 19:12:18] Arguments: --nthreads 1
[2023-03-12 19:12:18] Threads: 1
[2023-03-12 19:12:18] Checking for CVMFS
[2023-03-12 19:12:18] Probing /cvmfs/atlas.cern.ch... OK
[2023-03-12 19:12:33] Probing /cvmfs/atlas-condb.cern.ch... OK
[2023-03-12 19:12:33] Running cvmfs_config stat atlas.cern.ch
[2023-03-12 19:12:34] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2023-03-12 19:12:34] 2.10.1.0 47382 138 47184 116659 1 91 2827431 4096000 0 130560 0 413997 99.995 19851 91 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://128.142.161.84:3126 1
[2023-03-12 19:12:34] CVMFS is ok
[2023-03-12 19:12:34] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2023-03-12 19:12:34] Checking for apptainer binary...
[2023-03-12 19:12:34] Using apptainer found in PATH at /usr/bin/apptainer
[2023-03-12 19:12:34] Running /usr/bin/apptainer --version
[2023-03-12 19:12:34] apptainer version 1.1.6-1.el8
[2023-03-12 19:12:34] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2023-03-12 19:12:34] fx8s
[2023-03-12 19:12:34] apptainer works
[2023-03-12 19:13:24] Starting ATLAS job with PandaID=5781370245
[2023-03-12 19:13:24] Try creating a directory in /tmp
[2023-03-12 19:13:24] /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7  mktemp /tmp/tmp.XXXXX
[2023-03-12 19:13:24] /usr/bin/mktemp: failed to create file via template '/tmp/tmp.XXXXX': Read-only file system
[2023-03-12 19:13:24] mktemp /tmp failed
[2023-03-12 19:13:24] Try creating a directory in /var/tmp
[2023-03-12 19:13:24] /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7  mktemp /var/tmp/tmp.XXXXX
[2023-03-12 19:13:25] /usr/bin/mktemp: failed to create file via template '/var/tmp/tmp.XXXXX': Read-only file system
[2023-03-12 19:13:25] mktemp /var/tmp failed
[2023-03-12 19:13:25] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2023-03-12 19:30:04]  *** The last 200 lines of the pilot log: ***
[2023-03-12 19:30:04] Hypervisor vendor:     KVM
[2023-03-12 19:30:04] Virtualization type:   full
[2023-03-12 19:30:04] L1d cache:             16K
[2023-03-12 19:30:04] L1i cache:             64K
[2023-03-12 19:30:04] L2 cache:              2048K
[2023-03-12 19:30:04] L3 cache:              8192K
[2023-03-12 19:30:04] NUMA node0 CPU(s):     0
[2023-03-12 19:30:04] Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt rdtscp lm constant_tsc rep_good nopl nonstop_tsc 
[2023-03-12 19:30:04] 2023-03-12 18:29:28,748 | INFO     | pilot.util.workernode            | get_cpu_cores             | found 1 cores (1 cores per socket, 1 sockets)
[2023-03-12 19:30:04] 2023-03-12 18:29:28,748 | DEBUG    | pilot.util.workernode            | get_cpu_cores             | current model string: AMD FX-8370E Eight-Core Processor 2048 KB
[2023-03-12 19:30:04] 2023-03-12 18:29:28,748 | INFO     | pilot.util.container             | print_executable          | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2023-03-12 19:30:04] 2023-03-12 18:29:28,773 | INFO     | pilot.user.atlas.utilities       | get_memory_values         | using path: /var/lib/boinc/slots/0/PanDA_Pilot-5781370245/memory_monitor_summary.json (trf name=prmo
[2023-03-12 19:30:04] 2023-03-12 18:29:28,775 | DEBUG    | pilot.user.atlas.utilities       | get_memory_monitor_info   | summary_dictionary={'Avg': {'nprocs': 4.933, 'nthreads': 5.866, 'pss': 1435645.0, 'rchar': 68349034.
[2023-03-12 19:30:04] 2023-03-12 18:29:28,775 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard info from prmon json
[2023-03-12 19:30:04] 2023-03-12 18:29:28,775 | INFO     | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard memory fields from prmon json
[2023-03-12 19:30:04] 2023-03-12 18:29:28,775 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2023-03-12 19:30:04] 2023-03-12 18:29:28,775 | INFO     | pilot.util.timing                | timing_report             | . Timing measurements:
[2023-03-12 19:30:04] 2023-03-12 18:29:28,776 | INFO     | pilot.util.timing                | timing_report             | . get job = 0 s
[2023-03-12 19:30:04] 2023-03-12 18:29:28,776 | INFO     | pilot.util.timing                | timing_report             | . initial setup = 1 s
[2023-03-12 19:30:04] 2023-03-12 18:29:28,776 | INFO     | pilot.util.timing                | timing_report             | . payload setup = 9 s
[2023-03-12 19:30:04] 2023-03-12 18:29:28,776 | INFO     | pilot.util.timing                | timing_report             | . stage-in = 0 s
[2023-03-12 19:30:04] 2023-03-12 18:29:28,776 | INFO     | pilot.util.timing                | timing_report             | . payload execution = 879 s
[2023-03-12 19:30:04] 2023-03-12 18:29:28,776 | INFO     | pilot.util.timing                | timing_report             | . stage-out = 0 s
[2023-03-12 19:30:04] 2023-03-12 18:29:28,776 | INFO     | pilot.util.timing                | timing_report             | ..............................
[2023-03-12 19:30:04] 2023-03-12 18:29:28,777 | DEBUG    | pilot.control.job                | send_state                | data={'jobId': '5781370245', 'state': 'finished', 'timestamp': '2023-03-12T19:29:28+01:00', 'siteNam
[2023-03-12 19:30:04] 2023-03-12 18:29:28,777 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | heartbeat dictionary: {'jobId': '5781370245', 'state': 'finished', 'timestamp': '2023-03-12T19:29:28
[2023-03-12 19:30:04] 2023-03-12 18:29:28,778 | DEBUG    | pilot.control.job                | write_heartbeat_to_file   | wrote heartbeat to file: /var/lib/boinc/slots/0/heartbeat.json
[2023-03-12 19:30:04] 2023-03-12 18:29:28,901 | INFO     | pilot.control.job                | make_job_report           | 
[2023-03-12 19:30:04] 2023-03-12 18:29:28,901 | INFO     | pilot.control.job                | make_job_report           | job summary report
[2023-03-12 19:30:04] 2023-03-12 18:29:28,901 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2023-03-12 19:30:04] 2023-03-12 18:29:28,901 | INFO     | pilot.control.job                | make_job_report           | PanDA job id: 5781370245
[2023-03-12 19:30:04] 2023-03-12 18:29:28,901 | INFO     | pilot.control.job                | make_job_report           | task id: NULL
[2023-03-12 19:30:04] 2023-03-12 18:29:28,901 | INFO     | pilot.control.job                | make_job_report           | errors: (none)
[2023-03-12 19:30:04] 2023-03-12 18:29:28,901 | INFO     | pilot.control.job                | make_job_report           | status: LOG_TRANSFER = DONE 
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | pilot state: finished 
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | transexitcode: 0
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | exeerrorcode: 0
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | exeerrordiag: 
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | exitcode: 0
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | exitmsg: OK
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | cpuconsumptiontime: 756 s
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | nevents: 2
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | neventsw: 0
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | pid: 169382
[2023-03-12 19:30:04] 2023-03-12 18:29:28,902 | INFO     | pilot.control.job                | make_job_report           | pgrp: 169382
[2023-03-12 19:30:04] 2023-03-12 18:29:28,903 | INFO     | pilot.control.job                | make_job_report           | corecount: 1
[2023-03-12 19:30:04] 2023-03-12 18:29:28,903 | INFO     | pilot.control.job                | make_job_report           | event service: False
[2023-03-12 19:30:04] 2023-03-12 18:29:28,903 | INFO     | pilot.control.job                | make_job_report           | sizes: {0: 2536922, 1: 2537327, 892: 2557664, 894: 2566714, 897: 2566770, 899: 2566992}
[2023-03-12 19:30:04] 2023-03-12 18:29:28,903 | INFO     | pilot.control.job                | make_job_report           | --------------------------------------------------
[2023-03-12 19:30:04] 2023-03-12 18:29:28,903 | INFO     | pilot.control.job                | make_job_report           | 
[2023-03-12 19:30:04] 2023-03-12 18:29:28,903 | DEBUG    | pilot.control.job                | has_job_completed         | ls -lF /var/lib/boinc/slots/0:
[2023-03-12 19:30:04] 
[2023-03-12 19:30:04] 2023-03-12 18:29:28,903 | INFO     | pilot.util.container             | print_executable          | executing command: ls -lF /var/lib/boinc/slots/0
[2023-03-12 19:30:04] 2023-03-12 18:29:28,921 | DEBUG    | pilot.control.job                | has_job_completed         | total 42536
[2023-03-12 19:30:04] -rw-r--r--. 2 boinc boinc 37738636 Mar 12 19:12 EVNT.04972714._000024.pool.root.1
[2023-03-12 19:30:04] drwxrwx---. 2 boinc boinc     4096 Mar 12 19:29 PanDA_Pilot-5781370245/
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc      127 Mar 12 19:13 UkyKDmx3ev2n7Olcko1bjSoqABFKDmABFKDm7AsVDmoFGKDmYXZLkn.diag
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc   225535 Mar 12 19:29 a09e33f5-534f-4f86-963f-86001bff1d5c_73283.1.job.log
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc   162943 Mar 12 19:29 a09e33f5-534f-4f86-963f-86001bff1d5c_73283.1.job.log.tgz
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc  1704527 Mar 12 19:14 agis_ddmendpoints.agis.ALL.json
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc   969580 Mar 12 19:14 agis_schedconf.cvmfs.json
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc        0 Mar 12 19:12 boinc_lockfile
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     8192 Mar 12 19:29 boinc_mmap_file
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc      533 Mar 12 19:28 boinc_task_state.xml
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc     6575 Mar 12 19:29 heartbeat.json
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     6140 Mar 12 19:12 init_data.xml
[2023-03-12 19:30:04] -rw-r--r--. 2 boinc boinc   406245 Mar 12 19:12 input.tar.gz
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc      112 Mar 12 19:12 job.xml
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc     1010 Mar 12 19:29 memory_monitor_summary.json
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc  1421175 Mar 12 19:29 output.1.a09e33f5-534f-4f86-963f-86001bff1d5c_73283.pool.root
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc      464 Mar 12 19:29 output.list
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     2663 Mar 12 19:13 pandaJob.out
[2023-03-12 19:30:04] drwx------. 4 boinc boinc     4096 Mar 12 19:14 pilot3/
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc   395887 Mar 12 18:53 pilot3.tar.gz
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc   205728 Mar 12 19:29 pilotlog.txt
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     4239 Mar 12 18:53 queuedata.json
[2023-03-12 19:30:04] -rwxr-xr-x. 1 boinc boinc     8343 Mar 12 19:12 run_atlas*
[2023-03-12 19:30:04] -rwx------. 1 boinc boinc    26445 Mar 12 18:53 runpilot2-wrapper.sh*
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc      407 Mar 12 19:13 runtime_log
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     7026 Mar 12 19:13 runtime_log.err
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc      449 Mar 12 19:13 setup.sh.local
[2023-03-12 19:30:04] drwxrwx--x. 2 boinc boinc       68 Mar 12 19:12 shared/
[2023-03-12 19:30:04] -rw-r--r--. 2 boinc boinc    17098 Mar 12 19:12 start_atlas.sh
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     2416 Mar 12 19:13 stderr.txt
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc      107 Mar 12 19:12 wrapper_26015_x86_64-pc-linux-gnu
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc       25 Mar 12 19:28 wrapper_checkpoint.txt
[2023-03-12 19:30:04] 2023-03-12 18:29:28,922 | INFO     | pilot.util.queuehandling         | queue_report              | queue jobs had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,922 | INFO     | pilot.util.queuehandling         | queue_report              | queue payloads had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,922 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_in had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,922 | INFO     | pilot.util.queuehandling         | queue_report              | queue data_out had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,922 | INFO     | pilot.util.queuehandling         | queue_report              | queue current_data_in had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,922 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_jobs had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,922 | INFO     | pilot.util.queuehandling         | queue_report              | queue validated_payloads had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,922 | INFO     | pilot.util.queuehandling         | queue_report              | queue monitored_payloads had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,923 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_jobs had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,923 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_payloads had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,923 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_in had 1 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,923 | INFO     | pilot.util.queuehandling         | queue_report              | queue finished_data_out had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,923 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_jobs had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,923 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_payloads had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,923 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_in had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,924 | INFO     | pilot.util.queuehandling         | queue_report              | queue failed_data_out had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,924 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobs had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,924 | INFO     | pilot.util.queuehandling         | queue_report              | queue completed_jobids has 1 job(s)
[2023-03-12 19:30:04] 2023-03-12 18:29:28,924 | INFO     | pilot.util.queuehandling         | queue_report              | queue realtimelog_payloads had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,924 | INFO     | pilot.util.queuehandling         | queue_report              | queue messages had 0 job(s) [purged]
[2023-03-12 19:30:04] 2023-03-12 18:29:28,924 | INFO     | pilot.control.job                | has_job_completed         | job 5781370245 has completed (purged errors)
[2023-03-12 19:30:04] 2023-03-12 18:29:28,924 | DEBUG    | pilot.util.realtimelogger        | cleanup                   | attempting real-time logger cleanup
[2023-03-12 19:30:04] 2023-03-12 18:29:28,924 | INFO     | pilot.util.processes             | cleanup                   | overall cleanup function is called
[2023-03-12 19:30:04] 2023-03-12 18:29:28,927 | DEBUG    | pilot.util.processes             | cleanup                   | work directory was removed: /var/lib/boinc/slots/0/PanDA_Pilot-5781370245
[2023-03-12 19:30:04] 2023-03-12 18:29:29,932 | INFO     | pilot.info.jobdata               | collect_zombies           | --- collectZombieJob: --- 10, [169382]
[2023-03-12 19:30:04] 2023-03-12 18:29:29,932 | INFO     | pilot.info.jobdata               | collect_zombies           | zombie collector trying to kill pid 169382
[2023-03-12 19:30:04] 2023-03-12 18:29:29,932 | INFO     | pilot.info.jobdata               | collect_zombies           | harmless exception when collecting zombies: [Errno 10] No child processes
[2023-03-12 19:30:04] 2023-03-12 18:29:30,938 | INFO     | pilot.util.processes             | cleanup                   | collected zombie processes
[2023-03-12 19:30:04] 2023-03-12 18:29:30,938 | INFO     | pilot.util.processes             | cleanup                   | will now attempt to kill all subprocesses of pid=169382
[2023-03-12 19:30:04] 2023-03-12 18:29:30,999 | INFO     | pilot.util.processes             | kill_processes            | process IDs to be killed: [169382] (in reverse order)
[2023-03-12 19:30:04] 2023-03-12 18:29:31,031 | WARNING  | pilot.util.processes             | kill_processes            | found no corresponding commands to process id(s)
[2023-03-12 19:30:04] 2023-03-12 18:29:31,031 | INFO     | pilot.util.processes             | kill_orphans              | Do not look for orphan processes in BOINC jobs
[2023-03-12 19:30:04] 2023-03-12 18:29:31,031 | DEBUG    | pilot.util.queuehandling         | purge_queue               | queue purged
[2023-03-12 19:30:04] 2023-03-12 18:29:31,031 | INFO     | pilot.control.job                | retrieve                  | ready for new job
[2023-03-12 19:30:04] 2023-03-12 18:29:31,032 | INFO     | root                             | retrieve                  | pilot has finished with previous job - re-establishing logging
[2023-03-12 19:30:04] 2023-03-12 18:29:31,033 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2023-03-12 19:30:04] 2023-03-12 18:29:31,033 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ***  PanDA Pilot version 3.5.1 (14)  ***
[2023-03-12 19:30:04] 2023-03-12 18:29:31,033 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2023-03-12 19:30:04] 2023-03-12 18:29:31,033 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | 
[2023-03-12 19:30:04] 2023-03-12 18:29:31,033 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | pilot is running in a VM
[2023-03-12 19:30:04] 2023-03-12 18:29:31,033 | INFO     | pilot.util.auxiliary             | display_architecture_info | architecture information:
[2023-03-12 19:30:04] 2023-03-12 18:29:31,101 | INFO     | pilot.util.auxiliary             | display_architecture_info | 
[2023-03-12 19:30:04] LSB Version:	:core-4.1-amd64:core-4.1-noarch
[2023-03-12 19:30:04] Distributor ID:	CentOS
[2023-03-12 19:30:04] Description:	CentOS Linux release 7.9.2009 (Core)
[2023-03-12 19:30:04] Release:	7.9.2009
[2023-03-12 19:30:04] Codename:	Core
[2023-03-12 19:30:04] 2023-03-12 18:29:31,101 | INFO     | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
[2023-03-12 19:30:04] 2023-03-12 18:29:31,604 | DEBUG    | pilot.util.monitoring            | check_local_space         | checking local space on /var/lib/boinc/slots/0
[2023-03-12 19:30:04] 2023-03-12 18:29:31,604 | INFO     | pilot.util.container             | print_executable          | executing command: df -mP /var/lib/boinc/slots/0
[2023-03-12 19:30:04] 2023-03-12 18:29:31,618 | DEBUG    | pilot.util.workernode            | get_local_disk_space      | stdout=Filesystem          1048576-blocks  Used Available Capacity Mounted on
[2023-03-12 19:30:04] /dev/mapper/cl-root          45198 11747     33452      26% /var/lib/boinc/slots/0
[2023-03-12 19:30:04] 2023-03-12 18:29:31,618 | DEBUG    | pilot.util.workernode            | get_local_disk_space      | stderr=
[2023-03-12 19:30:04] 2023-03-12 18:29:31,618 | INFO     | pilot.util.monitoring            | check_local_space         | sufficient remaining disk space (35076964352 B)
[2023-03-12 19:30:04] 2023-03-12 18:29:31,618 | WARNING  | pilot.control.job                | proceed_with_getjob       | since timefloor is set to 0, pilot was only allowed to run one job
[2023-03-12 19:30:04] 2023-03-12 18:29:31,619 | DEBUG    | pilot.control.job                | retrieve                  | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:31,619 | INFO     | pilot.control.job                | retrieve                  | [job] retrieve thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:31,681 | DEBUG    | pilot.control.job                | control                   | job control ending since graceful_stop has been set
[2023-03-12 19:30:04] 2023-03-12 18:29:31,681 | DEBUG    | pilot.control.job                | control                   | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:31,681 | INFO     | pilot.control.job                | control                   | [job] control thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:31,734 | INFO     | pilot.control.monitor            | control                   | [monitor] control thread has ended
[2023-03-12 19:30:04] 2023-03-12 18:29:31,813 | DEBUG    | pilot.control.payload            | validate_post             | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:31,813 | INFO     | pilot.control.payload            | validate_post             | [payload] validate_post thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:31,860 | DEBUG    | pilot.control.payload            | failed_post               | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:31,860 | INFO     | pilot.control.payload            | failed_post               | [payload] failed_post thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:32,014 | WARNING  | pilot.util.common                | should_abort              | data:copytool_out:received graceful stop - abort after this iteration
[2023-03-12 19:30:04] 2023-03-12 18:29:32,221 | DEBUG    | pilot.control.data               | control                   | data control ending since graceful_stop has been set
[2023-03-12 19:30:04] 2023-03-12 18:29:32,221 | DEBUG    | pilot.control.data               | control                   | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:32,221 | INFO     | pilot.control.data               | control                   | [data] control thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:32,231 | DEBUG    | pilot.control.job                | create_data_payload       | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:32,231 | INFO     | pilot.control.job                | create_data_payload       | [job] create_data_payload thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:32,532 | DEBUG    | pilot.control.payload            | execute_payloads          | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:32,533 | INFO     | pilot.control.payload            | execute_payloads          | [payload] execute_payloads thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:32,605 | DEBUG    | pilot.control.data               | copytool_in               | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:32,605 | INFO     | pilot.control.data               | copytool_in               | [data] copytool_in thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:32,605 | DEBUG    | pilot.control.payload            | validate_pre              | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:32,605 | INFO     | pilot.control.payload            | validate_pre              | [payload] validate_pre thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:32,687 | DEBUG    | pilot.control.payload            | control                   | payload control ending since graceful_stop has been set
[2023-03-12 19:30:04] 2023-03-12 18:29:32,687 | DEBUG    | pilot.control.payload            | control                   | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:32,687 | INFO     | pilot.control.payload            | control                   | [payload] control thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:33,015 | DEBUG    | pilot.control.data               | copytool_out              | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:33,015 | INFO     | pilot.control.data               | copytool_out              | [data] copytool_out thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:33,099 | DEBUG    | pilot.control.job                | validate                  | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:33,099 | INFO     | pilot.control.job                | validate                  | [job] validate thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:33,170 | WARNING  | pilot.util.common                | should_abort              | data:queue_monitoring:received graceful stop - abort after this iteration
[2023-03-12 19:30:04] 2023-03-12 18:29:33,915 | WARNING  | pilot.util.common                | should_abort              | job:queue_monitor:received graceful stop - abort after this iteration
[2023-03-12 19:30:04] 2023-03-12 18:29:33,915 | DEBUG    | pilot.control.job                | queue_monitor             | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:33,915 | INFO     | pilot.control.job                | queue_monitor             | [job] queue monitor thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:36,173 | DEBUG    | pilot.control.data               | queue_monitoring          | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:36,173 | INFO     | pilot.control.data               | queue_monitoring          | [data] queue_monitor thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:29:42,086 | INFO     | pilot.control.payload            | get_logging_info          | job.realtimelogging is not enabled
[2023-03-12 19:30:04] 2023-03-12 18:29:42,087 | DEBUG    | pilot.control.payload            | run_realtimelog           | real-time logging not needed at this point
[2023-03-12 19:30:04] 2023-03-12 18:29:42,087 | DEBUG    | pilot.control.payload            | run_realtimelog           | realtime logger was not found, waiting ..
[2023-03-12 19:30:04] 2023-03-12 18:29:42,087 | DEBUG    | pilot.control.payload            | run_realtimelog           | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:29:42,087 | INFO     | pilot.control.payload            | run_realtimelog           | [payload] run_realtimelog thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:30:04,637 | WARNING  | pilot.control.job                | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 73 s)
[2023-03-12 19:30:04] 2023-03-12 18:30:04,638 | DEBUG    | pilot.control.job                | job_monitor               | will not set job_aborted yet
[2023-03-12 19:30:04] 2023-03-12 18:30:04,638 | INFO     | pilot.control.job                | job_monitor               | [job] job monitor thread has finished
[2023-03-12 19:30:04] 2023-03-12 18:30:04,704 | DEBUG    | pilot.util.processes             | threads_aborted           | aborting since only the main Pilot thread is still running (total thread count=1 with 0 daemon threa
[2023-03-12 19:30:04] 2023-03-12 18:30:04,704 | DEBUG    | pilot.workflow.generic           | run                       | all relevant threads have aborted (thread count=1)
[2023-03-12 19:30:04] 2023-03-12 18:30:04,704 | INFO     | pilot.workflow.generic           | run                       | end of generic workflow (traces error code: 0)
[2023-03-12 19:30:04] 2023-03-12 18:30:04,704 | INFO     | root                             | wrap_up                   | traces error code: 0
[2023-03-12 19:30:04] 2023-03-12 18:30:04,705 | INFO     | root                             | wrap_up                   | pilot has finished
[2023-03-12 19:30:04] 2023-03-12 18:30:04,779 [wrapper] ==== pilot stdout END ====
[2023-03-12 19:30:04] 2023-03-12 18:30:04,782 [wrapper] ==== wrapper stdout RESUME ====
[2023-03-12 19:30:04] 2023-03-12 18:30:04,785 [wrapper] pilotpid: 166330
[2023-03-12 19:30:04] 2023-03-12 18:30:04,788 [wrapper] Pilot exit status: 0
[2023-03-12 19:30:04] 2023-03-12 18:30:04,805 [wrapper] pandaids: 5781370245
[2023-03-12 19:30:04] 2023-03-12 18:30:04,811 [wrapper] apfmon messages muted
[2023-03-12 19:30:04] 2023-03-12 18:30:04,814 [wrapper] Test setup, not cleaning
[2023-03-12 19:30:04] 2023-03-12 18:30:04,817 [wrapper] ==== wrapper stdout END ====
[2023-03-12 19:30:04] 2023-03-12 18:30:04,820 [wrapper] ==== wrapper stderr END ====
[2023-03-12 19:30:04] 2023-03-12 18:30:04,826 [wrapper] wrapperexiting ec=0, duration=999
[2023-03-12 19:30:04] 2023-03-12 18:30:04,829 [wrapper] apfmon messages muted
[2023-03-12 19:30:04]  *** Error codes and diagnostics ***
[2023-03-12 19:30:04]     "exeErrorCode": 0,
[2023-03-12 19:30:04]     "exeErrorDiag": "",
[2023-03-12 19:30:04]     "pilotErrorCode": 0,
[2023-03-12 19:30:04]     "pilotErrorDiag": "",
[2023-03-12 19:30:04]  *** Listing of results directory ***
[2023-03-12 19:30:04] insgesamt 44040
[2023-03-12 19:30:04] -rwx------. 1 boinc boinc    26445 12. M&#195;&#164;r 18:53 runpilot2-wrapper.sh
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     4239 12. M&#195;&#164;r 18:53 queuedata.json
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc   395887 12. M&#195;&#164;r 18:53 pilot3.tar.gz
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc      107 12. M&#195;&#164;r 19:12 wrapper_26015_x86_64-pc-linux-gnu
[2023-03-12 19:30:04] -rwxr-xr-x. 1 boinc boinc     8343 12. M&#195;&#164;r 19:12 run_atlas
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc      112 12. M&#195;&#164;r 19:12 job.xml
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     6140 12. M&#195;&#164;r 19:12 init_data.xml
[2023-03-12 19:30:04] -rw-r--r--. 2 boinc boinc 37738636 12. M&#195;&#164;r 19:12 EVNT.04972714._000024.pool.root.1
[2023-03-12 19:30:04] -rw-r--r--. 2 boinc boinc    17098 12. M&#195;&#164;r 19:12 start_atlas.sh
[2023-03-12 19:30:04] drwxrwx--x. 2 boinc boinc       68 12. M&#195;&#164;r 19:12 shared
[2023-03-12 19:30:04] -rw-r--r--. 2 boinc boinc   406245 12. M&#195;&#164;r 19:12 input.tar.gz
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc        0 12. M&#195;&#164;r 19:12 boinc_lockfile
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     2663 12. M&#195;&#164;r 19:13 pandaJob.out
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc      449 12. M&#195;&#164;r 19:13 setup.sh.local
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc   969580 12. M&#195;&#164;r 19:14 agis_schedconf.cvmfs.json
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc  1704527 12. M&#195;&#164;r 19:14 agis_ddmendpoints.agis.ALL.json
[2023-03-12 19:30:04] drwx------. 4 boinc boinc     4096 12. M&#195;&#164;r 19:14 pilot3
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc  1421175 12. M&#195;&#164;r 19:29 output.1.a09e33f5-534f-4f86-963f-86001bff1d5c_73283.pool.root
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc     1010 12. M&#195;&#164;r 19:29 memory_monitor_summary.json
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc   162943 12. M&#195;&#164;r 19:29 a09e33f5-534f-4f86-963f-86001bff1d5c_73283.1.job.log.tgz
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc     6575 12. M&#195;&#164;r 19:29 heartbeat.json
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc      533 12. M&#195;&#164;r 19:29 boinc_task_state.xml
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc     8192 12. M&#195;&#164;r 19:29 boinc_mmap_file
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc       25 12. M&#195;&#164;r 19:29 wrapper_checkpoint.txt
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc     8887 12. M&#195;&#164;r 19:30 pilotlog.txt
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc   242455 12. M&#195;&#164;r 19:30 a09e33f5-534f-4f86-963f-86001bff1d5c_73283.1.job.log
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc      464 12. M&#195;&#164;r 19:30 output.list
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc      748 12. M&#195;&#164;r 19:30 runtime_log
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc  1843200 12. M&#195;&#164;r 19:30 result.tar.gz
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc      623 12. M&#195;&#164;r 19:30 UkyKDmx3ev2n7Olcko1bjSoqABFKDmABFKDm7AsVDmoFGKDmYXZLkn.diag
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc    11124 12. M&#195;&#164;r 19:30 runtime_log.err
[2023-03-12 19:30:04] -rw-r--r--. 1 boinc boinc    30414 12. M&#195;&#164;r 19:30 stderr.txt
[2023-03-12 19:30:04] HITS file was successfully produced:
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc 1421175 12. M&#195;&#164;r 19:29 shared/HITS.pool.root.1
[2023-03-12 19:30:04]  *** Contents of shared directory: ***
[2023-03-12 19:30:04] insgesamt 40464
[2023-03-12 19:30:04] -rw-r--r--. 2 boinc boinc 37738636 12. M&#195;&#164;r 19:12 ATLAS.root_0
[2023-03-12 19:30:04] -rw-r--r--. 2 boinc boinc    17098 12. M&#195;&#164;r 19:12 start_atlas.sh
[2023-03-12 19:30:04] -rw-r--r--. 2 boinc boinc   406245 12. M&#195;&#164;r 19:12 input.tar.gz
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc  1421175 12. M&#195;&#164;r 19:29 HITS.pool.root.1
[2023-03-12 19:30:04] -rw-------. 1 boinc boinc  1843200 12. M&#195;&#164;r 19:30 result.tar.gz
19:30:06 (160944): run_atlas exited; CPU time 744.482473
19:30:06 (160944): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN