Name | KvGKDmdgrt2n7Olcko1bjSoqABFKDmABFKDm7AsVDmYnFKDmkZq6Jm_0 |
Workunit | 2284901 |
Created | 7 Mar 2023, 18:57:56 UTC |
Sent | 7 Mar 2023, 18:58:43 UTC |
Report deadline | 14 Mar 2023, 18:58:43 UTC |
Received | 7 Mar 2023, 19:22:23 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 4351 |
Run time | 23 min 15 sec |
CPU time | 18 min 30 sec |
Validate state | Valid |
Credit | 8.31 |
Device peak FLOPS | 2.57 GFLOPS |
Application version | ATLAS Simulation v3.00 (native_mt) x86_64-pc-linux-gnu |
Peak working set size | 1.50 GB |
Peak swap size | 2.12 GB |
Peak disk usage | 83.78 MB |
<core_client_version>7.20.2</core_client_version> <![CDATA[ <stderr_txt> 19:58:54 (135385): wrapper (7.7.26015): starting 19:58:54 (135385): wrapper: running run_atlas (--nthreads 1) [2023-03-07 19:58:54] Arguments: --nthreads 1 [2023-03-07 19:58:54] Threads: 1 [2023-03-07 19:58:54] Checking for CVMFS [2023-03-07 19:59:21] Probing /cvmfs/atlas.cern.ch... OK [2023-03-07 19:59:33] Probing /cvmfs/atlas-condb.cern.ch... OK [2023-03-07 19:59:33] Running cvmfs_config stat atlas.cern.ch [2023-03-07 19:59:33] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE [2023-03-07 19:59:33] 2.10.1.0 135617 0 29488 116464 3 1 2220061 4096000 0 130560 0 0 0.000 851 143 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://128.142.161.84:3126 1 [2023-03-07 19:59:33] CVMFS is ok [2023-03-07 19:59:33] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 [2023-03-07 19:59:33] Checking for apptainer binary... [2023-03-07 19:59:33] Using apptainer found in PATH at /usr/bin/apptainer [2023-03-07 19:59:33] Running /usr/bin/apptainer --version [2023-03-07 19:59:33] apptainer version 1.1.6-1.el8 [2023-03-07 19:59:33] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname [2023-03-07 19:59:34] fx8s [2023-03-07 19:59:34] apptainer works [2023-03-07 20:00:24] Starting ATLAS job with PandaID=5776719065 [2023-03-07 20:00:24] Try creating a directory in /tmp [2023-03-07 20:00:24] /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 mktemp /tmp/tmp.XXXXX [2023-03-07 20:00:24] /usr/bin/mktemp: failed to create file via template '/tmp/tmp.XXXXX': Read-only file system [2023-03-07 20:00:24] mktemp /tmp failed [2023-03-07 20:00:24] Try creating a directory in /var/tmp [2023-03-07 20:00:24] /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 mktemp /var/tmp/tmp.XXXXX [2023-03-07 20:00:24] /usr/bin/mktemp: failed to create file via template '/var/tmp/tmp.XXXXX': Read-only file system [2023-03-07 20:00:24] mktemp /var/tmp failed [2023-03-07 20:00:24] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh [2023-03-07 20:22:07] *** The last 200 lines of the pilot log: *** [2023-03-07 20:22:07] 2023-03-07 19:21:50,616 | DEBUG | pilot.user.atlas.jobmetrics | get_job_metrics_string | job definition core count: 1 [2023-03-07 20:22:07] 2023-03-07 19:21:50,616 | INFO | pilot.util.features | __init__ | collecting machine features [2023-03-07 20:22:07] 2023-03-07 19:21:50,616 | INFO | pilot.util.features | set | machine features path does not exist (path="") [2023-03-07 20:22:07] 2023-03-07 19:21:50,616 | INFO | pilot.util.features | __init__ | collecting job features [2023-03-07 20:22:07] 2023-03-07 19:21:50,616 | INFO | pilot.util.features | set | job features path does not exist (path="") [2023-03-07 20:22:07] 2023-03-07 19:21:50,617 | DEBUG | pilot.api.analytics | get_fitted_data | removing tails from data to be fitted [2023-03-07 20:22:07] 2023-03-07 19:21:50,617 | INFO | pilot.api.analytics | get_fitted_data | fitting pss+swap vs Time [2023-03-07 20:22:07] 2023-03-07 19:21:50,617 | INFO | pilot.api.analytics | get_fitted_data | current memory leak: -228.72 B/s (using 13 data points, chi2=0.01) [2023-03-07 20:22:07] 2023-03-07 19:21:50,618 | DEBUG | pilot.user.atlas.jobmetrics | get_job_metrics | job metrics="actualCoreCount=0.89 nEvents=2 dbTime=5.48 dbData=4274626 workDirSize=849579 leak=-228. [2023-03-07 20:22:07] 2023-03-07 19:21:50,618 | INFO | pilot.control.job | get_data_structure | total number of processed events: 2 (read) [2023-03-07 20:22:07] 2023-03-07 19:21:50,619 | INFO | pilot.util.container | print_executable | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo [2023-03-07 20:22:07] 2023-03-07 19:21:50,647 | INFO | pilot.user.atlas.utilities | get_memory_values | using path: /var/lib/boinc/slots/0/PanDA_Pilot-5776719065/memory_monitor_summary.json (trf name=prmo [2023-03-07 20:22:07] 2023-03-07 19:21:50,649 | DEBUG | pilot.user.atlas.utilities | get_memory_monitor_info | summary_dictionary={'Avg': {'nprocs': 5.0, 'nthreads': 5.95, 'pss': 1435693.0, 'rchar': 51629134.0, [2023-03-07 20:22:07] 2023-03-07 19:21:50,649 | INFO | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard info from prmon json [2023-03-07 20:22:07] 2023-03-07 19:21:50,649 | INFO | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard memory fields from prmon json [2023-03-07 20:22:07] 2023-03-07 19:21:50,649 | INFO | pilot.util.timing | timing_report | .............................. [2023-03-07 20:22:07] 2023-03-07 19:21:50,650 | INFO | pilot.util.timing | timing_report | . Timing measurements: [2023-03-07 20:22:07] 2023-03-07 19:21:50,650 | INFO | pilot.util.timing | timing_report | . get job = 0 s [2023-03-07 20:22:07] 2023-03-07 19:21:50,650 | INFO | pilot.util.timing | timing_report | . initial setup = 2 s [2023-03-07 20:22:07] 2023-03-07 19:21:50,650 | INFO | pilot.util.timing | timing_report | . payload setup = 10 s [2023-03-07 20:22:07] 2023-03-07 19:21:50,650 | INFO | pilot.util.timing | timing_report | . stage-in = 0 s [2023-03-07 20:22:07] 2023-03-07 19:21:50,650 | INFO | pilot.util.timing | timing_report | . payload execution = 1203 s [2023-03-07 20:22:07] 2023-03-07 19:21:50,650 | INFO | pilot.util.timing | timing_report | . stage-out = 0 s [2023-03-07 20:22:07] 2023-03-07 19:21:50,650 | INFO | pilot.util.timing | timing_report | .............................. [2023-03-07 20:22:07] 2023-03-07 19:21:50,650 | DEBUG | pilot.control.job | send_state | data={'jobId': '5776719065', 'state': 'finished', 'timestamp': '2023-03-07T20:21:50+01:00', 'siteNam [2023-03-07 20:22:07] 2023-03-07 19:21:50,651 | DEBUG | pilot.control.job | write_heartbeat_to_file | heartbeat dictionary: {'jobId': '5776719065', 'state': 'finished', 'timestamp': '2023-03-07T20:21:50 [2023-03-07 20:22:07] 2023-03-07 19:21:50,651 | DEBUG | pilot.control.job | write_heartbeat_to_file | wrote heartbeat to file: /var/lib/boinc/slots/0/heartbeat.json [2023-03-07 20:22:07] 2023-03-07 19:21:50,900 | INFO | pilot.control.job | make_job_report | [2023-03-07 20:22:07] 2023-03-07 19:21:50,900 | INFO | pilot.control.job | make_job_report | job summary report [2023-03-07 20:22:07] 2023-03-07 19:21:50,900 | INFO | pilot.control.job | make_job_report | -------------------------------------------------- [2023-03-07 20:22:07] 2023-03-07 19:21:50,900 | INFO | pilot.control.job | make_job_report | PanDA job id: 5776719065 [2023-03-07 20:22:07] 2023-03-07 19:21:50,900 | INFO | pilot.control.job | make_job_report | task id: NULL [2023-03-07 20:22:07] 2023-03-07 19:21:50,900 | INFO | pilot.control.job | make_job_report | errors: (none) [2023-03-07 20:22:07] 2023-03-07 19:21:50,900 | INFO | pilot.control.job | make_job_report | status: LOG_TRANSFER = DONE [2023-03-07 20:22:07] 2023-03-07 19:21:50,900 | INFO | pilot.control.job | make_job_report | pilot state: finished [2023-03-07 20:22:07] 2023-03-07 19:21:50,900 | INFO | pilot.control.job | make_job_report | transexitcode: 0 [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | exeerrorcode: 0 [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | exeerrordiag: [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | exitcode: 0 [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | exitmsg: OK [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | cpuconsumptiontime: 1123 s [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | nevents: 2 [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | neventsw: 0 [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | pid: 144112 [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | pgrp: 144112 [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | corecount: 1 [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | event service: False [2023-03-07 20:22:07] 2023-03-07 19:21:50,901 | INFO | pilot.control.job | make_job_report | sizes: {0: 2538539, 1: 2538944, 1218: 2560660, 1219: 2569766, 1222: 2569932} [2023-03-07 20:22:07] 2023-03-07 19:21:50,902 | INFO | pilot.control.job | make_job_report | -------------------------------------------------- [2023-03-07 20:22:07] 2023-03-07 19:21:50,902 | INFO | pilot.control.job | make_job_report | [2023-03-07 20:22:07] 2023-03-07 19:21:50,902 | DEBUG | pilot.control.job | has_job_completed | ls -lF /var/lib/boinc/slots/0: [2023-03-07 20:22:07] [2023-03-07 20:22:07] 2023-03-07 19:21:50,902 | INFO | pilot.util.container | print_executable | executing command: ls -lF /var/lib/boinc/slots/0 [2023-03-07 20:22:07] 2023-03-07 19:21:50,927 | DEBUG | pilot.control.job | has_job_completed | total 44648 [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 254935 Mar 7 20:21 600521c9-fb72-4221-8389-c5ee9f58e5d2_33241.1.job.log [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 165815 Mar 7 20:21 600521c9-fb72-4221-8389-c5ee9f58e5d2_33241.1.job.log.tgz [2023-03-07 20:22:07] -rw-r--r--. 2 boinc boinc 39611081 Mar 7 19:58 EVNT.04972714._000022.pool.root.1 [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 127 Mar 7 20:00 KvGKDmdgrt2n7Olcko1bjSoqABFKDmABFKDm7AsVDmYnFKDmkZq6Jm.diag [2023-03-07 20:22:07] drwxrwx---. 2 boinc boinc 4096 Mar 7 20:21 PanDA_Pilot-5776719065/ [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 1705592 Mar 7 20:01 agis_ddmendpoints.agis.ALL.json [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 967906 Mar 7 20:01 agis_schedconf.cvmfs.json [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 0 Mar 7 19:58 boinc_lockfile [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 8192 Mar 7 20:21 boinc_mmap_file [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 534 Mar 7 20:21 boinc_task_state.xml [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 7315 Mar 7 20:21 heartbeat.json [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 6139 Mar 7 19:58 init_data.xml [2023-03-07 20:22:07] -rw-r--r--. 2 boinc boinc 408448 Mar 7 19:58 input.tar.gz [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 112 Mar 7 19:58 job.xml [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 1009 Mar 7 20:21 memory_monitor_summary.json [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 1569716 Mar 7 20:21 output.1.600521c9-fb72-4221-8389-c5ee9f58e5d2_33241.pool.root [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 464 Mar 7 20:21 output.list [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 2667 Mar 7 20:00 pandaJob.out [2023-03-07 20:22:07] drwx------. 4 boinc boinc 4096 Mar 7 20:01 pilot3/ [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 397653 Mar 7 19:57 pilot3.tar.gz [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 235191 Mar 7 20:21 pilotlog.txt [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 4239 Mar 7 19:55 queuedata.json [2023-03-07 20:22:07] -rwxr-xr-x. 1 boinc boinc 8343 Mar 7 19:58 run_atlas* [2023-03-07 20:22:07] -rwx------. 1 boinc boinc 26445 Mar 7 19:57 runpilot2-wrapper.sh* [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 407 Mar 7 20:00 runtime_log [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 7026 Mar 7 20:00 runtime_log.err [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 449 Mar 7 20:00 setup.sh.local [2023-03-07 20:22:07] drwxrwx--x. 2 boinc boinc 68 Mar 7 19:58 shared/ [2023-03-07 20:22:07] -rw-r--r--. 2 boinc boinc 17098 Mar 7 19:58 start_atlas.sh [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 2407 Mar 7 20:00 stderr.txt [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 107 Mar 7 19:58 wrapper_26015_x86_64-pc-linux-gnu [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 26 Mar 7 20:21 wrapper_checkpoint.txt [2023-03-07 20:22:07] 2023-03-07 19:21:50,927 | INFO | pilot.util.queuehandling | queue_report | queue jobs had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,927 | INFO | pilot.util.queuehandling | queue_report | queue payloads had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,927 | INFO | pilot.util.queuehandling | queue_report | queue data_in had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,927 | INFO | pilot.util.queuehandling | queue_report | queue data_out had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue current_data_in had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue validated_jobs had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue validated_payloads had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue monitored_payloads had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue finished_jobs had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue finished_payloads had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue finished_data_in had 1 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue finished_data_out had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue failed_jobs had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue failed_payloads had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,928 | INFO | pilot.util.queuehandling | queue_report | queue failed_data_in had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,929 | INFO | pilot.util.queuehandling | queue_report | queue failed_data_out had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,929 | INFO | pilot.util.queuehandling | queue_report | queue completed_jobs had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,929 | INFO | pilot.util.queuehandling | queue_report | queue completed_jobids has 1 job(s) [2023-03-07 20:22:07] 2023-03-07 19:21:50,929 | INFO | pilot.util.queuehandling | queue_report | queue realtimelog_payloads had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,929 | INFO | pilot.util.queuehandling | queue_report | queue messages had 0 job(s) [purged] [2023-03-07 20:22:07] 2023-03-07 19:21:50,929 | INFO | pilot.control.job | has_job_completed | job 5776719065 has completed (purged errors) [2023-03-07 20:22:07] 2023-03-07 19:21:50,929 | DEBUG | pilot.util.realtimelogger | cleanup | attempting real-time logger cleanup [2023-03-07 20:22:07] 2023-03-07 19:21:50,929 | INFO | pilot.util.processes | cleanup | overall cleanup function is called [2023-03-07 20:22:07] 2023-03-07 19:21:50,931 | DEBUG | pilot.util.processes | cleanup | work directory was removed: /var/lib/boinc/slots/0/PanDA_Pilot-5776719065 [2023-03-07 20:22:07] 2023-03-07 19:21:51,937 | INFO | pilot.info.jobdata | collect_zombies | --- collectZombieJob: --- 10, [144112] [2023-03-07 20:22:07] 2023-03-07 19:21:51,937 | INFO | pilot.info.jobdata | collect_zombies | zombie collector trying to kill pid 144112 [2023-03-07 20:22:07] 2023-03-07 19:21:51,937 | INFO | pilot.info.jobdata | collect_zombies | harmless exception when collecting zombies: [Errno 10] No child processes [2023-03-07 20:22:07] 2023-03-07 19:21:52,943 | INFO | pilot.util.processes | cleanup | collected zombie processes [2023-03-07 20:22:07] 2023-03-07 19:21:52,943 | INFO | pilot.util.processes | cleanup | will now attempt to kill all subprocesses of pid=144112 [2023-03-07 20:22:07] 2023-03-07 19:21:53,009 | INFO | pilot.util.processes | kill_processes | process IDs to be killed: [144112] (in reverse order) [2023-03-07 20:22:07] 2023-03-07 19:21:53,043 | WARNING | pilot.util.processes | kill_processes | found no corresponding commands to process id(s) [2023-03-07 20:22:07] 2023-03-07 19:21:53,044 | INFO | pilot.util.processes | kill_orphans | Do not look for orphan processes in BOINC jobs [2023-03-07 20:22:07] 2023-03-07 19:21:53,044 | DEBUG | pilot.util.queuehandling | purge_queue | queue purged [2023-03-07 20:22:07] 2023-03-07 19:21:53,044 | INFO | pilot.control.job | retrieve | ready for new job [2023-03-07 20:22:07] 2023-03-07 19:21:53,044 | INFO | root | retrieve | pilot has finished with previous job - re-establishing logging [2023-03-07 20:22:07] 2023-03-07 19:21:53,045 | INFO | pilot.util.auxiliary | pilot_version_banner | *************************************** [2023-03-07 20:22:07] 2023-03-07 19:21:53,045 | INFO | pilot.util.auxiliary | pilot_version_banner | *** PanDA Pilot version 3.5.1 (8) *** [2023-03-07 20:22:07] 2023-03-07 19:21:53,045 | INFO | pilot.util.auxiliary | pilot_version_banner | *************************************** [2023-03-07 20:22:07] 2023-03-07 19:21:53,045 | INFO | pilot.util.auxiliary | pilot_version_banner | [2023-03-07 20:22:07] 2023-03-07 19:21:53,046 | INFO | pilot.util.auxiliary | pilot_version_banner | pilot is running in a VM [2023-03-07 20:22:07] 2023-03-07 19:21:53,046 | INFO | pilot.util.auxiliary | display_architecture_info | architecture information: [2023-03-07 20:22:07] 2023-03-07 19:21:53,114 | INFO | pilot.util.auxiliary | display_architecture_info | [2023-03-07 20:22:07] LSB Version: :core-4.1-amd64:core-4.1-noarch [2023-03-07 20:22:07] Distributor ID: CentOS [2023-03-07 20:22:07] Description: CentOS Linux release 7.9.2009 (Core) [2023-03-07 20:22:07] Release: 7.9.2009 [2023-03-07 20:22:07] Codename: Core [2023-03-07 20:22:07] 2023-03-07 19:21:53,114 | INFO | pilot.util.auxiliary | pilot_version_banner | *************************************** [2023-03-07 20:22:07] 2023-03-07 19:21:53,617 | DEBUG | pilot.util.monitoring | check_local_space | checking local space on /var/lib/boinc/slots/0 [2023-03-07 20:22:07] 2023-03-07 19:21:53,618 | INFO | pilot.util.container | print_executable | executing command: df -mP /var/lib/boinc/slots/0 [2023-03-07 20:22:07] 2023-03-07 19:21:53,633 | DEBUG | pilot.util.workernode | get_local_disk_space | stdout=Filesystem 1048576-blocks Used Available Capacity Mounted on [2023-03-07 20:22:07] /dev/mapper/cl-root 45198 11140 34059 25% /var/lib/boinc/slots/0 [2023-03-07 20:22:07] 2023-03-07 19:21:53,633 | DEBUG | pilot.util.workernode | get_local_disk_space | stderr= [2023-03-07 20:22:07] 2023-03-07 19:21:53,634 | INFO | pilot.util.monitoring | check_local_space | sufficient remaining disk space (35713449984 B) [2023-03-07 20:22:07] 2023-03-07 19:21:53,634 | WARNING | pilot.control.job | proceed_with_getjob | since timefloor is set to 0, pilot was only allowed to run one job [2023-03-07 20:22:07] 2023-03-07 19:21:53,634 | DEBUG | pilot.control.job | retrieve | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:53,634 | INFO | pilot.control.job | retrieve | [job] retrieve thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:53,921 | DEBUG | pilot.control.job | validate | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:53,921 | INFO | pilot.control.job | validate | [job] validate thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:54,096 | WARNING | pilot.util.common | should_abort | data:copytool_out:received graceful stop - abort after this iteration [2023-03-07 20:22:07] 2023-03-07 19:21:54,140 | INFO | pilot.control.monitor | control | [monitor] control thread has ended [2023-03-07 20:22:07] 2023-03-07 19:21:54,174 | DEBUG | pilot.control.job | create_data_payload | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:54,174 | INFO | pilot.control.job | create_data_payload | [job] create_data_payload thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:54,394 | DEBUG | pilot.control.payload | execute_payloads | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:54,394 | INFO | pilot.control.payload | execute_payloads | [payload] execute_payloads thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:54,480 | DEBUG | pilot.control.job | control | job control ending since graceful_stop has been set [2023-03-07 20:22:07] 2023-03-07 19:21:54,481 | DEBUG | pilot.control.job | control | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:54,481 | INFO | pilot.control.job | control | [job] control thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:54,504 | DEBUG | pilot.control.payload | control | payload control ending since graceful_stop has been set [2023-03-07 20:22:07] 2023-03-07 19:21:54,504 | DEBUG | pilot.control.payload | control | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:54,504 | INFO | pilot.control.payload | control | [payload] control thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:54,578 | DEBUG | pilot.control.data | control | data control ending since graceful_stop has been set [2023-03-07 20:22:07] 2023-03-07 19:21:54,578 | DEBUG | pilot.control.data | control | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:54,579 | INFO | pilot.control.data | control | [data] control thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:54,621 | DEBUG | pilot.control.payload | validate_pre | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:54,621 | INFO | pilot.control.payload | validate_pre | [payload] validate_pre thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:54,717 | WARNING | pilot.util.common | should_abort | data:queue_monitoring:received graceful stop - abort after this iteration [2023-03-07 20:22:07] 2023-03-07 19:21:54,922 | DEBUG | pilot.control.data | copytool_in | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:54,922 | INFO | pilot.control.data | copytool_in | [data] copytool_in thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:55,032 | DEBUG | pilot.control.payload | validate_post | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:55,033 | INFO | pilot.control.payload | validate_post | [payload] validate_post thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:55,093 | DEBUG | pilot.control.payload | failed_post | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:55,093 | INFO | pilot.control.payload | failed_post | [payload] failed_post thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:55,097 | DEBUG | pilot.control.data | copytool_out | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:55,097 | INFO | pilot.control.data | copytool_out | [data] copytool_out thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:55,793 | WARNING | pilot.util.common | should_abort | job:queue_monitor:received graceful stop - abort after this iteration [2023-03-07 20:22:07] 2023-03-07 19:21:55,793 | DEBUG | pilot.control.job | queue_monitor | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:55,794 | INFO | pilot.control.job | queue_monitor | [job] queue monitor thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:55,818 | WARNING | pilot.control.job | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 73 s) [2023-03-07 20:22:07] 2023-03-07 19:21:55,819 | DEBUG | pilot.control.job | job_monitor | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:55,819 | INFO | pilot.control.job | job_monitor | [job] job monitor thread has finished [2023-03-07 20:22:07] 2023-03-07 19:21:57,720 | DEBUG | pilot.control.data | queue_monitoring | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:21:57,720 | INFO | pilot.control.data | queue_monitoring | [data] queue_monitor thread has finished [2023-03-07 20:22:07] 2023-03-07 19:22:07,217 | INFO | pilot.control.payload | get_logging_info | job.realtimelogging is not enabled [2023-03-07 20:22:07] 2023-03-07 19:22:07,217 | DEBUG | pilot.control.payload | run_realtimelog | real-time logging not needed at this point [2023-03-07 20:22:07] 2023-03-07 19:22:07,217 | DEBUG | pilot.control.payload | run_realtimelog | realtime logger was not found, waiting .. [2023-03-07 20:22:07] 2023-03-07 19:22:07,218 | DEBUG | pilot.control.payload | run_realtimelog | will not set job_aborted yet [2023-03-07 20:22:07] 2023-03-07 19:22:07,218 | INFO | pilot.control.payload | run_realtimelog | [payload] run_realtimelog thread has finished [2023-03-07 20:22:07] 2023-03-07 19:22:07,630 | DEBUG | pilot.util.processes | threads_aborted | aborting since only the main Pilot thread is still running (total thread count=1 with 0 daemon threa [2023-03-07 20:22:07] 2023-03-07 19:22:07,630 | DEBUG | pilot.workflow.generic | run | all relevant threads have aborted (thread count=1) [2023-03-07 20:22:07] 2023-03-07 19:22:07,630 | INFO | pilot.workflow.generic | run | end of generic workflow (traces error code: 0) [2023-03-07 20:22:07] 2023-03-07 19:22:07,631 | INFO | root | wrap_up | traces error code: 0 [2023-03-07 20:22:07] 2023-03-07 19:22:07,631 | INFO | root | wrap_up | pilot has finished [2023-03-07 20:22:07] 2023-03-07 19:22:07,705 [wrapper] ==== pilot stdout END ==== [2023-03-07 20:22:07] 2023-03-07 19:22:07,709 [wrapper] ==== wrapper stdout RESUME ==== [2023-03-07 20:22:07] 2023-03-07 19:22:07,712 [wrapper] pilotpid: 141050 [2023-03-07 20:22:07] 2023-03-07 19:22:07,715 [wrapper] Pilot exit status: 0 [2023-03-07 20:22:07] 2023-03-07 19:22:07,729 [wrapper] pandaids: 5776719065 [2023-03-07 20:22:07] 2023-03-07 19:22:07,736 [wrapper] apfmon messages muted [2023-03-07 20:22:07] 2023-03-07 19:22:07,739 [wrapper] Test setup, not cleaning [2023-03-07 20:22:07] 2023-03-07 19:22:07,742 [wrapper] ==== wrapper stdout END ==== [2023-03-07 20:22:07] 2023-03-07 19:22:07,745 [wrapper] ==== wrapper stderr END ==== [2023-03-07 20:22:07] 2023-03-07 19:22:07,750 [wrapper] wrapperexiting ec=0, duration=1303 [2023-03-07 20:22:07] 2023-03-07 19:22:07,753 [wrapper] apfmon messages muted [2023-03-07 20:22:07] *** Error codes and diagnostics *** [2023-03-07 20:22:07] "exeErrorCode": 0, [2023-03-07 20:22:07] "exeErrorDiag": "", [2023-03-07 20:22:07] "pilotErrorCode": 0, [2023-03-07 20:22:07] "pilotErrorDiag": "", [2023-03-07 20:22:07] *** Listing of results directory *** [2023-03-07 20:22:07] insgesamt 46232 [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 4239 7. Mär 19:55 queuedata.json [2023-03-07 20:22:07] -rwx------. 1 boinc boinc 26445 7. Mär 19:57 runpilot2-wrapper.sh [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 397653 7. Mär 19:57 pilot3.tar.gz [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 107 7. Mär 19:58 wrapper_26015_x86_64-pc-linux-gnu [2023-03-07 20:22:07] -rwxr-xr-x. 1 boinc boinc 8343 7. Mär 19:58 run_atlas [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 112 7. Mär 19:58 job.xml [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 6139 7. Mär 19:58 init_data.xml [2023-03-07 20:22:07] -rw-r--r--. 2 boinc boinc 39611081 7. Mär 19:58 EVNT.04972714._000022.pool.root.1 [2023-03-07 20:22:07] -rw-r--r--. 2 boinc boinc 17098 7. Mär 19:58 start_atlas.sh [2023-03-07 20:22:07] drwxrwx--x. 2 boinc boinc 68 7. Mär 19:58 shared [2023-03-07 20:22:07] -rw-r--r--. 2 boinc boinc 408448 7. Mär 19:58 input.tar.gz [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 0 7. Mär 19:58 boinc_lockfile [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 2667 7. Mär 20:00 pandaJob.out [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 449 7. Mär 20:00 setup.sh.local [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 967906 7. Mär 20:01 agis_schedconf.cvmfs.json [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 1705592 7. Mär 20:01 agis_ddmendpoints.agis.ALL.json [2023-03-07 20:22:07] drwx------. 4 boinc boinc 4096 7. Mär 20:01 pilot3 [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 1569716 7. Mär 20:21 output.1.600521c9-fb72-4221-8389-c5ee9f58e5d2_33241.pool.root [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 1009 7. Mär 20:21 memory_monitor_summary.json [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 165815 7. Mär 20:21 600521c9-fb72-4221-8389-c5ee9f58e5d2_33241.1.job.log.tgz [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 7315 7. Mär 20:21 heartbeat.json [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 8192 7. Mär 20:21 boinc_mmap_file [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 26 7. Mär 20:21 wrapper_checkpoint.txt [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 534 7. Mär 20:21 boinc_task_state.xml [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 8883 7. Mär 20:22 pilotlog.txt [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 271852 7. Mär 20:22 600521c9-fb72-4221-8389-c5ee9f58e5d2_33241.1.job.log [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 464 7. Mär 20:22 output.list [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 748 7. Mär 20:22 runtime_log [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 2027520 7. Mär 20:22 result.tar.gz [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 11125 7. Mär 20:22 runtime_log.err [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 626 7. Mär 20:22 KvGKDmdgrt2n7Olcko1bjSoqABFKDmABFKDm7AsVDmYnFKDmkZq6Jm.diag [2023-03-07 20:22:07] -rw-r--r--. 1 boinc boinc 31136 7. Mär 20:22 stderr.txt [2023-03-07 20:22:07] HITS file was successfully produced: [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 1569716 7. Mär 20:21 shared/HITS.pool.root.1 [2023-03-07 20:22:07] *** Contents of shared directory: *** [2023-03-07 20:22:07] insgesamt 42620 [2023-03-07 20:22:07] -rw-r--r--. 2 boinc boinc 39611081 7. Mär 19:58 ATLAS.root_0 [2023-03-07 20:22:07] -rw-r--r--. 2 boinc boinc 17098 7. Mär 19:58 start_atlas.sh [2023-03-07 20:22:07] -rw-r--r--. 2 boinc boinc 408448 7. Mär 19:58 input.tar.gz [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 1569716 7. Mär 20:21 HITS.pool.root.1 [2023-03-07 20:22:07] -rw-------. 1 boinc boinc 2027520 7. Mär 20:22 result.tar.gz 20:22:09 (135385): run_atlas exited; CPU time 1110.825386 20:22:09 (135385): called boinc_finish(0) </stderr_txt> ]]>
©2024 CERN