Name | 0P4LDmCOyb2n7Olcko1bjSoqABFKDmABFKDmgZyRDmEnLKDmxd1NRn_0 |
Workunit | 2272817 |
Created | 17 Jan 2023, 10:28:58 UTC |
Sent | 17 Jan 2023, 10:31:13 UTC |
Report deadline | 24 Jan 2023, 10:31:13 UTC |
Received | 17 Jan 2023, 10:51:00 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 4008 |
Run time | 19 min 18 sec |
CPU time | 15 min 35 sec |
Validate state | Valid |
Credit | 23.42 |
Device peak FLOPS | 3.51 GFLOPS |
Application version | ATLAS Simulation v1.25 (native_mt) x86_64-pc-linux-gnu |
Peak working set size | 1.42 GB |
Peak swap size | 2.12 GB |
Peak disk usage | 80.34 MB |
<core_client_version>7.16.1</core_client_version> <![CDATA[ <stderr_txt> 11:31:32 (15394): wrapper (7.7.26015): starting 11:31:32 (15394): wrapper: running run_atlas (--nthreads 1) [2023-01-17 11:31:32] Arguments: --nthreads 1 [2023-01-17 11:31:32] Threads: 1 [2023-01-17 11:31:32] Checking for CVMFS [2023-01-17 11:31:33] Probing /cvmfs/atlas.cern.ch... OK [2023-01-17 11:31:33] Probing /cvmfs/atlas-condb.cern.ch... OK [2023-01-17 11:31:33] Running cvmfs_config stat atlas.cern.ch [2023-01-17 11:31:33] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE [2023-01-17 11:31:33] 2.6.3.0 13181 1 28260 114652 3 10 2810805 2816001 23 65024 0 4673 99.8288 17189 1790 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://128.142.161.84:3126 1 [2023-01-17 11:31:33] CVMFS is ok [2023-01-17 11:31:33] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 [2023-01-17 11:31:33] Checking for apptainer binary... [2023-01-17 11:31:33] which: no apptainer in (/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin) [2023-01-17 11:31:33] apptainer is not installed, using version from CVMFS [2023-01-17 11:31:33] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname [2023-01-17 11:31:34] HPi7COS7 [2023-01-17 11:31:34] apptainer works [2023-01-17 11:31:34] Starting ATLAS job with PandaID=5723505103 [2023-01-17 11:31:34] Try creating a directory in /tmp [2023-01-17 11:31:34] /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 mktemp /tmp/tmp.XXXXX [2023-01-17 11:31:34] /tmp/tmp.JO0t0 [2023-01-17 11:31:34] Try creating a directory in /var/tmp [2023-01-17 11:31:34] /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 mktemp /var/tmp/tmp.XXXXX [2023-01-17 11:31:35] /var/tmp/tmp.kHiBY [2023-01-17 11:31:35] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh [2023-01-17 11:50:47] *** The last 200 lines of the pilot log: *** [2023-01-17 11:50:47] 2023-01-17 10:49:52,474 | DEBUG | pilot.control.job | send_state | REACHED_MAXTIME=None [2023-01-17 11:50:47] 2023-01-17 10:49:52,474 | INFO | pilot.control.job | send_state | pilot will not update the server (heartbeat message will be written to file) [2023-01-17 11:50:47] 2023-01-17 10:49:52,474 | INFO | pilot.control.job | is_final_update | job 5723505103 has finished - writing final server update [2023-01-17 11:50:47] 2023-01-17 10:49:52,474 | DEBUG | pilot.user.atlas.jobmetrics | get_job_metrics_string | job definition core count: 1 [2023-01-17 11:50:47] 2023-01-17 10:49:52,475 | DEBUG | pilot.api.analytics | get_fitted_data | removing tails from data to be fitted [2023-01-17 11:50:47] 2023-01-17 10:49:52,475 | INFO | pilot.api.analytics | get_fitted_data | fitting pss+swap vs Time [2023-01-17 11:50:47] 2023-01-17 10:49:52,476 | INFO | pilot.api.analytics | get_fitted_data | current memory leak: 63.67 B/s (using 10 data points, chi2=0.00) [2023-01-17 11:50:47] 2023-01-17 10:49:52,477 | DEBUG | pilot.user.atlas.jobmetrics | get_job_metrics | job metrics="actualCoreCount=0.87 nEvents=2 dbTime=6.13 dbData=4274626 workDirSize=848412 leak=63.67 [2023-01-17 11:50:47] 2023-01-17 10:49:52,477 | INFO | pilot.control.job | get_data_structure | total number of processed events: 2 (read) [2023-01-17 11:50:47] 2023-01-17 10:49:52,477 | INFO | pilot.util.container | print_executable | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo [2023-01-17 11:50:47] 2023-01-17 10:49:52,549 | INFO | pilot.user.atlas.utilities | get_memory_values | using path: /var/lib/boinc/slots/1/PanDA_Pilot-5723505103/memory_monitor_summary.json (trf name=prmo [2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | DEBUG | pilot.user.atlas.utilities | get_memory_monitor_info | summary_dictionary={'Avg': {'nprocs': 5.352, 'nthreads': 6.294, 'pss': 1287569.0, 'rchar': 59442939. [2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | INFO | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard info from prmon json [2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | INFO | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard memory fields from prmon json [2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | INFO | pilot.util.timing | timing_report | .............................. [2023-01-17 11:50:47] 2023-01-17 10:49:52,550 | INFO | pilot.util.timing | timing_report | . Timing measurements: [2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO | pilot.util.timing | timing_report | . get job = 0 s [2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO | pilot.util.timing | timing_report | . initial setup = 3 s [2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO | pilot.util.timing | timing_report | . payload setup = 10 s [2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO | pilot.util.timing | timing_report | . stage-in = 0 s [2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO | pilot.util.timing | timing_report | . payload execution = 1039 s [2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO | pilot.util.timing | timing_report | . stage-out = 0 s [2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | INFO | pilot.util.timing | timing_report | .............................. [2023-01-17 11:50:47] 2023-01-17 10:49:52,551 | DEBUG | pilot.control.job | send_state | data={'jobId': '5723505103', 'state': 'finished', 'timestamp': '2023-01-17T11:49:52+01:00', 'siteNam [2023-01-17 11:50:47] 2023-01-17 10:49:52,552 | DEBUG | pilot.control.job | write_heartbeat_to_file | heartbeat dictionary: {'jobId': '5723505103', 'state': 'finished', 'timestamp': '2023-01-17T11:49:52 [2023-01-17 11:50:47] 2023-01-17 10:49:52,552 | DEBUG | pilot.control.job | write_heartbeat_to_file | wrote heartbeat to file: /var/lib/boinc/slots/1/heartbeat.json [2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO | pilot.control.job | make_job_report | [2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO | pilot.control.job | make_job_report | job summary report [2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO | pilot.control.job | make_job_report | -------------------------------------------------- [2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO | pilot.control.job | make_job_report | PanDA job id: 5723505103 [2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO | pilot.control.job | make_job_report | task id: NULL [2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO | pilot.control.job | make_job_report | errors: (none) [2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO | pilot.control.job | make_job_report | status: LOG_TRANSFER = DONE [2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO | pilot.control.job | make_job_report | pilot state: finished [2023-01-17 11:50:47] 2023-01-17 10:49:52,687 | INFO | pilot.control.job | make_job_report | transexitcode: 0 [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | exeerrorcode: 0 [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | exeerrordiag: [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | exitcode: 0 [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | exitmsg: OK [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | cpuconsumptiontime: 959 s [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | nevents: 2 [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | neventsw: 0 [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | pid: 26630 [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | pgrp: 26630 [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | corecount: 1 [2023-01-17 11:50:47] 2023-01-17 10:49:52,688 | INFO | pilot.control.job | make_job_report | event service: False [2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | INFO | pilot.control.job | make_job_report | sizes: {0: 2526779, 1: 2527184, 1053: 2546861, 1054: 2555911, 1056: 2555967, 1057: 2556869} [2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | INFO | pilot.control.job | make_job_report | -------------------------------------------------- [2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | INFO | pilot.control.job | make_job_report | [2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | DEBUG | pilot.control.job | has_job_completed | ls -lF /var/lib/boinc/slots/1: [2023-01-17 11:50:47] [2023-01-17 11:50:47] 2023-01-17 10:49:52,689 | INFO | pilot.util.container | print_executable | executing command: ls -lF /var/lib/boinc/slots/1 [2023-01-17 11:50:47] 2023-01-17 10:49:52,708 | DEBUG | pilot.control.job | has_job_completed | total 43208 [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 131 Jan 17 11:31 0P4LDmCOyb2n7Olcko1bjSoqABFKDmABFKDmgZyRDmEnLKDmxd1NRn.diag [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 225191 Jan 17 11:49 9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.1.job.log [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 164246 Jan 17 11:49 9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.1.job.log.tgz [2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 38019645 Jan 17 11:31 EVNT.04972714._000023.pool.root.1 [2023-01-17 11:50:47] drwxrwx---. 2 boinc boinc 4096 Jan 17 11:49 PanDA_Pilot-5723505103/ [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1697825 Jan 17 11:32 agis_ddmendpoints.agis.ALL.json [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1038896 Jan 17 11:32 agis_schedconf.cvmfs.json [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 0 Jan 17 11:31 boinc_lockfile [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 8192 Jan 17 11:49 boinc_mmap_file [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 533 Jan 17 11:49 boinc_task_state.xml [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 6604 Jan 17 11:49 heartbeat.json [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 6045 Jan 17 11:31 init_data.xml [2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 402661 Jan 17 11:31 input.tar.gz [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 112 Jan 17 11:31 job.xml [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1017 Jan 17 11:49 memory_monitor_summary.json [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1769753 Jan 17 11:49 output.1.9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.pool.root [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 464 Jan 17 11:49 output.list [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 2655 Jan 17 11:31 pandaJob.out [2023-01-17 11:50:47] drwx------. 4 boinc boinc 245 Jan 17 11:32 pilot3/ [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 391889 Jan 17 11:28 pilot3.tar.gz [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 206242 Jan 17 11:49 pilotlog.txt [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 4540 Jan 17 11:25 queuedata.json [2023-01-17 11:50:47] -rwxr-xr-x. 1 boinc boinc 8273 Jan 17 11:31 run_atlas* [2023-01-17 11:50:47] -rwx------. 1 boinc boinc 26433 Jan 17 11:28 runpilot2-wrapper.sh* [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 407 Jan 17 11:31 runtime_log [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 6769 Jan 17 11:31 runtime_log.err [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 464 Jan 17 11:31 setup.sh.local [2023-01-17 11:50:47] drwxrwx--x. 2 boinc boinc 68 Jan 17 11:31 shared/ [2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 17790 Jan 17 11:31 start_atlas.sh [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 2419 Jan 17 11:31 stderr.txt [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 107 Jan 17 11:31 wrapper_26015_x86_64-pc-linux-gnu [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 25 Jan 17 11:49 wrapper_checkpoint.txt [2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO | pilot.util.queuehandling | queue_report | queue jobs had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO | pilot.util.queuehandling | queue_report | queue payloads had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO | pilot.util.queuehandling | queue_report | queue data_in had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO | pilot.util.queuehandling | queue_report | queue data_out had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO | pilot.util.queuehandling | queue_report | queue current_data_in had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO | pilot.util.queuehandling | queue_report | queue validated_jobs had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO | pilot.util.queuehandling | queue_report | queue validated_payloads had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO | pilot.util.queuehandling | queue_report | queue monitored_payloads had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,709 | INFO | pilot.util.queuehandling | queue_report | queue finished_jobs had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue finished_payloads had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue finished_data_in had 1 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue finished_data_out had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue failed_jobs had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue failed_payloads had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue failed_data_in had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue failed_data_out had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue completed_jobs had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue completed_jobids has 1 job(s) [2023-01-17 11:50:47] 2023-01-17 10:49:52,710 | INFO | pilot.util.queuehandling | queue_report | queue realtimelog_payloads had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,711 | INFO | pilot.util.queuehandling | queue_report | queue messages had 0 job(s) [purged] [2023-01-17 11:50:47] 2023-01-17 10:49:52,711 | INFO | pilot.control.job | has_job_completed | job 5723505103 has completed (purged errors) [2023-01-17 11:50:47] 2023-01-17 10:49:52,711 | DEBUG | pilot.util.realtimelogger | cleanup | attempting real-time logger cleanup [2023-01-17 11:50:47] 2023-01-17 10:49:52,711 | INFO | pilot.util.processes | cleanup | overall cleanup function is called [2023-01-17 11:50:47] 2023-01-17 10:49:52,713 | DEBUG | pilot.util.processes | cleanup | work directory was removed: /var/lib/boinc/slots/1/PanDA_Pilot-5723505103 [2023-01-17 11:50:47] 2023-01-17 10:49:53,715 | INFO | pilot.info.jobdata | collect_zombies | --- collectZombieJob: --- 10, [26630] [2023-01-17 11:50:47] 2023-01-17 10:49:53,715 | INFO | pilot.info.jobdata | collect_zombies | zombie collector trying to kill pid 26630 [2023-01-17 11:50:47] 2023-01-17 10:49:53,716 | INFO | pilot.info.jobdata | collect_zombies | harmless exception when collecting zombies: [Errno 10] No child processes [2023-01-17 11:50:47] 2023-01-17 10:49:54,735 | INFO | pilot.util.processes | cleanup | collected zombie processes [2023-01-17 11:50:47] 2023-01-17 10:49:54,735 | INFO | pilot.util.processes | cleanup | will now attempt to kill all subprocesses of pid=26630 [2023-01-17 11:50:47] 2023-01-17 10:49:54,809 | INFO | pilot.util.processes | kill_processes | process IDs to be killed: [26630] (in reverse order) [2023-01-17 11:50:47] 2023-01-17 10:49:54,847 | WARNING | pilot.util.processes | kill_processes | found no corresponding commands to process id(s) [2023-01-17 11:50:47] 2023-01-17 10:49:54,848 | INFO | pilot.util.processes | kill_orphans | Do not look for orphan processes in BOINC jobs [2023-01-17 11:50:47] 2023-01-17 10:49:54,848 | DEBUG | pilot.util.queuehandling | purge_queue | queue purged [2023-01-17 11:50:47] 2023-01-17 10:49:54,848 | INFO | pilot.control.job | retrieve | ready for new job [2023-01-17 11:50:47] 2023-01-17 10:49:54,848 | INFO | root | retrieve | pilot has finished with previous job - re-establishing logging [2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO | pilot.util.auxiliary | pilot_version_banner | *************************************** [2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO | pilot.util.auxiliary | pilot_version_banner | *** PanDA Pilot version 3.4.8 (5) *** [2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO | pilot.util.auxiliary | pilot_version_banner | *************************************** [2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO | pilot.util.auxiliary | pilot_version_banner | [2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO | pilot.util.auxiliary | pilot_version_banner | pilot is running in a VM [2023-01-17 11:50:47] 2023-01-17 10:49:54,849 | INFO | pilot.util.auxiliary | display_architecture_info | architecture information: [2023-01-17 11:50:47] 2023-01-17 10:49:55,009 | INFO | pilot.util.auxiliary | display_architecture_info | [2023-01-17 11:50:47] LSB Version: :core-4.1-amd64:core-4.1-noarch [2023-01-17 11:50:47] Distributor ID: CentOS [2023-01-17 11:50:47] Description: CentOS Linux release 7.9.2009 (Core) [2023-01-17 11:50:47] Release: 7.9.2009 [2023-01-17 11:50:47] Codename: Core [2023-01-17 11:50:47] 2023-01-17 10:49:55,010 | INFO | pilot.util.auxiliary | pilot_version_banner | *************************************** [2023-01-17 11:50:47] 2023-01-17 10:49:55,515 | DEBUG | pilot.util.monitoring | check_local_space | checking local space on /var/lib/boinc/slots/1 [2023-01-17 11:50:47] 2023-01-17 10:49:55,515 | INFO | pilot.util.container | print_executable | executing command: df -mP /var/lib/boinc/slots/1 [2023-01-17 11:50:47] 2023-01-17 10:49:55,533 | DEBUG | pilot.util.workernode | get_local_disk_space | stdout=Filesystem 1048576-blocks Used Available Capacity Mounted on [2023-01-17 11:50:47] /dev/mapper/centos-root 22002 11370 10632 52% /var/lib/boinc/slots/1 [2023-01-17 11:50:47] 2023-01-17 10:49:55,533 | DEBUG | pilot.util.workernode | get_local_disk_space | stderr= [2023-01-17 11:50:47] 2023-01-17 10:49:55,533 | INFO | pilot.util.monitoring | check_local_space | sufficient remaining disk space (11148460032 B) [2023-01-17 11:50:47] 2023-01-17 10:49:55,533 | WARNING | pilot.control.job | proceed_with_getjob | since timefloor is set to 0, pilot was only allowed to run one job [2023-01-17 11:50:47] 2023-01-17 10:49:55,534 | DEBUG | pilot.control.job | retrieve | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:55,534 | INFO | pilot.control.job | retrieve | [job] retrieve thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:55,534 | WARNING | pilot.control.monitor | control | aborting monitor loop since graceful_stop has been set [2023-01-17 11:50:47] 2023-01-17 10:49:55,534 | INFO | pilot.control.monitor | control | [monitor] control thread has ended [2023-01-17 11:50:47] 2023-01-17 10:49:55,595 | WARNING | pilot.util.common | should_abort | data:copytool_out:received graceful stop - abort after this iteration [2023-01-17 11:50:47] 2023-01-17 10:49:55,837 | DEBUG | pilot.control.payload | validate_pre | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:55,837 | INFO | pilot.control.payload | validate_pre | [payload] validate_pre thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:55,977 | DEBUG | pilot.control.data | copytool_in | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:55,978 | INFO | pilot.control.data | copytool_in | [data] copytool_in thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:56,367 | DEBUG | pilot.control.data | control | data control ending since graceful_stop has been set [2023-01-17 11:50:47] 2023-01-17 10:49:56,368 | DEBUG | pilot.control.data | control | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:56,368 | INFO | pilot.control.data | control | [data] control thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:56,435 | DEBUG | pilot.control.job | control | job control ending since graceful_stop has been set [2023-01-17 11:50:47] 2023-01-17 10:49:56,435 | DEBUG | pilot.control.job | control | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:56,435 | INFO | pilot.control.job | control | [job] control thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:56,448 | DEBUG | pilot.control.payload | execute_payloads | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:56,448 | INFO | pilot.control.payload | execute_payloads | [payload] execute_payloads thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:56,577 | DEBUG | pilot.control.payload | control | payload control ending since graceful_stop has been set [2023-01-17 11:50:47] 2023-01-17 10:49:56,577 | DEBUG | pilot.control.payload | control | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:56,577 | INFO | pilot.control.payload | control | [payload] control thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:56,606 | DEBUG | pilot.control.data | copytool_out | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:56,609 | INFO | pilot.control.data | copytool_out | [data] copytool_out thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:56,606 | DEBUG | pilot.control.job | create_data_payload | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:56,609 | INFO | pilot.control.job | create_data_payload | [job] create_data_payload thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:56,811 | DEBUG | pilot.control.job | validate | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:56,811 | INFO | pilot.control.job | validate | [job] validate thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:57,012 | DEBUG | pilot.control.payload | failed_post | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:57,013 | INFO | pilot.control.payload | failed_post | [payload] failed_post thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:57,109 | DEBUG | pilot.control.payload | validate_post | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:57,109 | INFO | pilot.control.payload | validate_post | [payload] validate_post thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:57,714 | WARNING | pilot.util.common | should_abort | job:queue_monitor:received graceful stop - abort after this iteration [2023-01-17 11:50:47] 2023-01-17 10:49:57,714 | DEBUG | pilot.control.job | queue_monitor | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:49:57,714 | INFO | pilot.control.job | queue_monitor | [job] queue monitor thread has finished [2023-01-17 11:50:47] 2023-01-17 10:49:58,347 | WARNING | pilot.util.common | should_abort | data:queue_monitoring:received graceful stop - abort after this iteration [2023-01-17 11:50:47] 2023-01-17 10:50:01,351 | DEBUG | pilot.control.data | queue_monitoring | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:50:01,352 | INFO | pilot.control.data | queue_monitoring | [data] queue_monitor thread has finished [2023-01-17 11:50:47] 2023-01-17 10:50:06,343 | INFO | pilot.control.payload | get_logging_info | job.realtimelogging is not enabled [2023-01-17 11:50:47] 2023-01-17 10:50:06,343 | DEBUG | pilot.control.payload | run_realtimelog | real-time logging not needed at this point [2023-01-17 11:50:47] 2023-01-17 10:50:06,343 | DEBUG | pilot.control.payload | run_realtimelog | realtime logger was not found, waiting .. [2023-01-17 11:50:47] 2023-01-17 10:50:06,343 | DEBUG | pilot.control.payload | run_realtimelog | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:50:06,344 | INFO | pilot.control.payload | run_realtimelog | [payload] run_realtimelog thread has finished [2023-01-17 11:50:47] 2023-01-17 10:50:46,003 | WARNING | pilot.control.job | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 74 s) [2023-01-17 11:50:47] 2023-01-17 10:50:46,003 | DEBUG | pilot.control.job | job_monitor | will not set job_aborted yet [2023-01-17 11:50:47] 2023-01-17 10:50:46,003 | INFO | pilot.control.job | job_monitor | [job] job monitor thread has finished [2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | DEBUG | pilot.util.processes | threads_aborted | aborting since only the main Pilot thread is still running (total thread count=1 with 0 daemon threa [2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | DEBUG | pilot.workflow.generic | run | all relevant threads have aborted (thread count=1) [2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | INFO | pilot.workflow.generic | run | end of generic workflow (traces error code: 0) [2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | INFO | root | wrap_up | traces error code: 0 [2023-01-17 11:50:47] 2023-01-17 10:50:46,970 | INFO | root | wrap_up | pilot has finished [2023-01-17 11:50:47] 2023-01-17 10:50:47,064 [wrapper] ==== pilot stdout END ==== [2023-01-17 11:50:47] 2023-01-17 10:50:47,068 [wrapper] ==== wrapper stdout RESUME ==== [2023-01-17 11:50:47] 2023-01-17 10:50:47,072 [wrapper] pilotpid: 23556 [2023-01-17 11:50:47] 2023-01-17 10:50:47,077 [wrapper] Pilot exit status: 0 [2023-01-17 11:50:47] 2023-01-17 10:50:47,100 [wrapper] pandaids: 5723505103 [2023-01-17 11:50:47] 2023-01-17 10:50:47,114 [wrapper] apfmon messages muted [2023-01-17 11:50:47] 2023-01-17 10:50:47,155 [wrapper] Test setup, not cleaning [2023-01-17 11:50:47] 2023-01-17 10:50:47,184 [wrapper] ==== wrapper stdout END ==== [2023-01-17 11:50:47] 2023-01-17 10:50:47,203 [wrapper] ==== wrapper stderr END ==== [2023-01-17 11:50:47] 2023-01-17 10:50:47,211 [wrapper] wrapperexiting ec=0, duration=1152 [2023-01-17 11:50:47] 2023-01-17 10:50:47,214 [wrapper] apfmon messages muted [2023-01-17 11:50:47] *** Error codes and diagnostics *** [2023-01-17 11:50:47] "exeErrorCode": 0, [2023-01-17 11:50:47] "exeErrorDiag": "", [2023-01-17 11:50:47] "pilotErrorCode": 0, [2023-01-17 11:50:47] "pilotErrorDiag": "", [2023-01-17 11:50:47] *** Listing of results directory *** [2023-01-17 11:50:47] insgesamt 45052 [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 4540 17. Jan 11:25 queuedata.json [2023-01-17 11:50:47] -rwx------. 1 boinc boinc 26433 17. Jan 11:28 runpilot2-wrapper.sh [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 391889 17. Jan 11:28 pilot3.tar.gz [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 107 17. Jan 11:31 wrapper_26015_x86_64-pc-linux-gnu [2023-01-17 11:50:47] -rwxr-xr-x. 1 boinc boinc 8273 17. Jan 11:31 run_atlas [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 112 17. Jan 11:31 job.xml [2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 17790 17. Jan 11:31 start_atlas.sh [2023-01-17 11:50:47] drwxrwx--x. 2 boinc boinc 68 17. Jan 11:31 shared [2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 402661 17. Jan 11:31 input.tar.gz [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 6045 17. Jan 11:31 init_data.xml [2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 38019645 17. Jan 11:31 EVNT.04972714._000023.pool.root.1 [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 0 17. Jan 11:31 boinc_lockfile [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 2655 17. Jan 11:31 pandaJob.out [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 464 17. Jan 11:31 setup.sh.local [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1038896 17. Jan 11:32 agis_schedconf.cvmfs.json [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1697825 17. Jan 11:32 agis_ddmendpoints.agis.ALL.json [2023-01-17 11:50:47] drwx------. 4 boinc boinc 245 17. Jan 11:32 pilot3 [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1769753 17. Jan 11:49 output.1.9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.pool.root [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1017 17. Jan 11:49 memory_monitor_summary.json [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 164246 17. Jan 11:49 9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.1.job.log.tgz [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 6604 17. Jan 11:49 heartbeat.json [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 533 17. Jan 11:50 boinc_task_state.xml [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 8192 17. Jan 11:50 boinc_mmap_file [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 25 17. Jan 11:50 wrapper_checkpoint.txt [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 9046 17. Jan 11:50 pilotlog.txt [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 242266 17. Jan 11:50 9bce17ff-3912-45b6-a142-d86f85cd25ce_51768.1.job.log [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 464 17. Jan 11:50 output.list [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 748 17. Jan 11:50 runtime_log [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 2191360 17. Jan 11:50 result.tar.gz [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 10880 17. Jan 11:50 runtime_log.err [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 633 17. Jan 11:50 0P4LDmCOyb2n7Olcko1bjSoqABFKDmABFKDmgZyRDmEnLKDmxd1NRn.diag [2023-01-17 11:50:47] -rw-r--r--. 1 boinc boinc 31230 17. Jan 11:50 stderr.txt [2023-01-17 11:50:47] HITS file was successfully produced: [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1769753 17. Jan 11:49 shared/HITS.pool.root.1 [2023-01-17 11:50:47] *** Contents of shared directory: *** [2023-01-17 11:50:47] insgesamt 41420 [2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 17790 17. Jan 11:31 start_atlas.sh [2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 402661 17. Jan 11:31 input.tar.gz [2023-01-17 11:50:47] -rw-r--r--. 2 boinc boinc 38019645 17. Jan 11:31 ATLAS.root_0 [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 1769753 17. Jan 11:49 HITS.pool.root.1 [2023-01-17 11:50:47] -rw-------. 1 boinc boinc 2191360 17. Jan 11:50 result.tar.gz 11:50:49 (15394): run_atlas exited; CPU time 935.515480 11:50:49 (15394): called boinc_finish(0) </stderr_txt> ]]>
©2024 CERN