| Name | 0QSKDmACgq3n7Olcko1bjSoqABFKDmABFKDm7AsVDm4PPKDm5jAEDn_0 |
| Workunit | 2325633 |
| Created | 17 Aug 2023, 0:37:43 UTC |
| Sent | 17 Aug 2023, 0:38:36 UTC |
| Report deadline | 24 Aug 2023, 0:38:36 UTC |
| Received | 17 Aug 2023, 1:25:43 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 4912 |
| Run time | 25 min 2 sec |
| CPU time | 9 min 25 sec |
| Validate state | Valid |
| Credit | 17.56 |
| Device peak FLOPS | 4.64 GFLOPS |
| Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 1.56 GB |
| Peak swap size | 3.18 GB |
| Peak disk usage | 89.48 MB |
Stderr output
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
03:59:37 (525001): wrapper (7.7.26015): starting
03:59:37 (525001): wrapper: running /usr/bin/wget (https://atlas-cric.cern.ch/cache/ddmendpoints.json -O agis_ddmendpoints.agis.ALL.json)
--2023-08-17 03:59:37-- https://atlas-cric.cern.ch/cache/ddmendpoints.json
Resolving atlas-cric.cern.ch (atlas-cric.cern.ch)... 188.185.66.30, 2001:1458:d00:1::100:218
Connecting to atlas-cric.cern.ch (atlas-cric.cern.ch)|188.185.66.30|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1659119 (1.6M) [application/json]
Saving to: ‘agis_ddmendpoints.agis.ALL.json’
0K .......... .......... .......... .......... .......... 3% 502K 3s
50K .......... .......... .......... .......... .......... 6% 10.5M 2s
100K .......... .......... .......... .......... .......... 9% 12.8M 1s
150K .......... .......... .......... .......... .......... 12% 1024K 1s
200K .......... .......... .......... .......... .......... 15% 85.6M 1s
250K .......... .......... .......... .......... .......... 18% 7.87M 1s
300K .......... .......... .......... .......... .......... 21% 890K 1s
350K .......... .......... .......... .......... .......... 24% 146M 1s
400K .......... .......... .......... .......... .......... 27% 2.73M 1s
450K .......... .......... .......... .......... .......... 30% 274M 1s
500K .......... .......... .......... .......... .......... 33% 292M 0s
550K .......... .......... .......... .......... .......... 37% 1.72M 0s
600K .......... .......... .......... .......... .......... 40% 3.96M 0s
650K .......... .......... .......... .......... .......... 43% 274M 0s
700K .......... .......... .......... .......... .......... 46% 455K 0s
750K .......... .......... .......... .......... .......... 49% 233M 0s
800K .......... .......... .......... .......... .......... 52% 24.9M 0s
850K .......... .......... .......... .......... .......... 55% 9.64M 0s
900K .......... .......... .......... .......... .......... 58% 219M 0s
950K .......... .......... .......... .......... .......... 61% 301M 0s
1000K .......... .......... .......... .......... .......... 64% 134M 0s
1050K .......... .......... .......... .......... .......... 67% 2.05M 0s
1100K .......... .......... .......... .......... .......... 70% 12.1M 0s
1150K .......... .......... .......... .......... .......... 74% 2.70M 0s
1200K .......... .......... .......... .......... .......... 77% 1.29M 0s
1250K .......... .......... .......... .......... .......... 80% 24.5M 0s
1300K .......... .......... .......... .......... .......... 83% 39.2M 0s
1350K .......... .......... .......... .......... .......... 86% 300M 0s
1400K .......... .......... .......... .......... .......... 89% 1.22M 0s
1450K .......... .......... .......... .......... .......... 92% 6.22M 0s
1500K .......... .......... .......... .......... .......... 95% 85.5M 0s
1550K .......... .......... .......... .......... .......... 98% 4.69M 0s
1600K .......... .......... 100% 704K=0.6s
2023-08-17 03:59:38 (2.77 MB/s) - ‘agis_ddmendpoints.agis.ALL.json’ saved [1659119/1659119]
03:59:39 (525001): /usr/bin/wget exited; CPU time 0.012448
03:59:39 (525001): wrapper: running run_atlas (--nthreads 1)
[2023-08-17 03:59:39] Arguments: --nthreads 1
[2023-08-17 03:59:39] Threads: 1
[2023-08-17 03:59:39] Checking for CVMFS
[2023-08-17 03:59:40] Probing /cvmfs/atlas.cern.ch... OK
[2023-08-17 03:59:40] Probing /cvmfs/atlas-condb.cern.ch... OK
[2023-08-17 03:59:40] Running cvmfs_config stat atlas.cern.ch
[2023-08-17 03:59:41] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2023-08-17 03:59:41] 2.10.1.0 487755 27 40956 122544 0 73 8615310 10240001 0 130560 0 104814 99.986 26948 1394 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
[2023-08-17 03:59:41] CVMFS is ok
[2023-08-17 03:59:41] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2023-08-17 03:59:41] Small home clusters do not require a local http proxy but it is suggested if
[2023-08-17 03:59:41] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2023-08-17 03:59:41] Further information can be found at the LHC@home message board.
[2023-08-17 03:59:41] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2023-08-17 03:59:41] Checking for apptainer binary...
[2023-08-17 03:59:41] apptainer is not installed, using version from CVMFS
[2023-08-17 03:59:41] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2023-08-17 03:59:47] debian-lhcathome
[2023-08-17 03:59:47] apptainer works
[2023-08-17 03:59:48] Starting ATLAS job with PandaID=5934228858
[2023-08-17 03:59:48] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc-client/slots/7 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2023-08-17 04:24:36] *** The last 200 lines of the pilot log: ***
[2023-08-17 04:24:37] >>>>>>>>>>>>>>>>>>>>>>>>> Information for user <<<<<<<<<<<<<<<<<<<<<<<<<
[2023-08-17 04:24:37] ************************************************************************
[2023-08-17 04:24:37] x86-64-v3
[2023-08-17 04:24:37] 2023-08-17 01:24:14,398 | INFO | pilot.user.atlas.utilities | get_cpu_arch | CPU arch script returned: x86-64-v3
[2023-08-17 04:24:37] 2023-08-17 01:24:14,398 | DEBUG | pilot.control.job | get_data_structure | cpu arch=x86-64-v3
[2023-08-17 04:24:37] 2023-08-17 01:24:14,398 | INFO | pilot.user.atlas.utilities | get_memory_values | using path: /var/lib/boinc-client/slots/7/PanDA_Pilot-5934228858/memory_monitor_summary.json (trf na
[2023-08-17 04:24:37] 2023-08-17 01:24:14,399 | DEBUG | pilot.user.atlas.utilities | get_memory_monitor_info | summary_dictionary={'Avg': {'nprocs': 5.049, 'nthreads': 5.849, 'pss': 1151190.0, 'rchar': 49706049.
[2023-08-17 04:24:37] 2023-08-17 01:24:14,400 | INFO | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard info from prmon json
[2023-08-17 04:24:37] 2023-08-17 01:24:14,400 | INFO | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard memory fields from prmon json
[2023-08-17 04:24:37] 2023-08-17 01:24:14,400 | INFO | pilot.util.timing | timing_report | ..............................
[2023-08-17 04:24:37] 2023-08-17 01:24:14,400 | INFO | pilot.util.timing | timing_report | . Timing measurements:
[2023-08-17 04:24:37] 2023-08-17 01:24:14,400 | INFO | pilot.util.timing | timing_report | . get job = 0 s
[2023-08-17 04:24:37] 2023-08-17 01:24:14,400 | INFO | pilot.util.timing | timing_report | . initial setup = 2 s
[2023-08-17 04:24:37] 2023-08-17 01:24:14,401 | INFO | pilot.util.timing | timing_report | . payload setup = 55 s
[2023-08-17 04:24:37] 2023-08-17 01:24:14,401 | INFO | pilot.util.timing | timing_report | . stage-in = 0 s
[2023-08-17 04:24:37] 2023-08-17 01:24:14,401 | INFO | pilot.util.timing | timing_report | . payload execution = 1247 s
[2023-08-17 04:24:37] 2023-08-17 01:24:14,401 | INFO | pilot.util.timing | timing_report | . stage-out = 2 s
[2023-08-17 04:24:37] 2023-08-17 01:24:14,401 | INFO | pilot.util.timing | timing_report | ..............................
[2023-08-17 04:24:37] 2023-08-17 01:24:14,401 | DEBUG | pilot.control.job | send_state | data={'jobId': '5934228858', 'state': 'finished', 'timestamp': '2023-08-17T04:22:43+03:00', 'siteNam
[2023-08-17 04:24:37] 2023-08-17 01:24:14,402 | DEBUG | pilot.control.job | write_heartbeat_to_file | heartbeat dictionary: {'jobId': '5934228858', 'state': 'finished', 'timestamp': '2023-08-17T04:22:43
[2023-08-17 04:24:37] 2023-08-17 01:24:14,402 | DEBUG | pilot.control.job | write_heartbeat_to_file | wrote heartbeat to file: /var/lib/boinc-client/slots/7/heartbeat.json
[2023-08-17 04:24:37] 2023-08-17 01:24:14,402 | DEBUG | pilot.control.job | queue_monitor | job.completed=False
[2023-08-17 04:24:37] 2023-08-17 01:24:14,681 | INFO | pilot.control.job | make_job_report |
[2023-08-17 04:24:37] 2023-08-17 01:24:14,681 | INFO | pilot.control.job | make_job_report | job summary report
[2023-08-17 04:24:37] 2023-08-17 01:24:14,681 | INFO | pilot.control.job | make_job_report | --------------------------------------------------
[2023-08-17 04:24:37] 2023-08-17 01:24:14,681 | INFO | pilot.control.job | make_job_report | PanDA job id: 5934228858
[2023-08-17 04:24:37] 2023-08-17 01:24:14,681 | INFO | pilot.control.job | make_job_report | task id: NULL
[2023-08-17 04:24:37] 2023-08-17 01:24:14,681 | INFO | pilot.control.job | make_job_report | errors: (none)
[2023-08-17 04:24:37] 2023-08-17 01:24:14,681 | INFO | pilot.control.job | make_job_report | status: LOG_TRANSFER = DONE
[2023-08-17 04:24:37] 2023-08-17 01:24:14,681 | INFO | pilot.control.job | make_job_report | pilot state: finished
[2023-08-17 04:24:37] 2023-08-17 01:24:14,681 | INFO | pilot.control.job | make_job_report | transexitcode: 0
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | exeerrorcode: 0
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | exeerrordiag:
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | exitcode: 0
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | exitmsg: OK
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | cpuconsumptiontime: 699 s
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | nevents: 2
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | neventsw: 0
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | pid: 536774
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | pgrp: 536774
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | corecount: 1
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | event service: False
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | sizes: {0: 2482461, 1: 2484004, 12: 2484004, 17: 2484238, 23: 2484266, 1307: 2507053, 1308: 2507180,
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report | --------------------------------------------------
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | INFO | pilot.control.job | make_job_report |
[2023-08-17 04:24:37] 2023-08-17 01:24:14,682 | DEBUG | pilot.control.job | has_job_completed | ls -lF /var/lib/boinc-client/slots/7:
[2023-08-17 04:24:37]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,683 | INFO | pilot.util.container | print_executable | executing command: ls -lF /var/lib/boinc-client/slots/7
[2023-08-17 04:24:37] 2023-08-17 01:24:14,701 | DEBUG | pilot.control.job | has_job_completed | total 43340
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 151 Aug 17 03:59 0QSKDmACgq3n7Olcko1bjSoqABFKDmABFKDm7AsVDm4PPKDm5jAEDn.diag
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 1659119 Aug 17 03:30 agis_ddmendpoints.agis.ALL.json
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 1015275 Aug 17 04:00 agis_schedconf.cvmfs.json
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 0 Aug 17 03:59 boinc_lockfile
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 8192 Aug 17 04:24 boinc_mmap_file
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 533 Aug 17 04:22 boinc_task_state.xml
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 501766 Aug 17 04:24 d713397d-425f-478e-b39b-ab1f733c42f6_24279.1.job.log
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 179024 Aug 17 04:22 d713397d-425f-478e-b39b-ab1f733c42f6_24279.1.job.log.tgz
[2023-08-17 04:24:37] -rw-r--r-- 2 boinc boinc 37073557 Aug 17 03:59 EVNT.04972714._000021.pool.root.1
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 8444 Aug 17 04:24 heartbeat.json
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 6496 Aug 17 03:59 init_data.xml
[2023-08-17 04:24:37] -rw-r--r-- 2 boinc boinc 927510 Aug 17 03:59 input.tar.gz
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 112 Aug 17 03:59 job.xml
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 1005 Aug 17 04:22 memory_monitor_summary.json
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 1423872 Aug 17 04:21 output.1.d713397d-425f-478e-b39b-ab1f733c42f6_24279.pool.root
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 464 Aug 17 04:22 output.list
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 2665 Aug 17 03:59 pandaJob.out
[2023-08-17 04:24:37] drwxrwx--- 2 boinc boinc 4096 Aug 17 04:22 PanDA_Pilot-5934228858/
[2023-08-17 04:24:37] drwx------ 5 boinc boinc 4096 Aug 17 04:00 pilot3/
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 918320 Aug 17 03:37 pilot3.tar.gz
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 487662 Aug 17 04:24 pilotlog.txt
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 4388 Aug 17 03:37 queuedata.json
[2023-08-17 04:24:37] -rwxr-xr-x 1 boinc boinc 7986 Aug 17 03:59 run_atlas*
[2023-08-17 04:24:37] -rwx------ 1 boinc boinc 27275 Aug 17 03:37 runpilot2-wrapper.sh*
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 407 Aug 17 03:59 runtime_log
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 7871 Aug 17 03:59 runtime_log.err
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 424 Aug 17 03:59 setup.sh.local
[2023-08-17 04:24:37] drwxrwx--x 2 boinc boinc 4096 Aug 17 03:59 shared/
[2023-08-17 04:24:37] -rw-r--r-- 2 boinc boinc 17632 Aug 17 03:59 start_atlas.sh
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 5253 Aug 17 03:59 stderr.txt
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 107 Aug 17 03:59 wrapper_26015_x86_64-pc-linux-gnu
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 25 Aug 17 04:24 wrapper_checkpoint.txt
[2023-08-17 04:24:37] 2023-08-17 01:24:14,701 | INFO | pilot.util.queuehandling | queue_report | queue jobs had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,701 | INFO | pilot.util.queuehandling | queue_report | queue payloads had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,701 | INFO | pilot.util.queuehandling | queue_report | queue data_in had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue data_out had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue current_data_in had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue validated_jobs had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue validated_payloads had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue monitored_payloads had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue finished_jobs had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue finished_payloads had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue finished_data_in had 1 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue finished_data_out had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue failed_jobs had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue failed_payloads had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue failed_data_in had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue failed_data_out had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue completed_jobs had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,702 | INFO | pilot.util.queuehandling | queue_report | queue completed_jobids has 1 job(s)
[2023-08-17 04:24:37] 2023-08-17 01:24:14,703 | INFO | pilot.util.queuehandling | queue_report | queue realtimelog_payloads had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,703 | INFO | pilot.util.queuehandling | queue_report | queue messages had 0 job(s) [purged]
[2023-08-17 04:24:37] 2023-08-17 01:24:14,703 | INFO | pilot.control.job | has_job_completed | job 5934228858 has completed (purged errors)
[2023-08-17 04:24:37] 2023-08-17 01:24:14,705 | DEBUG | pilot.util.realtimelogger | cleanup | attempting real-time logger cleanup
[2023-08-17 04:24:37] 2023-08-17 01:24:14,705 | INFO | pilot.util.processes | cleanup | overall cleanup function is called
[2023-08-17 04:24:37] 2023-08-17 01:24:14,707 | DEBUG | pilot.util.processes | cleanup | work directory was removed: /var/lib/boinc-client/slots/7/PanDA_Pilot-5934228858
[2023-08-17 04:24:37] 2023-08-17 01:24:15,718 | INFO | pilot.info.jobdata | collect_zombies | --- collectZombieJob: --- 10, [536774]
[2023-08-17 04:24:37] 2023-08-17 01:24:15,718 | INFO | pilot.info.jobdata | collect_zombies | zombie collector trying to kill pid 536774
[2023-08-17 04:24:37] 2023-08-17 01:24:15,718 | INFO | pilot.info.jobdata | collect_zombies | harmless exception when collecting zombies: [Errno 10] No child processes
[2023-08-17 04:24:37] 2023-08-17 01:24:16,726 | INFO | pilot.util.processes | cleanup | collected zombie processes
[2023-08-17 04:24:37] 2023-08-17 01:24:16,726 | INFO | pilot.util.processes | cleanup | will now attempt to kill all subprocesses of pid=536774
[2023-08-17 04:24:37] 2023-08-17 01:24:16,783 | INFO | pilot.util.processes | kill_processes | process IDs to be killed: [536774] (in reverse order)
[2023-08-17 04:24:37] 2023-08-17 01:24:16,870 | WARNING | pilot.util.processes | kill_processes | found no corresponding commands to process id(s)
[2023-08-17 04:24:37] 2023-08-17 01:24:16,870 | INFO | pilot.util.processes | kill_orphans | Do not look for orphan processes in BOINC jobs
[2023-08-17 04:24:37] 2023-08-17 01:24:16,871 | WARNING | pilot.util.processes | kill_processes | exception caught: [Errno 22] Invalid argument: '/proc/1/cmdline'
[2023-08-17 04:24:37] 2023-08-17 01:24:16,871 | DEBUG | pilot.util.queuehandling | purge_queue | queue purged
[2023-08-17 04:24:37] 2023-08-17 01:24:16,871 | INFO | pilot.control.job | retrieve | ready for new job
[2023-08-17 04:24:37] 2023-08-17 01:24:16,871 | INFO | root | retrieve | pilot has finished with previous job - re-establishing logging
[2023-08-17 04:24:37] 2023-08-17 01:24:16,873 | INFO | pilot.util.auxiliary | pilot_version_banner | **************************************
[2023-08-17 04:24:37] 2023-08-17 01:24:16,873 | INFO | pilot.util.auxiliary | pilot_version_banner | *** PanDA Pilot version 3.6.5.19 ***
[2023-08-17 04:24:37] 2023-08-17 01:24:16,873 | INFO | pilot.util.auxiliary | pilot_version_banner | **************************************
[2023-08-17 04:24:37] 2023-08-17 01:24:16,873 | INFO | pilot.util.auxiliary | pilot_version_banner |
[2023-08-17 04:24:37] 2023-08-17 01:24:16,873 | INFO | pilot.util.auxiliary | pilot_version_banner | pilot is running in a VM
[2023-08-17 04:24:37] 2023-08-17 01:24:16,873 | INFO | pilot.util.auxiliary | display_architecture_info | architecture information:
[2023-08-17 04:24:37] 2023-08-17 01:24:16,874 | INFO | pilot.util.container | print_executable | executing command: cat /etc/os-release
[2023-08-17 04:24:37] 2023-08-17 01:24:16,939 | INFO | pilot.util.filehandling | dump | cat /etc/os-release:
[2023-08-17 04:24:37] NAME="CentOS Linux"
[2023-08-17 04:24:37] VERSION="7 (Core)"
[2023-08-17 04:24:37] ID="centos"
[2023-08-17 04:24:37] ID_LIKE="rhel fedora"
[2023-08-17 04:24:37] VERSION_ID="7"
[2023-08-17 04:24:37] PRETTY_NAME="CentOS Linux 7 (Core)"
[2023-08-17 04:24:37] ANSI_COLOR="0;31"
[2023-08-17 04:24:37] CPE_NAME="cpe:/o:centos:centos:7"
[2023-08-17 04:24:37] HOME_URL="https://www.centos.org/"
[2023-08-17 04:24:37] BUG_REPORT_URL="https://bugs.centos.org/"
[2023-08-17 04:24:37]
[2023-08-17 04:24:37] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2023-08-17 04:24:37] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2023-08-17 04:24:37] REDHAT_SUPPORT_PRODUCT="centos"
[2023-08-17 04:24:37] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2023-08-17 04:24:37]
[2023-08-17 04:24:37] 2023-08-17 01:24:16,940 | INFO | pilot.util.auxiliary | pilot_version_banner | **************************************
[2023-08-17 04:24:37] 2023-08-17 01:24:17,446 | DEBUG | pilot.util.monitoring | check_local_space | checking local space on /var/lib/boinc-client/slots/7
[2023-08-17 04:24:37] 2023-08-17 01:24:17,446 | INFO | pilot.util.container | print_executable | executing command: df -mP /var/lib/boinc-client/slots/7
[2023-08-17 04:24:37] 2023-08-17 01:24:17,472 | DEBUG | pilot.util.workernode | get_local_disk_space | stdout=Filesystem 1048576-blocks Used Available Capacity Mounted on
[2023-08-17 04:24:37] /dev/sda6 49840 15427 31850 33% /var/lib/boinc-client/slots/7
[2023-08-17 04:24:37] 2023-08-17 01:24:17,472 | DEBUG | pilot.util.workernode | get_local_disk_space | stderr=
[2023-08-17 04:24:37] 2023-08-17 01:24:17,472 | INFO | pilot.util.monitoring | check_local_space | sufficient remaining disk space (33397145600 B)
[2023-08-17 04:24:37] 2023-08-17 01:24:17,472 | WARNING | pilot.control.job | proceed_with_getjob | since timefloor is set to 0, pilot was only allowed to run one job
[2023-08-17 04:24:37] 2023-08-17 01:24:17,472 | WARNING | pilot.control.job | retrieve | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2023-08-17 04:24:37] 2023-08-17 01:24:17,473 | WARNING | pilot.util.common | should_abort | job:job_monitor:received graceful stop - abort after this iteration
[2023-08-17 04:24:37] 2023-08-17 01:24:17,473 | INFO | pilot.control.job | job_monitor | aborting loop
[2023-08-17 04:24:37] 2023-08-17 01:24:17,708 | DEBUG | pilot.control.payload | control | payload control ending since graceful_stop has been set
[2023-08-17 04:24:37] 2023-08-17 01:24:17,738 | DEBUG | pilot.control.data | control | data control ending since graceful_stop has been set
[2023-08-17 04:24:37] 2023-08-17 01:24:17,742 | WARNING | pilot.util.common | should_abort | data:copytool_out:received graceful stop - abort after this iteration
[2023-08-17 04:24:37] 2023-08-17 01:24:17,923 | INFO | pilot.util.queuehandling | abort_jobs_in_queues | found 0 job(s) in 20 queues
[2023-08-17 04:24:37] 2023-08-17 01:24:17,923 | WARNING | pilot.control.monitor | run_checks | pilot monitor received instruction that args.graceful_stop has been set
[2023-08-17 04:24:37] 2023-08-17 01:24:17,923 | WARNING | pilot.control.monitor | run_checks | will wait for a maximum of 300 s for threads to finish
[2023-08-17 04:24:37] 2023-08-17 01:24:18,483 | INFO | pilot.control.job | retrieve | [job] retrieve thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:18,484 | INFO | pilot.control.job | job_monitor | [job] job monitor thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:18,559 | INFO | pilot.control.payload | failed_post | [payload] failed_post thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:18,586 | INFO | pilot.control.payload | validate_post | [payload] validate_post thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:18,720 | INFO | pilot.control.payload | control | [payload] control thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:18,745 | INFO | pilot.control.data | control | [data] control thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:18,871 | INFO | pilot.control.job | validate | [job] validate thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:19,027 | INFO | pilot.control.data | copytool_in | [data] copytool_in thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:19,114 | DEBUG | pilot.control.job | control | job control ending since graceful_stop has been set
[2023-08-17 04:24:37] 2023-08-17 01:24:19,163 | INFO | pilot.control.payload | validate_pre | [payload] validate_pre thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:19,246 | INFO | pilot.control.payload | execute_payloads | [payload] execute_payloads thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:19,519 | WARNING | pilot.util.common | should_abort | job:queue_monitor:received graceful stop - abort after this iteration
[2023-08-17 04:24:37] 2023-08-17 01:24:19,754 | INFO | pilot.control.data | copytool_out | [data] copytool_out thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:19,838 | WARNING | pilot.util.common | should_abort | data:queue_monitoring:received graceful stop - abort after this iteration
[2023-08-17 04:24:37] 2023-08-17 01:24:19,915 | INFO | pilot.control.job | create_data_payload | [job] create_data_payload thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:20,122 | INFO | pilot.control.job | control | [job] control thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:20,563 | INFO | pilot.control.job | queue_monitor | [job] queue monitor thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:23,858 | INFO | pilot.control.data | queue_monitoring | [data] queue_monitor thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:27,834 | INFO | pilot.control.payload | get_logging_info | job.realtimelogging is not enabled
[2023-08-17 04:24:37] 2023-08-17 01:24:27,834 | DEBUG | pilot.control.payload | run_realtimelog | real-time logging not needed at this point
[2023-08-17 04:24:37] 2023-08-17 01:24:27,834 | DEBUG | pilot.control.payload | run_realtimelog | realtime logger was not found, waiting ..
[2023-08-17 04:24:37] 2023-08-17 01:24:28,849 | INFO | pilot.control.payload | run_realtimelog | [payload] run_realtimelog thread has finished
[2023-08-17 04:24:37] 2023-08-17 01:24:30,350 | INFO | pilot.util.processes | threads_aborted | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140212
[2023-08-17 04:24:37] 2023-08-17 01:24:30,350 | DEBUG | pilot.workflow.generic | run | will proceed to set job_aborted
[2023-08-17 04:24:37] 2023-08-17 01:24:31,053 | WARNING | pilot.control.monitor | run_checks | job_aborted has been set - aborting pilot monitoring
[2023-08-17 04:24:37] 2023-08-17 01:24:31,054 | INFO | pilot.control.monitor | control | [monitor] control thread has ended
[2023-08-17 04:24:37] 2023-08-17 01:24:35,378 | DEBUG | pilot.workflow.generic | run | all relevant threads have aborted (thread count=1)
[2023-08-17 04:24:37] 2023-08-17 01:24:35,378 | INFO | pilot.workflow.generic | run | end of generic workflow (traces error code: 0)
[2023-08-17 04:24:37] 2023-08-17 01:24:35,378 | DEBUG | root | <module> | trace=<class 'pilot.workflow.generic.traces'>
[2023-08-17 04:24:37] 2023-08-17 01:24:35,378 | INFO | root | wrap_up | traces error code: 0
[2023-08-17 04:24:37] 2023-08-17 01:24:35,378 | INFO | root | wrap_up | pilot has finished (exit code=0, shell exit code=0)
[2023-08-17 04:24:37] 2023-08-17 01:24:35,934 [wrapper] ==== pilot stdout END ====
[2023-08-17 04:24:37] 2023-08-17 01:24:35,950 [wrapper] ==== wrapper stdout RESUME ====
[2023-08-17 04:24:37] 2023-08-17 01:24:35,963 [wrapper] pilotpid: 528871
[2023-08-17 04:24:37] 2023-08-17 01:24:36,131 [wrapper] Pilot exit status: 0
[2023-08-17 04:24:37] 2023-08-17 01:24:36,287 [wrapper] pandaids: 5934228858
[2023-08-17 04:24:37] 2023-08-17 01:24:36,300 [wrapper] apfmon messages muted
[2023-08-17 04:24:37] 2023-08-17 01:24:36,301 [wrapper] Test setup, not cleaning
[2023-08-17 04:24:37] 2023-08-17 01:24:36,303 [wrapper] ==== wrapper stdout END ====
[2023-08-17 04:24:37] 2023-08-17 01:24:36,307 [wrapper] ==== wrapper stderr END ====
[2023-08-17 04:24:37] 2023-08-17 01:24:36,313 [wrapper] wrapperexiting ec=0, duration=1487
[2023-08-17 04:24:37] 2023-08-17 01:24:36,315 [wrapper] apfmon messages muted
[2023-08-17 04:24:37] *** Error codes and diagnostics ***
[2023-08-17 04:24:37] "exeErrorCode": 0,
[2023-08-17 04:24:37] "exeErrorDiag": "",
[2023-08-17 04:24:37] "pilotErrorCode": 0,
[2023-08-17 04:24:37] "pilotErrorDiag": "",
[2023-08-17 04:24:37] *** Listing of results directory ***
[2023-08-17 04:24:37] total 45000
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 1659119 Aug 17 03:30 agis_ddmendpoints.agis.ALL.json
[2023-08-17 04:24:37] -rwx------ 1 boinc boinc 27275 Aug 17 03:37 runpilot2-wrapper.sh
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 4388 Aug 17 03:37 queuedata.json
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 918320 Aug 17 03:37 pilot3.tar.gz
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 107 Aug 17 03:59 wrapper_26015_x86_64-pc-linux-gnu
[2023-08-17 04:24:37] -rwxr-xr-x 1 boinc boinc 7986 Aug 17 03:59 run_atlas
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 112 Aug 17 03:59 job.xml
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 6496 Aug 17 03:59 init_data.xml
[2023-08-17 04:24:37] -rw-r--r-- 2 boinc boinc 37073557 Aug 17 03:59 EVNT.04972714._000021.pool.root.1
[2023-08-17 04:24:37] -rw-r--r-- 2 boinc boinc 17632 Aug 17 03:59 start_atlas.sh
[2023-08-17 04:24:37] drwxrwx--x 2 boinc boinc 4096 Aug 17 03:59 shared
[2023-08-17 04:24:37] -rw-r--r-- 2 boinc boinc 927510 Aug 17 03:59 input.tar.gz
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 0 Aug 17 03:59 boinc_lockfile
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 2665 Aug 17 03:59 pandaJob.out
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 424 Aug 17 03:59 setup.sh.local
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 1015275 Aug 17 04:00 agis_schedconf.cvmfs.json
[2023-08-17 04:24:37] drwx------ 5 boinc boinc 4096 Aug 17 04:00 pilot3
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 1423872 Aug 17 04:21 output.1.d713397d-425f-478e-b39b-ab1f733c42f6_24279.pool.root
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 1005 Aug 17 04:22 memory_monitor_summary.json
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 533 Aug 17 04:22 boinc_task_state.xml
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 179024 Aug 17 04:22 d713397d-425f-478e-b39b-ab1f733c42f6_24279.1.job.log.tgz
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 8444 Aug 17 04:24 heartbeat.json
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 8192 Aug 17 04:24 boinc_mmap_file
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 25 Aug 17 04:24 wrapper_checkpoint.txt
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 8509 Aug 17 04:24 pilotlog.txt
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 518449 Aug 17 04:24 d713397d-425f-478e-b39b-ab1f733c42f6_24279.1.job.log
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 464 Aug 17 04:24 output.list
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 748 Aug 17 04:24 runtime_log
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 2140160 Aug 17 04:24 result.tar.gz
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 12031 Aug 17 04:24 runtime_log.err
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 640 Aug 17 04:24 0QSKDmACgq3n7Olcko1bjSoqABFKDmABFKDm7AsVDm4PPKDm5jAEDn.diag
[2023-08-17 04:24:37] -rw-r--r-- 1 boinc boinc 32656 Aug 17 04:24 stderr.txt
[2023-08-17 04:24:37] HITS file was successfully produced:
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 1423872 Aug 17 04:21 shared/HITS.pool.root.1
[2023-08-17 04:24:37] *** Contents of shared directory: ***
[2023-08-17 04:24:37] total 40624
[2023-08-17 04:24:37] -rw-r--r-- 2 boinc boinc 37073557 Aug 17 03:59 ATLAS.root_0
[2023-08-17 04:24:37] -rw-r--r-- 2 boinc boinc 17632 Aug 17 03:59 start_atlas.sh
[2023-08-17 04:24:37] -rw-r--r-- 2 boinc boinc 927510 Aug 17 03:59 input.tar.gz
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 1423872 Aug 17 04:21 HITS.pool.root.1
[2023-08-17 04:24:37] -rw------- 1 boinc boinc 2140160 Aug 17 04:24 result.tar.gz
04:24:38 (525001): run_atlas exited; CPU time 539.226955
04:24:38 (525001): called boinc_finish(0)
</stderr_txt>
]]>
©2024 CERN