| Name | it4KDmm5czvnShfckohDCDFpABFKDmABFKDmyiALDm9CFKDmioikvn_0 |
| Workunit | 1960162 |
| Created | 12 Dec 2019, 12:49:55 UTC |
| Sent | 12 Dec 2019, 15:50:42 UTC |
| Report deadline | 19 Dec 2019, 15:50:42 UTC |
| Received | 12 Dec 2019, 17:34:52 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 3723 |
| Run time | 40 min 37 sec |
| CPU time | 42 min 31 sec |
| Validate state | Valid |
| Credit | 33.62 |
| Device peak FLOPS | 5.96 GFLOPS |
| Application version | ATLAS Simulation v0.92 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 1.79 GB |
| Peak swap size | 2.55 GB |
| Peak disk usage | 719.54 MB |
Stderr output
<core_client_version>7.5.1</core_client_version>
<![CDATA[
<stderr_txt>
16:57:44 (9323): wrapper (7.7.26015): starting
16:57:44 (9323): wrapper: running run_atlas (--nthreads 2)
Do 12. Dez 16:57:44 CET 2019: Using singularity image /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img
Do 12. Dez 16:57:44 CET 2019: Arguments: --nthreads 2
Do 12. Dez 16:57:44 CET 2019: Threads: 2
Do 12. Dez 16:57:44 CET 2019: Checking for CVMFS
Do 12. Dez 16:57:53 CET 2019: Probing /cvmfs/atlas.cern.ch... OK
Do 12. Dez 16:57:53 CET 2019: Probing /cvmfs/atlas-condb.cern.ch... OK
Do 12. Dez 16:57:54 CET 2019: Probing /cvmfs/grid.cern.ch... OK
Do 12. Dez 16:57:54 CET 2019: Probing /cvmfs/cernvm-prod.cern.ch... OK
Do 12. Dez 16:57:54 CET 2019: Probing /cvmfs/sft.cern.ch... OK
Do 12. Dez 16:57:56 CET 2019: Probing /cvmfs/alice.cern.ch... OK
Do 12. Dez 16:57:57 CET 2019: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
Do 12. Dez 16:57:57 CET 2019: 2.7.0.0 9485 0 22636 57874 3 1 2989865 4194304 0 65024 0 0 n/a 20277 2799 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
Do 12. Dez 16:57:57 CET 2019: CVMFS is ok
Do 12. Dez 16:57:57 CET 2019: Checking for singularity binary...
Do 12. Dez 16:57:57 CET 2019: which: no singularity in (/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin:/root/bin)
Do 12. Dez 16:57:57 CET 2019: Singularity is not installed, using version from CVMFS
Do 12. Dez 16:57:57 CET 2019: Checking singularity works with /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/current/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img hostname
Do 12. Dez 16:58:29 CET 2019: [34mINFO: [0m Convert SIF file to sandbox... RYZSL76 [34mINFO: [0m Cleaning up image...
Do 12. Dez 16:58:29 CET 2019: Singularity works
Do 12. Dez 16:58:32 CET 2019: Set ATHENA_PROC_NUMBER=2
Do 12. Dez 16:58:32 CET 2019: Starting ATLAS job with PandaID=4002876565
Do 12. Dez 16:58:32 CET 2019: Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/singularity/x86_64-el7/current/bin/singularity exec --pwd /root/Downloads/BOINC/slots/1 -B /cvmfs,/root /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img sh start_atlas.sh
Do 12. Dez 17:38:19 CET 2019: *** The last 200 lines of the pilot log: ***
Do 12. Dez 17:38:19 CET 2019: "avgRSS": 283359,
Do 12. Dez 17:38:19 CET 2019: "avgSwap": 0,
Do 12. Dez 17:38:19 CET 2019: "avgVMEM": 1030939,
Do 12. Dez 17:38:19 CET 2019: "rateRBYTES": 2947099,
Do 12. Dez 17:38:19 CET 2019: "rateRCHAR": 720046,
Do 12. Dez 17:38:19 CET 2019: "rateWBYTES": 746,
Do 12. Dez 17:38:19 CET 2019: "rateWCHAR": 7144
Do 12. Dez 17:38:19 CET 2019: },
Do 12. Dez 17:38:19 CET 2019: "Max": {
Do 12. Dez 17:38:19 CET 2019: "maxPSS": 624794,
Do 12. Dez 17:38:19 CET 2019: "maxRSS": 700620,
Do 12. Dez 17:38:19 CET 2019: "maxSwap": 0,
Do 12. Dez 17:38:19 CET 2019: "maxVMEM": 2259304,
Do 12. Dez 17:38:19 CET 2019: "totRBYTES": 1326194688,
Do 12. Dez 17:38:19 CET 2019: "totRCHAR": 324020973,
Do 12. Dez 17:38:19 CET 2019: "totWBYTES": 335872,
Do 12. Dez 17:38:19 CET 2019: "totWCHAR": 3215104
Do 12. Dez 17:38:19 CET 2019: }
Do 12. Dez 17:38:19 CET 2019: },
Do 12. Dez 17:38:19 CET 2019: "postExe": {
Do 12. Dez 17:38:19 CET 2019: "cpuTime": 5,
Do 12. Dez 17:38:19 CET 2019: "wallTime": 1
Do 12. Dez 17:38:19 CET 2019: },
Do 12. Dez 17:38:19 CET 2019: "preExe": {
Do 12. Dez 17:38:19 CET 2019: "cpuTime": 9,
Do 12. Dez 17:38:19 CET 2019: "wallTime": 35
Do 12. Dez 17:38:19 CET 2019: },
Do 12. Dez 17:38:19 CET 2019: "total": {
Do 12. Dez 17:38:19 CET 2019: "cpuTime": 232,
Do 12. Dez 17:38:19 CET 2019: "wallTime": 515
Do 12. Dez 17:38:19 CET 2019: },
Do 12. Dez 17:38:19 CET 2019: "validation": {
Do 12. Dez 17:38:19 CET 2019: "cpuTime": 0,
Do 12. Dez 17:38:19 CET 2019: "wallTime": 0
Do 12. Dez 17:38:19 CET 2019: },
Do 12. Dez 17:38:19 CET 2019: "wallTime": 479
Do 12. Dez 17:38:19 CET 2019: }
Do 12. Dez 17:38:19 CET 2019: },
Do 12. Dez 17:38:19 CET 2019: "machine": {
Do 12. Dez 17:38:19 CET 2019: "cpu_family": "23",
Do 12. Dez 17:38:19 CET 2019: "linux_distribution": [
Do 12. Dez 17:38:19 CET 2019: "CentOS Linux",
Do 12. Dez 17:38:19 CET 2019: "7.6.1810",
Do 12. Dez 17:38:19 CET 2019: "Core"
Do 12. Dez 17:38:19 CET 2019: ],
Do 12. Dez 17:38:19 CET 2019: "model": "8",
Do 12. Dez 17:38:19 CET 2019: "model_name": "AMD Ryzen 7 2700 Eight-Core Processor",
Do 12. Dez 17:38:19 CET 2019: "node": "RYZSL76",
Do 12. Dez 17:38:19 CET 2019: "platform": "Linux-3.10.0-1062.7.1.el7.x86_64-x86_64-with-centos-7.6.1810-Core"
Do 12. Dez 17:38:19 CET 2019: },
Do 12. Dez 17:38:19 CET 2019: "transform": {
Do 12. Dez 17:38:19 CET 2019: "cpuEfficiency": 0.589,
Do 12. Dez 17:38:19 CET 2019: "cpuPWEfficiency": 0.6455,
Do 12. Dez 17:38:19 CET 2019: "cpuTime": 20,
Do 12. Dez 17:38:19 CET 2019: "cpuTimeTotal": 2729,
Do 12. Dez 17:38:19 CET 2019: "externalCpuTime": 29,
Do 12. Dez 17:38:19 CET 2019: "processedEvents": 10,
Do 12. Dez 17:38:19 CET 2019: "trfPredata": null,
Do 12. Dez 17:38:19 CET 2019: "wallTime": 2113
Do 12. Dez 17:38:19 CET 2019: }
Do 12. Dez 17:38:19 CET 2019: }
Do 12. Dez 17:38:19 CET 2019: }
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,095 | DEBUG | queue_monitor | pilot.util.auxiliary.4002876565 | update_server | xml:will send fileinfo
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,095 | INFO | queue_monitor | pilot.control.job.4002876565 | send_state | pilot will not update the server (heartbeat message will be written to file)
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,095 | INFO | queue_monitor | pilot.control.job.4002876565 | send_state | job 4002876565 has finished - writing final server update
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,095 | DEBUG | queue_monitor | pilot.control.job.4002876565 | get_data_structure | building data structure to be sent to server with heartbeat
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,096 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | get_job_metrics | will not add max space = -351750733 B to job metrics
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,097 | DEBUG | queue_monitor | pilot.api.analytics | get_fitted_data | removing tails from data to be fitted
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,097 | INFO | queue_monitor | pilot.api.analytics | get_fitted_data | fitting pss+swap vs Time
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,105 | INFO | queue_monitor | pilot.api.analytics | get_fitted_data | current memory leak: -952.31 B/s (using 29 data points, chi2=7892357)
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,105 | DEBUG | queue_monitor | pilot.util.auxiliary.4002876565 | get_job_metrics | job metrics="coreCount=2 actualCoreCount=1 nEvents=10 leak=-952.31 chi2=7892357"
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,116 | INFO | queue_monitor | pilot.control.job.4002876565 | get_data_structure | total number of processed events: 10 (read)
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,121 | INFO | queue_monitor | pilot.user.atlas.utilities | get_memory_values | using path: /root/Downloads/BOINC/slots/1/PanDA_Pilot-4002876565/memory_monitor_summary.json (trf name=prmon)
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,128 | DEBUG | queue_monitor | pilot.user.atlas.utilities | get_memory_monitor_info | summary_dictionary={'Max': {'rx_packets': 69632, 'nprocs': 7, 'nthreads': 1, 'rx_bytes': 80277828, 'wtime': 2169, 'rss': 5603064, 'write_bytes': 25133056, 'vmem': 8671412, 'read_bytes': 3782299648, 'stime': 178, 'tx_bytes': 4524098, 'pss': 2200192, 'wchar': 31193742, 'rchar': 1072663479, 'tx_packets': 18599, 'swap': 0, 'utime': 2380}, 'Avg': {'write_bytes': 11584, 'nprocs': 6, 'nthreads': 0, 'rx_bytes': 37003, 'rx_packets': 32, 'vmem': 5158815, 'read_bytes': 1743413, 'swap': 0, 'tx_bytes': 2085, 'pss': 1381545, 'wchar': 14378, 'rchar': 494433, 'tx_packets': 8, 'rss': 3042125}}
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,128 | INFO | queue_monitor | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard info from prmon json
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,128 | INFO | queue_monitor | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard memory fields from prmon json
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,129 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | ..............................
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,129 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | . Timing measurements:
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,129 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | . get job = 0 s
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,129 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | . initial setup = 2 s
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,129 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | . payload setup = 0 s
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,129 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | . total setup = 2 s
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,129 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | . stage-in = 0 s
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,130 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | . payload execution = 2245 s
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,130 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | . stage-out = 4 s
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,130 | INFO | queue_monitor | pilot.util.auxiliary.4002876565 | timing_report | ..............................
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,131 | DEBUG | queue_monitor | pilot.control.job.4002876565 | send_state | wrote heartbeat to file /root/Downloads/BOINC/slots/1/heartbeat.json
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,131 | DEBUG | queue_monitor | pilot.control.job | queue_monitor | job 4002876565 was dequeued from the monitored payloads queue
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,131 | DEBUG | queue_monitor | pilot.control.job | queue_monitor | tmp job object deleted
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,269 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report |
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,269 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | job summary report
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,269 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | --------------------------------------------------
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,269 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | PanDA job id: 4002876565
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,269 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | task id: 000649-3918842-12203
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,270 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | errors: (none)
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,270 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | status: LOG_TRANSFER = DONE
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,270 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | pilot state: finished
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,272 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | transexitcode: 0
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,272 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | exeerrorcode: 0
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,272 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | exeerrordiag:
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,272 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | exitcode: 0
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,272 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | exitmsg: OK
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,272 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | cpuconsumptiontime: 2590 s
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,272 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | nevents: 10
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,273 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | neventsw: 0
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,273 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | pid: 16932
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,273 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | pgrp: 16932
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,273 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | corecount: 2
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,273 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | event service: False
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,273 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report | --------------------------------------------------
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,273 | INFO | retrieve | pilot.util.auxiliary.4002876565 | make_job_report |
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,273 | INFO | retrieve | pilot.control.job.4002876565 | has_job_completed | job 4002876565 has completed
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,274 | INFO | retrieve | pilot.util.processes | cleanup | overall cleanup function is called
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:21,279 | DEBUG | retrieve | pilot.util.processes | cleanup | work directory was removed: /root/Downloads/BOINC/slots/1/PanDA_Pilot-4002876565
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:22,280 | INFO | retrieve | pilot.info.jobdata | collect_zombies | --- collectZombieJob: --- 10, [16932]
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:22,280 | INFO | retrieve | pilot.info.jobdata | collect_zombies | zombie collector trying to kill pid 16932
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:22,280 | INFO | retrieve | pilot.info.jobdata | collect_zombies | harmless exception when collecting zombies: [Errno 10] No child processes
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,287 | INFO | retrieve | pilot.util.processes | cleanup | collected zombie processes
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,288 | INFO | retrieve | pilot.util.processes | cleanup | will now attempt to kill all subprocesses of pid=16932
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,490 | INFO | retrieve | pilot.util.processes | kill_processes | process IDs to be killed: [16932] (in reverse order)
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,715 | WARNING | retrieve | pilot.util.processes | kill_processes | found no corresponding commands to process id(s)
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,715 | INFO | retrieve | pilot.util.processes | kill_orphans | Do not look for orphan processes in BOINC jobs
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,723 | INFO | retrieve | pilot.util.processes | cleanup | resetting job object
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,724 | INFO | retrieve | pilot.control.job | retrieve | ready for new job
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,724 | INFO | retrieve | root | retrieve | pilot has finished for previous job - re-establishing logging
Do 12. Dez 17:38:19 CET 2019: mpi4py not found
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,768 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | ****************************************
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,768 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | *** PanDA Pilot version 2.3.3 (16) ***
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,769 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | ****************************************
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,769 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner |
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,770 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | pilot is running in a VM
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:23,770 | INFO | retrieve | pilot.util.auxiliary | display_architecture_info | architecture information:
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:24,300 | INFO | retrieve | pilot.util.auxiliary | display_architecture_info |
Do 12. Dez 17:38:19 CET 2019: LSB Version: :core-4.1-amd64:core-4.1-noarch
Do 12. Dez 17:38:19 CET 2019: Distributor ID: CentOS
Do 12. Dez 17:38:19 CET 2019: Description: CentOS Linux release 7.6.1810 (Core)
Do 12. Dez 17:38:19 CET 2019: Release: 7.6.1810
Do 12. Dez 17:38:19 CET 2019: Codename: Core
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:24,300 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | ****************************************
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:24,804 | DEBUG | retrieve | pilot.util.monitoring | check_local_space | checking local space on /root/Downloads/BOINC/slots/1
Do 12. Dez 17:38:19 CET 2019: 2019-12-12 16:37:24,882 | INFO | retrieve | pilot.util.monitoring | check_local_space | sufficient remaining disk space (6571425792 B)
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:24,882 | WARNING | retrieve | pilot.control.job | proceed_with_getjob | since timefloor is set to 0, pilot was only allowed to run one job
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:24,882 | DEBUG | retrieve | pilot.control.job | retrieve | [job] retrieve thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:24,883 | WARNING | queue_monitoring | pilot.util.common | should_abort | data:queue_monitoring:received graceful stop - abort after this iteration
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,018 | DEBUG | payload | pilot.control.payload | control | payload control ending since graceful_stop has been set
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,018 | DEBUG | payload | pilot.control.payload | control | [payload] control thread has finished
17:38:20 (9323): run_atlas exited; CPU time 2551.379965
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,138 | INFO | monitor | pilot.control.monitor | control | [monitor] control thread has ended
17:38:20 (9323): called boinc_finish(0)
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,203 | DEBUG | MainThread | pilot.workflow.generic | run | thread count now at 14 threads
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,203 | DEBUG | MainThread | pilot.workflow.generic | run | enumerate: [<_MainThread(MainThread, started 140552503711552)>, <ExcThread(job, started 140552341554944)>, <ExcThread(validate_pre, started 140551798126336)>, <ExcThread(queue_monitoring, started 140552307984128)>, <ExcThread(validate_post, started 140551789733632)>, <ExcThread(execute_payloads, started 140551328364288)>, <ExcThread(copytool_out, started 140552316376832)>, <ExcThread(data, started 140552324769536)>, <ExcThread(job_monitor, started 140551772948224)>, <ExcThread(validate, started 140552333162240)>, <ExcThread(queue_monitor, started 140551764555520)>, <ExcThread(failed_post, started 140551747770112)>, <ExcThread(copytool_in, started 140552299591424)>, <ExcThread(create_data_payload, started 140552291198720)>]
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,293 | DEBUG | copytool_in | pilot.control.data | copytool_in | [data] copytool_in thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,294 | INFO | validate_pre | pilot.control.payload | validate_pre | [payload] validate_pre thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,295 | DEBUG | validate | pilot.control.job | validate | [job] validate thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,344 | DEBUG | data | pilot.control.data | control | data control ending since graceful_stop has been set
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,345 | DEBUG | data | pilot.control.data | control | [data] control thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,735 | INFO | failed_post | pilot.control.payload | failed_post | [payload] failed_post thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:25,956 | INFO | validate_post | pilot.control.payload | validate_post | [payload] validate_post thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:26,162 | WARNING | queue_monitor | pilot.util.common | should_abort | job:queue_monitor:received graceful stop - abort after this iteration
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:26,162 | DEBUG | queue_monitor | pilot.control.job | queue_monitor | [job] queue monitor thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:26,188 | DEBUG | job | pilot.control.job | control | job control ending since graceful_stop has been set
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:26,188 | DEBUG | job | pilot.control.job | control | [job] control thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:26,210 | DEBUG | MainThread | pilot.workflow.generic | run | thread count now at 6 threads
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:26,210 | DEBUG | MainThread | pilot.workflow.generic | run | enumerate: [<_MainThread(MainThread, started 140552503711552)>, <ExcThread(queue_monitoring, started 140552307984128)>, <ExcThread(execute_payloads, started 140551328364288)>, <ExcThread(copytool_out, started 140552316376832)>, <ExcThread(job_monitor, started 140551772948224)>, <ExcThread(create_data_payload, started 140552291198720)>]
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:26,300 | INFO | execute_payloads | pilot.control.payload | execute_payloads | [payload] execute_payloads thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:26,307 | WARNING | copytool_out | pilot.util.common | should_abort | data:copytool_out:received graceful stop - abort after this iteration
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:26,308 | DEBUG | create_data_payload | pilot.control.job | create_data_payload | [job] create_data_payload thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:27,217 | DEBUG | MainThread | pilot.workflow.generic | run | thread count now at 4 threads
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:27,217 | DEBUG | MainThread | pilot.workflow.generic | run | enumerate: [<_MainThread(MainThread, started 140552503711552)>, <ExcThread(queue_monitoring, started 140552307984128)>, <ExcThread(copytool_out, started 140552316376832)>, <ExcThread(job_monitor, started 140551772948224)>]
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:27,311 | DEBUG | copytool_out | pilot.control.data | copytool_out | [data] copytool_out thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:27,917 | DEBUG | queue_monitoring | pilot.control.data | queue_monitoring | [data] queue_monitor thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:28,232 | DEBUG | MainThread | pilot.workflow.generic | run | thread count now at 2 threads
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:37:28,233 | DEBUG | MainThread | pilot.workflow.generic | run | enumerate: [<_MainThread(MainThread, started 140552503711552)>, <ExcThread(job_monitor, started 140551772948224)>]
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:05,101 | WARNING | job_monitor | pilot.control.job | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 73 s)
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:05,101 | DEBUG | job_monitor | pilot.control.job | job_monitor | [job] job monitor thread has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06,050 | INFO | MainThread | pilot.workflow.generic | run | end of generic workflow (traces error code: 0)
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06,050 | INFO | MainThread | root | wrap_up | traces error code: 0
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06,050 | INFO | MainThread | root | wrap_up | pilot has finished
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] ==== pilot stdout END ====
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] ==== wrapper stdout RESUME ====
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] Pilot exit status: 0
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] STATUSCODE: 0
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] apfmon messages muted
Do 12. Dez 17:38:20 CET 2019: ---- find pandaID.out ----
Do 12. Dez 17:38:20 CET 2019: total 60
Do 12. Dez 17:38:20 CET 2019: -rw-rw-r--. 1 root root 11357 Jul 25 16:38 LICENSE
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 20 Sep 9 13:04 MANIFEST.IN
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 8 Dec 2 11:02 PILOTVERSION
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 2212 Nov 14 11:01 README.md
Do 12. Dez 17:38:20 CET 2019: -rw-rw-r--. 1 root root 221 Jul 25 16:38 TODO.md
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 11 Dec 12 16:59 pandaIDs.out
Do 12. Dez 17:38:20 CET 2019: drwxrwxr-x. 14 root root 216 Dec 12 16:59 pilot
Do 12. Dez 17:38:20 CET 2019: -rwxr-xr-x. 1 root root 20750 Dec 2 11:02 pilot.py
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 766 Oct 10 16:01 setup.py
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 11 Dec 12 16:59 /root/Downloads/BOINC/slots/1/pilot2/pandaIDs.out
Do 12. Dez 17:38:20 CET 2019: 4002876565
Do 12. Dez 17:38:20 CET 2019:
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] Test setup, not cleaning
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] ==== wrapper stdout END ====
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] ==== wrapper stderr END ====
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] wrapper wrapperexiting ec=0, duration=2350
Do 12. Dez 17:38:20 CET 2019: 2019-12-12 16:38:06 UTC [wrapper] apfmon messages muted
Do 12. Dez 17:38:20 CET 2019: *** Error codes and diagnostics ***
Do 12. Dez 17:38:20 CET 2019: "exeErrorCode": 0,
Do 12. Dez 17:38:20 CET 2019: "exeErrorDiag": "",
Do 12. Dez 17:38:20 CET 2019: "pilotErrorCode": 0,
Do 12. Dez 17:38:20 CET 2019: "pilotErrorDiag": "",
Do 12. Dez 17:38:20 CET 2019: *** Listing of results directory ***
Do 12. Dez 17:38:20 CET 2019: insgesamt 385220
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 266835 12. Dez 13:26 pilot2.tar.gz
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 4492 12. Dez 13:46 queuedata.json
Do 12. Dez 17:38:20 CET 2019: -rwx------. 1 root root 12641 12. Dez 13:49 runpilot2-wrapper.sh
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 2958 12. Dez 13:49 pandaJobData.out
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 107 12. Dez 16:57 wrapper_26015_x86_64-pc-linux-gnu
Do 12. Dez 17:38:20 CET 2019: -rwxr-xr-x. 1 root root 4813 12. Dez 16:57 run_atlas
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 112 12. Dez 16:57 job.xml
Do 12. Dez 17:38:20 CET 2019: drwxrwx--x. 2 root root 86 12. Dez 16:57 shared
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 5720 12. Dez 16:57 init_data.xml
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 0 12. Dez 16:57 boinc_lockfile
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 365251149 12. Dez 16:58 EVNT.14296418._001447.pool.root.1
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 275014 12. Dez 16:58 input.tar.gz
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 815 12. Dez 16:58 RTE.tar.gz
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 8541 12. Dez 16:58 start_atlas.sh
Do 12. Dez 17:38:20 CET 2019: drwxr-xr-x. 3 root root 17 12. Dez 16:58 APPS
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 3742538 12. Dez 16:59 agis_schedconf.cvmfs.json
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 7755224 12. Dez 16:59 agis_ddmendpoints.json
Do 12. Dez 17:38:20 CET 2019: drwxr-xr-x. 3 root root 229 12. Dez 16:59 pilot2
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 535 12. Dez 17:23 boinc_task_state.xml
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 9192770 12. Dez 17:36 HITS.000649-3918842-12203._078090.pool.root.1
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 835 12. Dez 17:37 memory_monitor_summary.json
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 515508 12. Dez 17:37 log.000649-3918842-12203._078090.job.log.tgz.1
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 11707 12. Dez 17:37 heartbeat.json
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 8710 12. Dez 17:38 pilotlog.txt
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 244644 12. Dez 17:38 log.000649-3918842-12203._078090.job.log.1
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 491 12. Dez 17:38 it4KDmm5czvnShfckohDCDFpABFKDmABFKDmyiALDm9CFKDmioikvn.diag
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 499 12. Dez 17:38 output.list
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 742 12. Dez 17:38 runtime_log
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 778240 12. Dez 17:38 result.tar.gz
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 7679 12. Dez 17:38 runtime_log.err
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 8192 12. Dez 17:38 boinc_mmap_file
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 26 12. Dez 17:38 wrapper_checkpoint.txt
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 2732 12. Dez 17:38 stderr.txt
Do 12. Dez 17:38:20 CET 2019: HITS file was successfully produced:
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 9192770 12. Dez 17:36 shared/HITS.pool.root.1
Do 12. Dez 17:38:20 CET 2019: *** Contents of shared directory: ***
Do 12. Dez 17:38:20 CET 2019: insgesamt 372780
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 365251149 12. Dez 16:57 ATLAS.root_0
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 8513 12. Dez 16:57 start_atlas.sh
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 815 12. Dez 16:57 RTE.tar.gz
Do 12. Dez 17:38:20 CET 2019: -rw-r--r--. 1 root root 275014 12. Dez 16:57 input.tar.gz
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 9192770 12. Dez 17:36 HITS.pool.root.1
Do 12. Dez 17:38:20 CET 2019: -rw-------. 1 root root 778240 12. Dez 17:38 result.tar.gz
</stderr_txt>
]]>
©2024 CERN