Name ZmcKDm4uoDwnShfckohDCDFpABFKDmABFKDmyiALDmEEFKDmNI98Lm_0
Workunit 1973462
Created 20 Jan 2020, 16:17:35 UTC
Sent 21 Jan 2020, 2:18:55 UTC
Report deadline 28 Jan 2020, 2:18:55 UTC
Received 21 Jan 2020, 2:54:42 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 3848
Run time 34 min 11 sec
CPU time 45 min 50 sec
Validate state Valid
Credit 22.11
Device peak FLOPS 4.66 GFLOPS
Application version ATLAS Simulation v1.00 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 1.80 GB
Peak swap size 2.56 GB
Peak disk usage 715.35 MB

Stderr output

<core_client_version>7.16.1</core_client_version>
<![CDATA[
<stderr_txt>
03:20:06 (32735): wrapper (7.7.26015): starting
03:20:06 (32735): wrapper: running run_atlas (--nthreads 2)
Di 21. Jan 03:20:06 CET 2020: Arguments: --nthreads 2
Di 21. Jan 03:20:06 CET 2020: Threads: 2
Di 21. Jan 03:20:06 CET 2020: Checking for CVMFS
Di 21. Jan 03:20:06 CET 2020: Probing /cvmfs/atlas.cern.ch... OK
Di 21. Jan 03:20:06 CET 2020: Probing /cvmfs/atlas-condb.cern.ch... OK
Di 21. Jan 03:20:06 CET 2020: Probing /cvmfs/grid.cern.ch... OK
Di 21. Jan 03:20:07 CET 2020: Probing /cvmfs/cernvm-prod.cern.ch... OK
Di 21. Jan 03:20:07 CET 2020: Probing /cvmfs/sft.cern.ch... OK
Di 21. Jan 03:20:07 CET 2020: Probing /cvmfs/alice.cern.ch... OK
Di 21. Jan 03:20:07 CET 2020: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
Di 21. Jan 03:20:07 CET 2020: 2.7.0.0 3040 9587 82524 59415 2 61 2260727 4194305 1 65024 0 182864 97.1345 1072498 1654 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
Di 21. Jan 03:20:07 CET 2020: CVMFS is ok
Di 21. Jan 03:20:07 CET 2020: Using singularity image /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img
Di 21. Jan 03:20:07 CET 2020: Checking for singularity binary...
Di 21. Jan 03:20:07 CET 2020: Using singularity found in PATH at /usr/bin/singularity
Di 21. Jan 03:20:07 CET 2020: Running /usr/bin/singularity --version
Di 21. Jan 03:20:07 CET 2020: singularity version 3.5.2-1.1.el7
Di 21. Jan 03:20:07 CET 2020: Checking singularity works with /usr/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img hostname
Di 21. Jan 03:20:08 CET 2020: ryzcos7
Di 21. Jan 03:20:08 CET 2020: Singularity works
Di 21. Jan 03:20:08 CET 2020: Set ATHENA_PROC_NUMBER=2
Di 21. Jan 03:20:08 CET 2020: Starting ATLAS job with PandaID=4002876565
Di 21. Jan 03:20:08 CET 2020: Running command: /usr/bin/singularity exec --pwd /var/lib/boinc/slots/0 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img sh start_atlas.sh
Di 21. Jan 03:54:16 CET 2020:  *** The last 200 lines of the pilot log: ***
Di 21. Jan 03:54:16 CET 2020:           "cpuTime": 3, 
Di 21. Jan 03:54:16 CET 2020:           "wallTime": 1
Di 21. Jan 03:54:16 CET 2020:         }, 
Di 21. Jan 03:54:16 CET 2020:         "preExe": {
Di 21. Jan 03:54:16 CET 2020:           "cpuTime": 3, 
Di 21. Jan 03:54:16 CET 2020:           "wallTime": 15
Di 21. Jan 03:54:16 CET 2020:         }, 
Di 21. Jan 03:54:16 CET 2020:         "total": {
Di 21. Jan 03:54:16 CET 2020:           "cpuTime": 132, 
Di 21. Jan 03:54:16 CET 2020:           "wallTime": 309
Di 21. Jan 03:54:16 CET 2020:         }, 
Di 21. Jan 03:54:16 CET 2020:         "validation": {
Di 21. Jan 03:54:16 CET 2020:           "cpuTime": 0, 
Di 21. Jan 03:54:16 CET 2020:           "wallTime": 0
Di 21. Jan 03:54:16 CET 2020:         }, 
Di 21. Jan 03:54:16 CET 2020:         "wallTime": 293
Di 21. Jan 03:54:16 CET 2020:       }
Di 21. Jan 03:54:16 CET 2020:     }, 
Di 21. Jan 03:54:16 CET 2020:     "machine": {
Di 21. Jan 03:54:16 CET 2020:       "cpu_family": "23", 
Di 21. Jan 03:54:16 CET 2020:       "linux_distribution": [
Di 21. Jan 03:54:16 CET 2020:         "CentOS Linux", 
Di 21. Jan 03:54:16 CET 2020:         "7.6.1810", 
Di 21. Jan 03:54:16 CET 2020:         "Core"
Di 21. Jan 03:54:16 CET 2020:       ], 
Di 21. Jan 03:54:16 CET 2020:       "model": "8", 
Di 21. Jan 03:54:16 CET 2020:       "model_name": "AMD Ryzen 7 2700 Eight-Core Processor", 
Di 21. Jan 03:54:16 CET 2020:       "node": "ryzcos7", 
Di 21. Jan 03:54:16 CET 2020:       "platform": "Linux-3.10.0-693.el7.x86_64-x86_64-with-centos-7.6.1810-Core"
Di 21. Jan 03:54:16 CET 2020:     }, 
Di 21. Jan 03:54:16 CET 2020:     "transform": {
Di 21. Jan 03:54:16 CET 2020:       "cpuEfficiency": 0.7101, 
Di 21. Jan 03:54:16 CET 2020:       "cpuPWEfficiency": 0.7454, 
Di 21. Jan 03:54:16 CET 2020:       "cpuTime": 9, 
Di 21. Jan 03:54:16 CET 2020:       "cpuTimeTotal": 2860, 
Di 21. Jan 03:54:16 CET 2020:       "externalCpuTime": 27, 
Di 21. Jan 03:54:16 CET 2020:       "processedEvents": 10, 
Di 21. Jan 03:54:16 CET 2020:       "trfPredata": null, 
Di 21. Jan 03:54:16 CET 2020:       "wallTime": 1909
Di 21. Jan 03:54:16 CET 2020:     }
Di 21. Jan 03:54:16 CET 2020:   }
Di 21. Jan 03:54:16 CET 2020: }
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,428 | DEBUG    | queue_monitor       | pilot.util.auxiliary.4002876565  | update_server             | xml:will send fileinfo
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,428 | DEBUG    | queue_monitor       | pilot.control.job                | get_proper_state          | state=finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,428 | DEBUG    | queue_monitor       | pilot.control.job                | get_proper_state          | serverstate=running
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,428 | DEBUG    | queue_monitor       | pilot.control.job                | get_proper_state          | serverstate=finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,429 | INFO     | queue_monitor       | pilot.control.job.4002876565     | send_state                | pilot will not update the server (heartbeat message will be written to file)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,429 | INFO     | queue_monitor       | pilot.control.job.4002876565     | send_state                | job 4002876565 has finished - writing final server update
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,429 | DEBUG    | queue_monitor       | pilot.control.job.4002876565     | get_data_structure        | building data structure to be sent to server with heartbeat
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,429 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | get_job_metrics           | will not add max space = -353151565 B to job metrics
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,430 | DEBUG    | queue_monitor       | pilot.api.analytics              | get_fitted_data           | removing tails from data to be fitted
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,430 | INFO     | queue_monitor       | pilot.api.analytics              | get_fitted_data           | fitting pss+swap vs Time
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,431 | INFO     | queue_monitor       | pilot.api.analytics              | get_fitted_data           | current memory leak: -781.68 B/s (using 25 data points, chi2=3622412)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,431 | DEBUG    | queue_monitor       | pilot.util.auxiliary.4002876565  | get_job_metrics           | job metrics="coreCount=2 actualCoreCount=1 nEvents=10 leak=-781.68 chi2=3622412"
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,431 | INFO     | queue_monitor       | pilot.control.job.4002876565     | get_data_structure        | total number of processed events: 10 (read)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,432 | INFO     | queue_monitor       | pilot.user.atlas.utilities       | get_memory_values         | using path: /var/lib/boinc/slots/0/PanDA_Pilot-4002876565/memory_monitor_summary.json (trf name=prmon)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,435 | DEBUG    | queue_monitor       | pilot.user.atlas.utilities       | get_memory_monitor_info   | summary_dictionary={'Max': {'rx_packets': 32591, 'nprocs': 10, 'nthreads': 1, 'rx_bytes': 17954763, 'wtime': 1904, 'rss': 5702080, 'write_bytes': 15044608, 'vmem': 8730468, 'read_bytes': 3055408128, 'stime': 87, 'tx_bytes': 7535632, 'pss': 2243960, 'wchar': 21522501, 'rchar': 1056319771, 'tx_packets': 21790, 'swap': 0, 'utime': 2677}, 'Avg': {'write_bytes': 7898, 'nprocs': 6, 'nthreads': 0, 'rx_bytes': 9425, 'rx_packets': 17, 'vmem': 6176769, 'read_bytes': 1604023, 'swap': 0, 'tx_bytes': 3956, 'pss': 1713608, 'wchar': 11298, 'rchar': 554545, 'tx_packets': 11, 'rss': 3829970}}
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,435 | INFO     | queue_monitor       | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard info from prmon json
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,435 | INFO     | queue_monitor       | pilot.user.atlas.utilities       | get_memory_monitor_info   | extracted standard memory fields from prmon json
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | ..............................
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | . Timing measurements:
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | . get job = 0 s
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | . initial setup = 1 s
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | . payload setup = 0 s
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | . total setup = 1 s
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | . stage-in = 0 s
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | . payload execution = 1964 s
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | . stage-out = 3 s
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,436 | INFO     | queue_monitor       | pilot.util.auxiliary.4002876565  | timing_report             | ..............................
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,437 | DEBUG    | queue_monitor       | pilot.control.job.4002876565     | send_state                | wrote heartbeat to file /var/lib/boinc/slots/0/heartbeat.json
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,438 | DEBUG    | queue_monitor       | pilot.control.job                | queue_monitor             | job 4002876565 was dequeued from the monitored payloads queue
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,438 | DEBUG    | queue_monitor       | pilot.control.job                | queue_monitor             | tmp job object deleted
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,445 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | 
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,445 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | job summary report
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,445 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | --------------------------------------------------
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,445 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | PanDA job id: 4002876565
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,445 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | task id: 000649-197458-8183
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,445 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | errors: (none)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,445 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | status: LOG_TRANSFER = DONE 
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,445 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | pilot state: finished 
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | transexitcode: 0
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | exeerrorcode: 0
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | exeerrordiag: 
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | exitcode: 0
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | exitmsg: OK
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | cpuconsumptiontime: 2781 s
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | nevents: 10
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | neventsw: 0
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | pid: 7408
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | pgrp: 7408
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,446 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | corecount: 2
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | event service: False
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | --------------------------------------------------
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.auxiliary.4002876565  | make_job_report           | 
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue jobs has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue payloads has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue data_in has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue data_out has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue current_data_in has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue validated_jobs has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,447 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue validated_payloads has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue monitored_payloads has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue finished_jobs has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue finished_payloads has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue finished_data_in has 1 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue finished_data_out has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue failed_jobs has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue failed_payloads has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue failed_data_in has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue failed_data_out has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue completed_jobs has 0 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,448 | INFO     | retrieve            | pilot.util.queuehandling         | queue_report              | queue completed_jobids has 1 job(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,449 | INFO     | retrieve            | pilot.control.job.4002876565     | has_job_completed         | job 4002876565 has completed (purged errors)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,449 | INFO     | retrieve            | pilot.util.processes             | cleanup                   | overall cleanup function is called
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:25,460 | DEBUG    | retrieve            | pilot.util.processes             | cleanup                   | work directory was removed: /var/lib/boinc/slots/0/PanDA_Pilot-4002876565
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:26,462 | INFO     | retrieve            | pilot.info.jobdata               | collect_zombies           | --- collectZombieJob: --- 10, [7408]
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:26,462 | INFO     | retrieve            | pilot.info.jobdata               | collect_zombies           | zombie collector trying to kill pid 7408
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:26,462 | INFO     | retrieve            | pilot.info.jobdata               | collect_zombies           | harmless exception when collecting zombies: [Errno 10] No child processes
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,465 | INFO     | retrieve            | pilot.util.processes             | cleanup                   | collected zombie processes
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,465 | INFO     | retrieve            | pilot.util.processes             | cleanup                   | will now attempt to kill all subprocesses of pid=7408
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,555 | INFO     | retrieve            | pilot.util.processes             | kill_processes            | process IDs to be killed: [7408] (in reverse order)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,680 | WARNING  | retrieve            | pilot.util.processes             | kill_processes            | found no corresponding commands to process id(s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,681 | INFO     | retrieve            | pilot.util.processes             | kill_orphans              | Do not look for orphan processes in BOINC jobs
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,681 | INFO     | retrieve            | pilot.control.job                | retrieve                  | ready for new job
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,681 | INFO     | retrieve            | root                             | retrieve                  | pilot has finished for previous job - re-establishing logging
Di 21. Jan 03:54:16 CET 2020: mpi4py not found
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,711 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,712 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | ***  PanDA Pilot version 2.3.4 (12)  ***
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,712 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,712 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | 
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,712 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | pilot is running in a VM
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:27,712 | INFO     | retrieve            | pilot.util.auxiliary             | display_architecture_info | architecture information:
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:28,025 | INFO     | retrieve            | pilot.util.auxiliary             | display_architecture_info | 
Di 21. Jan 03:54:16 CET 2020: LSB Version:	:core-4.1-amd64:core-4.1-noarch
Di 21. Jan 03:54:16 CET 2020: Distributor ID:	CentOS
Di 21. Jan 03:54:16 CET 2020: Description:	CentOS Linux release 7.6.1810 (Core) 
Di 21. Jan 03:54:16 CET 2020: Release:	7.6.1810
Di 21. Jan 03:54:16 CET 2020: Codename:	Core
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:28,026 | INFO     | retrieve            | pilot.util.auxiliary             | pilot_version_banner      | ****************************************
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:28,530 | DEBUG    | retrieve            | pilot.util.monitoring            | check_local_space         | checking local space on /var/lib/boinc/slots/0
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:28,571 | INFO     | retrieve            | pilot.util.monitoring            | check_local_space         | sufficient remaining disk space (7912554496 B)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:28,571 | WARNING  | retrieve            | pilot.control.job                | proceed_with_getjob       | since timefloor is set to 0, pilot was only allowed to run one job
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:28,571 | DEBUG    | retrieve            | pilot.control.job                | retrieve                  | [job] retrieve thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:28,776 | WARNING  | copytool_out        | pilot.util.common                | should_abort              | data:copytool_out:received graceful stop - abort after this iteration
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:28,874 | INFO     | validate_post       | pilot.control.payload            | validate_post             | [payload] validate_post thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:28,969 | DEBUG    | create_data_payload | pilot.control.job                | create_data_payload       | [job] create_data_payload thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,043 | DEBUG    | copytool_in         | pilot.control.data               | copytool_in               | [data] copytool_in thread has finished
03:54:16 (32735): run_atlas exited; CPU time 2750.907639
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,067 | INFO     | monitor             | pilot.control.monitor            | control                   | [monitor] control thread has ended
03:54:16 (32735): called boinc_finish(0)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,335 | DEBUG    | payload             | pilot.control.payload            | control                   | payload control ending since graceful_stop has been set
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,335 | DEBUG    | payload             | pilot.control.payload            | control                   | [payload] control thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,335 | DEBUG    | data                | pilot.control.data               | control                   | data control ending since graceful_stop has been set
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,336 | DEBUG    | data                | pilot.control.data               | control                   | [data] control thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,354 | DEBUG    | MainThread          | pilot.workflow.generic           | run                       | thread count now at 10 threads
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,355 | DEBUG    | MainThread          | pilot.workflow.generic           | run                       | enumerate: [<_MainThread(MainThread, started 140224287737664)>, <ExcThread(job, started 140224125318912)>, <ExcThread(execute_payloads, started 140223384098560)>, <ExcThread(queue_monitoring, started 140224004863744)>, <ExcThread(copytool_out, started 140224021649152)>, <ExcThread(validate_pre, started 140223996471040)>, <ExcThread(job_monitor, started 140223409276672)>, <ExcThread(failed_post, started 140223400883968)>, <ExcThread(validate, started 140224116926208)>, <ExcThread(queue_monitor, started 140223392491264)>]
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,450 | INFO     | validate_pre        | pilot.control.payload            | validate_pre              | [payload] validate_pre thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,477 | INFO     | failed_post         | pilot.control.payload            | failed_post               | [payload] failed_post thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,561 | INFO     | execute_payloads    | pilot.control.payload            | execute_payloads          | [payload] execute_payloads thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,776 | DEBUG    | copytool_out        | pilot.control.data               | copytool_out              | [data] copytool_out thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,852 | DEBUG    | job                 | pilot.control.job                | control                   | job control ending since graceful_stop has been set
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:29,853 | DEBUG    | job                 | pilot.control.job                | control                   | [job] control thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:30,047 | DEBUG    | validate            | pilot.control.job                | validate                  | [job] validate thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:30,360 | DEBUG    | MainThread          | pilot.workflow.generic           | run                       | thread count now at 4 threads
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:30,360 | DEBUG    | MainThread          | pilot.workflow.generic           | run                       | enumerate: [<_MainThread(MainThread, started 140224287737664)>, <ExcThread(queue_monitoring, started 140224004863744)>, <ExcThread(job_monitor, started 140223409276672)>, <ExcThread(queue_monitor, started 140223392491264)>]
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:30,461 | WARNING  | queue_monitor       | pilot.util.common                | should_abort              | job:queue_monitor:received graceful stop - abort after this iteration
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:30,461 | DEBUG    | queue_monitor       | pilot.control.job                | queue_monitor             | [job] queue monitor thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:30,680 | WARNING  | queue_monitoring    | pilot.util.common                | should_abort              | data:queue_monitoring:received graceful stop - abort after this iteration
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:31,364 | DEBUG    | MainThread          | pilot.workflow.generic           | run                       | thread count now at 3 threads
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:31,364 | DEBUG    | MainThread          | pilot.workflow.generic           | run                       | enumerate: [<_MainThread(MainThread, started 140224287737664)>, <ExcThread(queue_monitoring, started 140224004863744)>, <ExcThread(job_monitor, started 140223409276672)>]
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:33,684 | DEBUG    | queue_monitoring    | pilot.control.data               | queue_monitoring          | [data] queue_monitor thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:34,378 | DEBUG    | MainThread          | pilot.workflow.generic           | run                       | thread count now at 2 threads
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:53:34,378 | DEBUG    | MainThread          | pilot.workflow.generic           | run                       | enumerate: [<_MainThread(MainThread, started 140224287737664)>, <ExcThread(job_monitor, started 140223409276672)>]
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15,643 | WARNING  | job_monitor         | pilot.control.job                | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 72 s)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15,643 | DEBUG    | job_monitor         | pilot.control.job                | job_monitor               | [job] job monitor thread has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15,669 | INFO     | MainThread          | pilot.workflow.generic           | run                       | end of generic workflow (traces error code: 0)
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15,669 | INFO     | MainThread          | root                             | wrap_up                   | traces error code: 0
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15,669 | INFO     | MainThread          | root                             | wrap_up                   | pilot has finished
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15 UTC [wrapper] ==== pilot stdout END ====
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15 UTC [wrapper] ==== wrapper stdout RESUME ====
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15 UTC [wrapper] Pilot exit status: 0
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15 UTC [wrapper] STATUSCODE: 0
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:15 UTC [wrapper] apfmon messages muted
Di 21. Jan 03:54:16 CET 2020: ---- find pandaID.out ----
Di 21. Jan 03:54:16 CET 2020: total 60
Di 21. Jan 03:54:16 CET 2020: -rw-------.  1 boinc boinc 11357 Jul 25 16:38 LICENSE
Di 21. Jan 03:54:16 CET 2020: -rw-------.  1 boinc boinc    20 Sep  9 13:04 MANIFEST.IN
Di 21. Jan 03:54:16 CET 2020: -rw-------.  1 boinc boinc     8 Dec 12 19:00 PILOTVERSION
Di 21. Jan 03:54:16 CET 2020: -rw-------.  1 boinc boinc  2212 Nov 14 11:01 README.md
Di 21. Jan 03:54:16 CET 2020: -rw-------.  1 boinc boinc   221 Jul 25 16:38 TODO.md
Di 21. Jan 03:54:16 CET 2020: -rw-------.  1 boinc boinc    11 Jan 21 03:20 pandaIDs.out
Di 21. Jan 03:54:16 CET 2020: drwx------. 14 boinc boinc   216 Jan 21 03:20 pilot
Di 21. Jan 03:54:16 CET 2020: -rwx------.  1 boinc boinc 21225 Dec 12 19:00 pilot.py
Di 21. Jan 03:54:16 CET 2020: -rw-------.  1 boinc boinc   766 Oct 10 16:01 setup.py
Di 21. Jan 03:54:16 CET 2020: -rw-------. 1 boinc boinc 11 Jan 21 03:20 /var/lib/boinc/slots/0/pilot2/pandaIDs.out
Di 21. Jan 03:54:16 CET 2020: 4002876565
Di 21. Jan 03:54:16 CET 2020: 
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:16 UTC [wrapper] Test setup, not cleaning
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:16 UTC [wrapper] ==== wrapper stdout END ====
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:16 UTC [wrapper] ==== wrapper stderr END ====
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:16 UTC [wrapper] wrapper wrapperexiting ec=0, duration=2048
Di 21. Jan 03:54:16 CET 2020: 2020-01-21 02:54:16 UTC [wrapper] apfmon messages muted
Di 21. Jan 03:54:16 CET 2020:  *** Error codes and diagnostics ***
Di 21. Jan 03:54:16 CET 2020:     "exeErrorCode": 0,
Di 21. Jan 03:54:16 CET 2020:     "exeErrorDiag": "",
Di 21. Jan 03:54:16 CET 2020:     "pilotErrorCode": 0,
Di 21. Jan 03:54:16 CET 2020:     "pilotErrorDiag": "",
Di 21. Jan 03:54:16 CET 2020:  *** Listing of results directory ***
Di 21. Jan 03:54:16 CET 2020: insgesamt 379016
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc    267260 20. Jan 16:32 pilot2.tar.gz
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc      4492 20. Jan 17:15 queuedata.json
Di 21. Jan 03:54:16 CET 2020: -rwx------. 1 boinc boinc     12641 20. Jan 17:17 runpilot2-wrapper.sh
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc       107 21. Jan 03:20 wrapper_26015_x86_64-pc-linux-gnu
Di 21. Jan 03:54:16 CET 2020: -rwxr-xr-x. 1 boinc boinc      5557 21. Jan 03:20 run_atlas
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc       112 21. Jan 03:20 job.xml
Di 21. Jan 03:54:16 CET 2020: drwxrwx--x. 2 boinc boinc        86 21. Jan 03:20 shared
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc      5991 21. Jan 03:20 init_data.xml
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc         0 21. Jan 03:20 boinc_lockfile
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc      8505 21. Jan 03:20 start_atlas.sh
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc       815 21. Jan 03:20 RTE.tar.gz
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc    275417 21. Jan 03:20 input.tar.gz
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc 365251149 21. Jan 03:20 EVNT.14296418._001447.pool.root.1
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc      2938 21. Jan 03:20 pandaJob.out
Di 21. Jan 03:54:16 CET 2020: drwxr-xr-x. 3 boinc boinc        17 21. Jan 03:20 APPS
Di 21. Jan 03:54:16 CET 2020: -rw-------. 1 boinc boinc   3699225 21. Jan 03:20 agis_schedconf.cvmfs.json
Di 21. Jan 03:54:16 CET 2020: -rw-------. 1 boinc boinc   7792440 21. Jan 03:20 agis_ddmendpoints.json
Di 21. Jan 03:54:16 CET 2020: drwx------. 3 boinc boinc       229 21. Jan 03:20 pilot2
Di 21. Jan 03:54:16 CET 2020: -rw-r--r--. 1 boinc boinc       535 21. Jan 03:43 boinc_task_state.xml
Di 21. Jan 03:54:16 CET 2020: -rw-------. 1 boinc boinc   9192758 21. Jan 03:52 HITS.000649-197458-8183._078090.pool.root.1
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc       834 21. Jan 03:53 memory_monitor_summary.json
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc    509484 21. Jan 03:53 log.000649-197458-8183._078090.job.log.tgz.1
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc     11691 21. Jan 03:53 heartbeat.json
Di 21. Jan 03:54:17 CET 2020: -rw-r--r--. 1 boinc boinc        26 21. Jan 03:54 wrapper_checkpoint.txt
Di 21. Jan 03:54:17 CET 2020: -rw-r--r--. 1 boinc boinc      8192 21. Jan 03:54 boinc_mmap_file
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc      8330 21. Jan 03:54 pilotlog.txt
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc    214456 21. Jan 03:54 log.000649-197458-8183._078090.job.log.1
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc       490 21. Jan 03:54 ZmcKDm4uoDwnShfckohDCDFpABFKDmABFKDmyiALDmEEFKDmNI98Lm.diag
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc       493 21. Jan 03:54 output.list
Di 21. Jan 03:54:17 CET 2020: -rw-r--r--. 1 boinc boinc      7053 21. Jan 03:54 runtime_log.err
Di 21. Jan 03:54:17 CET 2020: -rw-r--r--. 1 boinc boinc       736 21. Jan 03:54 runtime_log
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc    747520 21. Jan 03:54 result.tar.gz
Di 21. Jan 03:54:17 CET 2020: -rw-r--r--. 1 boinc boinc      2213 21. Jan 03:54 stderr.txt
Di 21. Jan 03:54:17 CET 2020: HITS file was successfully produced:
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc 9192758 21. Jan 03:52 shared/HITS.pool.root.1
Di 21. Jan 03:54:17 CET 2020:  *** Contents of shared directory: ***
Di 21. Jan 03:54:17 CET 2020: insgesamt 366692
Di 21. Jan 03:54:17 CET 2020: -rw-r--r--. 1 boinc boinc      8505 21. Jan 03:20 start_atlas.sh
Di 21. Jan 03:54:17 CET 2020: -rw-r--r--. 1 boinc boinc       815 21. Jan 03:20 RTE.tar.gz
Di 21. Jan 03:54:17 CET 2020: -rw-r--r--. 1 boinc boinc    275417 21. Jan 03:20 input.tar.gz
Di 21. Jan 03:54:17 CET 2020: -rw-r--r--. 1 boinc boinc 365251149 21. Jan 03:20 ATLAS.root_0
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc   9192758 21. Jan 03:52 HITS.pool.root.1
Di 21. Jan 03:54:17 CET 2020: -rw-------. 1 boinc boinc    747520 21. Jan 03:54 result.tar.gz

</stderr_txt>
]]>


©2024 CERN