Name Yi5LDm5NtS0n7Olcko1bjSoqABFKDmABFKDm1XmMDm8UGKDmjiC3pn_0
Workunit 2155324
Created 15 Jan 2022, 8:14:49 UTC
Sent 15 Jan 2022, 8:20:09 UTC
Report deadline 22 Jan 2022, 8:20:09 UTC
Received 15 Jan 2022, 8:28:35 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 3765
Run time 8 min 4 sec
CPU time 25 sec
Validate state Valid
Credit 1.87
Device peak FLOPS 1.66 GFLOPS
Application version ATLAS Simulation v1.07 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 153.34 MB
Peak swap size 1.94 GB
Peak disk usage 37.54 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
09:20:20 (3039): wrapper (7.7.26015): starting
09:20:20 (3039): wrapper: running run_atlas (--nthreads 1)
[2022-01-15 09:20:20] Arguments: --nthreads 1
[2022-01-15 09:20:20] Threads: 1
[2022-01-15 09:20:20] Checking for CVMFS
[2022-01-15 09:20:24] Probing /cvmfs/atlas.cern.ch... OK
[2022-01-15 09:20:25] Probing /cvmfs/atlas-condb.cern.ch... OK
[2022-01-15 09:20:25] Running cvmfs_config stat atlas.cern.ch
[2022-01-15 09:20:26] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2022-01-15 09:20:26] 2.6.0.0 3267 0 26616 99700 3 1 6498 4194305 0 65024 0 0 n/a 531 1718 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch DIRECT 1
[2022-01-15 09:20:26] CVMFS is ok
[2022-01-15 09:20:26] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2022-01-15 09:20:26] Small home clusters do not require a local http proxy but it is suggested if
[2022-01-15 09:20:26] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2022-01-15 09:20:26] Further information can be found at the LHC@home message board.
[2022-01-15 09:20:26] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2022-01-15 09:20:26] Checking for singularity binary...
[2022-01-15 09:20:26] Using singularity found in PATH at /usr/bin/singularity
[2022-01-15 09:20:26] Running /usr/bin/singularity --version
[2022-01-15 09:20:26] 2.6.1-dist
[2022-01-15 09:20:26] Checking singularity works with /usr/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2022-01-15 09:20:52] apu10r
[2022-01-15 09:20:52] Singularity works
[2022-01-15 09:20:52] Starting ATLAS job with PandaID=5327934273
[2022-01-15 09:20:52] Running command: /usr/bin/singularity exec --pwd /usr/bin/slots/0 -B /cvmfs,/usr /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2022-01-15 09:28:21]  *** The last 200 lines of the pilot log: ***
[2022-01-15 09:28:21]  ddm_activity=<filter object at 0x7f01dec48650>
[2022-01-15 09:28:21]  ddmendpoint=NDGF-T1_DATADISK
[2022-01-15 09:28:21]  direct_access_lan=False
[2022-01-15 09:28:21]  direct_access_wan=False
[2022-01-15 09:28:21]  domain=
[2022-01-15 09:28:21]  filesize=22281
[2022-01-15 09:28:21]  filetype=log
[2022-01-15 09:28:21]  guid=52b4405e-64e7-49ab-8672-f0a63a557250
[2022-01-15 09:28:21]  inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK']
[2022-01-15 09:28:21]  is_tar=False
[2022-01-15 09:28:21]  lfn=c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.1.job.log.tgz
[2022-01-15 09:28:21]  mtime=0
[2022-01-15 09:28:21]  protocol_id=None
[2022-01-15 09:28:21]  protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}, {'endpoint': 'srm://srm.ndgf.org:8443/srm/managerv2?SFN=', 'flavour': '
[2022-01-15 09:28:21]  replicas=None
[2022-01-15 09:28:21]  scope=hc_test
[2022-01-15 09:28:21]  status=None
[2022-01-15 09:28:21]  status_code=0
[2022-01-15 09:28:21]  storage_token=
[2022-01-15 09:28:21]  surl=/usr/bin/slots/0/PanDA_Pilot-5327934273/c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.1.job.log.tgz
[2022-01-15 09:28:21]  turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/hc_test/03/f5/c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.1.job.log.tgz
[2022-01-15 09:28:21]  workdir=None
[2022-01-15 09:28:21] ]
[2022-01-15 09:28:21] 2022-01-15 08:26:16,584 | INFO     | transferring file c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.1.job.log.tgz from /usr/bin/slots/0/PanDA_Pilot-5327934273/c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.
[2022-01-15 09:28:21] 2022-01-15 08:26:16,584 | INFO     | executing command: /usr/bin/env mv /usr/bin/slots/0/PanDA_Pilot-5327934273/c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.1.job.log.tgz /usr/bin/slots/0/c08d2bfa-b29b-
[2022-01-15 09:28:21] 2022-01-15 08:26:16,618 | INFO     | Adding to output.list: c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.1.job.log.tgz davs://dav.ndgf.org:443;autodir=no;spacetoken=ATLASDATADISK/atlas/disk/atlasdatadis
[2022-01-15 09:28:21] 2022-01-15 08:26:16,620 | INFO     | executing command: ps aux -q 8130
[2022-01-15 09:28:21] 2022-01-15 08:26:16,658 | INFO     | summary of transferred files:
[2022-01-15 09:28:21] 2022-01-15 08:26:16,658 | INFO     |  -- lfn=c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.1.job.log.tgz, status_code=0, status=transferred
[2022-01-15 09:28:21] 2022-01-15 08:26:16,659 | INFO     | stage-out finished correctly
[2022-01-15 09:28:21] 2022-01-15 08:26:17,189 | INFO     | monitor loop #3: job 0:5327934273 is in state 'failed'
[2022-01-15 09:28:21] 2022-01-15 08:26:17,190 | INFO     | will abort job monitoring soon since job state=failed (job is still in queue)
[2022-01-15 09:28:21] 2022-01-15 08:26:19,109 | INFO     | finished stage-out (of log) for failed payload
[2022-01-15 09:28:21] 2022-01-15 08:26:19,289 | INFO     | job 5327934273 has state=failed
[2022-01-15 09:28:21] 2022-01-15 08:26:19,289 | INFO     | preparing for final server update for job 5327934273 in state='failed'
[2022-01-15 09:28:21] 2022-01-15 08:27:18,794 | INFO     | monitor loop #4: job 0:5327934273 is in state 'failed'
[2022-01-15 09:28:21] 2022-01-15 08:27:18,795 | INFO     | will abort job monitoring soon since job state=failed (job is still in queue)
[2022-01-15 09:28:21] 2022-01-15 08:27:49,605 | INFO     | 367 s have passed since pilot start
[2022-01-15 09:28:21] 2022-01-15 08:28:14,781 | INFO     | proceeding with final server update
[2022-01-15 09:28:21] 2022-01-15 08:28:14,782 | INFO     | pilot will not update the server (heartbeat message will be written to file)
[2022-01-15 09:28:21] 2022-01-15 08:28:14,782 | INFO     | job 5327934273 has failed - writing final server update
[2022-01-15 09:28:21] 2022-01-15 08:28:14,782 | WARNING  | making sure that job.state is set to failed since a pilot error code is set
[2022-01-15 09:28:21] 2022-01-15 08:28:14,782 | WARNING  | format EVNTtoHITS has no such key: dbData
[2022-01-15 09:28:21] 2022-01-15 08:28:14,782 | WARNING  | format EVNTtoHITS has no such key: dbTime
[2022-01-15 09:28:21] 2022-01-15 08:28:14,782 | INFO     | will not add max space = -38962457 B to job metrics
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | WARNING  | wrong length of table data, x=[1642234995.0, 1642235056.0, 1642235117.0], y=[1565.0, 28818.0, 136772.0] (must be same and length>=4)
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | INFO     | mean actualcorecount: 1.000000
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | INFO     | payload/TRF did not report the number of read events
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | INFO     | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2022-01-15 09:28:21] 2022-01-15 08:28:14,846 | INFO     | using path: /usr/bin/slots/0/PanDA_Pilot-5327934273/memory_monitor_summary.json (trf name=prmon)
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | extracted standard info from prmon json
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | extracted standard memory fields from prmon json
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | ..............................
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | . Timing measurements:
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | . get job = 0 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . initial setup = 2 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . payload setup = 61 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . total setup = 63 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . stage-in = 1 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . payload execution = 190 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . stage-out = 0 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | ..............................
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | building log extracts (sent to the server as 'pilotLog')
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | executing command: tail -n 20 /usr/bin/slots/0/PanDA_Pilot-5327934273/pilotlog.txt
[2022-01-15 09:28:21] 2022-01-15 08:28:14,876 | WARNING  | detected the following tail of warning/fatal messages in the pilot log:
[2022-01-15 09:28:21] - Log from pilotlog.txt -
[2022-01-15 09:28:21] 2022-01-15 08:28:14,782 | INFO     | will not add max space = -38962457 B to job metrics
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | WARNING  | wrong length of table data, x=[1642234995.0, 1642235056.0, 1642235117.0], y=[1565.0, 28818.0, 136772.0] (must be same and length>=4)
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | INFO     | mean actualcorecount: 1.000000
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | INFO     | payload/TRF did not report the number of read events
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | INFO     | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2022-01-15 09:28:21] 2022-01-15 08:28:14,846 | INFO     | using path: /usr/bin/slots/0/PanDA_Pilot-5327934273/memory_monitor_summary.json (trf name=prmon)
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | extracted standard info from prmon json
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | extracted standard memory fields from prmon json
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | ..............................
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | . Timing measurements:
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | . get job = 0 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . initial setup = 2 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . payload setup = 61 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . total setup = 63 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . stage-in = 1 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . payload execution = 190 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . stage-out = 0 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | ..............................
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | building log extracts (sent to the server as 'pilotLog')
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | executing command: tail -n 20 /usr/bin/slots/0/PanDA_Pilot-5327934273/pilotlog.txt
[2022-01-15 09:28:21] 2022-01-15 08:28:14,876 | WARNING  | 
[2022-01-15 09:28:21] XXXXXXXXXXXXXXXXXXXXX[begin log extracts]
[2022-01-15 09:28:21] - Log from pilotlog.txt -
[2022-01-15 09:28:21] 2022-01-15 08:28:14,782 | INFO     | will not add max space = -38962457 B to job metrics
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | WARNING  | wrong length of table data, x=[1642234995.0, 1642235056.0, 1642235117.0], y=[1565.0, 28818.0, 136772.0] (must be same and length>=4)
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | INFO     | mean actualcorecount: 1.000000
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | INFO     | payload/TRF did not report the number of read events
[2022-01-15 09:28:21] 2022-01-15 08:28:14,783 | INFO     | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2022-01-15 09:28:21] 2022-01-15 08:28:14,846 | INFO     | using path: /usr/bin/slots/0/PanDA_Pilot-5327934273/memory_monitor_summary.json (trf name=prmon)
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | extracted standard info from prmon json
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | extracted standard memory fields from prmon json
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | ..............................
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | . Timing measurements:
[2022-01-15 09:28:21] 2022-01-15 08:28:14,847 | INFO     | . get job = 0 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . initial setup = 2 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . payload setup = 61 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . total setup = 63 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . stage-in = 1 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . payload execution = 190 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | . stage-out = 0 s
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | ..............................
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | building log extracts (sent to the server as 'pilotLog')
[2022-01-15 09:28:21] 2022-01-15 08:28:14,848 | INFO     | executing command: tail -n 20 /usr/bin/slots/0/PanDA_Pilot-5327934273/pilotlog.txt
[2022-01-15 09:28:21] XXXXXXXXXXXXXXXXXXXXX[end log extracts]
[2022-01-15 09:28:21] 2022-01-15 08:28:14,876 | WARNING  | pilotErrorCodes = [1305] (will report primary/first error code)
[2022-01-15 09:28:21] 2022-01-15 08:28:14,877 | WARNING  | pilotErrorDiags = ['Failed to execute payload'] (will report primary/first error diag)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,054 | INFO     | 
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | job summary report
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | --------------------------------------------------
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | PanDA job id: 5327934273
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | task id: NULL
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | error 1/1: 1305: Failed to execute payload
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | status: LOG_TRANSFER = DONE 
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | pilot state: failed 
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | transexitcode: 65
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | exeerrorcode: 65
[2022-01-15 09:28:21] 2022-01-15 08:28:15,055 | INFO     | exeerrordiag: EVNTtoHITS got a SIGBUS signal (exit code 135)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,058 | INFO     | exitcode: 65
[2022-01-15 09:28:21] 2022-01-15 08:28:15,058 | INFO     | exitmsg: EVNTtoHITS got a SIGBUS signal (exit code 135)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,058 | INFO     | cpuconsumptiontime: 50 s
[2022-01-15 09:28:21] 2022-01-15 08:28:15,058 | INFO     | nevents: 0
[2022-01-15 09:28:21] 2022-01-15 08:28:15,058 | INFO     | neventsw: 0
[2022-01-15 09:28:21] 2022-01-15 08:28:15,058 | INFO     | pid: 11069
[2022-01-15 09:28:21] 2022-01-15 08:28:15,058 | INFO     | pgrp: 11069
[2022-01-15 09:28:21] 2022-01-15 08:28:15,059 | INFO     | corecount: 1
[2022-01-15 09:28:21] 2022-01-15 08:28:15,059 | INFO     | event service: False
[2022-01-15 09:28:21] 2022-01-15 08:28:15,059 | INFO     | sizes: {4297863: 3813150, 4297864: 3813262, 4297865: 3813481, 4297866: 3813427, 4297876: 3813483, 4298132: 3833394, 4298133: 3837904, 4298136: 3837904, 4298252: 38
[2022-01-15 09:28:21] 2022-01-15 08:28:15,059 | INFO     | --------------------------------------------------
[2022-01-15 09:28:21] 2022-01-15 08:28:15,059 | INFO     | 
[2022-01-15 09:28:21] 2022-01-15 08:28:15,059 | INFO     | executing command: ls -lF /usr/bin/slots/0
[2022-01-15 09:28:21] 2022-01-15 08:28:15,093 | INFO     | queue jobs has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue payloads has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue data_in has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue data_out has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue current_data_in has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue validated_jobs has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue validated_payloads has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue monitored_payloads has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue finished_jobs has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue finished_payloads has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,094 | INFO     | queue finished_data_in has 1 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,095 | INFO     | queue finished_data_out has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,095 | INFO     | queue failed_jobs has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,095 | INFO     | queue failed_payloads has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,095 | INFO     | queue failed_data_in has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,095 | INFO     | queue failed_data_out has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,095 | INFO     | queue completed_jobs has 0 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,095 | INFO     | queue completed_jobids has 1 job(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,095 | INFO     | job 5327934273 has completed (purged errors)
[2022-01-15 09:28:21] 2022-01-15 08:28:15,095 | INFO     | overall cleanup function is called
[2022-01-15 09:28:21] 2022-01-15 08:28:16,102 | INFO     | --- collectZombieJob: --- 10, [11069]
[2022-01-15 09:28:21] 2022-01-15 08:28:16,103 | INFO     | zombie collector trying to kill pid 11069
[2022-01-15 09:28:21] 2022-01-15 08:28:16,103 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2022-01-15 09:28:21] 2022-01-15 08:28:17,108 | INFO     | collected zombie processes
[2022-01-15 09:28:21] 2022-01-15 08:28:17,108 | INFO     | will now attempt to kill all subprocesses of pid=11069
[2022-01-15 09:28:21] 2022-01-15 08:28:17,176 | INFO     | process IDs to be killed: [11069] (in reverse order)
[2022-01-15 09:28:21] 2022-01-15 08:28:17,246 | WARNING  | found no corresponding commands to process id(s)
[2022-01-15 09:28:21] 2022-01-15 08:28:17,246 | INFO     | Do not look for orphan processes in BOINC jobs
[2022-01-15 09:28:21] 2022-01-15 08:28:17,246 | INFO     | ready for new job
[2022-01-15 09:28:21] 2022-01-15 08:28:17,247 | INFO     | pilot has finished for previous job - re-establishing logging
[2022-01-15 09:28:21] 2022-01-15 08:28:17,247 | INFO     | ****************************************
[2022-01-15 09:28:21] 2022-01-15 08:28:17,247 | INFO     | ***  PanDA Pilot version 2.12.8 (1)  ***
[2022-01-15 09:28:21] 2022-01-15 08:28:17,248 | INFO     | ****************************************
[2022-01-15 09:28:21] 2022-01-15 08:28:17,248 | INFO     | 
[2022-01-15 09:28:21] 2022-01-15 08:28:17,248 | INFO     | pilot is running in a VM
[2022-01-15 09:28:21] 2022-01-15 08:28:17,248 | INFO     | architecture information:
[2022-01-15 09:28:21] 2022-01-15 08:28:17,268 | INFO     | 
[2022-01-15 09:28:21] 
[2022-01-15 09:28:21] 2022-01-15 08:28:17,269 | INFO     | ****************************************
[2022-01-15 09:28:21] 2022-01-15 08:28:17,808 | INFO     | sufficient remaining disk space (10213130240 B)
[2022-01-15 09:28:21] 2022-01-15 08:28:17,809 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2022-01-15 09:28:21] 2022-01-15 08:28:17,810 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2022-01-15 09:28:21] 2022-01-15 08:28:17,939 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2022-01-15 09:28:21] 2022-01-15 08:28:18,035 | INFO     | [payload] failed_post thread has finished
[2022-01-15 09:28:21] 2022-01-15 08:28:18,352 | INFO     | [payload] validate_post thread has finished
[2022-01-15 09:28:21] 2022-01-15 08:28:18,546 | INFO     | [payload] validate_pre thread has finished
[2022-01-15 09:28:21] 2022-01-15 08:28:18,670 | INFO     | [monitor] control thread has ended
[2022-01-15 09:28:21] 2022-01-15 08:28:19,169 | INFO     | [payload] execute_payloads thread has finished
[2022-01-15 09:28:21] 2022-01-15 08:28:20,067 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2022-01-15 09:28:21] 2022-01-15 08:28:20,348 | WARNING  | no jobs in monitored_payloads queue (waited for 62 s)
[2022-01-15 09:28:21] 2022-01-15 08:28:21,000 | INFO     | end of generic workflow (traces error code: 0)
[2022-01-15 09:28:21] 2022-01-15 08:28:21,000 | INFO     | traces error code: 0
[2022-01-15 09:28:21] 2022-01-15 08:28:21,000 | INFO     | pilot has finished
[2022-01-15 09:28:21] 2022-01-15 08:28:21,100 [wrapper] ==== pilot stdout END ====
[2022-01-15 09:28:21] 2022-01-15 08:28:21,104 [wrapper] ==== wrapper stdout RESUME ====
[2022-01-15 09:28:21] 2022-01-15 08:28:21,109 [wrapper] pilotpid: 8130
[2022-01-15 09:28:21] 2022-01-15 08:28:21,114 [wrapper] Pilot exit status: 0
[2022-01-15 09:28:21] 2022-01-15 08:28:21,137 [wrapper] pandaids: 5327934273
[2022-01-15 09:28:21] 2022-01-15 08:28:21,148 [wrapper] apfmon messages muted
[2022-01-15 09:28:21] 2022-01-15 08:28:21,154 [wrapper] Test setup, not cleaning
[2022-01-15 09:28:21] 2022-01-15 08:28:21,159 [wrapper] ==== wrapper stdout END ====
[2022-01-15 09:28:21] 2022-01-15 08:28:21,164 [wrapper] ==== wrapper stderr END ====
[2022-01-15 09:28:21] 2022-01-15 08:28:21,173 [wrapper] wrapperexiting ec=0, duration=449
[2022-01-15 09:28:21] 2022-01-15 08:28:21,179 [wrapper] apfmon messages muted
[2022-01-15 09:28:21]  *** Error codes and diagnostics ***
[2022-01-15 09:28:21]     "exeErrorCode": 65,
[2022-01-15 09:28:21]     "exeErrorDiag": "EVNTtoHITS got a SIGBUS signal (exit code 135)",
[2022-01-15 09:28:21]     "pilotErrorCode": 1305,
[2022-01-15 09:28:21]     "pilotErrorDiag": "Failed to execute payload",
[2022-01-15 09:28:21]  *** Listing of results directory ***
[2022-01-15 09:28:21] insgesamt 42084
[2022-01-15 09:28:21] -rw-r--r--. 1 root root   344354 15. Jan 08:26 pilot2.tar.gz
[2022-01-15 09:28:21] -rwx------. 1 4871 1028    26862 15. Jan 09:14 runpilot2-wrapper.sh
[2022-01-15 09:28:21] -rw-r--r--. 1 root root     4534 15. Jan 09:14 queuedata.json
[2022-01-15 09:28:21] -rw-r--r--. 1 root root      107 15. Jan 09:20 wrapper_26015_x86_64-pc-linux-gnu
[2022-01-15 09:28:21] -rwxr-xr-x. 1 root root     6969 15. Jan 09:20 run_atlas
[2022-01-15 09:28:21] -rw-r--r--. 1 root root      112 15. Jan 09:20 job.xml
[2022-01-15 09:28:21] -rw-r--r--. 2 root root 38971704 15. Jan 09:20 EVNT.04972714._000035.pool.root.1
[2022-01-15 09:28:21] -rw-r--r--. 1 root root     5842 15. Jan 09:20 init_data.xml
[2022-01-15 09:28:21] drwxrwx--x. 2 root root       68 15. Jan 09:20 shared
[2022-01-15 09:28:21] -rw-r--r--. 2 root root   356138 15. Jan 09:20 input.tar.gz
[2022-01-15 09:28:21] -rw-r--r--. 2 root root    16583 15. Jan 09:20 start_atlas.sh
[2022-01-15 09:28:21] -rw-r--r--. 1 root root        0 15. Jan 09:20 boinc_lockfile
[2022-01-15 09:28:21] -rw-r--r--. 1 root root     2614 15. Jan 09:20 pandaJob.out
[2022-01-15 09:28:21] -rw-------. 1 root root  1102276 15. Jan 09:21 agis_schedconf.cvmfs.json
[2022-01-15 09:28:21] -rw-------. 1 root root  1929639 15. Jan 09:21 cric_ddmendpoints.json
[2022-01-15 09:28:21] drwxr-xr-x. 4  320  320      260 15. Jan 09:21 pilot2
[2022-01-15 09:28:21] -rw-------. 1 root root     1012 15. Jan 09:26 memory_monitor_summary.json
[2022-01-15 09:28:21] -rw-r--r--. 1 root root      530 15. Jan 09:26 boinc_task_state.xml
[2022-01-15 09:28:21] -rw-------. 1 root root    22281 15. Jan 09:26 c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.1.job.log.tgz
[2022-01-15 09:28:21] -rw-------. 1 root root     7174 15. Jan 09:28 heartbeat.json
[2022-01-15 09:28:21] -rw-r--r--. 1 root root     8192 15. Jan 09:28 boinc_mmap_file
[2022-01-15 09:28:21] -rw-r--r--. 1 root root       23 15. Jan 09:28 wrapper_checkpoint.txt
[2022-01-15 09:28:21] -rw-------. 1 root root     1713 15. Jan 09:28 pilotlog.txt
[2022-01-15 09:28:21] -rw-------. 1 root root    73547 15. Jan 09:28 c08d2bfa-b29b-44b6-ad08-fb9b4a002a58_51757.1.job.log
[2022-01-15 09:28:21] -rw-------. 1 root root      263 15. Jan 09:28 output.list
[2022-01-15 09:28:21] -rw-------. 1 root root      566 15. Jan 09:28 Yi5LDm5NtS0n7Olcko1bjSoqABFKDmABFKDm1XmMDm8UGKDmjiC3pn.diag
[2022-01-15 09:28:21] -rw-r--r--. 1 root root     7826 15. Jan 09:28 runtime_log.err
[2022-01-15 09:28:21] -rw-r--r--. 1 root root      686 15. Jan 09:28 runtime_log
[2022-01-15 09:28:21] -rw-------. 1 root root   112640 15. Jan 09:28 result.tar.gz
[2022-01-15 09:28:21] -rw-r--r--. 1 root root    21613 15. Jan 09:28 stderr.txt
[2022-01-15 09:28:21] No HITS result produced
[2022-01-15 09:28:21]  *** Contents of shared directory: ***
[2022-01-15 09:28:21] insgesamt 38540
[2022-01-15 09:28:21] -rw-r--r--. 2 root root 38971704 15. Jan 09:20 ATLAS.root_0
[2022-01-15 09:28:21] -rw-r--r--. 2 root root   356138 15. Jan 09:20 input.tar.gz
[2022-01-15 09:28:21] -rw-r--r--. 2 root root    16583 15. Jan 09:20 start_atlas.sh
[2022-01-15 09:28:21] -rw-------. 1 root root   112640 15. Jan 09:28 result.tar.gz
09:28:23 (3039): run_atlas exited; CPU time 25.128662
09:28:23 (3039): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN