Name | N0aNDmAxbw2n7Olcko1bjSoqABFKDmABFKDm7AsVDmCPGKDm68y91n_1 |
Workunit | 2287473 |
Created | 15 Mar 2023, 13:57:55 UTC |
Sent | 15 Mar 2023, 16:38:21 UTC |
Report deadline | 22 Mar 2023, 16:38:21 UTC |
Received | 15 Mar 2023, 19:11:05 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 4704 |
Run time | 2 hours 21 min 5 sec |
CPU time | 8 hours 18 min 57 sec |
Validate state | Valid |
Credit | 8.52 |
Device peak FLOPS | 20.06 GFLOPS |
Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
Peak working set size | 2.51 GB |
Peak swap size | 2.96 GB |
Peak disk usage | 1.10 GB |
<core_client_version>7.20.5</core_client_version> <![CDATA[ <stderr_txt> 17:48:30 (425970): wrapper (7.7.26015): starting 17:48:30 (425970): wrapper: running run_atlas (--nthreads 4) [2023-03-15 17:48:30] Arguments: --nthreads 4 [2023-03-15 17:48:30] Threads: 4 [2023-03-15 17:48:30] Checking for CVMFS [2023-03-15 17:48:36] Probing /cvmfs/atlas.cern.ch... OK [2023-03-15 17:48:38] Probing /cvmfs/atlas-condb.cern.ch... OK [2023-03-15 17:48:38] Running cvmfs_config stat atlas.cern.ch [2023-03-15 17:48:38] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE [2023-03-15 17:48:38] 2.10.0.0 426192 0 24740 116776 3 1 5183165 10240000 0 130560 0 0 100.000 0 0 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.101.101:3128 1 [2023-03-15 17:48:38] CVMFS is ok [2023-03-15 17:48:38] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 [2023-03-15 17:48:38] Checking for apptainer binary... [2023-03-15 17:48:38] Using apptainer found in PATH at /usr/bin/apptainer [2023-03-15 17:48:38] Running /usr/bin/apptainer --version [2023-03-15 17:48:38] apptainer version 1.1.0-rc.2 [2023-03-15 17:48:38] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname [2023-03-15 17:48:38] atlas6l2 [2023-03-15 17:48:38] apptainer works [2023-03-15 17:48:38] Set ATHENA_PROC_NUMBER=4 [2023-03-15 17:48:38] Set ATHENA_CORE_NUMBER=4 [2023-03-15 17:48:38] Starting ATLAS job with PandaID=5753961892 [2023-03-15 17:48:38] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc_data/boinc-01/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh [2023-03-15 20:09:32] *** The last 200 lines of the pilot log: *** [2023-03-15 20:09:32] surl=/var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892/HITS.32413688._000229-102270-1678869975.pool.root.1 [2023-03-15 20:09:32] turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid1/49/4f/HITS.32413688._000229-102270-1678869975.pool.root.1 [2023-03-15 20:09:32] workdir=None [2023-03-15 20:09:32] ] [2023-03-15 20:09:32] 2023-03-15 19:09:00,788 | INFO | transferring file HITS.32413688._000229-102270-1678869975.pool.root.1 from /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892/HITS.32413688._000229-102270 [2023-03-15 20:09:32] 2023-03-15 19:09:00,788 | INFO | executing command: /usr/bin/env mv /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892/HITS.32413688._000229-102270-1678869975.pool.root.1 /var/lib/boinc_d [2023-03-15 20:09:32] 2023-03-15 19:09:00,801 | INFO | Adding to output.list: HITS.32413688._000229-102270-1678869975.pool.root.1 davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid1/49/4f/HITS.32413688._00022 [2023-03-15 20:09:32] 2023-03-15 19:09:00,801 | INFO | executing command: ps aux -q 429779 [2023-03-15 20:09:32] 2023-03-15 19:09:00,814 | INFO | summary of transferred files: [2023-03-15 20:09:32] 2023-03-15 19:09:00,814 | INFO | -- lfn=HITS.32413688._000229-102270-1678869975.pool.root.1, status_code=0, status=transferred [2023-03-15 20:09:32] 2023-03-15 19:09:00,815 | INFO | executing command: ls -lF /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892 [2023-03-15 20:09:32] 2023-03-15 19:09:00,844 | INFO | executing command: ls -lF /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892 [2023-03-15 20:09:32] 2023-03-15 19:09:00,855 | INFO | will create archive /var/lib/boinc_data/boinc-01/slots/0/log.32413688._000229-102270-1678869975.job.log.tgz.1 [2023-03-15 20:09:32] 2023-03-15 19:09:00,855 | INFO | executing command: pwd;tar cvfz /var/lib/boinc_data/boinc-01/slots/0/log.32413688._000229-102270-1678869975.job.log.tgz.1 tarball_PandaJob_5753961892_BOINC-TEST -- [2023-03-15 20:09:32] 2023-03-15 19:09:00,931 | INFO | copied /var/lib/boinc_data/boinc-01/slots/0/log.32413688._000229-102270-1678869975.job.log.tgz.1 to /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892 [2023-03-15 20:09:32] 2023-03-15 19:09:00,931 | INFO | prepare to stage-out 1 log file(s) [2023-03-15 20:09:32] 2023-03-15 19:09:00,931 | INFO | stage-out will not be done in a container [2023-03-15 20:09:32] 2023-03-15 19:09:00,932 | INFO | configured copytools per activity: acopytools={'pr': ['mv'], 'pw': ['mv'], 'read_lan': ['mv'], 'write_lan': ['mv'], 'default': ['rucio']} [2023-03-15 20:09:32] 2023-03-15 19:09:00,932 | INFO | [prepare_destinations][pl]: allowed (local) destinations: ['NDGF-T1_DATADISK'] [2023-03-15 20:09:32] 2023-03-15 19:09:00,932 | INFO | [prepare_destinations][pl]: resolved default destination ddm=NDGF-T1_DATADISK [2023-03-15 20:09:32] 2023-03-15 19:09:00,933 | INFO | [prepare_destinations][pl]: Requested fspec.ddmendpoint=LRZ-LMU_DATADISK is not in the list of allowed (local) destinations .. will consider default ddm=NDGF-T1_DA [2023-03-15 20:09:32] 2023-03-15 19:09:00,933 | INFO | trying to use copytool=mv for activity=['pl', 'pw', 'w', 'default'] [2023-03-15 20:09:32] 2023-03-15 19:09:01,007 | INFO | Resolved protocol to be used for transfer: '{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}': l [2023-03-15 20:09:32] 2023-03-15 19:09:01,007 | INFO | ready to transfer (stage-out) files: [ accessmode= [2023-03-15 20:09:32] activity=['pl', 'pw', 'w', 'default'] [2023-03-15 20:09:32] allow_lan=True [2023-03-15 20:09:32] allow_wan=False [2023-03-15 20:09:32] checkinputsize=True [2023-03-15 20:09:32] checksum={'adler32': '96371972'} [2023-03-15 20:09:32] dataset=valid1.601229.PhPy8EG_A14_ttbar_hdamp258p75_SingleLep.simul.log.e8472_s4066_tid32413688_00 [2023-03-15 20:09:32] ddm_activity=['write_lan', 'write_wan'] [2023-03-15 20:09:32] ddmendpoint=NDGF-T1_DATADISK [2023-03-15 20:09:32] ddmendpoint_alt=NDGF-T1_DATADISK [2023-03-15 20:09:32] direct_access_lan=False [2023-03-15 20:09:32] direct_access_wan=False [2023-03-15 20:09:32] domain= [2023-03-15 20:09:32] filesize=269380 [2023-03-15 20:09:32] filetype=log [2023-03-15 20:09:32] guid=8b3367ba-6de4-4efb-ae3e-fcc5584d8c92 [2023-03-15 20:09:32] inputddms=['NDGF-T1_DATADISK', 'CERN-PROD_DATADISK'] [2023-03-15 20:09:32] is_tar=False [2023-03-15 20:09:32] lfn=log.32413688._000229-102270-1678869975.job.log.tgz.1 [2023-03-15 20:09:32] mtime=0 [2023-03-15 20:09:32] protocol_id=None [2023-03-15 20:09:32] protocols=[{'endpoint': 'davs://dav.ndgf.org:443', 'flavour': 'WEBDAV', 'id': 331, 'path': '/atlas/disk/atlasdatadisk/rucio/'}] [2023-03-15 20:09:32] replicas=None [2023-03-15 20:09:32] scope=valid1 [2023-03-15 20:09:32] status=None [2023-03-15 20:09:32] status_code=0 [2023-03-15 20:09:32] storage_token= [2023-03-15 20:09:32] surl=/var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892/log.32413688._000229-102270-1678869975.job.log.tgz.1 [2023-03-15 20:09:32] turl=davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid1/82/a5/log.32413688._000229-102270-1678869975.job.log.tgz.1 [2023-03-15 20:09:32] workdir=None [2023-03-15 20:09:32] ] [2023-03-15 20:09:32] 2023-03-15 19:09:01,035 | INFO | transferring file log.32413688._000229-102270-1678869975.job.log.tgz.1 from /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892/log.32413688._000229-102270 [2023-03-15 20:09:32] 2023-03-15 19:09:01,035 | INFO | executing command: /usr/bin/env mv /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892/log.32413688._000229-102270-1678869975.job.log.tgz.1 /var/lib/boinc_ [2023-03-15 20:09:32] 2023-03-15 19:09:01,053 | INFO | Adding to output.list: log.32413688._000229-102270-1678869975.job.log.tgz.1 davs://dav.ndgf.org:443/atlas/disk/atlasdatadisk/rucio/valid1/82/a5/log.32413688._00022 [2023-03-15 20:09:32] 2023-03-15 19:09:01,054 | INFO | executing command: ps aux -q 429779 [2023-03-15 20:09:32] 2023-03-15 19:09:01,075 | INFO | summary of transferred files: [2023-03-15 20:09:32] 2023-03-15 19:09:01,076 | INFO | -- lfn=log.32413688._000229-102270-1678869975.job.log.tgz.1, status_code=0, status=transferred [2023-03-15 20:09:32] 2023-03-15 19:09:01,076 | INFO | stage-out finished correctly [2023-03-15 20:09:32] 2023-03-15 19:09:04,469 | INFO | finished stage-out for finished payload, adding job to finished_jobs queue [2023-03-15 20:09:32] 2023-03-15 19:09:06,267 | INFO | job 5753961892 has state=finished [2023-03-15 20:09:32] 2023-03-15 19:09:06,267 | INFO | preparing for final server update for job 5753961892 in state='finished' [2023-03-15 20:09:32] 2023-03-15 19:09:06,268 | INFO | pilot will not update the server (heartbeat message will be written to file) [2023-03-15 20:09:32] 2023-03-15 19:09:06,269 | INFO | job 5753961892 has finished - writing final server update [2023-03-15 20:09:32] 2023-03-15 19:09:06,269 | WARNING | format EVNTtoHITS has no such key: dbData [2023-03-15 20:09:32] 2023-03-15 19:09:06,269 | WARNING | format EVNTtoHITS has no such key: dbTime [2023-03-15 20:09:32] 2023-03-15 19:09:06,271 | INFO | fitting pss+swap vs Time [2023-03-15 20:09:32] 2023-03-15 19:09:06,271 | INFO | current chi2=3.3640872394431702 (change=16.65707831244252 %) [2023-03-15 20:09:32] 2023-03-15 19:09:06,271 | INFO | right removable region: 132 [2023-03-15 20:09:32] 2023-03-15 19:09:06,271 | INFO | current chi2=2.1308728314563963 (change=47.2091075891332 %) [2023-03-15 20:09:32] 2023-03-15 19:09:06,271 | INFO | current chi2=1.0822463208205524 (change=49.21112584269681 %) [2023-03-15 20:09:32] 2023-03-15 19:09:06,271 | INFO | current chi2=0.7078163480450244 (change=34.59748169821798 %) [2023-03-15 20:09:32] 2023-03-15 19:09:06,272 | INFO | current chi2=0.6854452688786681 (change=3.1605767835321665 %) [2023-03-15 20:09:32] 2023-03-15 19:09:06,272 | INFO | left removable region: 40 [2023-03-15 20:09:32] 2023-03-15 19:09:06,272 | INFO | current memory leak: -3.64 B/s (using 92 data points, chi2=0.00) [2023-03-15 20:09:32] 2023-03-15 19:09:06,272 | INFO | total number of processed events: 500 (read) [2023-03-15 20:09:32] 2023-03-15 19:09:06,272 | INFO | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo [2023-03-15 20:09:32] 2023-03-15 19:09:06,303 | INFO | using path: /var/lib/boinc_data/boinc-01/slots/0/PanDA_Pilot-5753961892/memory_monitor_summary.json (trf name=prmon) [2023-03-15 20:09:32] 2023-03-15 19:09:06,306 | INFO | extracted standard info from prmon json [2023-03-15 20:09:32] 2023-03-15 19:09:06,306 | INFO | extracted standard memory fields from prmon json [2023-03-15 20:09:32] 2023-03-15 19:09:06,306 | INFO | .............................. [2023-03-15 20:09:32] 2023-03-15 19:09:06,306 | INFO | . Timing measurements: [2023-03-15 20:09:32] 2023-03-15 19:09:06,306 | INFO | . get job = 0 s [2023-03-15 20:09:32] 2023-03-15 19:09:06,306 | INFO | . initial setup = 1 s [2023-03-15 20:09:32] 2023-03-15 19:09:06,307 | INFO | . payload setup = 7 s [2023-03-15 20:09:32] 2023-03-15 19:09:06,307 | INFO | . stage-in = 0 s [2023-03-15 20:09:32] 2023-03-15 19:09:06,307 | INFO | . payload execution = 8377 s [2023-03-15 20:09:32] 2023-03-15 19:09:06,307 | INFO | . stage-out = 0 s [2023-03-15 20:09:32] 2023-03-15 19:09:06,307 | INFO | .............................. [2023-03-15 20:09:32] 2023-03-15 19:09:06,359 | INFO | [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | job summary report [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | -------------------------------------------------- [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | PanDA job id: 5753961892 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | task id: 32413688 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | errors: (none) [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | status: LOG_TRANSFER = DONE [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | pilot state: finished [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | transexitcode: 0 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | exeerrorcode: 0 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | exeerrordiag: [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | exitcode: 0 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | exitmsg: OK [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | cpuconsumptiontime: 29970 s [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | nevents: 500 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | neventsw: 0 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | pid: 432316 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | pgrp: 432316 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | corecount: 4 [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | event service: False [2023-03-15 20:09:32] 2023-03-15 19:09:06,360 | INFO | sizes: {0: 2537430, 11: 2537430, 8387: 2565357, 8388: 2565356, 8389: 2574394, 8393: 2574450, 8395: 2575428} [2023-03-15 20:09:32] 2023-03-15 19:09:06,361 | INFO | -------------------------------------------------- [2023-03-15 20:09:32] 2023-03-15 19:09:06,361 | INFO | [2023-03-15 20:09:32] 2023-03-15 19:09:06,361 | INFO | executing command: ls -lF /var/lib/boinc_data/boinc-01/slots/0 [2023-03-15 20:09:32] 2023-03-15 19:09:06,377 | INFO | queue jobs had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,377 | INFO | queue payloads had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,377 | INFO | queue data_in had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,377 | INFO | queue data_out had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue current_data_in had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue validated_jobs had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue validated_payloads had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue monitored_payloads had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue finished_jobs had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue finished_payloads had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue finished_data_in had 1 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue finished_data_out had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue failed_jobs had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue failed_payloads had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue failed_data_in had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue failed_data_out had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue completed_jobs had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue completed_jobids has 1 job(s) [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue realtimelog_payloads had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | queue messages had 0 job(s) [purged] [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | job 5753961892 has completed (purged errors) [2023-03-15 20:09:32] 2023-03-15 19:09:06,378 | INFO | overall cleanup function is called [2023-03-15 20:09:32] 2023-03-15 19:09:07,385 | INFO | --- collectZombieJob: --- 10, [432316] [2023-03-15 20:09:32] 2023-03-15 19:09:07,385 | INFO | zombie collector trying to kill pid 432316 [2023-03-15 20:09:32] 2023-03-15 19:09:07,385 | INFO | harmless exception when collecting zombies: [Errno 10] No child processes [2023-03-15 20:09:32] 2023-03-15 19:09:08,391 | INFO | collected zombie processes [2023-03-15 20:09:32] 2023-03-15 19:09:08,391 | INFO | will now attempt to kill all subprocesses of pid=432316 [2023-03-15 20:09:32] 2023-03-15 19:09:08,430 | INFO | process IDs to be killed: [432316] (in reverse order) [2023-03-15 20:09:32] 2023-03-15 19:09:08,468 | WARNING | found no corresponding commands to process id(s) [2023-03-15 20:09:32] 2023-03-15 19:09:08,468 | INFO | Do not look for orphan processes in BOINC jobs [2023-03-15 20:09:32] 2023-03-15 19:09:08,468 | INFO | ready for new job [2023-03-15 20:09:32] 2023-03-15 19:09:08,469 | INFO | pilot has finished with previous job - re-establishing logging [2023-03-15 20:09:32] 2023-03-15 19:09:08,470 | INFO | *************************************** [2023-03-15 20:09:32] 2023-03-15 19:09:08,471 | INFO | *** PanDA Pilot version 3.4.8 (5) *** [2023-03-15 20:09:32] 2023-03-15 19:09:08,471 | INFO | *************************************** [2023-03-15 20:09:32] 2023-03-15 19:09:08,471 | INFO | [2023-03-15 20:09:32] 2023-03-15 19:09:08,472 | INFO | pilot is running in a VM [2023-03-15 20:09:32] 2023-03-15 19:09:08,472 | INFO | architecture information: [2023-03-15 20:09:32] 2023-03-15 19:09:08,547 | INFO | [2023-03-15 20:09:32] LSB Version: :core-4.1-amd64:core-4.1-noarch [2023-03-15 20:09:32] Distributor ID: CentOS [2023-03-15 20:09:32] Description: CentOS Linux release 7.9.2009 (Core) [2023-03-15 20:09:32] Release: 7.9.2009 [2023-03-15 20:09:32] Codename: Core [2023-03-15 20:09:32] 2023-03-15 19:09:08,547 | INFO | *************************************** [2023-03-15 20:09:32] 2023-03-15 19:09:09,050 | INFO | executing command: df -mP /var/lib/boinc_data/boinc-01/slots/0 [2023-03-15 20:09:32] 2023-03-15 19:09:09,070 | INFO | sufficient remaining disk space (40577794048 B) [2023-03-15 20:09:32] 2023-03-15 19:09:09,071 | WARNING | since timefloor is set to 0, pilot was only allowed to run one job [2023-03-15 20:09:32] 2023-03-15 19:09:09,071 | INFO | [job] retrieve thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:09,072 | WARNING | aborting monitor loop since graceful_stop has been set [2023-03-15 20:09:32] 2023-03-15 19:09:09,072 | INFO | [data] copytool_in thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:09,072 | INFO | [monitor] control thread has ended [2023-03-15 20:09:32] 2023-03-15 19:09:09,139 | WARNING | data:copytool_out:received graceful stop - abort after this iteration [2023-03-15 20:09:32] 2023-03-15 19:09:09,354 | INFO | [data] control thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:09,665 | INFO | [payload] execute_payloads thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:09,860 | INFO | [payload] control thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:10,023 | INFO | [job] create_data_payload thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:10,114 | INFO | [job] validate thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:10,140 | INFO | [data] copytool_out thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:10,169 | INFO | [payload] validate_pre thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:10,362 | INFO | [job] control thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:10,423 | INFO | [payload] validate_post thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:10,529 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration [2023-03-15 20:09:32] 2023-03-15 19:09:10,550 | INFO | [payload] failed_post thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:11,371 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration [2023-03-15 20:09:32] 2023-03-15 19:09:11,371 | INFO | [job] queue monitor thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:13,531 | INFO | [data] queue_monitor thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:20,674 | INFO | job.realtimelogging is not enabled [2023-03-15 20:09:32] 2023-03-15 19:09:20,674 | INFO | [payload] run_realtimelog thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:32,054 | WARNING | no jobs in monitored_payloads queue (waited for 73 s) [2023-03-15 20:09:32] 2023-03-15 19:09:32,054 | INFO | [job] job monitor thread has finished [2023-03-15 20:09:32] 2023-03-15 19:09:32,474 | INFO | end of generic workflow (traces error code: 0) [2023-03-15 20:09:32] 2023-03-15 19:09:32,475 | INFO | traces error code: 0 [2023-03-15 20:09:32] 2023-03-15 19:09:32,475 | INFO | pilot has finished [2023-03-15 20:09:32] 2023-03-15 19:09:32,522 [wrapper] ==== pilot stdout END ==== [2023-03-15 20:09:32] 2023-03-15 19:09:32,524 [wrapper] ==== wrapper stdout RESUME ==== [2023-03-15 20:09:32] 2023-03-15 19:09:32,526 [wrapper] pilotpid: 429779 [2023-03-15 20:09:32] 2023-03-15 19:09:32,528 [wrapper] Pilot exit status: 0 [2023-03-15 20:09:32] 2023-03-15 19:09:32,541 [wrapper] pandaids: 5753961892 [2023-03-15 20:09:32] 2023-03-15 19:09:32,545 [wrapper] apfmon messages muted [2023-03-15 20:09:32] 2023-03-15 19:09:32,549 [wrapper] Test setup, not cleaning [2023-03-15 20:09:32] 2023-03-15 19:09:32,553 [wrapper] ==== wrapper stdout END ==== [2023-03-15 20:09:32] 2023-03-15 19:09:32,555 [wrapper] ==== wrapper stderr END ==== [2023-03-15 20:09:32] 2023-03-15 19:09:32,561 [wrapper] wrapperexiting ec=0, duration=8453 [2023-03-15 20:09:32] 2023-03-15 19:09:32,565 [wrapper] apfmon messages muted [2023-03-15 20:09:32] *** Error codes and diagnostics *** [2023-03-15 20:09:32] "exeErrorCode": 0, [2023-03-15 20:09:32] "exeErrorDiag": "", [2023-03-15 20:09:32] "pilotErrorCode": 0, [2023-03-15 20:09:32] "pilotErrorDiag": "", [2023-03-15 20:09:32] *** Listing of results directory *** [2023-03-15 20:09:32] insgesamt 727436 [2023-03-15 20:09:32] -rw-r--r-- 1 yeti yeti 386707 Mär 15 09:36 pilot3.tar.gz [2023-03-15 20:09:32] -rw-r--r-- 1 yeti yeti 4332 Mär 15 09:44 queuedata.json [2023-03-15 20:09:32] -rwx------ 1 yeti yeti 26447 Mär 15 09:46 runpilot2-wrapper.sh [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 107 Mär 15 17:48 wrapper_26015_x86_64-pc-linux-gnu [2023-03-15 20:09:32] -rwxr-xr-x 1 yeti yeti 7986 Mär 15 17:48 run_atlas [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 112 Mär 15 17:48 job.xml [2023-03-15 20:09:32] -rw-r--r-- 2 yeti yeti 17293 Mär 15 17:48 start_atlas.sh [2023-03-15 20:09:32] drwxrwx--x 2 yeti yeti 4096 Mär 15 17:48 shared [2023-03-15 20:09:32] -rw-r--r-- 2 yeti yeti 398356 Mär 15 17:48 input.tar.gz [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 6440 Mär 15 17:48 init_data.xml [2023-03-15 20:09:32] -rw-r--r-- 2 yeti yeti 436382292 Mär 15 17:48 EVNT.29838250._000010.pool.root.1 [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 0 Mär 15 17:48 boinc_lockfile [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 2549 Mär 15 17:48 pandaJob.out [2023-03-15 20:09:32] -rw------- 1 yeti yeti 450 Mär 15 17:48 setup.sh.local [2023-03-15 20:09:32] -rw------- 1 yeti yeti 972199 Mär 15 17:48 agis_schedconf.cvmfs.json [2023-03-15 20:09:32] -rw------- 1 yeti yeti 1425877 Mär 15 17:48 agis_ddmendpoints.agis.ALL.json [2023-03-15 20:09:32] drwx------ 4 yeti yeti 4096 Mär 15 17:49 pilot3 [2023-03-15 20:09:32] -rw------- 1 yeti yeti 303830562 Mär 15 20:08 HITS.32413688._000229-102270-1678869975.pool.root.1 [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 537 Mär 15 20:08 boinc_task_state.xml [2023-03-15 20:09:32] -rw------- 1 yeti yeti 1018 Mär 15 20:08 memory_monitor_summary.json [2023-03-15 20:09:32] -rw------- 1 yeti yeti 269380 Mär 15 20:09 log.32413688._000229-102270-1678869975.job.log.tgz.1 [2023-03-15 20:09:32] -rw------- 1 yeti yeti 7664 Mär 15 20:09 heartbeat.json [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 27 Mär 15 20:09 wrapper_checkpoint.txt [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 8192 Mär 15 20:09 boinc_mmap_file [2023-03-15 20:09:32] -rw------- 1 yeti yeti 3034 Mär 15 20:09 pilotlog.txt [2023-03-15 20:09:32] -rw------- 1 yeti yeti 363751 Mär 15 20:09 log.32413688._000229-102270-1678869975.job.log.1 [2023-03-15 20:09:32] -rw------- 1 yeti yeti 399 Mär 15 20:09 output.list [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 674 Mär 15 20:09 runtime_log [2023-03-15 20:09:32] -rw------- 1 yeti yeti 655360 Mär 15 20:09 result.tar.gz [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 11318 Mär 15 20:09 runtime_log.err [2023-03-15 20:09:32] -rw------- 1 yeti yeti 629 Mär 15 20:09 N0aNDmAxbw2n7Olcko1bjSoqABFKDmABFKDm7AsVDmCPGKDm68y91n.diag [2023-03-15 20:09:32] -rw-rw-r-- 1 yeti yeti 21840 Mär 15 20:09 stderr.txt [2023-03-15 20:09:32] HITS file was successfully produced: [2023-03-15 20:09:32] -rw------- 1 yeti yeti 303830562 Mär 15 20:08 shared/HITS.pool.root.1 [2023-03-15 20:09:32] *** Contents of shared directory: *** [2023-03-15 20:09:32] insgesamt 723928 [2023-03-15 20:09:32] -rw-r--r-- 2 yeti yeti 17293 Mär 15 17:48 start_atlas.sh [2023-03-15 20:09:32] -rw-r--r-- 2 yeti yeti 398356 Mär 15 17:48 input.tar.gz [2023-03-15 20:09:32] -rw-r--r-- 2 yeti yeti 436382292 Mär 15 17:48 ATLAS.root_0 [2023-03-15 20:09:32] -rw------- 1 yeti yeti 303830562 Mär 15 20:08 HITS.pool.root.1 [2023-03-15 20:09:32] -rw------- 1 yeti yeti 655360 Mär 15 20:09 result.tar.gz 20:09:34 (425970): run_atlas exited; CPU time 29937.588387 20:09:34 (425970): called boinc_finish(0) </stderr_txt> ]]>
©2024 CERN