Name | 3aqMDmpd2gynfZGDcpSWOuwoABFKDmABFKDm2IFNDmmCFKDmnKxlQm_0 |
Workunit | 2063714 |
Created | 18 Mar 2021, 7:52:59 UTC |
Sent | 18 Mar 2021, 7:56:30 UTC |
Report deadline | 25 Mar 2021, 7:56:30 UTC |
Received | 18 Mar 2021, 8:29:13 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 4389 |
Run time | 7 min 20 sec |
CPU time | 3 min 43 sec |
Validate state | Valid |
Credit | 0.64 |
Device peak FLOPS | 3.56 GFLOPS |
Application version | ATLAS long simulation v1.00 (native_mt) x86_64-pc-linux-gnu |
Peak working set size | 2.53 GB |
Peak swap size | 3.13 GB |
Peak disk usage | 88.99 MB |
<core_client_version>7.16.11</core_client_version> <![CDATA[ <stderr_txt> 10:21:22 (20555): wrapper (7.7.26015): starting 10:21:22 (20555): wrapper: running run_atlas (--nthreads 1) [2021-03-18 10:21:22] Arguments: --nthreads 1 [2021-03-18 10:21:22] Threads: 1 [2021-03-18 10:21:22] Checking for CVMFS [2021-03-18 10:21:22] Probing /cvmfs/atlas.cern.ch... OK [2021-03-18 10:21:23] Probing /cvmfs/atlas-condb.cern.ch... OK [2021-03-18 10:21:26] Probing /cvmfs/grid.cern.ch... OK [2021-03-18 10:21:26] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE [2021-03-18 10:21:26] 2.8.0.0 15600 35 58416 81004 0 61 3949051 4096000 0 130560 0 43249 99.9954 1070 443 http://cvmfs-stratum-one.cern.ch:8000/cvmfs/atlas.cern.ch DIRECT 1 [2021-03-18 10:21:26] CVMFS is ok [2021-03-18 10:21:26] Using singularity image /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img [2021-03-18 10:21:26] Checking for singularity binary... [2021-03-18 10:21:26] Using singularity found in PATH at /usr/bin/singularity [2021-03-18 10:21:26] Running /usr/bin/singularity --version [2021-03-18 10:21:26] singularity version 3.7.1-1.el7 [2021-03-18 10:21:26] Checking singularity works with /usr/bin/singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img hostname [2021-03-18 10:21:26] CentOS7 [2021-03-18 10:21:26] Singularity works [2021-03-18 10:21:26] Starting ATLAS job with PandaID=5002834760 [2021-03-18 10:21:26] Running command: /usr/bin/singularity exec --pwd /var/lib/boinc/slots/1 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/containers/images/singularity/x86_64-centos7.img sh start_atlas.sh [2021-03-18 10:28:40] *** The last 200 lines of the pilot log: *** [2021-03-18 10:28:40] }, [2021-03-18 10:28:40] "transformSetup": { [2021-03-18 10:28:40] "cpuTime": 0.0, [2021-03-18 10:28:40] "wallTime": 0.01 [2021-03-18 10:28:40] }, [2021-03-18 10:28:40] "trfPredata": null, [2021-03-18 10:28:40] "wallTime": 341.03 [2021-03-18 10:28:40] } [2021-03-18 10:28:40] } [2021-03-18 10:28:40] } [2021-03-18 10:28:40] 2021-03-18 08:28:02,983 | DEBUG | queue_monitor | pilot.user.atlas.common | update_server | no need to update logstash for this job [2021-03-18 10:28:40] 2021-03-18 08:28:02,983 | DEBUG | queue_monitor | pilot.control.job | get_proper_state | state=finished [2021-03-18 10:28:40] 2021-03-18 08:28:02,983 | DEBUG | queue_monitor | pilot.control.job | get_proper_state | serverstate=running [2021-03-18 10:28:40] 2021-03-18 08:28:02,983 | DEBUG | queue_monitor | pilot.control.job | get_proper_state | serverstate=finished [2021-03-18 10:28:40] 2021-03-18 08:28:02,983 | INFO | queue_monitor | pilot.control.job | send_state | pilot will not update the server (heartbeat message will be written to file) [2021-03-18 10:28:40] 2021-03-18 08:28:02,984 | INFO | queue_monitor | pilot.control.job | send_state | job 5002834760 has finished - writing final server update [2021-03-18 10:28:40] 2021-03-18 08:28:02,984 | DEBUG | queue_monitor | pilot.control.job | get_data_structure | building data structure to be sent to server with heartbeat [2021-03-18 10:28:40] 2021-03-18 08:28:02,984 | DEBUG | queue_monitor | pilot.user.atlas.jobmetrics | get_job_metrics_string | job definition core count: 8 [2021-03-18 10:28:40] 2021-03-18 08:28:02,984 | INFO | queue_monitor | pilot.user.atlas.jobmetrics | get_job_metrics_string | will not add max space = -36036836 B to job metrics [2021-03-18 10:28:40] 2021-03-18 08:28:02,984 | WARNING | queue_monitor | pilot.api.analytics | get_fitted_data | wrong length of table data, x=[1616055719.0, 1616055780.0, 1616055841.0, 1616055902.0, 1616055963.0, 1616056024.0], y=[1038.0, 689802.0, 871922.0, 1405022.0, 2694227.0, 2751851.0] (must be same and length>=4) [2021-03-18 10:28:40] 2021-03-18 08:28:02,984 | DEBUG | queue_monitor | pilot.user.atlas.jobmetrics | get_job_metrics | job metrics="actualCoreCount=4 nEvents=2 dbTime=28.77 dbData=4274899" [2021-03-18 10:28:40] 2021-03-18 08:28:02,984 | INFO | queue_monitor | pilot.control.job | get_data_structure | mean actualcorecount: 3.200000 [2021-03-18 10:28:40] 2021-03-18 08:28:02,984 | INFO | queue_monitor | pilot.control.job | get_data_structure | total number of processed events: 2 (read) [2021-03-18 10:28:40] 2021-03-18 08:28:02,985 | INFO | queue_monitor | pilot.user.atlas.utilities | get_memory_values | using path: /var/lib/boinc/slots/1/PanDA_Pilot-5002834760/memory_monitor_summary.json (trf name=prmon) [2021-03-18 10:28:40] 2021-03-18 08:28:02,986 | DEBUG | queue_monitor | pilot.user.atlas.utilities | get_memory_monitor_info | summary_dictionary={'Max': {'rx_packets': 62999, 'nprocs': 5, 'nthreads': 6, 'rx_bytes': 90251205, 'wtime': 310, 'rss': 2759500, 'write_bytes': 2748416, 'vmem': 3853172, 'read_bytes': 1609185280, 'stime': 12, 'tx_bytes': 3592327, 'pss': 2751851, 'wchar': 5544840, 'rchar': 489555897, 'tx_packets': 18191, 'swap': 0, 'utime': 183}, 'Avg': {'write_bytes': 8854.0, 'nprocs': 4.333, 'nthreads': 5.166, 'rx_bytes': 290748.0, 'rx_packets': 202.954, 'vmem': 2293416.0, 'read_bytes': 5184063.0, 'swap': 0.0, 'tx_bytes': 11572.0, 'pss': 1402310.0, 'wchar': 17862.0, 'rchar': 1577126.0, 'tx_packets': 58.603, 'rss': 1408898.0}, 'HW': {'mem': {'MemTotal': 4654084}, 'cpu': {'CoresPerSocket': 4, 'ModelName': 'Intel(R) Core(TM) i5-4440 CPU @ 3.10GHz', 'ThreadsPerCore': 1, 'CPUs': 4, 'Sockets': 1}}, 'prmon': {'Version': '2.2.0'}} [2021-03-18 10:28:40] 2021-03-18 08:28:02,986 | INFO | queue_monitor | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard info from prmon json [2021-03-18 10:28:40] 2021-03-18 08:28:02,986 | INFO | queue_monitor | pilot.user.atlas.utilities | get_memory_monitor_info | extracted standard memory fields from prmon json [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | .............................. [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | . Timing measurements: [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | . get job = 0 s [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | . initial setup = 1 s [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | . payload setup = 5 s [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | . total setup = 6 s [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | . stage-in = 1 s [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | . payload execution = 363 s [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | . stage-out = 1 s [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | INFO | queue_monitor | pilot.util.timing | timing_report | .............................. [2021-03-18 10:28:40] 2021-03-18 08:28:02,987 | DEBUG | queue_monitor | pilot.control.job | send_state | is_harvester_mode(args) : False [2021-03-18 10:28:40] 2021-03-18 08:28:02,988 | DEBUG | queue_monitor | pilot.control.job | write_heartbeat_to_file | heartbeat dictionary: {'pilotErrorCode': 0, 'rateWBYTES': 8854.0, 'pilotID': 'http://aipanda403.cern.ch/data/jobs/2021-03-18/BOINC-TEST/5002834760.out|PR|2.9.6 (20)', 'meanCoreCount': 3.2, 'totRBYTES': 1609185280, 'siteName': 'BOINC-TEST', 'avgVMEM': 2293416.0, 'coreCount': 8, 'totWCHAR': 5544840, 'rateRCHAR': 1577126.0, 'jobId': '5002834760', 'totRCHAR': 489555897, 'exeErrorCode': 0, 'rateWCHAR': 17862.0, 'metaData': '{\n "cmdLine": "\'/cvmfs/atlas.cern.ch/repo/sw/software/21.0/Athena/21.0.31/InstallArea/x86_64-slc6-gcc62-opt/share/Sim_tf.py\' \'--maxEvents=2\' \'--skipEvents=0\' \'--firstEvent=118011\' \'--randomSeed=109\' \'--DBRelease=all:current\' \'--geometryVersion=default:ATLAS-R2-2016-01-00-01_VALIDATION\' \'--conditionsTag\' \'default:OFLCOND-MC16-SDR-14\' \'--physicsList=FTFP_BERT_ATL_VALIDATION\' \'--preExec\' \'EVNTtoHITS:simFlags.SimBarcodeOffset.set_Value_and_Lock(200000)\' \'EVNTtoHITS:simFlags.TRTRangeCut=30.0;simFlags.TightMuonStepping=True\' \'--postInclude\' \'default:RecJobTransforms/UseFrontier.py\' \'--simulator=ATLFASTII\' \'--truthStrategy=MC15aPlus\' \'--DataRunNumber=361106\' \'--outputHitsFile\' \'output.1.663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.pool.root\' \'--inputEvgenFile\' \'EVNT.04972714._000034.pool.root.1\'", \n "created": "2021-03-18T10:27:45", \n "executor": [\n {\n "asetup": null, \n "errMsg": "", \n "exeConfig": {\n "inputs": [\n "EVNT"\n ], \n "outputs": [\n "HITS"\n ], \n "script": "athena.py", \n "substep": "sim"\n }, \n "logfileReport": {\n "countSummary": {\n "CATASTROPHE": 0, \n "CRITICAL": 0, \n "DEBUG": 0, \n "ERROR": 0, \n "FATAL": 0, \n "IGNORED": 0, \n "INFO": 3407, \n "UNKNOWN": 3392, \n "VERBOSE": 0, \n "WARNING": 24\n }, \n "details": {}\n }, \n "metaData": {}, \n "name": "EVNTtoHITS", \n "rc": 0, \n "statusOK": true, \n "validation": true\n }\n ], \n "exitAcronym": "OK", \n "exitCode": 0, \n "exitMsg": "OK", \n "exitMsgExtra": "", \n "files": {\n "input": [\n {\n "dataset": null, \n "nentries": 1000, \n "subFiles": [\n {\n "file_guid": "D499C9B8-3CD9-2A45-A0DC-6501DB8CA66C", \n "name": "EVNT.04972714._000034.pool.root.1"\n }\n ], \n "type": "EVNT"\n }\n ], \n "output": [\n {\n "argName": "outputHITSFile", \n "dataset": null, \n "subFiles": [\n {\n "file_guid": "2BE41C9F-4241-C74E-8877-FF9929E27EA1", \n "file_size": 3109186, \n "name": "output.1.663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.pool.root", \n "nentries": 2\n }\n ], \n "type": "HITS"\n }\n ]\n }, \n "name": "Sim_tf", \n "reportVersion": "2.0.9", \n "resource": {\n "dbDataTotal": 8549798, \n "dbTimeTotal": 57.54, \n "executor": {\n "EVNTtoHITS": {\n "cpuTime": 215.44, \n "dbData": 4274899, \n "dbTime": 28.77, \n "memory": {\n "Avg": {\n "avgPSS": 1344281, \n "avgRSS": 1347664, \n "avgSwap": 0, \n "avgVMEM": 1904176, \n "rateRBYTES": 4398421, \n "rateRCHAR": 1480466, \n "rateWBYTES": 6196, \n "rateWCHAR": 12783\n }, \n "Max": {\n "maxPSS": 2646396, \n "maxRSS": 2649836, \n "maxSwap": 0, \n "maxVMEM": 3294616, \n "totRBYTES": 1372307456, \n "totRCHAR": 461905517, \n "totWBYTES": 1933312, \n "totWCHAR": 3988602\n }\n }, \n "nevents": 2, \n "postExe": {\n "cpuTime": 0.82, \n "wallTime": 0.92\n }, \n "preExe": {\n "cpuTime": 0.33, \n "wallTime": 0.81\n }, \n "total": {\n "cpuTime": 216.59, \n "wallTime": 325.33\n }, \n "validation": {\n "cpuTime": 0.0, \n "wallTime": 0.75\n }, \n "wallTime": 322.85\n }\n }, \n "machine": {\n "cpu_family": "6", \n "linux_distribution": [\n "CentOS Linux", \n "7.8.2003", \n "Core"\n ], \n "model": "60", \n "model_name": "Intel(R) Core(TM) i5-4440 CPU @ 3.10GHz", \n "node": "CentOS7", \n "platform": "Linux-3.10.0-1160.15.2.el7.x86_64-x86_64-with-centos-7.8.2003-Core"\n }, \n "transform": {\n "cpuEfficiency": 0.6428, \n "cpuPWEfficiency": 0.6428, \n "cpuTime": 3.76, \n "cpuTimeTotal": 216.59, \n "externalCpuTime": 1.38, \n "inFileValidation": {\n "cpuTime": 0.15, \n "wallTime": 7.28\n }, \n "outFileValidation": {\n "cpuTime": 0.0, \n "wallTime": 3.33\n }, \n "processedEvents": 2, \n "reportGeneration": {\n "cpuTime": 0.08, \n "wallTime": 5.08\n }, \n "transformSetup": {\n "cpuTime": 0.0, \n "wallTime": 0.01\n }, \n "trfPredata": null, \n "wallTime": 341.03\n }\n }\n}', 'xml': '{"output.1.663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.pool.root": {"adler32": "ca08ba91", "surl": "root://eosatlas.cern.ch:1094//eos/atlas/atlasdatadisk/rucio/hc_test/27/13/output.1.663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.pool.root", "guid": "2BE41C9F-4241-C74E-8877-FF9929E27EA1", "fsize": 3109186}, "663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.1.job.log.tgz": {"adler32": "44e16493", "surl": "root://eosatlas.cern.ch:1094//eos/atlas/atlasdatadisk/rucio/hc_test/67/a3/663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.1.job.log.tgz", "guid": "70b90a99-e7b6-4b3e-93e8-1d026af2374a", "fsize": 176347}}', 'maxVMEM': 3853172, 'cpuConversionFactor': 1.0, 'avgSWAP': 0.0, 'state': 'finished', 'transExitCode': 0, 'pilotErrorDiag': '', 'node': 'CentOS7', 'avgRSS': 1408898.0, 'avgPSS': 1402310.0, 'timestamp': '2021-03-18T10:28:02+02:00', 'pilotTiming': '0|1|363|1|6', 'attemptNr': 0, 'totWBYTES': 2748416, 'nEvents': 2, 'rateRBYTES': 5184063.0, 'pilotLog': '', 'cpuConsumptionTime': 229, 'startTime': 1616055695.012218, 'cpuConsumptionUnit': 's+Intel(R) Core(TM) i5-4440 CPU @ 3.10GHz 6144 KB', 'exeErrorDiag': '', 'maxSWAP': 0, 'jobMetrics': 'actualCoreCount=4 nEvents=2 dbTime=28.77 dbData=4274899', 'maxRSS': 2759500, 'schedulerID': 'harvester-CERN_central_ACTA', 'endTime': 1616056082.987914, 'maxPSS': 2751851} [2021-03-18 10:28:40] 2021-03-18 08:28:02,988 | DEBUG | queue_monitor | pilot.control.job | write_heartbeat_to_file | wrote heartbeat to file /var/lib/boinc/slots/1/heartbeat.json [2021-03-18 10:28:40] 2021-03-18 08:28:02,988 | DEBUG | queue_monitor | pilot.control.job | queue_monitor | job 5002834760 was dequeued from the monitored payloads queue [2021-03-18 10:28:40] 2021-03-18 08:28:03,110 | DEBUG | queue_monitor | pilot.control.job | queue_monitor | tmp job object deleted [2021-03-18 10:28:40] 2021-03-18 08:28:03,533 | INFO | retrieve | pilot.control.job | make_job_report | [2021-03-18 10:28:40] 2021-03-18 08:28:03,533 | INFO | retrieve | pilot.control.job | make_job_report | job summary report [2021-03-18 10:28:40] 2021-03-18 08:28:03,533 | INFO | retrieve | pilot.control.job | make_job_report | -------------------------------------------------- [2021-03-18 10:28:40] 2021-03-18 08:28:03,533 | INFO | retrieve | pilot.control.job | make_job_report | PanDA job id: 5002834760 [2021-03-18 10:28:40] 2021-03-18 08:28:03,533 | INFO | retrieve | pilot.control.job | make_job_report | task id: NULL [2021-03-18 10:28:40] 2021-03-18 08:28:03,533 | INFO | retrieve | pilot.control.job | make_job_report | errors: (none) [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | status: LOG_TRANSFER = DONE [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | pilot state: finished [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | transexitcode: 0 [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | exeerrorcode: 0 [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | exeerrordiag: [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | exitcode: 0 [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | exitmsg: OK [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | cpuconsumptiontime: 229 s [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | nevents: 2 [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | neventsw: 0 [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | pid: 26486 [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | pgrp: 26486 [2021-03-18 10:28:40] 2021-03-18 08:28:03,534 | INFO | retrieve | pilot.control.job | make_job_report | corecount: 8 [2021-03-18 10:28:40] 2021-03-18 08:28:03,535 | INFO | retrieve | pilot.control.job | make_job_report | event service: False [2021-03-18 10:28:40] 2021-03-18 08:28:03,535 | INFO | retrieve | pilot.control.job | make_job_report | sizes: {0: 8497324, 2: 8497547, 3: 8497547, 13: 8497571, 372: 8532602, 374: 8542509, 375: 8542603} [2021-03-18 10:28:40] 2021-03-18 08:28:03,535 | INFO | retrieve | pilot.control.job | make_job_report | -------------------------------------------------- [2021-03-18 10:28:40] 2021-03-18 08:28:03,535 | INFO | retrieve | pilot.control.job | make_job_report | [2021-03-18 10:28:40] 2021-03-18 08:28:03,535 | DEBUG | retrieve | pilot.control.job | has_job_completed | ls -lF /var/lib/boinc/slots/1: [2021-03-18 10:28:40] [2021-03-18 10:28:40] 2021-03-18 08:28:03,535 | INFO | retrieve | pilot.util.container | execute | executing command: ls -lF /var/lib/boinc/slots/1 [2021-03-18 10:28:40] 2021-03-18 08:28:03,555 | DEBUG | retrieve | pilot.control.job | has_job_completed | total 45544 [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 142 Mar 18 10:21 3aqMDmpd2gynfZGDcpSWOuwoABFKDmABFKDm2IFNDmmCFKDmnKxlQm.diag [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 162246 Mar 18 10:28 663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.1.job.log [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 176347 Mar 18 10:28 663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.1.job.log.tgz [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 1174577 Mar 18 10:21 agis_schedconf.cvmfs.json [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 0 Mar 18 10:21 boinc_lockfile [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 8192 Mar 18 10:27 boinc_mmap_file [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 532 Mar 18 10:27 boinc_task_state.xml [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 1943413 Mar 18 10:21 cric_ddmendpoints.json [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 37595586 Mar 18 10:21 EVNT.04972714._000034.pool.root.1 [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 6995 Mar 18 10:28 heartbeat.json [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 6081 Mar 18 10:21 init_data.xml [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 1048539 Mar 18 10:21 input.tar.gz [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 112 Mar 18 10:21 job.xml [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 1010 Mar 18 10:27 memory_monitor_summary.json [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 3109186 Mar 18 10:27 output.1.663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.pool.root [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 546 Mar 18 10:28 output.list [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 2619 Mar 18 10:21 pandaJob.out [2021-03-18 10:28:40] drwxrwx---. 2 boinc boinc 4096 Mar 18 10:28 PanDA_Pilot-5002834760/ [2021-03-18 10:28:40] drwx------. 5 boinc boinc 4096 Mar 18 10:21 pilot2/ [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 1042975 Mar 18 09:24 pilot2.tar.gz [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 144490 Mar 18 10:28 pilotlog.txt [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 4974 Mar 18 09:52 queuedata.json [2021-03-18 10:28:40] -rwxr-xr-x. 1 boinc boinc 5573 Mar 18 10:21 run_atlas* [2021-03-18 10:28:40] -rwx------. 1 boinc boinc 20043 Mar 18 09:52 runpilot2-wrapper.sh* [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 407 Mar 18 10:21 runtime_log [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 5471 Mar 18 10:21 runtime_log.err [2021-03-18 10:28:40] drwxrwx--x. 2 boinc boinc 68 Mar 18 10:21 shared/ [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 16549 Mar 18 10:21 start_atlas.sh [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 1676 Mar 18 10:21 stderr.txt [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 107 Mar 18 10:21 wrapper_26015_x86_64-pc-linux-gnu [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 24 Mar 18 10:27 wrapper_checkpoint.txt [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue jobs has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue payloads has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue data_in has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue data_out has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue current_data_in has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue validated_jobs has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue validated_payloads has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue monitored_payloads has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue finished_jobs has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue finished_payloads has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue finished_data_in has 1 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,556 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue finished_data_out has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,557 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue failed_jobs has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,557 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue failed_payloads has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,557 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue failed_data_in has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,557 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue failed_data_out has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,557 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue completed_jobs has 0 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,557 | INFO | retrieve | pilot.util.queuehandling | queue_report | queue completed_jobids has 1 job(s) [2021-03-18 10:28:40] 2021-03-18 08:28:03,557 | INFO | retrieve | pilot.control.job | has_job_completed | job 5002834760 has completed (purged errors) [2021-03-18 10:28:40] 2021-03-18 08:28:03,557 | INFO | retrieve | pilot.util.processes | cleanup | overall cleanup function is called [2021-03-18 10:28:40] 2021-03-18 08:28:03,558 | DEBUG | retrieve | pilot.util.processes | cleanup | work directory was removed: /var/lib/boinc/slots/1/PanDA_Pilot-5002834760 [2021-03-18 10:28:40] 2021-03-18 08:28:04,564 | INFO | retrieve | pilot.info.jobdata | collect_zombies | --- collectZombieJob: --- 10, [26486] [2021-03-18 10:28:40] 2021-03-18 08:28:04,564 | INFO | retrieve | pilot.info.jobdata | collect_zombies | zombie collector trying to kill pid 26486 [2021-03-18 10:28:40] 2021-03-18 08:28:04,564 | INFO | retrieve | pilot.info.jobdata | collect_zombies | harmless exception when collecting zombies: [Errno 10] No child processes [2021-03-18 10:28:40] 2021-03-18 08:28:05,582 | INFO | retrieve | pilot.util.processes | cleanup | collected zombie processes [2021-03-18 10:28:40] 2021-03-18 08:28:05,582 | INFO | retrieve | pilot.util.processes | cleanup | will now attempt to kill all subprocesses of pid=26486 [2021-03-18 10:28:40] 2021-03-18 08:28:05,613 | INFO | retrieve | pilot.util.processes | kill_processes | process IDs to be killed: [26486] (in reverse order) [2021-03-18 10:28:40] 2021-03-18 08:28:05,682 | WARNING | retrieve | pilot.util.processes | kill_processes | found no corresponding commands to process id(s) [2021-03-18 10:28:40] 2021-03-18 08:28:05,682 | INFO | retrieve | pilot.util.processes | kill_orphans | Do not look for orphan processes in BOINC jobs [2021-03-18 10:28:40] 2021-03-18 08:28:05,683 | DEBUG | retrieve | pilot.util.queuehandling | purge_queue | queue purged [2021-03-18 10:28:40] 2021-03-18 08:28:05,683 | INFO | retrieve | pilot.control.job | retrieve | ready for new job [2021-03-18 10:28:40] 2021-03-18 08:28:05,683 | INFO | retrieve | root | retrieve | pilot has finished for previous job - re-establishing logging [2021-03-18 10:28:40] 2021-03-18 08:28:05,683 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | **************************************** [2021-03-18 10:28:40] 2021-03-18 08:28:05,683 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | *** PanDA Pilot version 2.9.6 (20) *** [2021-03-18 10:28:40] 2021-03-18 08:28:05,683 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | **************************************** [2021-03-18 10:28:40] 2021-03-18 08:28:05,683 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | [2021-03-18 10:28:40] 2021-03-18 08:28:05,684 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | pilot is running in a VM [2021-03-18 10:28:40] 2021-03-18 08:28:05,684 | INFO | retrieve | pilot.util.auxiliary | display_architecture_info | architecture information: [2021-03-18 10:28:40] 2021-03-18 08:28:06,351 | INFO | retrieve | pilot.util.auxiliary | display_architecture_info | [2021-03-18 10:28:40] LSB Version: :core-4.1-amd64:core-4.1-noarch [2021-03-18 10:28:40] Distributor ID: CentOS [2021-03-18 10:28:40] Description: CentOS Linux release 7.8.2003 (Core) [2021-03-18 10:28:40] Release: 7.8.2003 [2021-03-18 10:28:40] Codename: Core [2021-03-18 10:28:40] 2021-03-18 08:28:06,351 | INFO | retrieve | pilot.util.auxiliary | pilot_version_banner | **************************************** [2021-03-18 10:28:40] 2021-03-18 08:28:06,854 | DEBUG | retrieve | pilot.util.monitoring | check_local_space | checking local space on /var/lib/boinc/slots/1 [2021-03-18 10:28:40] 2021-03-18 08:28:06,866 | INFO | retrieve | pilot.util.monitoring | check_local_space | sufficient remaining disk space (13873709056 B) [2021-03-18 10:28:40] 2021-03-18 08:28:06,867 | WARNING | retrieve | pilot.control.job | proceed_with_getjob | since timefloor is set to 0, pilot was only allowed to run one job [2021-03-18 10:28:40] 2021-03-18 08:28:06,867 | DEBUG | retrieve | pilot.control.job | retrieve | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:06,867 | DEBUG | retrieve | pilot.control.job | retrieve | [job] retrieve thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:07,047 | DEBUG | validate_pre | pilot.control.payload | validate_pre | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:07,047 | INFO | validate_pre | pilot.control.payload | validate_pre | [payload] validate_pre thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:07,333 | DEBUG | data | pilot.control.data | control | data control ending since graceful_stop has been set [2021-03-18 10:28:40] 2021-03-18 08:28:07,333 | DEBUG | data | pilot.control.data | control | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:07,333 | DEBUG | data | pilot.control.data | control | [data] control thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:07,421 | INFO | monitor | pilot.control.monitor | control | [monitor] control thread has ended [2021-03-18 10:28:40] 2021-03-18 08:28:07,535 | DEBUG | payload | pilot.control.payload | control | payload control ending since graceful_stop has been set [2021-03-18 10:28:40] 2021-03-18 08:28:07,535 | DEBUG | payload | pilot.control.payload | control | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:07,535 | DEBUG | payload | pilot.control.payload | control | [payload] control thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:07,545 | DEBUG | create_data_payload | pilot.control.job | create_data_payload | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:07,545 | DEBUG | validate | pilot.control.job | validate | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:07,545 | DEBUG | create_data_payload | pilot.control.job | create_data_payload | [job] create_data_payload thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:07,545 | DEBUG | validate | pilot.control.job | validate | [job] validate thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:07,727 | WARNING | copytool_out | pilot.util.common | should_abort | data:copytool_out:received graceful stop - abort after this iteration [2021-03-18 10:28:40] 2021-03-18 08:28:07,754 | DEBUG | job | pilot.control.job | control | job control ending since graceful_stop has been set [2021-03-18 10:28:40] 2021-03-18 08:28:07,754 | DEBUG | failed_post | pilot.control.payload | failed_post | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:07,755 | DEBUG | job | pilot.control.job | control | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:07,755 | INFO | failed_post | pilot.control.payload | failed_post | [payload] failed_post thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:07,755 | DEBUG | job | pilot.control.job | control | [job] control thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:07,923 | DEBUG | copytool_in | pilot.control.data | copytool_in | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:07,923 | DEBUG | execute_payloads | pilot.control.payload | execute_payloads | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:07,924 | INFO | execute_payloads | pilot.control.payload | execute_payloads | [payload] execute_payloads thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:07,924 | DEBUG | copytool_in | pilot.control.data | copytool_in | [data] copytool_in thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:08,232 | WARNING | queue_monitor | pilot.util.common | should_abort | job:queue_monitor:received graceful stop - abort after this iteration [2021-03-18 10:28:40] 2021-03-18 08:28:08,232 | DEBUG | queue_monitor | pilot.control.job | queue_monitor | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:08,232 | DEBUG | queue_monitor | pilot.control.job | queue_monitor | [job] queue monitor thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:08,474 | DEBUG | validate_post | pilot.control.payload | validate_post | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:08,474 | INFO | validate_post | pilot.control.payload | validate_post | [payload] validate_post thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:08,549 | WARNING | queue_monitoring | pilot.util.common | should_abort | data:queue_monitoring:received graceful stop - abort after this iteration [2021-03-18 10:28:40] 2021-03-18 08:28:08,733 | DEBUG | copytool_out | pilot.control.data | copytool_out | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:08,734 | DEBUG | copytool_out | pilot.control.data | copytool_out | [data] copytool_out thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:11,568 | DEBUG | queue_monitoring | pilot.control.data | queue_monitoring | will not set job_aborted yet [2021-03-18 10:28:40] 2021-03-18 08:28:11,568 | DEBUG | queue_monitoring | pilot.control.data | queue_monitoring | [data] queue_monitor thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:38,832 | WARNING | job_monitor | pilot.control.job | check_job_monitor_waiting_time | no jobs in monitored_payloads queue (waited for 72 s) [2021-03-18 10:28:40] 2021-03-18 08:28:38,832 | DEBUG | job_monitor | pilot.util.processes | threads_aborted | aborting since the last relevant thread is about to finish [2021-03-18 10:28:40] 2021-03-18 08:28:38,832 | DEBUG | job_monitor | pilot.control.job | job_monitor | will proceed to set job_aborted [2021-03-18 10:28:40] 2021-03-18 08:28:38,832 | DEBUG | job_monitor | pilot.control.job | job_monitor | [job] job monitor thread has finished [2021-03-18 10:28:40] 2021-03-18 08:28:39,826 | INFO | MainThread | pilot.workflow.generic | run | end of generic workflow (traces error code: 0) [2021-03-18 10:28:40] 2021-03-18 08:28:39,827 | INFO | MainThread | root | wrap_up | traces error code: 0 [2021-03-18 10:28:40] 2021-03-18 08:28:39,827 | INFO | MainThread | root | wrap_up | pilot has finished [2021-03-18 10:28:40] 2021-03-18 08:28:39,924 [wrapper] ==== pilot stdout END ==== [2021-03-18 10:28:40] 2021-03-18 08:28:39,927 [wrapper] ==== wrapper stdout RESUME ==== [2021-03-18 10:28:40] 2021-03-18 08:28:39,929 [wrapper] Pilot exit status: 0 [2021-03-18 10:28:40] 2021-03-18 08:28:39,998 [wrapper] pandaids: 5002834760 [2021-03-18 10:28:40] 2021-03-18 08:28:40,004 [wrapper] apfmon messages muted [2021-03-18 10:28:40] 2021-03-18 08:28:40,007 [wrapper] Test setup, not cleaning [2021-03-18 10:28:40] 2021-03-18 08:28:40,009 [wrapper] ==== wrapper stdout END ==== [2021-03-18 10:28:40] 2021-03-18 08:28:40,012 [wrapper] ==== wrapper stderr END ==== [2021-03-18 10:28:40] 2021-03-18 08:28:40,017 [wrapper] wrapperexiting ec=0, duration=433 [2021-03-18 10:28:40] 2021-03-18 08:28:40,019 [wrapper] apfmon messages muted [2021-03-18 10:28:40] *** Error codes and diagnostics *** [2021-03-18 10:28:40] "exeErrorCode": 0, [2021-03-18 10:28:40] "exeErrorDiag": "", [2021-03-18 10:28:40] "pilotErrorCode": 0, [2021-03-18 10:28:40] "pilotErrorDiag": "", [2021-03-18 10:28:40] *** Listing of results directory *** [2021-03-18 10:28:40] total 48784 [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 1042975 Mar 18 09:24 pilot2.tar.gz [2021-03-18 10:28:40] -rwx------. 1 boinc boinc 20043 Mar 18 09:52 runpilot2-wrapper.sh [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 4974 Mar 18 09:52 queuedata.json [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 107 Mar 18 10:21 wrapper_26015_x86_64-pc-linux-gnu [2021-03-18 10:28:40] -rwxr-xr-x. 1 boinc boinc 5573 Mar 18 10:21 run_atlas [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 112 Mar 18 10:21 job.xml [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 6081 Mar 18 10:21 init_data.xml [2021-03-18 10:28:40] drwxrwx--x. 2 boinc boinc 68 Mar 18 10:21 shared [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 0 Mar 18 10:21 boinc_lockfile [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 16549 Mar 18 10:21 start_atlas.sh [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 1048539 Mar 18 10:21 input.tar.gz [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 37595586 Mar 18 10:21 EVNT.04972714._000034.pool.root.1 [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 2619 Mar 18 10:21 pandaJob.out [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 1174577 Mar 18 10:21 agis_schedconf.cvmfs.json [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 1943413 Mar 18 10:21 cric_ddmendpoints.json [2021-03-18 10:28:40] drwx------. 5 boinc boinc 4096 Mar 18 10:21 pilot2 [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 3109186 Mar 18 10:27 output.1.663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.pool.root [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 532 Mar 18 10:27 boinc_task_state.xml [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 1010 Mar 18 10:27 memory_monitor_summary.json [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 176347 Mar 18 10:28 663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.1.job.log.tgz [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 6995 Mar 18 10:28 heartbeat.json [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 24 Mar 18 10:28 wrapper_checkpoint.txt [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 8192 Mar 18 10:28 boinc_mmap_file [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 8646 Mar 18 10:28 pilotlog.txt [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 178948 Mar 18 10:28 663b0eed-5f96-4c6a-aec4-e2f307afc9d0_85369.1.job.log [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 546 Mar 18 10:28 output.list [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 748 Mar 18 10:28 runtime_log [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 3481600 Mar 18 10:28 result.tar.gz [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 9355 Mar 18 10:28 runtime_log.err [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 576 Mar 18 10:28 3aqMDmpd2gynfZGDcpSWOuwoABFKDmABFKDm2IFNDmmCFKDmnKxlQm.diag [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 39559 Mar 18 10:28 stderr.txt [2021-03-18 10:28:40] HITS file was successfully produced: [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 3109186 Mar 18 10:27 shared/HITS.pool.root.1 [2021-03-18 10:28:40] *** Contents of shared directory: *** [2021-03-18 10:28:40] total 44200 [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 37595586 Mar 18 10:21 ATLAS.root_0 [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 16549 Mar 18 10:21 start_atlas.sh [2021-03-18 10:28:40] -rw-r--r--. 1 boinc boinc 1048539 Mar 18 10:21 input.tar.gz [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 3109186 Mar 18 10:27 HITS.pool.root.1 [2021-03-18 10:28:40] -rw-------. 1 boinc boinc 3481600 Mar 18 10:28 result.tar.gz 10:28:42 (20555): run_atlas exited; CPU time 223.563998 10:28:42 (20555): called boinc_finish(0) </stderr_txt> ]]>
©2024 CERN