Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
2019-04-13 01:43:25 (169428): vboxwrapper (7.9.26200): starting
2019-04-13 01:43:26 (169428): Feature: Checkpoint interval offset (531 seconds)
2019-04-13 01:43:26 (169428): Detected: VirtualBox COM Interface (Version: 5.2.18)
2019-04-13 01:43:26 (169428): Detected: Minimum checkpoint interval (900.000000 seconds)
2019-04-13 01:43:26 (169428): Successfully copied 'init_data.xml' to the shared directory.
2019-04-13 01:43:26 (169428): Create VM. (boinc_27c82e24c9b86655, slot#0)
2019-04-13 01:43:26 (169428): Setting Memory Size for VM. (6600MB)
2019-04-13 01:43:26 (169428): Setting CPU Count for VM. (4)
2019-04-13 01:43:26 (169428): Setting Chipset Options for VM.
2019-04-13 01:43:26 (169428): Setting Boot Options for VM.
2019-04-13 01:43:26 (169428): Enabling VM Network Access.
2019-04-13 01:43:26 (169428): Setting Network Configuration for NAT.
2019-04-13 01:43:26 (169428): Disabling USB Support for VM.
2019-04-13 01:43:26 (169428): Disabling COM Port Support for VM.
2019-04-13 01:43:26 (169428): Disabling LPT Port Support for VM.
2019-04-13 01:43:26 (169428): Disabling Audio Support for VM.
2019-04-13 01:43:26 (169428): Disabling Clipboard Support for VM.
2019-04-13 01:43:26 (169428): Disabling Drag and Drop Support for VM.
2019-04-13 01:43:26 (169428): Adding storage controller(s) to VM.
2019-04-13 01:43:26 (169428): Adding virtual disk drive to VM. (vm_image.vdi)
2019-04-13 01:43:27 (169428): Adding VirtualBox Guest Additions to VM.
2019-04-13 01:43:27 (169428): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2019-04-13 01:43:27 (169428): forwarding host port 38375 to guest port 80
2019-04-13 01:43:27 (169428): Enabling remote desktop for VM.
2019-04-13 01:43:27 (169428): Enabling shared directory for VM.
2019-04-13 01:43:27 (169428): Starting VM. (boinc_27c82e24c9b86655, slot#0)
2019-04-13 01:43:37 (169428): Guest Log: BIOS: VirtualBox 5.2.18

2019-04-13 01:43:37 (169428): Guest Log: CPUID EDX: 0x178bfbff

2019-04-13 01:43:37 (169428): Guest Log: BIOS: ata0-0: PCHS=16383/16/63 LCHS=1024/255/63

2019-04-13 01:43:37 (169428): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032

2019-04-13 01:43:37 (169428): Guest Log: BIOS: Booting from Hard Disk...

2019-04-13 01:43:37 (169428): Successfully started VM. (PID = '169532')
2019-04-13 01:43:37 (169428): Reporting VM Process ID to BOINC.
2019-04-13 01:43:42 (169428): Guest Log: BIOS: KBD: unsupported int 16h function 03

2019-04-13 01:43:42 (169428): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 

2019-04-13 01:43:42 (169428): VM state change detected. (old = 'poweroff', new = 'running')
2019-04-13 01:43:47 (169428): Detected: Web Application Enabled (http://localhost:38375)
2019-04-13 01:43:47 (169428): Detected: Remote Desktop Enabled (localhost:38376)
2019-04-13 01:43:52 (169428): Preference change detected
2019-04-13 01:43:52 (169428): Setting CPU throttle for VM. (100%)
2019-04-13 01:43:52 (169428): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 600 seconds) or (Vbox_job.xml: 900 seconds))
2019-04-13 01:44:07 (169428): Guest Log: vboxguest: major 0, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)

2019-04-13 01:44:17 (169428): Guest Log: VBoxGuest: VBoxGuestCommonGuestCapsAcquire: pSession(0xffff8801aec55410), OR(0x0), NOT(0xffffffff), flags(0x0)

2019-04-13 01:44:17 (169428): Guest Log: VBoxGuest: VBoxGuestCommonGuestCapsAcquire: pSession(0xffff8801ae3a3c10), OR(0x0), NOT(0xffffffff), flags(0x0)

2019-04-13 01:44:17 (169428): Guest Log: VBoxGuest: VBoxGuestCommonGuestCapsAcquire: pSession(0xffff8801ae3a2810), OR(0x0), NOT(0xffffffff), flags(0x0)

2019-04-13 01:44:17 (169428): Guest Log: VBoxGuest: VBoxGuestCommonGuestCapsAcquire: pSession(0xffff8801aba10610), OR(0x0), NOT(0xffffffff), flags(0x0)

2019-04-13 01:45:07 (169428): Guest Log: Copying input files into RunAtlas.

2019-04-13 01:45:22 (169428): Guest Log: Copied input files into RunAtlas.

2019-04-13 01:45:42 (169428): Guest Log: copied the webapp to /var/www

2019-04-13 01:45:42 (169428): Guest Log: set up http_proxy http://192.168.200.1:0

2019-04-13 01:45:42 (169428): Guest Log: ATHENA_PROC_NUMBER=4

2019-04-13 01:45:42 (169428): Guest Log: Starting ATLAS job. ( )

2019-04-13 02:57:48 (169428): Guest Log: log_extracts:

2019-04-13 02:57:48 (169428): Guest Log: - Last 10 lines from /home/atlas01/RunAtlas/Panda_Pilot_7928_1555112861/PandaJob/athena_stdout.txt -

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.trfExe.preExecute 2019-04-13 01:51:33,229 INFO Batch/grid running - command outputs will not be echoed. Logs for EVNTtoHITS are in log.EVNTtoHITS

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.trfExe.preExecute 2019-04-13 01:51:33,229 INFO Now writing wrapper for substep executor EVNTtoHITS

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.trfExe._writeAthenaWrapper 2019-04-13 01:51:33,229 INFO Valgrind not engaged

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.trfExe.preExecute 2019-04-13 01:51:33,230 INFO Athena will be executed in a subshell via ['./runwrapper.EVNTtoHITS.sh']

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.trfExe.execute 2019-04-13 01:51:33,230 INFO Starting execution of EVNTtoHITS (['./runwrapper.EVNTtoHITS.sh'])

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.trfExe.execute 2019-04-13 02:55:14,982 INFO EVNTtoHITS executor returns 33

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.trfExe.validate 2019-04-13 02:55:15,911 ERROR Validation of return code failed: Non-zero return code from EVNTtoHITS (33) (Error code 65)

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.trfExe.validate 2019-04-13 02:55:15,955 INFO Scanning logfile log.EVNTtoHITS for errors

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.transform.execute 2019-04-13 02:55:16,008 CRITICAL Transform executor raised TransformValidationException: Non-zero return code from EVNTtoHITS (33); Logfile error in log.EVNTtoHITS: "IOVDbSvc            FATAL Conditions database connection COOLOFL_TRT/OFLP200 cannot be opened - STOP"

2019-04-13 02:57:48 (169428): Guest Log: PyJobTransforms.transform.execute 2019-04-13 02:55:19,514 WARNING Transform now exiting early with exit code 65 (Non-zero return code from EVNTtoHITS (33); Logfile error in log.EVNTtoHITS: "IOVDbSvc            FATAL Conditions database connection COOLOFL_TRT/OFLP200 cannot be opened - STOP")

2019-04-13 02:57:48 (169428): Guest Log: - Walltime -

2019-04-13 02:57:48 (169428): Guest Log: JobRetrival=2, StageIn=17, Execution=3982, StageOut=0, CleanUp=22

2019-04-13 02:57:48 (169428): Guest Log: The last 10 lines of the pilot log.

2019-04-13 02:57:48 (169428): Guest Log:     <metadata att_name="surl" att_value="srm://srm.ndgf.org:8443/srm/managerv2?SFN=/atlas/disk/atlasdatadisk/rucio/mc16_13TeV/01/24/log.17602216._009758.job.log.tgz.1"/>

2019-04-13 02:57:48 (169428): Guest Log:     <metadata att_name="fsize" att_value="79844"/>

2019-04-13 02:57:48 (169428): Guest Log:     <metadata att_name="adler32" att_value="82d11ca8"/>

2019-04-13 02:57:48 (169428): Guest Log:   </File>

2019-04-13 02:57:48 (169428): Guest Log: </POOLFILECATALOG>

2019-04-13 02:57:48 (169428): Guest Log: 2019-04-13 00:57:43 UTC [wrapper] ---------

2019-04-13 02:57:48 (169428): Guest Log: 2019-04-13 00:57:43 UTC [wrapper] output list

2019-04-13 02:57:48 (169428): Guest Log: log.17602216._009758.job.log.tgz.1 srm://srm.ndgf.org:8443;autodir=no;spacetoken=ATLASDATADISK/srm/managerv2?SFN=/atlas/disk/atlasdatadisk/rucio/mc16_13TeV/01/24/log.17602216._009758.job.log.tgz.1:checksumtype=adler32:checksumvalue=82d11ca8

2019-04-13 02:57:48 (169428): Guest Log: 2019-04-13 00:57:43 UTC [wrapper] ==== wrapper stdout END ====

2019-04-13 02:57:48 (169428): Guest Log: 2019-04-13 00:57:43 UTC [wrapper] ==== wrapper stderr END ====

2019-04-13 02:57:48 (169428): Guest Log: Listing of results directory

2019-04-13 02:57:48 (169428): Guest Log: total 383308

2019-04-13 02:57:48 (169428): Guest Log: -rw-r--r-- 1 atlas01 atlas01   1089918 Apr  3 05:59 pilotcode.tar.gz

2019-04-13 02:57:48 (169428): Guest Log: -rwx------ 1 atlas01 atlas01     15214 Apr  5 14:12 runpilot3-wrapper.sh

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01      2884 Apr  5 14:12 pandaJobData.out

2019-04-13 02:57:48 (169428): Guest Log: -rwxr-xr-x 1 atlas01 atlas01 376813841 Apr 13 01:45 EVNT.16926542._000196.pool.root.1

2019-04-13 02:57:48 (169428): Guest Log: -rwxr-xr-x 1 atlas01 atlas01     10355 Apr 13 01:45 init_data.xml

2019-04-13 02:57:48 (169428): Guest Log: -rwxr-xr-x 1 atlas01 atlas01   1098425 Apr 13 01:45 input.tar.gz

2019-04-13 02:57:48 (169428): Guest Log: -rwxr-xr-x 1 atlas01 atlas01       786 Apr 13 01:45 RTE.tar.gz

2019-04-13 02:57:48 (169428): Guest Log: -rwxr-xr-x 1 atlas01 atlas01      8644 Apr 13 01:45 start_atlas.sh

2019-04-13 02:57:48 (169428): Guest Log: drwxr-xr-x 3 atlas01 atlas01      4096 Apr 13 01:45 APPS

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01       243 Apr 13 01:45 setup.sh.local

2019-04-13 02:57:48 (169428): Guest Log: lrwxrwxrwx 1 atlas01 atlas01        16 Apr 13 01:46 RunJob.py -> pilot3/RunJob.py

2019-04-13 02:57:48 (169428): Guest Log: lrwxrwxrwx 1 atlas01 atlas01        21 Apr 13 01:46 RunJobEvent.py -> pilot3/RunJobEvent.py

2019-04-13 02:57:48 (169428): Guest Log: lrwxrwxrwx 1 atlas01 atlas01        16 Apr 13 01:46 VmPeak.py -> pilot3/VmPeak.py

2019-04-13 02:57:48 (169428): Guest Log: lrwxrwxrwx 1 atlas01 atlas01        19 Apr 13 01:46 PILOTVERSION -> pilot3/PILOTVERSION

2019-04-13 02:57:48 (169428): Guest Log: lrwxrwxrwx 1 atlas01 atlas01        15 Apr 13 01:46 pilot.py -> pilot3/pilot.py

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01        22 Apr 13 01:46 PILOT_INITDIR

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01        50 Apr 13 01:47 CURRENT_SITEWORKDIR

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01     11294 Apr 13 01:47 pilotlog.txt

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01         1 Apr 13 01:47 STATUSCODE

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01        11 Apr 13 01:47 pandaIDs.out

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01        19 Apr 13 01:47 START_TIME_4298707090

2019-04-13 02:57:48 (169428): Guest Log: -rw-r--r-- 1 atlas01 atlas01      3803 Apr 13 01:47 queuedata.json

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01      2884 Apr 13 01:47 pandaJobData_1.out

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01   7210745 Apr 13 01:49 agis_ddmendpoints.cvmfs.json

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01   4834636 Apr 13 01:49 agis_schedconf.cvmfs.json

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01       297 Apr 13 02:55 memory_monitor_summary.json

2019-04-13 02:57:48 (169428): Guest Log: drwx------ 6 atlas01 atlas01     12288 Apr 13 02:55 pilot3

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01       203 Apr 13 02:55 pilot_error_report.json

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01       166 Apr 13 02:55 workdir_size-4298707090.json

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01     79844 Apr 13 02:55 log.17602216._009758.job.log.tgz.1

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01      1757 Apr 13 02:56 log_extracts.txt

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01     10478 Apr 13 02:56 panda_node_struct.pickle

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01       137 Apr 13 02:57 pilotlog-last.txt

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01       598 Apr 13 02:57 metadata-surl.xml

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01      3882 Apr 13 02:57 jobSmallFiles.tgz

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01    361394 Apr 13 02:57 log.17602216._009758.job.log.1

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01       489 Apr 13 02:57 QU0MDmUtcWunShfckohDCDFpABFKDmABFKDmlRcYDmABFKDmzDNUvm.diag

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01       241 Apr 13 02:57 output.list

2019-04-13 02:57:48 (169428): Guest Log: -rw-r--r-- 1 atlas01 atlas01      7869 Apr 13 02:57 runtime_log.err

2019-04-13 02:57:48 (169428): Guest Log: -rw-r--r-- 1 atlas01 atlas01       712 Apr 13 02:57 runtime_log

2019-04-13 02:57:48 (169428): Guest Log: -rw------- 1 atlas01 atlas01    819200 Apr 13 02:57 result.tar.gz

2019-04-13 02:57:48 (169428): Guest Log: No HITS file was produced

2019-04-13 02:57:48 (169428): Guest Log: Successfully finished the ATLAS job!

2019-04-13 02:57:48 (169428): Guest Log: Copying the results back to the shared directory!

2019-04-13 02:57:48 (169428): Guest Log: Copied the result file back to the shared directory and created atlas_done file!

2019-04-13 02:57:48 (169428): Guest Log: Success! Shutting down the machine.

2019-04-13 02:57:48 (169428): VM Completion File Detected.
2019-04-13 02:57:48 (169428): Powering off VM.
2019-04-13 02:57:50 (169428): Successfully stopped VM.
2019-04-13 02:57:55 (169428): Deregistering VM. (boinc_27c82e24c9b86655, slot#0)
2019-04-13 02:57:55 (169428): Removing virtual disk drive(s) from VM.
2019-04-13 02:57:55 (169428): Removing network bandwidth throttle group from VM.
2019-04-13 02:57:55 (169428): Removing storage controller(s) from VM.
2019-04-13 02:57:55 (169428): Removing VM from VirtualBox.
02:58:00 (169428): called boinc_finish(0)

</stderr_txt>
]]>

©2024 CERN