Name CMS_160370_1591079429.006700_0
Workunit 2018300
Created 2 Jun 2020, 6:30:34 UTC
Sent 7 Jun 2020, 13:39:06 UTC
Report deadline 14 Jun 2020, 13:39:06 UTC
Received 8 Jun 2020, 14:53:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 3625
Run time 7 hours 0 min 59 sec
CPU time 3 hours 44 min 38 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 1.59 GFLOPS
Application version CMS Simulation v50.00 (vbox64_mt_mcore_cms)
x86_64-pc-linux-gnu
Peak working set size 1.93 GB
Peak swap size 3.89 GB
Peak disk usage 2.61 GB

Stderr output

<core_client_version>7.17.0</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
2020-06-07 15:40:19 (1152445): vboxwrapper (7.7.26196): starting
2020-06-07 15:40:22 (1152445): Feature: Checkpoint interval offset (58 seconds)
2020-06-07 15:40:22 (1152445): Detected: VirtualBox VboxManage Interface (Version: 6.1.10)
2020-06-07 15:40:22 (1152445): Detected: Minimum checkpoint interval (600.000000 seconds)
2020-06-07 15:40:22 (1152445): Detected: Heartbeat check (file: 'heartbeat' every 1200.000000 seconds)
2020-06-07 15:40:22 (1152445): Successfully copied 'init_data.xml' to the shared directory.
2020-06-07 15:40:23 (1152445): Create VM. (boinc_9f8025cee3b32379, slot#7)
2020-06-07 15:40:24 (1152445): Setting Memory Size for VM. (1896MB)
2020-06-07 15:40:24 (1152445): Setting CPU Count for VM. (1)
2020-06-07 15:40:24 (1152445): Setting Chipset Options for VM.
2020-06-07 15:40:24 (1152445): Setting Boot Options for VM.
2020-06-07 15:40:25 (1152445): Setting Network Configuration for NAT.
2020-06-07 15:40:25 (1152445): Enabling VM Network Access.
2020-06-07 15:40:25 (1152445): Disabling USB Support for VM.
2020-06-07 15:40:25 (1152445): Disabling COM Port Support for VM.
2020-06-07 15:40:25 (1152445): Disabling LPT Port Support for VM.
2020-06-07 15:40:26 (1152445): Disabling Audio Support for VM.
2020-06-07 15:40:26 (1152445): Disabling Clipboard Support for VM.
2020-06-07 15:40:26 (1152445): Disabling Drag and Drop Support for VM.
2020-06-07 15:40:27 (1152445): Adding storage controller(s) to VM.
2020-06-07 15:40:27 (1152445): Adding virtual disk drive to VM. (vm_image.vdi)
2020-06-07 15:40:27 (1152445): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2020-06-07 15:40:28 (1152445): forwarding host port 45045 to guest port 80
2020-06-07 15:40:28 (1152445): Enabling remote desktop for VM.
2020-06-07 15:40:28 (1152445): Enabling shared directory for VM.
2020-06-07 15:40:29 (1152445): Starting VM. (boinc_9f8025cee3b32379, slot#7)
2020-06-07 15:40:31 (1152445): Successfully started VM. (PID = '1153087')
2020-06-07 15:40:31 (1152445): Reporting VM Process ID to BOINC.
2020-06-07 15:40:31 (1152445): Guest Log: BIOS: VirtualBox 6.1.9
2020-06-07 15:40:31 (1152445): Guest Log: CPUID EDX: 0x178bfbff
2020-06-07 15:40:31 (1152445): Guest Log: BIOS: ata0-0: PCHS=16383/16/63 LCHS=1024/255/63
2020-06-07 15:40:32 (1152445): VM state change detected. (old = 'poweroff', new = 'running')
2020-06-07 15:40:32 (1152445): Detected: Web Application Enabled (http://localhost:45045)
2020-06-07 15:40:32 (1152445): Detected: Remote Desktop Enabled (localhost:56879)
2020-06-07 15:40:32 (1152445): Preference change detected
2020-06-07 15:40:32 (1152445): Setting CPU throttle for VM. (100%)
2020-06-07 15:40:32 (1152445): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 120 seconds) or (Vbox_job.xml: 600 seconds))
2020-06-07 15:40:33 (1152445): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2020-06-07 15:40:33 (1152445): Guest Log: BIOS: Booting from Hard Disk...
2020-06-07 15:40:37 (1152445): Guest Log: BIOS: KBD: unsupported int 16h function 03
2020-06-07 15:40:37 (1152445): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2020-06-07 15:41:09 (1152445): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2020-06-07 15:41:09 (1152445): Guest Log: vboxguest: misc device minor 56, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2020-06-07 15:41:59 (1152445): Guest Log: VBoxService 5.2.6 r120293 (verbosity: 0) linux.amd64 (Jan 15 2018 14:51:00) release log
2020-06-07 15:41:59 (1152445): Guest Log: 00:00:00.000713 main     Log opened 2020-06-07T13:41:57.629486000Z
2020-06-07 15:41:59 (1152445): Guest Log: 00:00:00.001742 main     OS Product: Linux
2020-06-07 15:41:59 (1152445): Guest Log: 00:00:00.002105 main     OS Release: 4.14.157-17.cernvm.x86_64
2020-06-07 15:41:59 (1152445): Guest Log: 00:00:00.002225 main     OS Version: #1 SMP Wed Dec 4 17:26:45 CET 2019
2020-06-07 15:41:59 (1152445): Guest Log: 00:00:00.002326 main     Executable: /usr/share/vboxguest52/usr/sbin/VBoxService
2020-06-07 15:41:59 (1152445): Guest Log: 00:00:00.002330 main     Process ID: 2905
2020-06-07 15:41:59 (1152445): Guest Log: 00:00:00.002332 main     Package type: LINUX_64BITS_GENERIC
2020-06-07 15:41:59 (1152445): Guest Log: 00:00:00.013252 main     5.2.6 r120293 started. Verbose level = 0
2020-06-07 15:43:14 (1152445): Guest Log: [INFO] Mounting the shared directory
2020-06-07 15:43:17 (1152445): Guest Log: [INFO] Shared directory mounted, enabling vboxmonitor
2020-06-07 15:43:17 (1152445): Guest Log: [DEBUG] Testing network connection to cern.ch on port 80
2020-06-07 15:43:17 (1152445): Guest Log: [DEBUG] Connection to cern.ch 80 port [tcp/http] succeeded!
2020-06-07 15:43:17 (1152445): Guest Log: [DEBUG] 0
2020-06-07 15:43:17 (1152445): Guest Log: [DEBUG] Testing VCCS connection to vccs.cern.ch on port 443
2020-06-07 15:43:17 (1152445): Guest Log: [DEBUG] Connection to vccs.cern.ch 443 port [tcp/https] succeeded!
2020-06-07 15:43:17 (1152445): Guest Log: [DEBUG] 0
2020-06-07 15:43:17 (1152445): Guest Log: [DEBUG] Testing connection to Condor server on port 9618
2020-06-07 15:43:17 (1152445): Guest Log: [DEBUG] Connection to vocms0840.cern.ch 9618 port [tcp/condor] succeeded!
2020-06-07 15:43:17 (1152445): Guest Log: [DEBUG] 0
2020-06-07 15:44:34 (1152445): Guest Log: [DEBUG] Probing CVMFS ...
2020-06-07 15:44:45 (1152445): Guest Log: Probing /cvmfs/grid.cern.ch... OK
2020-06-07 15:44:47 (1152445): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2020-06-07 15:44:47 (1152445): Guest Log: 2.4.4.0 3659 1 27908 12423 3 1 1242455 4096000 2 65024 0 3 100 0 0 http://s1fnal-cvmfs.openhtc.io/cvmfs/grid.cern.ch DIRECT 1
2020-06-07 15:45:30 (1152445): Guest Log: [INFO] Reading volunteer information
2020-06-07 15:45:30 (1152445): Guest Log: [INFO] Volunteer: Ralfy (165)
2020-06-07 15:45:30 (1152445): Guest Log: [INFO] VMID: 49b2fac1-df25-48d2-a4ee-4612ca6a31f8
2020-06-07 15:45:31 (1152445): Guest Log: [INFO] Requesting an X509 credential from LHC@home
2020-06-07 15:45:33 (1152445): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev
2020-06-07 15:45:34 (1152445): Guest Log: [INFO] Running the fast benchmark.
2020-06-07 15:49:11 (1152445): Guest Log: [INFO] Machine performance 2.47 HEPSPEC06
2020-06-07 15:49:12 (1152445): Guest Log: [INFO] CMS application starting. Check log files.
2020-06-07 15:49:17 (1152445): Guest Log: [DEBUG] HTCondor ping
2020-06-07 15:49:18 (1152445): Guest Log: [DEBUG] 0
2020-06-07 17:20:30 (1152445): Status Report: Job Duration: '64800.000000'
2020-06-07 17:20:30 (1152445): Status Report: Elapsed Time: '6000.728904'
2020-06-07 17:20:30 (1152445): Status Report: CPU Time: '3262.590000'
2020-06-07 19:00:30 (1152445): Status Report: Job Duration: '64800.000000'
2020-06-07 19:00:30 (1152445): Status Report: Elapsed Time: '12002.139551'
2020-06-07 19:00:30 (1152445): Status Report: CPU Time: '6512.230000'
2020-06-07 20:40:29 (1152445): Status Report: Job Duration: '64800.000000'
2020-06-07 20:40:29 (1152445): Status Report: Elapsed Time: '18002.392586'
2020-06-07 20:40:29 (1152445): Status Report: CPU Time: '9793.140000'
2020-06-07 22:20:28 (1152445): Status Report: Job Duration: '64800.000000'
2020-06-07 22:20:28 (1152445): Status Report: Elapsed Time: '24002.954956'
2020-06-07 22:20:28 (1152445): Status Report: CPU Time: '12904.720000'
2020-06-07 22:40:14 (1152445): VM state change detected. (old = 'running', new = 'paused')
2020-06-08 16:49:36 (1152445): Error in resume VM for VM: -2135228414
Command:
VBoxManage -q controlvm "boinc_9f8025cee3b32379" resume
Output:
VBoxManage: error: VM is paused due to host power management
VBoxManage: error: Details: code VBOX_E_INVALID_VM_STATE (0x80bb0002), component ConsoleWrap, interface IConsole, callee nsISupports
VBoxManage: error: Context: "Resume()" at line 410 of file VBoxManageControlVM.cpp

2020-06-08 16:49:46 (1152445): Error in resume VM for VM: -2135228414
Command:
VBoxManage -q controlvm "boinc_9f8025cee3b32379" resume
Output:
VBoxManage: error: Cannot resume the machine as it is not paused (machine state: Running)
VBoxManage: error: Details: code VBOX_E_INVALID_VM_STATE (0x80bb0002), component ConsoleWrap, interface IConsole, callee nsISupports
VBoxManage: error: Context: "Resume()" at line 410 of file VBoxManageControlVM.cpp

2020-06-08 16:49:47 (1152445): VM state change detected. (old = 'paused', new = 'running')
2020-06-08 16:49:48 (1152445): Guest Log: 06:58:19.594535 timesync vgsvcTimeSyncWorker: Radical host time change: 65 379 055 000 000ns (HostNow=1 591 627 785 207 000 000 ns HostLast=1 591 562 406 152 000 000 ns)
2020-06-08 16:49:59 (1152445): Guest Log: 06:58:30.421203 timesync vgsvcTimeSyncWorker: Radical guest time change: 65 382 039 786 000ns (GuestNow=1 591 627 798 205 932 000 ns GuestLast=1 591 562 416 166 146 000 ns fSetTimeLastLoop=true )
2020-06-08 16:50:09 (1152445): Guest Log: [ERROR] Condor ended after 90047 seconds.
2020-06-08 16:50:09 (1152445): Guest Log: [INFO] Shutting Down.
2020-06-08 16:50:10 (1152445): VM Completion File Detected.
2020-06-08 16:50:10 (1152445): VM Completion Message: Condor ended after 90047 seconds.
.
2020-06-08 16:50:10 (1152445): Powering off VM.
2020-06-08 16:50:16 (1152445): Successfully stopped VM.
2020-06-08 16:50:16 (1152445): Deregistering VM. (boinc_9f8025cee3b32379, slot#7)
2020-06-08 16:50:16 (1152445): Removing network bandwidth throttle group from VM.
2020-06-08 16:50:17 (1152445): Removing storage controller(s) from VM.
2020-06-08 16:50:19 (1152445): Removing VM from VirtualBox.
2020-06-08 16:50:20 (1152445): Removing virtual disk drive from VirtualBox.
16:50:26 (1152445): called boinc_finish(1)

</stderr_txt>
]]>


©2024 CERN