Name CMS_3326347_1660302935.628450_0
Workunit 2203745
Created 12 Aug 2022, 11:15:39 UTC
Sent 13 Aug 2022, 3:18:57 UTC
Report deadline 20 Aug 2022, 3:18:57 UTC
Received 13 Aug 2022, 13:54:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 4679
Run time 9 hours 34 min 25 sec
CPU time 3 days 11 hours 31 min 36 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 32.00 GFLOPS
Application version CMS Simulation v60.64 (vbox64_mt_mcore_cms)
x86_64-pc-linux-gnu
Peak working set size 265.88 MB
Peak swap size 6.62 GB
Peak disk usage 366.17 MB

Stderr output

<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 194 (0xc2, -62)</message>
<stderr_txt>
2022-08-12 22:18:33 (148070): Detected: vboxwrapper 26205
2022-08-12 22:18:33 (148070): Detected: BOINC client v7.16.6
2022-08-12 22:18:33 (148070): Detected: VirtualBox VboxManage Interface (Version: 6.1.34)
2022-08-12 22:18:33 (148070): Detected: Heartbeat check (file: 'heartbeat' every 1200.000000 seconds)
2022-08-12 22:18:33 (148070): Successfully copied 'init_data.xml' to the shared directory.
2022-08-12 22:18:33 (148070): Create VM. (boinc_07a9797cd1bb1f7c, slot#1)
2022-08-12 22:18:33 (148070): Setting Memory Size for VM. (29672MB)
2022-08-12 22:18:33 (148070): Setting CPU Count for VM. (32)
2022-08-12 22:18:33 (148070): Setting Chipset Options for VM.
2022-08-12 22:18:33 (148070): Setting Graphics Controller Options for VM.
2022-08-12 22:18:34 (148070): Setting Boot Options for VM.
2022-08-12 22:18:34 (148070): Setting Network Configuration for NAT.
2022-08-12 22:18:34 (148070): Enabling VM Network Access.
2022-08-12 22:18:34 (148070): Disabling USB Support for VM.
2022-08-12 22:18:34 (148070): Disabling COM Port Support for VM.
2022-08-12 22:18:34 (148070): Disabling LPT Port Support for VM.
2022-08-12 22:18:34 (148070): Disabling Audio Support for VM.
2022-08-12 22:18:34 (148070): Disabling Clipboard Support for VM.
2022-08-12 22:18:34 (148070): Disabling Drag and Drop Support for VM.
2022-08-12 22:18:34 (148070): Adding storage controller(s) to VM.
2022-08-12 22:18:34 (148070): Adding virtual disk drive to VM. (CMS_2022_08_10.vdi)
2022-08-12 22:18:35 (148070): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2022-08-12 22:18:35 (148070): forwarding host port 39897 to guest port 80
2022-08-12 22:18:35 (148070): Enabling remote desktop for VM.
2022-08-12 22:18:35 (148070): Enabling shared directory for VM.
2022-08-12 22:18:35 (148070): Starting VM using VBoxManage interface. (boinc_07a9797cd1bb1f7c, slot#1)
2022-08-12 22:18:37 (148070): Successfully started VM. (PID = '148458')
2022-08-12 22:18:37 (148070): Reporting VM Process ID to BOINC.
2022-08-12 22:18:37 (148070): Guest Log: BIOS: VirtualBox 6.1.34
2022-08-12 22:18:37 (148070): Guest Log: CPUID EDX: 0x178bfbff
2022-08-12 22:18:37 (148070): Guest Log: BIOS: No PCI IDE controller, not probing IDE
2022-08-12 22:18:37 (148070): Guest Log: BIOS: AHCI 0-P#0: PCHS=16383/16/63 LCHS=1024/255/63 0x0000000002800000 sectors
2022-08-12 22:18:37 (148070): VM state change detected. (old = 'poweredoff', new = 'running')
2022-08-12 22:18:37 (148070): Detected: Web Application Enabled (http://localhost:39897)
2022-08-12 22:18:37 (148070): Detected: Remote Desktop Enabled (localhost:53429)
2022-08-12 22:18:37 (148070): Preference change detected
2022-08-12 22:18:37 (148070): Setting CPU throttle for VM. (100%)
2022-08-12 22:18:37 (148070): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 600 seconds))
2022-08-12 22:18:38 (148070): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2022-08-12 22:18:38 (148070): Guest Log: BIOS: Booting from Hard Disk...
2022-08-12 22:18:41 (148070): Guest Log: BIOS: KBD: unsupported int 16h function 03
2022-08-12 22:18:41 (148070): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2022-08-12 22:22:20 (148070): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds
2022-08-12 22:22:20 (148070): Guest Log: vboxguest: misc device minor 56, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2022-08-12 22:23:25 (148070): Guest Log: VBoxService 5.2.6 r120293 (verbosity: 0) linux.amd64 (Jan 15 2018 14:51:00) release log
2022-08-12 22:23:25 (148070): Guest Log: 00:00:00.000253 main     Log opened 2022-08-13T04:23:24.225613000Z
2022-08-12 22:23:25 (148070): Guest Log: 00:00:00.000448 main     OS Product: Linux
2022-08-12 22:23:25 (148070): Guest Log: 00:00:00.001932 main     OS Release: 4.14.232-19.cernvm.x86_64
2022-08-12 22:23:25 (148070): Guest Log: 00:00:00.003344 main     OS Version: #1 SMP Fri Apr 30 17:12:25 CEST 2021
2022-08-12 22:23:25 (148070): Guest Log: 00:00:00.003388 main     Executable: /usr/sbin/VBoxService
2022-08-12 22:23:25 (148070): Guest Log: 00:00:00.003389 main     Process ID: 3400
2022-08-12 22:23:25 (148070): Guest Log: 00:00:00.003390 main     Package type: LINUX_64BITS_GENERIC
2022-08-12 22:23:25 (148070): Guest Log: 00:00:00.021483 main     5.2.6 r120293 started. Verbose level = 0
2022-08-12 22:25:34 (148070): Guest Log: [INFO] Mounting the shared directory
2022-08-12 22:25:35 (148070): Guest Log: [INFO] Shared directory mounted, enabling vboxmonitor
2022-08-12 22:25:36 (148070): Guest Log: [INFO] Sourcing essential functions from /cvmfs/grid.cern.ch
2022-08-12 22:25:38 (148070): Guest Log: [INFO] Testing connection to cern.ch
2022-08-12 22:25:39 (148070): Guest Log: [INFO] Testing connection to VCCS
2022-08-12 22:25:40 (148070): Guest Log: [INFO] Testing connection to HTCondor
2022-08-12 22:25:42 (148070): Guest Log: [INFO] Testing connection to WMAgent
2022-08-12 22:25:43 (148070): Guest Log: [INFO] Testing connection to EOSCMS
2022-08-12 22:25:45 (148070): Guest Log: [INFO] Testing connection to CMS-Factory
2022-08-12 22:25:46 (148070): Guest Log: [INFO] Testing connection to CMS-Frontier
2022-08-12 22:25:47 (148070): Guest Log: [INFO] Testing connection to Frontier
2022-08-12 22:25:50 (148070): Guest Log: [INFO] Could not find a local HTTP proxy
2022-08-12 22:25:51 (148070): Guest Log: [INFO] CVMFS and Frontier will have to use DIRECT connections
2022-08-12 22:25:52 (148070): Guest Log: [INFO] This makes the application less efficient
2022-08-12 22:25:53 (148070): Guest Log: [INFO] It also puts higher load on the project servers
2022-08-12 22:25:54 (148070): Guest Log: [INFO] Setting up a local HTTP proxy is highly recommended
2022-08-12 22:25:55 (148070): Guest Log: [INFO] Advice can be found in the project forum
2022-08-12 22:25:56 (148070): Guest Log: [INFO] Reloading and probing the CVMFS configuration
2022-08-12 22:29:00 (148070): Guest Log: [INFO] Probing /cvmfs/cvmfs-config.cern.ch... OK
2022-08-12 22:29:19 (148070): Guest Log: [INFO] Probing /cvmfs/grid.cern.ch... OK
2022-08-12 22:31:00 (148070): Guest Log: [INFO] Probing /cvmfs/singularity.opensciencegrid.org... OK
2022-08-12 22:31:00 (148070): Guest Log: [INFO] Probing /cvmfs/cms-ib.cern.ch... OK
2022-08-12 22:31:01 (148070): Guest Log: [INFO] Probing /cvmfs/oasis.opensciencegrid.org... OK
2022-08-12 22:31:02 (148070): Guest Log: [INFO] Probing /cvmfs/cms.cern.ch... OK
2022-08-12 22:31:10 (148070): Guest Log: [INFO] Excerpt from "cvmfs_config stat": VERSION HOST PROXY
2022-08-12 22:31:10 (148070): Guest Log: [INFO] 2.7.2.0 http://s1fnal-cvmfs.openhtc.io:8080 DIRECT
2022-08-12 22:31:12 (148070): Guest Log: [INFO] Reading volunteer information
2022-08-12 22:31:31 (148070): Guest Log: [INFO] Requesting an X509 credential from LHC@home
2022-08-12 22:31:34 (148070): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev
2022-08-12 22:31:41 (148070): Guest Log: [INFO] CMS application starting. Check log files.
2022-08-12 22:32:01 (148070): Guest Log: [INFO] Requesting an idtoken from LHC@home
2022-08-12 22:32:04 (148070): Guest Log: [INFO] Requesting an idtoken from vLHC@home-dev
2022-08-12 23:57:37 (148070): Status Report: Job Duration: '64800.000000'
2022-08-12 23:57:37 (148070): Status Report: Elapsed Time: '6000.000000'
2022-08-12 23:57:37 (148070): Status Report: CPU Time: '43293.030000'
2022-08-13 01:36:37 (148070): Status Report: Job Duration: '64800.000000'
2022-08-13 01:36:37 (148070): Status Report: Elapsed Time: '12000.000000'
2022-08-13 01:36:37 (148070): Status Report: CPU Time: '98624.290000'
2022-08-13 03:15:38 (148070): Status Report: Job Duration: '64800.000000'
2022-08-13 03:15:38 (148070): Status Report: Elapsed Time: '18000.000000'
2022-08-13 03:15:38 (148070): Status Report: CPU Time: '153920.300000'
2022-08-13 04:54:38 (148070): Status Report: Job Duration: '64800.000000'
2022-08-13 04:54:38 (148070): Status Report: Elapsed Time: '24000.000000'
2022-08-13 04:54:38 (148070): Status Report: CPU Time: '211655.800000'
2022-08-13 06:33:39 (148070): Status Report: Job Duration: '64800.000000'
2022-08-13 06:33:39 (148070): Status Report: Elapsed Time: '30000.000000'
2022-08-13 06:33:39 (148070): Status Report: CPU Time: '266603.910000'
2022-08-13 07:52:51 (148070): VM Heartbeat file specified, but missing heartbeat.
2022-08-13 07:52:51 (148070): Powering off VM.
2022-08-13 07:52:52 (148070): Successfully stopped VM.
2022-08-13 07:52:52 (148070): Deregistering VM. (boinc_07a9797cd1bb1f7c, slot#1)
2022-08-13 07:52:52 (148070): Removing network bandwidth throttle group from VM.
2022-08-13 07:52:52 (148070): Removing VM from VirtualBox.

    Hypervisor System Log:


    VM Execution Log:


    VM Startup Log:


    VM Trace Log:

Processor#76 speed: 3700 MHz
Processor#76 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#77 speed: 3700 MHz
Processor#77 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#78 speed: 3700 MHz
Processor#78 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#79 speed: 3700 MHz
Processor#79 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#80 speed: 3700 MHz
Processor#80 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#81 speed: 3700 MHz
Processor#81 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#82 speed: 3700 MHz
Processor#82 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#83 speed: 3700 MHz
Processor#83 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#84 speed: 3700 MHz
Processor#84 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#85 speed: 3700 MHz
Processor#85 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#86 speed: 3700 MHz
Processor#86 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Processor#87 speed: 3700 MHz
Processor#87 description: Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz
Memory size: 64287 MByte
Memory available: 42427 MByte
Operating system: Linux
Operating system version: 5.15.0-43-generic

2022-08-12 22:18:33 (148070): 
Command: VBoxManage -q showvminfo "boinc_07a9797cd1bb1f7c" --machinereadable 
Exit Code: -2135228415
Output:
VBoxManage: error: Could not find a registered machine named 'boinc_07a9797cd1bb1f7c'
VBoxManage: error: Details: code VBOX_E_OBJECT_NOT_FOUND (0x80bb0001), component VirtualBoxWrap, interface IVirtualBox, callee nsISupports
VBoxManage: error: Context: "FindMachine(Bstr(VMNameOrUuid).raw(), machine.asOutParam())" at line 2732 of file VBoxManageInfo.cpp

2022-08-12 22:18:33 (148070): 
Command: VBoxManage -q showhdinfo "/var/lib/boinc3/slots/1/vm_image.vdi" 
Exit Code: -2135228412
Output:
VBoxManage: error: Could not find file for the medium '/var/lib/boinc3/slots/1/vm_image.vdi' (VERR_FILE_NOT_FOUND)
VBoxManage: error: Details: code VBOX_E_FILE_ERROR (0x80bb0004), component MediumWrap, interface IMedium, callee nsISupports
VBoxManage: error: Context: "OpenMedium(Bstr(pszFilenameOrUuid).raw(), enmDevType, enmAccessMode, fForceNewUuidOnOpen, pMedium.asOutParam())" at line 187 of file VBoxManageDisk.cpp

2022-08-12 22:18:33 (148070): 
Command: VBoxManage -q createvm --name "boinc_07a9797cd1bb1f7c" --basefolder "/var/lib/boinc3/slots/1" --ostype "Linux26_64" --register
Exit Code: 0
Output:
Virtual machine 'boinc_07a9797cd1bb1f7c' is created and registered.
UUID: 635dade6-d0cb-4a70-9a20-f37340082357
Settings file: '/var/lib/boinc3/slots/1/boinc_07a9797cd1bb1f7c/boinc_07a9797cd1bb1f7c.vbox'

2022-08-12 22:18:33 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --description "CMS_3326347_1660302935.628450_0" 
Exit Code: 0
Output:

2022-08-12 22:18:33 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --memory 29672 
Exit Code: 0
Output:

2022-08-12 22:18:33 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --cpus 32 
Exit Code: 0
Output:

2022-08-12 22:18:33 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --acpi on --ioapic on --rtcuseutc on 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --vram 16 --graphicscontroller VBoxVGA 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --boot1 disk --boot2 dvd --boot3 none --boot4 none 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --nic1 nat --natdnsproxy1 on --cableconnected1 off 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --cableconnected1 on 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --usb off 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --uart1 off --uart2 off 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --lpt1 off --lpt2 off 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --audio none 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --clipboard disabled 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --draganddrop disabled 
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q storagectl "boinc_07a9797cd1bb1f7c" --name "Hard Disk Controller" --add "sata" --controller "IntelAHCI" --hostiocache off --portcount 3
Exit Code: 0
Output:

2022-08-12 22:18:34 (148070): 
Command: VBoxManage -q showhdinfo "/var/lib/boinc3/projects/lhcathomedev.cern.ch_lhcathome-dev/CMS_2022_08_10.vdi" 
Exit Code: 0
Output:
UUID:           24f6e875-14cf-4b4c-a0c0-25a95201255c
Parent UUID:    base
State:          locked read
Type:           multiattach
Location:       /var/lib/boinc3/projects/lhcathomedev.cern.ch_lhcathome-dev/CMS_2022_08_10.vdi
Storage format: VDI
Format variant: dynamic default
Capacity:       20480 MBytes
Size on disk:   3840 MBytes
Encryption:     disabled
Property:       AllocationBlockSize=1048576
Child UUIDs:    bf1ef44e-9b4f-4d6d-8005-a19eda8cfac7

2022-08-12 22:18:35 (148070): 
Command: VBoxManage -q storageattach "boinc_07a9797cd1bb1f7c" --storagectl "Hard Disk Controller" --port 0 --device 0 --type hdd --mtype multiattach --medium "/var/lib/boinc3/projects/lhcathomedev.cern.ch_lhcathome-dev/CMS_2022_08_10.vdi" 
Exit Code: 0
Output:

2022-08-12 22:18:35 (148070): 
Command: VBoxManage -q bandwidthctl "boinc_07a9797cd1bb1f7c" add "boinc_07a9797cd1bb1f7c_net" --type network --limit 1024G 
Exit Code: 0
Output:

2022-08-12 22:18:35 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --natpf1 ",tcp,127.0.0.1,39897,,80" 
Exit Code: 0
Output:

2022-08-12 22:18:35 (148070): 
Command: VBoxManage -q list extpacks
Exit Code: 0
Output:
Extension Packs: 2
Pack no. 0:   VNC
Version:      6.1.34
Revision:     150636
Edition:      
Description:  VNC plugin module
VRDE Module:  VBoxVNC
Usable:       true 
Why unusable: 

Pack no. 1:   Oracle VM VirtualBox Extension Pack
Version:      6.1.34
Revision:     150636
Edition:      
Description:  Oracle Cloud Infrastructure integration, USB 2.0 and USB 3.0 Host Controller, Host Webcam, VirtualBox RDP, PXE ROM, Disk Encryption, NVMe.
VRDE Module:  VBoxVRDP
Usable:       true 
Why unusable: 

2022-08-12 22:18:35 (148070): 
Command: VBoxManage -q modifyvm "boinc_07a9797cd1bb1f7c" --vrde on --vrdeextpack default --vrdeauthlibrary default --vrdeauthtype null --vrdeport 53429 
Exit Code: 0
Output:

2022-08-12 22:18:35 (148070): 
Command: VBoxManage -q sharedfolder add "boinc_07a9797cd1bb1f7c" --name "shared" --hostpath "/var/lib/boinc3/slots/1/shared"
Exit Code: 0
Output:

2022-08-12 22:18:36 (148070): 
Command: VBoxManage -q startvm "boinc_07a9797cd1bb1f7c" --type headless
Exit Code: 0
Output:
Waiting for VM "boinc_07a9797cd1bb1f7c" to power on...
VM "boinc_07a9797cd1bb1f7c" has been successfully started.

2022-08-12 22:18:37 (148070): 
Command: VBoxManage -q controlvm "boinc_07a9797cd1bb1f7c" cpuexecutioncap 100 
Exit Code: 0
Output:

2022-08-13 07:52:52 (148070): 
Command: VBoxManage -q controlvm "boinc_07a9797cd1bb1f7c" poweroff
Exit Code: 0
Output:
0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%

2022-08-13 07:52:52 (148070): 
Command: VBoxManage -q snapshot "boinc_07a9797cd1bb1f7c" list 
Exit Code: 0
Output:
This machine does not have any snapshots

2022-08-13 07:52:52 (148070): 
Command: VBoxManage -q bandwidthctl "boinc_07a9797cd1bb1f7c" remove "boinc_07a9797cd1bb1f7c_net" 
Exit Code: 0
Output:

2022-08-13 07:52:52 (148070): 
Command: VBoxManage -q unregistervm "boinc_07a9797cd1bb1f7c" --delete 
Exit Code: 0
Output:
0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%

07:52:57 (148070): called boinc_finish(194)

</stderr_txt>
]]>


©2024 CERN