Name | CMS_94296_1577549698.890239_0 |
Workunit | 1965802 |
Created | 28 Dec 2019, 16:15:01 UTC |
Sent | 30 Dec 2019, 14:05:40 UTC |
Report deadline | 6 Jan 2020, 14:05:40 UTC |
Received | 30 Dec 2019, 15:35:58 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 207 (0x000000CF) EXIT_NO_SUB_TASKS |
Computer ID | 4046 |
Run time | 24 min 9 sec |
CPU time | 2 min 38 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 4.09 GFLOPS |
Application version | CMS Simulation v49.00 (vbox64_mt_mcore_cms) windows_x86_64 |
Peak working set size | 79.15 MB |
Peak swap size | 106.32 MB |
Peak disk usage | 2.81 GB |
<core_client_version>7.14.2</core_client_version> <![CDATA[ <message> The ring 2 stack is in use. (0xcf) - exit code 207 (0xcf)</message> <stderr_txt> 2019-12-30 07:10:07 (560): Detected: vboxwrapper 26197 2019-12-30 07:10:07 (560): Detected: BOINC client v7.7 2019-12-30 07:10:07 (560): Detected: VirtualBox VboxManage Interface (Version: 6.0.14) 2019-12-30 07:10:08 (560): Detected: Heartbeat check (file: 'heartbeat' every 1200.000000 seconds) 2019-12-30 07:10:08 (560): Successfully copied 'init_data.xml' to the shared directory. 2019-12-30 07:10:11 (560): Create VM. (boinc_33d8ef42ac24c92c, slot#1) 2019-12-30 07:10:11 (560): Setting Memory Size for VM. (1896MB) 2019-12-30 07:10:12 (560): Setting CPU Count for VM. (1) 2019-12-30 07:10:12 (560): Setting Chipset Options for VM. 2019-12-30 07:10:12 (560): Setting Boot Options for VM. 2019-12-30 07:10:12 (560): Setting Network Configuration for NAT. 2019-12-30 07:10:13 (560): Enabling VM Network Access. 2019-12-30 07:10:13 (560): Disabling USB Support for VM. 2019-12-30 07:10:13 (560): Disabling COM Port Support for VM. 2019-12-30 07:10:14 (560): Disabling LPT Port Support for VM. 2019-12-30 07:10:14 (560): Disabling Audio Support for VM. 2019-12-30 07:10:15 (560): Disabling Clipboard Support for VM. 2019-12-30 07:10:16 (560): Disabling Drag and Drop Support for VM. 2019-12-30 07:10:17 (560): Adding storage controller(s) to VM. 2019-12-30 07:10:17 (560): Adding virtual disk drive to VM. (vm_image.vdi) 2019-12-30 07:10:19 (560): Adding VirtualBox Guest Additions to VM. 2019-12-30 07:10:19 (560): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2019-12-30 07:10:19 (560): forwarding host port 51734 to guest port 80 2019-12-30 07:10:20 (560): Enabling remote desktop for VM. 2019-12-30 07:10:20 (560): Enabling shared directory for VM. 2019-12-30 07:10:20 (560): Starting VM using VBoxManage interface. (boinc_33d8ef42ac24c92c, slot#1) 2019-12-30 07:10:24 (560): Successfully started VM. (PID = '4392') 2019-12-30 07:10:24 (560): Reporting VM Process ID to BOINC. 2019-12-30 07:10:24 (560): Guest Log: BIOS: VirtualBox 6.0.14 2019-12-30 07:10:24 (560): Guest Log: CPUID EDX: 0x178bfbff 2019-12-30 07:10:24 (560): Guest Log: BIOS: ata0-0: PCHS=16383/16/63 LCHS=1024/255/63 2019-12-30 07:10:24 (560): VM state change detected. (old = 'PoweredOff', new = 'Running') 2019-12-30 07:10:24 (560): Detected: Web Application Enabled (http://localhost:51734) 2019-12-30 07:10:24 (560): Detected: Remote Desktop Enabled (localhost:51735) 2019-12-30 07:10:24 (560): Preference change detected 2019-12-30 07:10:24 (560): Setting CPU throttle for VM. (70%) 2019-12-30 07:10:25 (560): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 600 seconds)) 2019-12-30 07:10:26 (560): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2019-12-30 07:10:26 (560): Guest Log: BIOS: Booting from Hard Disk... 2019-12-30 07:10:28 (560): Guest Log: BIOS: KBD: unsupported int 16h function 03 2019-12-30 07:10:28 (560): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2019-12-30 07:10:50 (560): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2019-12-30 07:10:50 (560): Guest Log: vboxguest: misc device minor 56, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2019-12-30 07:11:22 (560): Guest Log: VBoxService 5.2.6 r120293 (verbosity: 0) linux.amd64 (Jan 15 2018 14:51:00) release log 2019-12-30 07:11:22 (560): Guest Log: 00:00:00.000142 main Log opened 2019-12-30T15:11:21.162471000Z 2019-12-30 07:11:22 (560): Guest Log: 00:00:00.000278 main OS Product: Linux 2019-12-30 07:11:22 (560): Guest Log: 00:00:00.000311 main OS Release: 4.14.44-11.cernvm.x86_64 2019-12-30 07:11:22 (560): Guest Log: 00:00:00.000337 main OS Version: #1 SMP Mon May 28 16:49:00 CEST 2018 2019-12-30 07:11:22 (560): Guest Log: 00:00:00.000361 main Executable: /usr/share/vboxguest52/usr/sbin/VBoxService 2019-12-30 07:11:22 (560): Guest Log: 00:00:00.000362 main Process ID: 2961 2019-12-30 07:11:22 (560): Guest Log: 00:00:00.000363 main Package type: LINUX_64BITS_GENERIC 2019-12-30 07:11:22 (560): Guest Log: 00:00:00.002416 main 5.2.6 r120293 started. Verbose level = 0 2019-12-30 07:12:20 (560): Guest Log: [INFO] Mounting the shared directory 2019-12-30 07:12:20 (560): Guest Log: [INFO] Shared directory mounted, enabling vboxmonitor 2019-12-30 07:12:20 (560): Guest Log: [DEBUG] Testing network connection to cern.ch on port 80 2019-12-30 07:12:20 (560): Guest Log: [DEBUG] Connection to cern.ch 80 port [tcp/http] succeeded! 2019-12-30 07:12:20 (560): Guest Log: [DEBUG] 0 2019-12-30 07:12:20 (560): Guest Log: [DEBUG] Testing VCCS connection to vccs.cern.ch on port 443 2019-12-30 07:12:21 (560): Guest Log: [DEBUG] Connection to vccs.cern.ch 443 port [tcp/https] succeeded! 2019-12-30 07:12:21 (560): Guest Log: [DEBUG] 0 2019-12-30 07:12:21 (560): Guest Log: [DEBUG] Testing connection to Condor server on port 9618 2019-12-30 07:12:21 (560): Guest Log: [DEBUG] Connection to vocms0840.cern.ch 9618 port [tcp/condor] succeeded! 2019-12-30 07:12:21 (560): Guest Log: [DEBUG] 0 2019-12-30 07:13:36 (560): Guest Log: [DEBUG] Probing CVMFS ... 2019-12-30 07:13:38 (560): Guest Log: Probing /cvmfs/grid.cern.ch... OK 2019-12-30 07:13:40 (560): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2019-12-30 07:13:40 (560): Guest Log: 2.4.4.0 3702 1 25840 11113 3 1 1460701 10240001 2 65024 0 3 100 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/grid.cern.ch DIRECT 1 2019-12-30 07:16:01 (560): Guest Log: [INFO] Reading volunteer information 2019-12-30 07:16:01 (560): Guest Log: [INFO] Volunteer: David Duvall (217) 2019-12-30 07:16:01 (560): Guest Log: [INFO] VMID: c5ab4400-4ef6-44a9-aaed-bee78432355d 2019-12-30 07:16:02 (560): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2019-12-30 07:16:07 (560): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2019-12-30 07:16:11 (560): Guest Log: [INFO] Running the fast benchmark. 2019-12-30 07:18:26 (560): Guest Log: [INFO] Machine performance 3.75 HEPSPEC06 2019-12-30 07:18:26 (560): Guest Log: [INFO] CMS application starting. Check log files. 2019-12-30 07:18:33 (560): Guest Log: [DEBUG] HTCondor ping 2019-12-30 07:18:42 (560): Guest Log: [DEBUG] 0 2019-12-30 07:29:05 (560): Guest Log: Did the tarball get created? 2019-12-30 07:29:05 (560): Guest Log: /tmp/CMS_94296_1577549698.890239_0.tgz 2019-12-30 07:29:05 (560): Guest Log: Here is the upload output 2019-12-30 07:29:05 (560): Guest Log: Here is the upload error 2019-12-30 07:29:05 (560): Guest Log: Here is the condor directory 2019-12-30 07:29:05 (560): Guest Log: MasterLog 2019-12-30 07:29:05 (560): Guest Log: ProcLog 2019-12-30 07:29:05 (560): Guest Log: StartdHistoryLog 2019-12-30 07:29:05 (560): Guest Log: StarterLog 2019-12-30 07:29:05 (560): Guest Log: StartLog 2019-12-30 07:29:05 (560): Guest Log: XferStatsLog 2019-12-30 07:29:05 (560): Guest Log: Here is the MasterLog 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ****************************************************** 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ** condor_master (CONDOR_MASTER) STARTING UP 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ** /usr/sbin/condor_master 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ** $CondorPlatform: x86_64_RedHat6 $ 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ** PID = 6393 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ** Log last touched time unavailable (No such file or directory) 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 ****************************************************** 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 Using config source: /etc/condor/condor_config 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 Using local config sources: 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/10_security.config 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/14_network.config 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/20_workernode.config 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/30_lease.config 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/35_cms.config 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/40_ccb.config 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/62-benchmark.conf 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 /etc/condor/condor_config.local 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 config Macros = 170, Sorted = 170, StringBytes = 6777, TablesBytes = 6224 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 CLASSAD_CACHING is OFF 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 Daemon Log is logging: D_ALWAYS D_ERROR 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 Daemoncore: Listening at <10.0.2.15:36451> on TCP (ReliSock). 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 DaemonCore: command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451&noUDP> 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 DaemonCore: private command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451> 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#121706 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:47 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:48 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 6613 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:57 Setting ready state 'Ready' for STARTD 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 10:51:48 Preen pid is 15974 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 10:51:48 DefaultReaper unexpectedly called on pid 15974, status 0. 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 11:19:49 Sent SIGQUIT to STARTD (pid 6613) 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 11:19:49 AllReaper unexpectedly called on pid 6613, status 0. 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 11:19:49 The STARTD (pid 6613) exited with status 0 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 11:19:49 All daemons are gone. Exiting. 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 11:19:49 **** condor_master (condor_MASTER) pid 6393 EXITING WITH STATUS 0 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ****************************************************** 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ** condor_master (CONDOR_MASTER) STARTING UP 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ** /usr/sbin/condor_master 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ** $CondorPlatform: x86_64_RedHat6 $ 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ** PID = 4516 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ** Log last touched 12/30 10:18:41 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 ****************************************************** 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 Using config source: /etc/condor/condor_config 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 Using local config sources: 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 /etc/condor/config.d/10_security.config 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 /etc/condor/config.d/14_network.config 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 /etc/condor/config.d/20_workernode.config 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 /etc/condor/config.d/30_lease.config 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 /etc/condor/config.d/35_cms.config 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 /etc/condor/config.d/40_ccb.config 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 /etc/condor/config.d/62-benchmark.conf 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 /etc/condor/condor_config.local 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 config Macros = 170, Sorted = 170, StringBytes = 6795, TablesBytes = 6224 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 CLASSAD_CACHING is OFF 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 Daemon Log is logging: D_ALWAYS D_ERROR 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 Daemoncore: Listening at <10.0.2.15:45897> on TCP (ReliSock). 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 DaemonCore: command socket at <10.0.2.15:45897?addrs=10.0.2.15-45897&noUDP> 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:41 DaemonCore: private command socket at <10.0.2.15:45897?addrs=10.0.2.15-45897> 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:52 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#1478307 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:52 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:18:52 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 4547 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:19:07 Setting ready state 'Ready' for STARTD 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:29:01 Got SIGTERM. Performing graceful shutdown. 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:29:01 Sent SIGTERM to STARTD (pid 4547) 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:29:01 AllReaper unexpectedly called on pid 4547, status 0. 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:29:01 The STARTD (pid 4547) exited with status 0 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:29:01 All daemons are gone. Exiting. 2019-12-30 07:29:05 (560): Guest Log: 12/30/19 10:29:01 **** condor_master (condor_MASTER) pid 4516 EXITING WITH STATUS 0 2019-12-30 07:29:05 (560): Guest Log: Here is the KernelTuning.log 2019-12-30 07:29:05 (560): Guest Log: Here is the StartLog 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:48 ****************************************************** 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:48 ** condor_startd (CONDOR_STARTD) STARTING UP 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:48 ** /usr/sbin/condor_startd 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:48 ** SubsystemInfo: name=STARTD type=STARTD(7) class=DAEMON(1) 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:48 ** Configuration: subsystem:STARTD local:<NONE> class:DAEMON 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:48 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-12-30 07:29:05 (560): Guest Log: 03/25/19 09:51:48 ** $CondorPlatform: x86_64_RedHat6 $ 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 ** PID = 6613 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 ** Log last touched time unavailable (No such file or directory) 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 ****************************************************** 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 Using config source: /etc/condor/condor_config 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 Using local config sources: 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/10_security.config 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/14_network.config 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/20_workernode.config 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/30_lease.config 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/35_cms.config 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/40_ccb.config 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/62-benchmark.conf 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 /etc/condor/condor_config.local 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 config Macros = 171, Sorted = 171, StringBytes = 6803, TablesBytes = 6260 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 CLASSAD_CACHING is ENABLED 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 Daemon Log is logging: D_ALWAYS D_ERROR 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 Daemoncore: Listening at <10.0.2.15:38681> on TCP (ReliSock). 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 DaemonCore: command socket at <10.0.2.15:38681?addrs=10.0.2.15-38681&noUDP> 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 DaemonCore: private command socket at <10.0.2.15:38681?addrs=10.0.2.15-38681> 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:48 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#121707 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 VM-gahp server reported an internal error 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 VM universe will be tested to check if it is available 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 History file rotation is enabled. 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 Maximum history file size is: 20971520 bytes 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 Number of rotated history files is: 2 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2019-12-30 07:29:06 (560): Guest Log: slot type 0: Cpus: 1.000000, Memory: 3000, Swap: 100.00%, Disk: 100.00% 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 New machine resource allocated 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 Setting up slot pairings 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'multicore' 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'mips' 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'kflops' 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 State change: IS_OWNER is false 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 Changing state: Owner -> Unclaimed 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 State change: RunBenchmarks is TRUE 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 Changing activity: Idle -> Benchmarking 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:54 BenchMgr:StartBenchmarks() 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:57 Initial update sent to collector(s) 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:51:57 Sending DC_SET_READY message to master <10.0.2.15:36451?addrs=10.0.2.15-36451> 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:01 Request accepted. 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:01 Remote owner is cmst1@cms 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:01 State change: claiming protocol successful 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:01 Changing state and activity: Unclaimed/Benchmarking -> Claimed/Idle 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:02 Got activate_claim request from shadow (137.138.52.94) 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:02 Remote job ID is 105057.6 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:02 Got universe "VANILLA" (5) from request classad 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:02 State change: claim-activation protocol successful 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:02 Changing activity: Idle -> Busy 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 09:52:16 State change: benchmarks completed 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:51:48 PERMISSION DENIED to gsi@unmapped from host 10.0.2.15 for command 448 (GIVE_STATE), access level READ: reason: READ authorization policy contains no matching ALLOW entry for this request; identifiers used for this host: 10.0.2.15, hostname size = 0, original ip address = 10.0.2.15 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:51:48 DC_AUTHENTICATE: Command not authorized, done! 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:35 Called deactivate_claim_forcibly() 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:35 Got activate claim while starter is still alive. 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:35 Telling shadow to try again later. 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:35 Starter pid 10357 exited with status 0 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:35 State change: starter exited 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:35 Changing activity: Busy -> Idle 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:36 Got activate_claim request from shadow (137.138.52.94) 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:36 Remote job ID is 105090.4 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:36 Got universe "VANILLA" (5) from request classad 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:36 State change: claim-activation protocol successful 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 10:55:36 Changing activity: Idle -> Busy 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 shutdown fast 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Killing job multicore 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Killing job mips 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Killing job kflops 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Changing state and activity: Claimed/Busy -> Preempting/Killing 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Got DEACTIVATE_CLAIM while in Preempting state, ignoring. 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Got RELEASE_CLAIM while in Preempting state, ignoring. 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Starter pid 16322 exited with status 0 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 State change: starter exited 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 State change: No preempting claim, returning to owner 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Changing state and activity: Preempting/Killing -> Owner/Idle 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 State change: IS_OWNER is false 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Changing state: Owner -> Unclaimed 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Deleting cron job manager 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Killing job multicore 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Killing job multicore 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'multicore' 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Deleting benchmark job mgr 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Killing job mips 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Killing job kflops 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Killing job mips 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Killing job kflops 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'mips' 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'kflops' 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 All resources are free, exiting. 2019-12-30 07:29:06 (560): Guest Log: 03/25/19 11:19:49 **** condor_startd (condor_STARTD) pid 6613 EXITING WITH STATUS 0 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ****************************************************** 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ** condor_startd (CONDOR_STARTD) STARTING UP 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ** /usr/sbin/condor_startd 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ** SubsystemInfo: name=STARTD type=STARTD(7) class=DAEMON(1) 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ** Configuration: subsystem:STARTD local:<NONE> class:DAEMON 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ** $CondorPlatform: x86_64_RedHat6 $ 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ** PID = 4547 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ** Log last touched 12/30 10:18:41 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 ****************************************************** 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 Using config source: /etc/condor/condor_config 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 Using local config sources: 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 /etc/condor/config.d/10_security.config 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 /etc/condor/config.d/14_network.config 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 /etc/condor/config.d/20_workernode.config 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 /etc/condor/config.d/30_lease.config 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 /etc/condor/config.d/35_cms.config 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 /etc/condor/config.d/40_ccb.config 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 /etc/condor/config.d/62-benchmark.conf 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 /etc/condor/condor_config.local 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 config Macros = 171, Sorted = 171, StringBytes = 6821, TablesBytes = 6260 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 CLASSAD_CACHING is ENABLED 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 Daemon Log is logging: D_ALWAYS D_ERROR 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 Daemoncore: Listening at <10.0.2.15:33699> on TCP (ReliSock). 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 DaemonCore: command socket at <10.0.2.15:33699?addrs=10.0.2.15-33699&noUDP> 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:18:52 DaemonCore: private command socket at <10.0.2.15:33699?addrs=10.0.2.15-33699> 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:00 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#1478308 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 VM-gahp server reported an internal error 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 VM universe will be tested to check if it is available 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 History file rotation is enabled. 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 Maximum history file size is: 20971520 bytes 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 Number of rotated history files is: 2 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2019-12-30 07:29:06 (560): Guest Log: slot type 0: Cpus: 1.000000, Memory: 3000, Swap: 100.00%, Disk: 100.00% 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 New machine resource allocated 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 Setting up slot pairings 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 CronJobList: Adding job 'multicore' 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 CronJobList: Adding job 'mips' 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 CronJobList: Adding job 'kflops' 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 State change: IS_OWNER is false 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 Changing state: Owner -> Unclaimed 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 State change: RunBenchmarks is TRUE 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 Changing activity: Idle -> Benchmarking 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:01 BenchMgr:StartBenchmarks() 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:04 Initial update sent to collector(s) 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:04 Sending DC_SET_READY message to master <10.0.2.15:45897?addrs=10.0.2.15-45897> 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:26 State change: benchmarks completed 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:26 Changing activity: Benchmarking -> Idle 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:29 condor_write(): Socket closed when trying to write 4096 bytes to collector vocms0840.cern.ch, fd is 11 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:19:29 Buf::write(): condor_write() failed 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:20:04 condor_write(): Socket closed when trying to write 4096 bytes to collector vocms0840.cern.ch, fd is 8 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:20:04 Buf::write(): condor_write() failed 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 No resources have been claimed for 600 seconds 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Shutting down Condor on this machine. 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Got SIGTERM. Performing graceful shutdown. 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 shutdown graceful 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Killing job multicore 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Killing job mips 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Killing job kflops 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Deleting cron job manager 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Killing job multicore 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJob: 'multicore': Trying to kill illegal PID 0 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Killing job multicore 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJob: 'multicore': Trying to kill illegal PID 0 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJobList: Deleting all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJobList: Deleting job 'multicore' 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJob: 'multicore': Trying to kill illegal PID 0 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJobList: Deleting all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Deleting benchmark job mgr 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Killing job mips 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Killing job kflops 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Killing job mips 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Killing job kflops 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJobList: Deleting all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJobList: Deleting job 'mips' 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJobList: Deleting job 'kflops' 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 Cron: Killing all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 CronJobList: Deleting all jobs 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 All resources are free, exiting. 2019-12-30 07:29:06 (560): Guest Log: 12/30/19 10:29:01 **** condor_startd (condor_STARTD) pid 4547 EXITING WITH STATUS 0 2019-12-30 07:29:06 (560): Guest Log: [ERROR] No jobs were available to run. 2019-12-30 07:29:06 (560): Guest Log: [INFO] Shutting Down. 2019-12-30 07:29:06 (560): VM Completion File Detected. 2019-12-30 07:29:06 (560): VM Completion Message: No jobs were available to run. . 2019-12-30 07:29:06 (560): Powering off VM. 2019-12-30 07:34:07 (560): VM did not power off when requested. 2019-12-30 07:34:07 (560): VM was successfully terminated. 2019-12-30 07:34:07 (560): Deregistering VM. (boinc_33d8ef42ac24c92c, slot#1) 2019-12-30 07:34:07 (560): Removing network bandwidth throttle group from VM. 2019-12-30 07:34:07 (560): Removing VM from VirtualBox. 07:34:13 (560): called boinc_finish(207) </stderr_txt> ]]>
©2025 CERN