Name | CMS_2556136_1575632547.368331_0 |
Workunit | 1957704 |
Created | 6 Dec 2019, 11:42:31 UTC |
Sent | 9 Dec 2019, 0:14:18 UTC |
Report deadline | 16 Dec 2019, 0:14:18 UTC |
Received | 9 Dec 2019, 1:19:11 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 207 (0x000000CF) EXIT_NO_SUB_TASKS |
Computer ID | 3986 |
Run time | 19 min 12 sec |
CPU time | 2 min 20 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 10.10 GFLOPS |
Application version | CMS Simulation v49.00 (vbox64_mt_mcore_cms) windows_x86_64 |
Peak working set size | 81.13 MB |
Peak swap size | 109.50 MB |
Peak disk usage | 2.81 GB |
<core_client_version>7.14.2</core_client_version> <![CDATA[ <message> The ring 2 stack is in use. (0xcf) - exit code 207 (0xcf)</message> <stderr_txt> 2019-12-08 17:51:19 (180): Detected: vboxwrapper 26197 2019-12-08 17:51:19 (180): Detected: BOINC client v7.7 2019-12-08 17:51:20 (180): Detected: VirtualBox VboxManage Interface (Version: 6.0.10) 2019-12-08 17:51:20 (180): Detected: Heartbeat check (file: 'heartbeat' every 1200.000000 seconds) 2019-12-08 17:51:20 (180): Successfully copied 'init_data.xml' to the shared directory. 2019-12-08 17:51:22 (180): Create VM. (boinc_bc8d5cccc3cd606b, slot#6) 2019-12-08 17:51:22 (180): Setting Memory Size for VM. (2792MB) 2019-12-08 17:51:23 (180): Setting CPU Count for VM. (2) 2019-12-08 17:51:23 (180): Setting Chipset Options for VM. 2019-12-08 17:51:23 (180): Setting Boot Options for VM. 2019-12-08 17:51:24 (180): Setting Network Configuration for NAT. 2019-12-08 17:51:24 (180): Enabling VM Network Access. 2019-12-08 17:51:24 (180): Disabling USB Support for VM. 2019-12-08 17:51:25 (180): Disabling COM Port Support for VM. 2019-12-08 17:51:25 (180): Disabling LPT Port Support for VM. 2019-12-08 17:51:25 (180): Disabling Audio Support for VM. 2019-12-08 17:51:25 (180): Disabling Clipboard Support for VM. 2019-12-08 17:51:26 (180): Disabling Drag and Drop Support for VM. 2019-12-08 17:51:26 (180): Adding storage controller(s) to VM. 2019-12-08 17:51:26 (180): Adding virtual disk drive to VM. (vm_image.vdi) 2019-12-08 17:51:27 (180): Adding VirtualBox Guest Additions to VM. 2019-12-08 17:51:27 (180): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2019-12-08 17:51:27 (180): forwarding host port 61706 to guest port 80 2019-12-08 17:51:27 (180): Enabling remote desktop for VM. 2019-12-08 17:51:28 (180): Enabling shared directory for VM. 2019-12-08 17:51:28 (180): Starting VM using VBoxManage interface. (boinc_bc8d5cccc3cd606b, slot#6) 2019-12-08 17:51:31 (180): Successfully started VM. (PID = '15540') 2019-12-08 17:51:31 (180): Reporting VM Process ID to BOINC. 2019-12-08 17:51:31 (180): Guest Log: BIOS: VirtualBox 6.0.10 2019-12-08 17:51:31 (180): Guest Log: CPUID EDX: 0x178bfbff 2019-12-08 17:51:31 (180): Guest Log: BIOS: ata0-0: PCHS=16383/16/63 LCHS=1024/255/63 2019-12-08 17:51:31 (180): VM state change detected. (old = 'PoweredOff', new = 'Running') 2019-12-08 17:51:31 (180): Detected: Web Application Enabled (http://localhost:61706) 2019-12-08 17:51:31 (180): Detected: Remote Desktop Enabled (localhost:61707) 2019-12-08 17:51:31 (180): Preference change detected 2019-12-08 17:51:31 (180): Setting CPU throttle for VM. (100%) 2019-12-08 17:51:32 (180): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 300 seconds) or (Vbox_job.xml: 600 seconds)) 2019-12-08 17:51:33 (180): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2019-12-08 17:51:33 (180): Guest Log: BIOS: Booting from Hard Disk... 2019-12-08 17:51:35 (180): Guest Log: BIOS: KBD: unsupported int 16h function 03 2019-12-08 17:51:35 (180): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2019-12-08 17:51:50 (180): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2019-12-08 17:51:50 (180): Guest Log: vboxguest: misc device minor 56, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2019-12-08 17:52:12 (180): Guest Log: VBoxService 5.2.6 r120293 (verbosity: 0) linux.amd64 (Jan 15 2018 14:51:00) release log 2019-12-08 17:52:12 (180): Guest Log: 00:00:00.000110 main Log opened 2019-12-09T00:52:12.653014000Z 2019-12-08 17:52:12 (180): Guest Log: 00:00:00.000219 main OS Product: Linux 2019-12-08 17:52:12 (180): Guest Log: 00:00:00.000237 main OS Release: 4.14.44-11.cernvm.x86_64 2019-12-08 17:52:12 (180): Guest Log: 00:00:00.000252 main OS Version: #1 SMP Mon May 28 16:49:00 CEST 2018 2019-12-08 17:52:12 (180): Guest Log: 00:00:00.000265 main Executable: /usr/share/vboxguest52/usr/sbin/VBoxService 2019-12-08 17:52:12 (180): Guest Log: 00:00:00.000266 main Process ID: 2999 2019-12-08 17:52:12 (180): Guest Log: 00:00:00.000266 main Package type: LINUX_64BITS_GENERIC 2019-12-08 17:52:12 (180): Guest Log: 00:00:00.000676 main 5.2.6 r120293 started. Verbose level = 0 2019-12-08 17:52:26 (180): Guest Log: [INFO] Mounting the shared directory 2019-12-08 17:52:26 (180): Guest Log: [INFO] Shared directory mounted, enabling vboxmonitor 2019-12-08 17:52:26 (180): Guest Log: [DEBUG] Testing network connection to cern.ch on port 80 2019-12-08 17:52:27 (180): Guest Log: [DEBUG] Connection to cern.ch 80 port [tcp/http] succeeded! 2019-12-08 17:52:27 (180): Guest Log: [DEBUG] 0 2019-12-08 17:52:27 (180): Guest Log: [DEBUG] Testing VCCS connection to vccs.cern.ch on port 443 2019-12-08 17:52:27 (180): Guest Log: [DEBUG] Connection to vccs.cern.ch 443 port [tcp/https] succeeded! 2019-12-08 17:52:27 (180): Guest Log: [DEBUG] 0 2019-12-08 17:52:27 (180): Guest Log: [DEBUG] Testing connection to Condor server on port 9618 2019-12-08 17:52:27 (180): Guest Log: [DEBUG] Connection to vocms0840.cern.ch 9618 port [tcp/condor] succeeded! 2019-12-08 17:52:27 (180): Guest Log: [DEBUG] 0 2019-12-08 17:53:32 (180): Guest Log: [DEBUG] Probing CVMFS ... 2019-12-08 17:53:33 (180): Guest Log: Probing /cvmfs/grid.cern.ch... OK 2019-12-08 17:53:33 (180): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2019-12-08 17:53:33 (180): Guest Log: 2.4.4.0 3737 1 25836 10939 4 1 1460701 10240001 2 65024 0 3 100 0 0 http://s1unl-cvmfs.openhtc.io/cvmfs/grid.cern.ch DIRECT 1 2019-12-08 17:53:47 (180): Guest Log: [INFO] Reading volunteer information 2019-12-08 17:53:47 (180): Guest Log: [INFO] Volunteer: wHewitt (218) 2019-12-08 17:53:47 (180): Guest Log: [INFO] VMID: c5ab4400-4ef6-44a9-aaed-bee78432355d 2019-12-08 17:53:47 (180): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2019-12-08 17:53:48 (180): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2019-12-08 17:53:50 (180): Guest Log: [INFO] Running the fast benchmark. 2019-12-08 17:54:31 (180): Guest Log: [INFO] Machine performance 25.47 HEPSPEC06 2019-12-08 17:54:31 (180): Guest Log: [INFO] CMS application starting. Check log files. 2019-12-08 17:54:32 (180): Guest Log: [DEBUG] HTCondor ping 2019-12-08 17:54:34 (180): Guest Log: [DEBUG] 0 2019-12-08 18:05:16 (180): Guest Log: Did the tarball get created? 2019-12-08 18:05:16 (180): Guest Log: /tmp/CMS_2556136_1575632547.368331_0.tgz 2019-12-08 18:05:16 (180): Guest Log: Here is the upload output 2019-12-08 18:05:16 (180): Guest Log: Here is the upload error 2019-12-08 18:05:16 (180): Guest Log: Here is the condor directory 2019-12-08 18:05:16 (180): Guest Log: MasterLog 2019-12-08 18:05:16 (180): Guest Log: ProcLog 2019-12-08 18:05:16 (180): Guest Log: StartdHistoryLog 2019-12-08 18:05:16 (180): Guest Log: StarterLog 2019-12-08 18:05:16 (180): Guest Log: StartLog 2019-12-08 18:05:16 (180): Guest Log: XferStatsLog 2019-12-08 18:05:16 (180): Guest Log: Here is the MasterLog 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ****************************************************** 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ** condor_master (CONDOR_MASTER) STARTING UP 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ** /usr/sbin/condor_master 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ** $CondorPlatform: x86_64_RedHat6 $ 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ** PID = 6393 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ** Log last touched time unavailable (No such file or directory) 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 ****************************************************** 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 Using config source: /etc/condor/condor_config 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 Using local config sources: 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/10_security.config 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/14_network.config 2019-12-08 18:05:16 (180): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/20_workernode.config 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/30_lease.config 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/35_cms.config 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/40_ccb.config 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/62-benchmark.conf 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 /etc/condor/condor_config.local 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 config Macros = 170, Sorted = 170, StringBytes = 6777, TablesBytes = 6224 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 CLASSAD_CACHING is OFF 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 Daemon Log is logging: D_ALWAYS D_ERROR 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 Daemoncore: Listening at <10.0.2.15:36451> on TCP (ReliSock). 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 DaemonCore: command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451&noUDP> 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 DaemonCore: private command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451> 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#121706 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:47 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:48 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 6613 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 09:51:57 Setting ready state 'Ready' for STARTD 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 10:51:48 Preen pid is 15974 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 10:51:48 DefaultReaper unexpectedly called on pid 15974, status 0. 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 11:19:49 Sent SIGQUIT to STARTD (pid 6613) 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 11:19:49 AllReaper unexpectedly called on pid 6613, status 0. 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 11:19:49 The STARTD (pid 6613) exited with status 0 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 11:19:49 All daemons are gone. Exiting. 2019-12-08 18:05:17 (180): Guest Log: 03/25/19 11:19:49 **** condor_master (condor_MASTER) pid 6393 EXITING WITH STATUS 0 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ****************************************************** 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ** condor_master (CONDOR_MASTER) STARTING UP 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ** /usr/sbin/condor_master 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ** $CondorPlatform: x86_64_RedHat6 $ 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ** PID = 4544 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ** Log last touched 12/8 17:54:34 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 ****************************************************** 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 Using config source: /etc/condor/condor_config 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 Using local config sources: 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 /etc/condor/config.d/10_security.config 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 /etc/condor/config.d/14_network.config 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 /etc/condor/config.d/20_workernode.config 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 /etc/condor/config.d/30_lease.config 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 /etc/condor/config.d/35_cms.config 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 /etc/condor/config.d/40_ccb.config 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 /etc/condor/config.d/62-benchmark.conf 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 /etc/condor/condor_config.local 2019-12-08 18:05:17 (180): Guest Log: 12/08/19 17:54:34 config Macros = 173, Sorted = 173, StringBytes = 6797, TablesBytes = 6332 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 17:54:34 CLASSAD_CACHING is OFF 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 17:54:34 Daemon Log is logging: D_ALWAYS D_ERROR 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 17:54:34 Daemoncore: Listening at <10.0.2.15:37199> on TCP (ReliSock). 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 17:54:34 DaemonCore: command socket at <10.0.2.15:37199?addrs=10.0.2.15-37199&noUDP> 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 17:54:34 DaemonCore: private command socket at <10.0.2.15:37199?addrs=10.0.2.15-37199> 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 17:54:38 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#1397746 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 17:54:38 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 17:54:38 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 4561 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 17:54:46 Setting ready state 'Ready' for STARTD 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 18:05:12 Got SIGTERM. Performing graceful shutdown. 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 18:05:12 Sent SIGTERM to STARTD (pid 4561) 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 18:05:12 AllReaper unexpectedly called on pid 4561, status 0. 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 18:05:12 The STARTD (pid 4561) exited with status 0 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 18:05:12 All daemons are gone. Exiting. 2019-12-08 18:05:18 (180): Guest Log: 12/08/19 18:05:12 **** condor_master (condor_MASTER) pid 4544 EXITING WITH STATUS 0 2019-12-08 18:05:18 (180): Guest Log: Here is the KernelTuning.log 2019-12-08 18:05:18 (180): Guest Log: Here is the StartLog 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ****************************************************** 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ** condor_startd (CONDOR_STARTD) STARTING UP 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ** /usr/sbin/condor_startd 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ** SubsystemInfo: name=STARTD type=STARTD(7) class=DAEMON(1) 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ** Configuration: subsystem:STARTD local:<NONE> class:DAEMON 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ** $CondorPlatform: x86_64_RedHat6 $ 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ** PID = 6613 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ** Log last touched time unavailable (No such file or directory) 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 ****************************************************** 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 Using config source: /etc/condor/condor_config 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 Using local config sources: 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/10_security.config 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/14_network.config 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/20_workernode.config 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/30_lease.config 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/35_cms.config 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/40_ccb.config 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/62-benchmark.conf 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 /etc/condor/condor_config.local 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 config Macros = 171, Sorted = 171, StringBytes = 6803, TablesBytes = 6260 2019-12-08 18:05:18 (180): Guest Log: 03/25/19 09:51:48 CLASSAD_CACHING is ENABLED 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:48 Daemon Log is logging: D_ALWAYS D_ERROR 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:48 Daemoncore: Listening at <10.0.2.15:38681> on TCP (ReliSock). 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:48 DaemonCore: command socket at <10.0.2.15:38681?addrs=10.0.2.15-38681&noUDP> 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:48 DaemonCore: private command socket at <10.0.2.15:38681?addrs=10.0.2.15-38681> 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:48 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#121707 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 VM-gahp server reported an internal error 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 VM universe will be tested to check if it is available 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 History file rotation is enabled. 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 Maximum history file size is: 20971520 bytes 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 Number of rotated history files is: 2 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2019-12-08 18:05:19 (180): Guest Log: slot type 0: Cpus: 1.000000, Memory: 3000, Swap: 100.00%, Disk: 100.00% 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 New machine resource allocated 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 Setting up slot pairings 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'multicore' 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'mips' 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'kflops' 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 State change: IS_OWNER is false 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 Changing state: Owner -> Unclaimed 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 State change: RunBenchmarks is TRUE 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 Changing activity: Idle -> Benchmarking 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:54 BenchMgr:StartBenchmarks() 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:57 Initial update sent to collector(s) 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:51:57 Sending DC_SET_READY message to master <10.0.2.15:36451?addrs=10.0.2.15-36451> 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:01 Request accepted. 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:01 Remote owner is cmst1@cms 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:01 State change: claiming protocol successful 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:01 Changing state and activity: Unclaimed/Benchmarking -> Claimed/Idle 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:02 Got activate_claim request from shadow (137.138.52.94) 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:02 Remote job ID is 105057.6 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:02 Got universe "VANILLA" (5) from request classad 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:02 State change: claim-activation protocol successful 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:02 Changing activity: Idle -> Busy 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 09:52:16 State change: benchmarks completed 2019-12-08 18:05:19 (180): Guest Log: 03/25/19 10:51:48 PERMISSION DENIED to gsi@unmapped from host 10.0.2.15 for command 448 (GIVE_STATE), access level READ: reason: READ authorization policy contains no matching ALLOW entry for this request; identifiers used for this host: 10.0.2.15, hostname size = 0, original ip address = 10.0.2.15 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:51:48 DC_AUTHENTICATE: Command not authorized, done! 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:35 Called deactivate_claim_forcibly() 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:35 Got activate claim while starter is still alive. 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:35 Telling shadow to try again later. 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:35 Starter pid 10357 exited with status 0 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:35 State change: starter exited 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:35 Changing activity: Busy -> Idle 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:36 Got activate_claim request from shadow (137.138.52.94) 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:36 Remote job ID is 105090.4 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:36 Got universe "VANILLA" (5) from request classad 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:36 State change: claim-activation protocol successful 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 10:55:36 Changing activity: Idle -> Busy 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 shutdown fast 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Killing job multicore 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Killing job mips 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Killing job kflops 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Changing state and activity: Claimed/Busy -> Preempting/Killing 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Got DEACTIVATE_CLAIM while in Preempting state, ignoring. 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Got RELEASE_CLAIM while in Preempting state, ignoring. 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Starter pid 16322 exited with status 0 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 State change: starter exited 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 State change: No preempting claim, returning to owner 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Changing state and activity: Preempting/Killing -> Owner/Idle 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 State change: IS_OWNER is false 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Changing state: Owner -> Unclaimed 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Deleting cron job manager 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Killing job multicore 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Killing job multicore 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'multicore' 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Deleting benchmark job mgr 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Killing job mips 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Killing job kflops 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-08 18:05:20 (180): Guest Log: 03/25/19 11:19:49 Killing job mips 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 Killing job kflops 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'mips' 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'kflops' 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 All resources are free, exiting. 2019-12-08 18:05:21 (180): Guest Log: 03/25/19 11:19:49 **** condor_startd (condor_STARTD) pid 6613 EXITING WITH STATUS 0 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ****************************************************** 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ** condor_startd (CONDOR_STARTD) STARTING UP 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ** /usr/sbin/condor_startd 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ** SubsystemInfo: name=STARTD type=STARTD(7) class=DAEMON(1) 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ** Configuration: subsystem:STARTD local:<NONE> class:DAEMON 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ** $CondorPlatform: x86_64_RedHat6 $ 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ** PID = 4561 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ** Log last touched 12/8 17:54:34 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 ****************************************************** 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 Using config source: /etc/condor/condor_config 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 Using local config sources: 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 /etc/condor/config.d/10_security.config 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 /etc/condor/config.d/14_network.config 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 /etc/condor/config.d/20_workernode.config 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 /etc/condor/config.d/30_lease.config 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 /etc/condor/config.d/35_cms.config 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 /etc/condor/config.d/40_ccb.config 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 /etc/condor/config.d/62-benchmark.conf 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 /etc/condor/condor_config.local 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 config Macros = 174, Sorted = 174, StringBytes = 6822, TablesBytes = 6368 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 CLASSAD_CACHING is ENABLED 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 Daemon Log is logging: D_ALWAYS D_ERROR 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 Daemoncore: Listening at <10.0.2.15:41591> on TCP (ReliSock). 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 DaemonCore: command socket at <10.0.2.15:41591?addrs=10.0.2.15-41591&noUDP> 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:38 DaemonCore: private command socket at <10.0.2.15:41591?addrs=10.0.2.15-41591> 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#1397747 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 VM-gahp server reported an internal error 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 VM universe will be tested to check if it is available 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 History file rotation is enabled. 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 Maximum history file size is: 20971520 bytes 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 Number of rotated history files is: 2 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2019-12-08 18:05:21 (180): Guest Log: slot type 0: Cpus: 1.000000, Memory: 2250, Swap: 50.00%, Disk: 50.00% 2019-12-08 18:05:21 (180): Guest Log: slot type 0: Cpus: 1.000000, Memory: 2250, Swap: 50.00%, Disk: 50.00% 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 slot1: New machine resource allocated 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 Setting up slot pairings 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 slot2: New machine resource allocated 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 Setting up slot pairings 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 CronJobList: Adding job 'multicore' 2019-12-08 18:05:21 (180): Guest Log: 12/08/19 17:54:42 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 CronJobList: Adding job 'mips' 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 CronJobList: Adding job 'kflops' 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 slot1: State change: IS_OWNER is false 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 slot1: Changing state: Owner -> Unclaimed 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 State change: RunBenchmarks is TRUE 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 slot1: Changing activity: Idle -> Benchmarking 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 BenchMgr:StartBenchmarks() 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 slot2: State change: IS_OWNER is false 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 slot2: Changing state: Owner -> Unclaimed 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 State change: RunBenchmarks is TRUE 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 slot2: Changing activity: Idle -> Benchmarking 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:42 slot2: Changing activity: Benchmarking -> Idle 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:45 Initial update sent to collector(s) 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:54:45 Sending DC_SET_READY message to master <10.0.2.15:37199?addrs=10.0.2.15-37199> 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:55:00 State change: benchmarks completed 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 17:55:00 slot1: Changing activity: Benchmarking -> Idle 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 No resources have been claimed for 600 seconds 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Shutting down Condor on this machine. 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Got SIGTERM. Performing graceful shutdown. 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 shutdown graceful 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Cron: Killing all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Killing job multicore 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Cron: Killing all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Killing job mips 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Killing job kflops 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Deleting cron job manager 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Cron: Killing all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Killing job multicore 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Cron: Killing all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Killing job multicore 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 CronJobList: Deleting all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 CronJobList: Deleting job 'multicore' 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Cron: Killing all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 CronJobList: Deleting all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Deleting benchmark job mgr 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Cron: Killing all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Killing job mips 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Killing job kflops 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Cron: Killing all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Killing job mips 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 Killing job kflops 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 CronJobList: Deleting all jobs 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 CronJobList: Deleting job 'mips' 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 CronJobList: Deleting job 'kflops' 2019-12-08 18:05:22 (180): Guest Log: 12/08/19 18:05:12 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2019-12-08 18:05:23 (180): Guest Log: 12/08/19 18:05:12 Cron: Killing all jobs 2019-12-08 18:05:23 (180): Guest Log: 12/08/19 18:05:12 CronJobList: Deleting all jobs 2019-12-08 18:05:23 (180): Guest Log: 12/08/19 18:05:12 All resources are free, exiting. 2019-12-08 18:05:23 (180): Guest Log: 12/08/19 18:05:12 **** condor_startd (condor_STARTD) pid 4561 EXITING WITH STATUS 0 2019-12-08 18:05:23 (180): Guest Log: [ERROR] No jobs were available to run. 2019-12-08 18:05:23 (180): Guest Log: [INFO] Shutting Down. 2019-12-08 18:05:23 (180): VM Completion File Detected. 2019-12-08 18:05:23 (180): VM Completion Message: No jobs were available to run. . 2019-12-08 18:05:23 (180): Powering off VM. 2019-12-08 18:10:23 (180): VM did not power off when requested. 2019-12-08 18:10:23 (180): VM was successfully terminated. 2019-12-08 18:10:23 (180): Deregistering VM. (boinc_bc8d5cccc3cd606b, slot#6) 2019-12-08 18:10:24 (180): Removing network bandwidth throttle group from VM. 2019-12-08 18:10:24 (180): Removing VM from VirtualBox. 18:10:29 (180): called boinc_finish(207) </stderr_txt> ]]>
©2024 CERN