Name | CMS_699164_1563886140.487300_0 |
Workunit | 1910730 |
Created | 23 Jul 2019, 12:49:02 UTC |
Sent | 24 Jul 2019, 16:43:58 UTC |
Report deadline | 31 Jul 2019, 16:43:58 UTC |
Received | 24 Jul 2019, 16:59:49 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 207 (0x000000CF) EXIT_NO_SUB_TASKS |
Computer ID | 3846 |
Run time | 13 min 55 sec |
CPU time | 2 min 49 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 3.74 GFLOPS |
Application version | CMS Simulation v49.00 (vbox64_mt_mcore_cms) x86_64-pc-linux-gnu |
Peak working set size | 337.18 MB |
Peak swap size | 2.49 GB |
Peak disk usage | 2.81 GB |
<core_client_version>7.14.2</core_client_version> <![CDATA[ <message> process exited with code 207 (0xcf, -49)</message> <stderr_txt> 2019-07-24 18:44:35 (31770): vboxwrapper (7.7.26196): starting 2019-07-24 18:44:35 (31770): Feature: Checkpoint interval offset (556 seconds) 2019-07-24 18:44:35 (31770): Detected: VirtualBox VboxManage Interface (Version: 6.0.8) 2019-07-24 18:44:35 (31770): Detected: Minimum checkpoint interval (600.000000 seconds) 2019-07-24 18:44:35 (31770): Detected: Heartbeat check (file: 'heartbeat' every 1200.000000 seconds) 2019-07-24 18:44:35 (31770): Successfully copied 'init_data.xml' to the shared directory. 2019-07-24 18:44:35 (31770): Create VM. (boinc_bca66c9b385b73ab, slot#1) 2019-07-24 18:44:35 (31770): Setting Memory Size for VM. (1896MB) 2019-07-24 18:44:35 (31770): Setting CPU Count for VM. (1) 2019-07-24 18:44:35 (31770): Setting Chipset Options for VM. 2019-07-24 18:44:35 (31770): Setting Boot Options for VM. 2019-07-24 18:44:35 (31770): Setting Network Configuration for NAT. 2019-07-24 18:44:35 (31770): Enabling VM Network Access. 2019-07-24 18:44:35 (31770): Disabling USB Support for VM. 2019-07-24 18:44:35 (31770): Disabling COM Port Support for VM. 2019-07-24 18:44:36 (31770): Disabling LPT Port Support for VM. 2019-07-24 18:44:36 (31770): Disabling Audio Support for VM. 2019-07-24 18:44:36 (31770): Disabling Clipboard Support for VM. 2019-07-24 18:44:36 (31770): Disabling Drag and Drop Support for VM. 2019-07-24 18:44:36 (31770): Adding storage controller(s) to VM. 2019-07-24 18:44:36 (31770): Adding virtual disk drive to VM. (vm_image.vdi) 2019-07-24 18:44:36 (31770): Adding VirtualBox Guest Additions to VM. 2019-07-24 18:44:36 (31770): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2019-07-24 18:44:36 (31770): forwarding host port 55017 to guest port 80 2019-07-24 18:44:36 (31770): Enabling remote desktop for VM. 2019-07-24 18:44:36 (31770): Enabling shared directory for VM. 2019-07-24 18:44:36 (31770): Starting VM. (boinc_bca66c9b385b73ab, slot#1) 2019-07-24 18:44:38 (31770): Successfully started VM. (PID = '32265') 2019-07-24 18:44:38 (31770): Reporting VM Process ID to BOINC. 2019-07-24 18:44:38 (31770): Guest Log: BIOS: VirtualBox 6.0.8 2019-07-24 18:44:38 (31770): Guest Log: CPUID EDX: 0x178bfbff 2019-07-24 18:44:38 (31770): Guest Log: BIOS: ata0-0: PCHS=16383/16/63 LCHS=1024/255/63 2019-07-24 18:44:38 (31770): VM state change detected. (old = 'poweroff', new = 'running') 2019-07-24 18:44:38 (31770): Detected: Web Application Enabled (http://localhost:55017) 2019-07-24 18:44:38 (31770): Detected: Remote Desktop Enabled (localhost:34537) 2019-07-24 18:44:38 (31770): Preference change detected 2019-07-24 18:44:38 (31770): Setting CPU throttle for VM. (100%) 2019-07-24 18:44:38 (31770): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 600 seconds)) 2019-07-24 18:44:40 (31770): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2019-07-24 18:44:40 (31770): Guest Log: BIOS: Booting from Hard Disk... 2019-07-24 18:44:42 (31770): Guest Log: BIOS: KBD: unsupported int 16h function 03 2019-07-24 18:44:42 (31770): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2019-07-24 18:45:07 (31770): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2019-07-24 18:45:07 (31770): Guest Log: vboxguest: misc device minor 56, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2019-07-24 18:45:32 (31770): Guest Log: VBoxService 5.2.6 r120293 (verbosity: 0) linux.amd64 (Jan 15 2018 14:51:00) release log 2019-07-24 18:45:32 (31770): Guest Log: 00:00:00.000302 main Log opened 2019-07-24T16:45:31.726145000Z 2019-07-24 18:45:32 (31770): Guest Log: 00:00:00.000831 main OS Product: Linux 2019-07-24 18:45:32 (31770): Guest Log: 00:00:00.000897 main OS Release: 4.14.44-11.cernvm.x86_64 2019-07-24 18:45:32 (31770): Guest Log: 00:00:00.000961 main OS Version: #1 SMP Mon May 28 16:49:00 CEST 2018 2019-07-24 18:45:32 (31770): Guest Log: 00:00:00.001001 main Executable: /usr/share/vboxguest52/usr/sbin/VBoxService 2019-07-24 18:45:32 (31770): Guest Log: 00:00:00.001003 main Process ID: 2977 2019-07-24 18:45:32 (31770): Guest Log: 00:00:00.001004 main Package type: LINUX_64BITS_GENERIC 2019-07-24 18:45:32 (31770): Guest Log: 00:00:00.002532 main 5.2.6 r120293 started. Verbose level = 0 2019-07-24 18:45:56 (31770): Guest Log: [INFO] Mounting the shared directory 2019-07-24 18:45:56 (31770): Guest Log: [INFO] Shared directory mounted, enabling vboxmonitor 2019-07-24 18:45:56 (31770): Guest Log: [DEBUG] Testing network connection to cern.ch on port 80 2019-07-24 18:45:56 (31770): Guest Log: [DEBUG] Connection to cern.ch 80 port [tcp/http] succeeded! 2019-07-24 18:45:56 (31770): Guest Log: [DEBUG] 0 2019-07-24 18:45:56 (31770): Guest Log: [DEBUG] Testing VCCS connection to vccs.cern.ch on port 443 2019-07-24 18:45:56 (31770): Guest Log: [DEBUG] Connection to vccs.cern.ch 443 port [tcp/https] succeeded! 2019-07-24 18:45:57 (31770): Guest Log: [DEBUG] 0 2019-07-24 18:45:57 (31770): Guest Log: [DEBUG] Testing connection to Condor server on port 9618 2019-07-24 18:45:57 (31770): Guest Log: [DEBUG] Connection to vccondor01.cern.ch 9618 port [tcp/condor] succeeded! 2019-07-24 18:45:57 (31770): Guest Log: [DEBUG] 0 2019-07-24 18:47:03 (31770): Guest Log: [DEBUG] Probing CVMFS ... 2019-07-24 18:47:06 (31770): Guest Log: Probing /cvmfs/grid.cern.ch... OK 2019-07-24 18:47:07 (31770): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2019-07-24 18:47:07 (31770): Guest Log: 2.4.4.0 3716 1 25912 9821 3 1 1454385 10240001 2 65024 0 3 100 2 14 http://s1bnl-cvmfs.openhtc.io/cvmfs/grid.cern.ch http://137.138.77.28:3128 1 2019-07-24 18:47:12 (31770): Guest Log: [INFO] Reading volunteer information 2019-07-24 18:47:12 (31770): Guest Log: [INFO] Volunteer: Laurence (2) 2019-07-24 18:47:12 (31770): Guest Log: [INFO] VMID: c5ab4400-4ef6-44a9-aaed-bee78432355d 2019-07-24 18:47:13 (31770): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2019-07-24 18:47:13 (31770): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2019-07-24 18:47:14 (31770): Guest Log: [INFO] Running the fast benchmark. 2019-07-24 18:48:13 (31770): Guest Log: [INFO] Machine performance 8.51 HEPSPEC06 2019-07-24 18:48:13 (31770): Guest Log: [INFO] CMS application starting. Check log files. 2019-07-24 18:48:13 (31770): Guest Log: [DEBUG] HTCondor ping 2019-07-24 18:48:14 (31770): Guest Log: [DEBUG] 0 2019-07-24 18:58:22 (31770): Guest Log: Did the tarball get created? 2019-07-24 18:58:22 (31770): Guest Log: /tmp/CMS_699164_1563886140.487300_0.tgz 2019-07-24 18:58:22 (31770): Guest Log: Here is the upload output 2019-07-24 18:58:22 (31770): Guest Log: Here is the upload error 2019-07-24 18:58:22 (31770): Guest Log: Here is the condor directory 2019-07-24 18:58:22 (31770): Guest Log: MasterLog 2019-07-24 18:58:22 (31770): Guest Log: ProcLog 2019-07-24 18:58:22 (31770): Guest Log: StartdHistoryLog 2019-07-24 18:58:22 (31770): Guest Log: StarterLog 2019-07-24 18:58:22 (31770): Guest Log: StartLog 2019-07-24 18:58:22 (31770): Guest Log: XferStatsLog 2019-07-24 18:58:22 (31770): Guest Log: Here is the MasterLog 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ****************************************************** 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ** condor_master (CONDOR_MASTER) STARTING UP 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ** /usr/sbin/condor_master 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ** $CondorPlatform: x86_64_RedHat6 $ 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ** PID = 6393 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ** Log last touched time unavailable (No such file or directory) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 ****************************************************** 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 Using config source: /etc/condor/condor_config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 Using local config sources: 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/10_security.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/14_network.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/20_workernode.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/30_lease.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/35_cms.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/40_ccb.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/62-benchmark.conf 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 /etc/condor/condor_config.local 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 config Macros = 170, Sorted = 170, StringBytes = 6777, TablesBytes = 6224 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 CLASSAD_CACHING is OFF 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 Daemon Log is logging: D_ALWAYS D_ERROR 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 Daemoncore: Listening at <10.0.2.15:36451> on TCP (ReliSock). 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 DaemonCore: command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451&noUDP> 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 DaemonCore: private command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451> 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#121706 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:47 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 6613 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:57 Setting ready state 'Ready' for STARTD 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:51:48 Preen pid is 15974 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:51:48 DefaultReaper unexpectedly called on pid 15974, status 0. 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 11:19:49 Sent SIGQUIT to STARTD (pid 6613) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 11:19:49 AllReaper unexpectedly called on pid 6613, status 0. 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 11:19:49 The STARTD (pid 6613) exited with status 0 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 11:19:49 All daemons are gone. Exiting. 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 11:19:49 **** condor_master (condor_MASTER) pid 6393 EXITING WITH STATUS 0 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ****************************************************** 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ** condor_master (CONDOR_MASTER) STARTING UP 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ** /usr/sbin/condor_master 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ** $CondorPlatform: x86_64_RedHat6 $ 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ** PID = 4523 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ** Log last touched 7/24 18:48:13 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 ****************************************************** 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 Using config source: /etc/condor/condor_config 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 Using local config sources: 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 /etc/condor/config.d/10_security.config 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 /etc/condor/config.d/14_network.config 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 /etc/condor/config.d/20_workernode.config 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 /etc/condor/config.d/30_lease.config 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 /etc/condor/config.d/35_cms.config 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 /etc/condor/config.d/40_ccb.config 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 /etc/condor/config.d/62-benchmark.conf 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 /etc/condor/condor_config.local 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 config Macros = 170, Sorted = 170, StringBytes = 6782, TablesBytes = 6224 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 CLASSAD_CACHING is OFF 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 Daemon Log is logging: D_ALWAYS D_ERROR 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 Daemoncore: Listening at <10.0.2.15:32813> on TCP (ReliSock). 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 DaemonCore: command socket at <10.0.2.15:32813?addrs=10.0.2.15-32813&noUDP> 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 DaemonCore: private command socket at <10.0.2.15:32813?addrs=10.0.2.15-32813> 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 127.0.0.1:9618?addrs=127.0.0.1-9618#4112 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:13 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:14 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 4533 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:48:20 Setting ready state 'Ready' for STARTD 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:58:17 Got SIGTERM. Performing graceful shutdown. 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:58:17 Sent SIGTERM to STARTD (pid 4533) 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:58:17 AllReaper unexpectedly called on pid 4533, status 0. 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:58:17 The STARTD (pid 4533) exited with status 0 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:58:17 All daemons are gone. Exiting. 2019-07-24 18:58:22 (31770): Guest Log: 07/24/19 18:58:17 **** condor_master (condor_MASTER) pid 4523 EXITING WITH STATUS 0 2019-07-24 18:58:22 (31770): Guest Log: Here is the KernelTuning.log 2019-07-24 18:58:22 (31770): Guest Log: Here is the StartLog 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ****************************************************** 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ** condor_startd (CONDOR_STARTD) STARTING UP 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ** /usr/sbin/condor_startd 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ** SubsystemInfo: name=STARTD type=STARTD(7) class=DAEMON(1) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ** Configuration: subsystem:STARTD local:<NONE> class:DAEMON 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ** $CondorPlatform: x86_64_RedHat6 $ 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ** PID = 6613 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ** Log last touched time unavailable (No such file or directory) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 ****************************************************** 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 Using config source: /etc/condor/condor_config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 Using local config sources: 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/10_security.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/14_network.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/20_workernode.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/30_lease.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/35_cms.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/40_ccb.config 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 /etc/condor/config.d/62-benchmark.conf 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 /etc/condor/condor_config.local 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 config Macros = 171, Sorted = 171, StringBytes = 6803, TablesBytes = 6260 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 CLASSAD_CACHING is ENABLED 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 Daemon Log is logging: D_ALWAYS D_ERROR 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 Daemoncore: Listening at <10.0.2.15:38681> on TCP (ReliSock). 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 DaemonCore: command socket at <10.0.2.15:38681?addrs=10.0.2.15-38681&noUDP> 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 DaemonCore: private command socket at <10.0.2.15:38681?addrs=10.0.2.15-38681> 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:48 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#121707 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 VM-gahp server reported an internal error 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 VM universe will be tested to check if it is available 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 History file rotation is enabled. 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 Maximum history file size is: 20971520 bytes 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 Number of rotated history files is: 2 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2019-07-24 18:58:22 (31770): Guest Log: slot type 0: Cpus: 1.000000, Memory: 3000, Swap: 100.00%, Disk: 100.00% 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 New machine resource allocated 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 Setting up slot pairings 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'multicore' 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'mips' 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'kflops' 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 State change: IS_OWNER is false 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 Changing state: Owner -> Unclaimed 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 State change: RunBenchmarks is TRUE 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 Changing activity: Idle -> Benchmarking 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:54 BenchMgr:StartBenchmarks() 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:57 Initial update sent to collector(s) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:51:57 Sending DC_SET_READY message to master <10.0.2.15:36451?addrs=10.0.2.15-36451> 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:01 Request accepted. 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:01 Remote owner is cmst1@cms 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:01 State change: claiming protocol successful 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:01 Changing state and activity: Unclaimed/Benchmarking -> Claimed/Idle 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:02 Got activate_claim request from shadow (137.138.52.94) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:02 Remote job ID is 105057.6 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:02 Got universe "VANILLA" (5) from request classad 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:02 State change: claim-activation protocol successful 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:02 Changing activity: Idle -> Busy 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 09:52:16 State change: benchmarks completed 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:51:48 PERMISSION DENIED to gsi@unmapped from host 10.0.2.15 for command 448 (GIVE_STATE), access level READ: reason: READ authorization policy contains no matching ALLOW entry for this request; identifiers used for this host: 10.0.2.15, hostname size = 0, original ip address = 10.0.2.15 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:51:48 DC_AUTHENTICATE: Command not authorized, done! 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:35 Called deactivate_claim_forcibly() 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:35 Got activate claim while starter is still alive. 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:35 Telling shadow to try again later. 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:35 Starter pid 10357 exited with status 0 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:35 State change: starter exited 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:35 Changing activity: Busy -> Idle 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:36 Got activate_claim request from shadow (137.138.52.94) 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:36 Remote job ID is 105090.4 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:36 Got universe "VANILLA" (5) from request classad 2019-07-24 18:58:22 (31770): Guest Log: 03/25/19 10:55:36 State change: claim-activation protocol successful 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 10:55:36 Changing activity: Idle -> Busy 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 shutdown fast 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Killing job multicore 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Killing job mips 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Killing job kflops 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Changing state and activity: Claimed/Busy -> Preempting/Killing 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Got DEACTIVATE_CLAIM while in Preempting state, ignoring. 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Got RELEASE_CLAIM while in Preempting state, ignoring. 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Starter pid 16322 exited with status 0 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 State change: starter exited 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 State change: No preempting claim, returning to owner 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Changing state and activity: Preempting/Killing -> Owner/Idle 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 State change: IS_OWNER is false 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Changing state: Owner -> Unclaimed 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Deleting cron job manager 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Killing job multicore 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Killing job multicore 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'multicore' 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Deleting benchmark job mgr 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Killing job mips 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Killing job kflops 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Killing job mips 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Killing job kflops 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'mips' 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'kflops' 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 All resources are free, exiting. 2019-07-24 18:58:23 (31770): Guest Log: 03/25/19 11:19:49 **** condor_startd (condor_STARTD) pid 6613 EXITING WITH STATUS 0 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ****************************************************** 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ** condor_startd (CONDOR_STARTD) STARTING UP 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ** /usr/sbin/condor_startd 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ** SubsystemInfo: name=STARTD type=STARTD(7) class=DAEMON(1) 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ** Configuration: subsystem:STARTD local:<NONE> class:DAEMON 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ** $CondorPlatform: x86_64_RedHat6 $ 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ** PID = 4533 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ** Log last touched 7/24 18:48:13 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 ****************************************************** 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 Using config source: /etc/condor/condor_config 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 Using local config sources: 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 /etc/condor/config.d/10_security.config 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 /etc/condor/config.d/14_network.config 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 /etc/condor/config.d/20_workernode.config 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 /etc/condor/config.d/30_lease.config 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 /etc/condor/config.d/35_cms.config 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 /etc/condor/config.d/40_ccb.config 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 /etc/condor/config.d/62-benchmark.conf 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 /etc/condor/condor_config.local 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 config Macros = 171, Sorted = 171, StringBytes = 6808, TablesBytes = 6260 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 CLASSAD_CACHING is ENABLED 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 Daemon Log is logging: D_ALWAYS D_ERROR 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 Daemoncore: Listening at <10.0.2.15:38513> on TCP (ReliSock). 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 DaemonCore: command socket at <10.0.2.15:38513?addrs=10.0.2.15-38513&noUDP> 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 DaemonCore: private command socket at <10.0.2.15:38513?addrs=10.0.2.15-38513> 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:14 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 127.0.0.1:9618?addrs=127.0.0.1-9618#4113 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 VM-gahp server reported an internal error 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 VM universe will be tested to check if it is available 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 History file rotation is enabled. 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 Maximum history file size is: 20971520 bytes 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 Number of rotated history files is: 2 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2019-07-24 18:58:23 (31770): Guest Log: slot type 0: Cpus: 1.000000, Memory: 3000, Swap: 100.00%, Disk: 100.00% 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 New machine resource allocated 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 Setting up slot pairings 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 CronJobList: Adding job 'multicore' 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:16 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:17 CronJobList: Adding job 'mips' 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:17 CronJobList: Adding job 'kflops' 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:17 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:17 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:17 State change: IS_OWNER is false 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:17 Changing state: Owner -> Unclaimed 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:17 State change: RunBenchmarks is TRUE 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:17 Changing activity: Idle -> Benchmarking 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:17 BenchMgr:StartBenchmarks() 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:20 Initial update sent to collector(s) 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:20 Sending DC_SET_READY message to master <10.0.2.15:32813?addrs=10.0.2.15-32813> 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:41 State change: benchmarks completed 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:48:41 Changing activity: Benchmarking -> Idle 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 No resources have been claimed for 600 seconds 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Shutting down Condor on this machine. 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Got SIGTERM. Performing graceful shutdown. 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 shutdown graceful 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Killing job multicore 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Killing job mips 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Killing job kflops 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Deleting cron job manager 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Killing job multicore 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Killing job multicore 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJobList: Deleting all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJobList: Deleting job 'multicore' 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJobList: Deleting all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Deleting benchmark job mgr 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Killing job mips 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Killing job kflops 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Killing job mips 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Killing job kflops 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJobList: Deleting all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJobList: Deleting job 'mips' 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJobList: Deleting job 'kflops' 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 Cron: Killing all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 CronJobList: Deleting all jobs 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 All resources are free, exiting. 2019-07-24 18:58:23 (31770): Guest Log: 07/24/19 18:58:17 **** condor_startd (condor_STARTD) pid 4533 EXITING WITH STATUS 0 2019-07-24 18:58:23 (31770): Guest Log: [ERROR] No jobs were available to run. 2019-07-24 18:58:23 (31770): Guest Log: [INFO] Shutting Down. 2019-07-24 18:58:23 (31770): VM Completion File Detected. 2019-07-24 18:58:23 (31770): VM Completion Message: No jobs were available to run. . 2019-07-24 18:58:23 (31770): Powering off VM. 2019-07-24 18:58:23 (31770): Successfully stopped VM. 2019-07-24 18:58:23 (31770): Deregistering VM. (boinc_bca66c9b385b73ab, slot#1) 2019-07-24 18:58:23 (31770): Removing network bandwidth throttle group from VM. 2019-07-24 18:58:23 (31770): Removing storage controller(s) from VM. 2019-07-24 18:58:23 (31770): Removing VM from VirtualBox. 2019-07-24 18:58:23 (31770): Removing virtual disk drive from VirtualBox. 18:58:28 (31770): called boinc_finish(207) </stderr_txt> ]]>
©2024 CERN