Name | CMS_3963839_1583318426.646535_0 |
Workunit | 1991711 |
Created | 4 Mar 2020, 10:40:30 UTC |
Sent | 8 Mar 2020, 11:30:34 UTC |
Report deadline | 15 Mar 2020, 11:30:34 UTC |
Received | 8 Mar 2020, 11:50:45 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 207 (0x000000CF) EXIT_NO_SUB_TASKS |
Computer ID | 3625 |
Run time | 17 min 42 sec |
CPU time | 6 min 1 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 2.31 GFLOPS |
Application version | CMS Simulation v49.00 (vbox64_mt_mcore_cms) x86_64-pc-linux-gnu |
Peak working set size | 107.34 MB |
Peak swap size | 2.66 GB |
Peak disk usage | 2.81 GB |
<core_client_version>7.17.0</core_client_version> <![CDATA[ <message> process exited with code 207 (0xcf, -49)</message> <stderr_txt> 2020-03-08 12:31:54 (920938): vboxwrapper (7.7.26196): starting 2020-03-08 12:31:55 (920938): Feature: Checkpoint interval offset (140 seconds) 2020-03-08 12:31:55 (920938): Detected: VirtualBox VboxManage Interface (Version: 6.1.4) 2020-03-08 12:31:56 (920938): Detected: Minimum checkpoint interval (600.000000 seconds) 2020-03-08 12:31:56 (920938): Detected: Heartbeat check (file: 'heartbeat' every 1200.000000 seconds) 2020-03-08 12:31:56 (920938): Successfully copied 'init_data.xml' to the shared directory. 2020-03-08 12:31:56 (920938): Create VM. (boinc_58d5bd76dfbcc271, slot#11) 2020-03-08 12:31:57 (920938): Setting Memory Size for VM. (1896MB) 2020-03-08 12:31:57 (920938): Setting CPU Count for VM. (1) 2020-03-08 12:31:57 (920938): Setting Chipset Options for VM. 2020-03-08 12:31:58 (920938): Setting Boot Options for VM. 2020-03-08 12:31:58 (920938): Setting Network Configuration for NAT. 2020-03-08 12:31:58 (920938): Enabling VM Network Access. 2020-03-08 12:31:58 (920938): Disabling USB Support for VM. 2020-03-08 12:31:58 (920938): Disabling COM Port Support for VM. 2020-03-08 12:31:59 (920938): Disabling LPT Port Support for VM. 2020-03-08 12:31:59 (920938): Disabling Audio Support for VM. 2020-03-08 12:31:59 (920938): Disabling Clipboard Support for VM. 2020-03-08 12:31:59 (920938): Disabling Drag and Drop Support for VM. 2020-03-08 12:31:59 (920938): Adding storage controller(s) to VM. 2020-03-08 12:32:00 (920938): Adding virtual disk drive to VM. (vm_image.vdi) 2020-03-08 12:32:00 (920938): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2020-03-08 12:32:00 (920938): forwarding host port 39157 to guest port 80 2020-03-08 12:32:01 (920938): Enabling remote desktop for VM. 2020-03-08 12:32:01 (920938): Enabling shared directory for VM. 2020-03-08 12:32:02 (920938): Starting VM. (boinc_58d5bd76dfbcc271, slot#11) 2020-03-08 12:32:04 (920938): Successfully started VM. (PID = '921449') 2020-03-08 12:32:04 (920938): Reporting VM Process ID to BOINC. 2020-03-08 12:32:04 (920938): Guest Log: BIOS: VirtualBox 6.1.3 2020-03-08 12:32:04 (920938): Guest Log: CPUID EDX: 0x178bfbff 2020-03-08 12:32:04 (920938): Guest Log: BIOS: ata0-0: PCHS=16383/16/63 LCHS=1024/255/63 2020-03-08 12:32:04 (920938): VM state change detected. (old = 'poweroff', new = 'running') 2020-03-08 12:32:04 (920938): Detected: Web Application Enabled (http://localhost:39157) 2020-03-08 12:32:04 (920938): Detected: Remote Desktop Enabled (localhost:33943) 2020-03-08 12:32:04 (920938): Preference change detected 2020-03-08 12:32:04 (920938): Setting CPU throttle for VM. (100%) 2020-03-08 12:32:05 (920938): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 120 seconds) or (Vbox_job.xml: 600 seconds)) 2020-03-08 12:32:06 (920938): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2020-03-08 12:32:06 (920938): Guest Log: BIOS: Booting from Hard Disk... 2020-03-08 12:32:11 (920938): Guest Log: BIOS: KBD: unsupported int 16h function 03 2020-03-08 12:32:11 (920938): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2020-03-08 12:32:38 (920938): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2020-03-08 12:32:38 (920938): Guest Log: vboxguest: misc device minor 56, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2020-03-08 12:33:29 (920938): Guest Log: VBoxService 5.2.6 r120293 (verbosity: 0) linux.amd64 (Jan 15 2018 14:51:00) release log 2020-03-08 12:33:29 (920938): Guest Log: 00:00:00.004724 main Log opened 2020-03-08T11:33:28.285299000Z 2020-03-08 12:33:29 (920938): Guest Log: 00:00:00.005544 main OS Product: Linux 2020-03-08 12:33:29 (920938): Guest Log: 00:00:00.005680 main OS Release: 4.14.44-11.cernvm.x86_64 2020-03-08 12:33:29 (920938): Guest Log: 00:00:00.005783 main OS Version: #1 SMP Mon May 28 16:49:00 CEST 2018 2020-03-08 12:33:29 (920938): Guest Log: 00:00:00.006063 main Executable: /usr/share/vboxguest52/usr/sbin/VBoxService 2020-03-08 12:33:29 (920938): Guest Log: 00:00:00.006066 main Process ID: 2900 2020-03-08 12:33:29 (920938): Guest Log: 00:00:00.006068 main Package type: LINUX_64BITS_GENERIC 2020-03-08 12:33:29 (920938): Guest Log: 00:00:00.035626 main 5.2.6 r120293 started. Verbose level = 0 2020-03-08 12:34:31 (920938): Guest Log: [INFO] Mounting the shared directory 2020-03-08 12:34:31 (920938): Guest Log: [INFO] Shared directory mounted, enabling vboxmonitor 2020-03-08 12:34:31 (920938): Guest Log: [DEBUG] Testing network connection to cern.ch on port 80 2020-03-08 12:34:31 (920938): Guest Log: [DEBUG] Connection to cern.ch 80 port [tcp/http] succeeded! 2020-03-08 12:34:31 (920938): Guest Log: [DEBUG] 0 2020-03-08 12:34:31 (920938): Guest Log: [DEBUG] Testing VCCS connection to vccs.cern.ch on port 443 2020-03-08 12:34:32 (920938): Guest Log: [DEBUG] Connection to vccs.cern.ch 443 port [tcp/https] succeeded! 2020-03-08 12:34:32 (920938): Guest Log: [DEBUG] 0 2020-03-08 12:34:32 (920938): Guest Log: [DEBUG] Testing connection to Condor server on port 9618 2020-03-08 12:34:32 (920938): Guest Log: [DEBUG] Connection to vocms0840.cern.ch 9618 port [tcp/condor] succeeded! 2020-03-08 12:34:32 (920938): Guest Log: [DEBUG] 0 2020-03-08 12:35:50 (920938): Guest Log: [DEBUG] Probing CVMFS ... 2020-03-08 12:35:54 (920938): Guest Log: Probing /cvmfs/grid.cern.ch... OK 2020-03-08 12:35:56 (920938): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2020-03-08 12:35:56 (920938): Guest Log: 2.4.4.0 3629 1 25840 11671 3 1 1460701 10240001 2 65024 0 3 100 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/grid.cern.ch DIRECT 1 2020-03-08 12:36:06 (920938): Guest Log: [INFO] Reading volunteer information 2020-03-08 12:36:06 (920938): Guest Log: [INFO] Volunteer: Ralfy (165) 2020-03-08 12:36:06 (920938): Guest Log: [INFO] VMID: c5ab4400-4ef6-44a9-aaed-bee78432355d 2020-03-08 12:36:07 (920938): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2020-03-08 12:36:07 (920938): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2020-03-08 12:36:12 (920938): Guest Log: [INFO] Running the fast benchmark. 2020-03-08 12:39:07 (920938): Guest Log: [INFO] Machine performance 3.25 HEPSPEC06 2020-03-08 12:39:07 (920938): Guest Log: [INFO] CMS application starting. Check log files. 2020-03-08 12:39:09 (920938): Guest Log: [DEBUG] HTCondor ping 2020-03-08 12:39:10 (920938): Guest Log: [DEBUG] 0 2020-03-08 12:49:24 (920938): Guest Log: Did the tarball get created? 2020-03-08 12:49:24 (920938): Guest Log: /tmp/CMS_3963839_1583318426.646535_0.tgz 2020-03-08 12:49:24 (920938): Guest Log: Here is the upload output 2020-03-08 12:49:24 (920938): Guest Log: Here is the upload error 2020-03-08 12:49:24 (920938): Guest Log: Here is the condor directory 2020-03-08 12:49:24 (920938): Guest Log: MasterLog 2020-03-08 12:49:24 (920938): Guest Log: ProcLog 2020-03-08 12:49:24 (920938): Guest Log: StartdHistoryLog 2020-03-08 12:49:24 (920938): Guest Log: StarterLog 2020-03-08 12:49:24 (920938): Guest Log: StartLog 2020-03-08 12:49:24 (920938): Guest Log: XferStatsLog 2020-03-08 12:49:24 (920938): Guest Log: Here is the MasterLog 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ****************************************************** 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ** condor_master (CONDOR_MASTER) STARTING UP 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ** /usr/sbin/condor_master 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ** $CondorPlatform: x86_64_RedHat6 $ 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ** PID = 6393 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ** Log last touched time unavailable (No such file or directory) 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 ****************************************************** 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 Using config source: /etc/condor/condor_config 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 Using local config sources: 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/10_security.config 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/14_network.config 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/20_workernode.config 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/30_lease.config 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/35_cms.config 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/40_ccb.config 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/62-benchmark.conf 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 /etc/condor/condor_config.local 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 config Macros = 170, Sorted = 170, StringBytes = 6777, TablesBytes = 6224 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 CLASSAD_CACHING is OFF 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 Daemon Log is logging: D_ALWAYS D_ERROR 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 Daemoncore: Listening at <10.0.2.15:36451> on TCP (ReliSock). 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 DaemonCore: command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451&noUDP> 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 DaemonCore: private command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451> 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#121706 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:47 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:48 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 6613 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 09:51:57 Setting ready state 'Ready' for STARTD 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 10:51:48 Preen pid is 15974 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 10:51:48 DefaultReaper unexpectedly called on pid 15974, status 0. 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 11:19:49 Sent SIGQUIT to STARTD (pid 6613) 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 11:19:49 AllReaper unexpectedly called on pid 6613, status 0. 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 11:19:49 The STARTD (pid 6613) exited with status 0 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 11:19:49 All daemons are gone. Exiting. 2020-03-08 12:49:24 (920938): Guest Log: 03/25/19 11:19:49 **** condor_master (condor_MASTER) pid 6393 EXITING WITH STATUS 0 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ****************************************************** 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ** condor_master (CONDOR_MASTER) STARTING UP 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ** /usr/sbin/condor_master 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ** $CondorPlatform: x86_64_RedHat6 $ 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ** PID = 4442 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ** Log last touched 3/8 12:39:10 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 ****************************************************** 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 Using config source: /etc/condor/condor_config 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 Using local config sources: 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 /etc/condor/config.d/10_security.config 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 /etc/condor/config.d/14_network.config 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 /etc/condor/config.d/20_workernode.config 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 /etc/condor/config.d/30_lease.config 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 /etc/condor/config.d/35_cms.config 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 /etc/condor/config.d/40_ccb.config 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 /etc/condor/config.d/62-benchmark.conf 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 /etc/condor/condor_config.local 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 config Macros = 170, Sorted = 170, StringBytes = 6795, TablesBytes = 6224 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 CLASSAD_CACHING is OFF 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 Daemon Log is logging: D_ALWAYS D_ERROR 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 Daemoncore: Listening at <10.0.2.15:46449> on TCP (ReliSock). 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 DaemonCore: command socket at <10.0.2.15:46449?addrs=10.0.2.15-46449&noUDP> 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:10 DaemonCore: private command socket at <10.0.2.15:46449?addrs=10.0.2.15-46449> 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:11 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#1964189 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:12 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:12 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 4452 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:39:22 Setting ready state 'Ready' for STARTD 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:49:20 Got SIGTERM. Performing graceful shutdown. 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:49:20 Sent SIGTERM to STARTD (pid 4452) 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:49:20 AllReaper unexpectedly called on pid 4452, status 0. 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:49:20 The STARTD (pid 4452) exited with status 0 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:49:20 All daemons are gone. Exiting. 2020-03-08 12:49:24 (920938): Guest Log: 03/08/20 12:49:20 **** condor_master (condor_MASTER) pid 4442 EXITING WITH STATUS 0 2020-03-08 12:49:24 (920938): Guest Log: Here is the KernelTuning.log 2020-03-08 12:49:24 (920938): Guest Log: Here is the StartLog 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 Number of rotated history files is: 2 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2020-03-08 12:49:27 (920938): Guest Log: slot type 0: Cpus: 1.000000, Memory: 3000, Swap: 100.00%, Disk: 100.00% 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 New machine resource allocated 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 Setting up slot pairings 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'multicore' 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'mips' 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'kflops' 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 State change: IS_OWNER is false 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 Changing state: Owner -> Unclaimed 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 State change: RunBenchmarks is TRUE 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 Changing activity: Idle -> Benchmarking 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:54 BenchMgr:StartBenchmarks() 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:57 Initial update sent to collector(s) 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:51:57 Sending DC_SET_READY message to master <10.0.2.15:36451?addrs=10.0.2.15-36451> 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:01 Request accepted. 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:01 Remote owner is cmst1@cms 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:01 State change: claiming protocol successful 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:01 Changing state and activity: Unclaimed/Benchmarking -> Claimed/Idle 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:02 Got activate_claim request from shadow (137.138.52.94) 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:02 Remote job ID is 105057.6 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:02 Got universe "VANILLA" (5) from request classad 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:02 State change: claim-activation protocol successful 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:02 Changing activity: Idle -> Busy 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 09:52:16 State change: benchmarks completed 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:51:48 PERMISSION DENIED to gsi@unmapped from host 10.0.2.15 for command 448 (GIVE_STATE), access level READ: reason: READ authorization policy contains no matching ALLOW entry for this request; identifiers used for this host: 10.0.2.15, hostname size = 0, original ip address = 10.0.2.15 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:51:48 DC_AUTHENTICATE: Command not authorized, done! 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:35 Called deactivate_claim_forcibly() 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:35 Got activate claim while starter is still alive. 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:35 Telling shadow to try again later. 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:35 Starter pid 10357 exited with status 0 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:35 State change: starter exited 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:35 Changing activity: Busy -> Idle 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:36 Got activate_claim request from shadow (137.138.52.94) 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:36 Remote job ID is 105090.4 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:36 Got universe "VANILLA" (5) from request classad 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:36 State change: claim-activation protocol successful 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 10:55:36 Changing activity: Idle -> Busy 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 shutdown fast 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Killing job multicore 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Killing job mips 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Killing job kflops 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Changing state and activity: Claimed/Busy -> Preempting/Killing 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Got DEACTIVATE_CLAIM while in Preempting state, ignoring. 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Got RELEASE_CLAIM while in Preempting state, ignoring. 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Starter pid 16322 exited with status 0 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 State change: starter exited 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 State change: No preempting claim, returning to owner 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Changing state and activity: Preempting/Killing -> Owner/Idle 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 State change: IS_OWNER is false 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Changing state: Owner -> Unclaimed 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Deleting cron job manager 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Killing job multicore 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Killing job multicore 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'multicore' 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Deleting benchmark job mgr 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Killing job mips 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Killing job kflops 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Killing job mips 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Killing job kflops 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'mips' 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'kflops' 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 All resources are free, exiting. 2020-03-08 12:49:27 (920938): Guest Log: 03/25/19 11:19:49 **** condor_startd (condor_STARTD) pid 6613 EXITING WITH STATUS 0 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ****************************************************** 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ** condor_startd (CONDOR_STARTD) STARTING UP 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ** /usr/sbin/condor_startd 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ** SubsystemInfo: name=STARTD type=STARTD(7) class=DAEMON(1) 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ** Configuration: subsystem:STARTD local:<NONE> class:DAEMON 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ** $CondorPlatform: x86_64_RedHat6 $ 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ** PID = 4452 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ** Log last touched 3/8 12:39:10 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 ****************************************************** 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 Using config source: /etc/condor/condor_config 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 Using local config sources: 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 /etc/condor/config.d/10_security.config 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 /etc/condor/config.d/14_network.config 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 /etc/condor/config.d/20_workernode.config 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 /etc/condor/config.d/30_lease.config 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 /etc/condor/config.d/35_cms.config 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 /etc/condor/config.d/40_ccb.config 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 /etc/condor/config.d/62-benchmark.conf 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 /etc/condor/condor_config.local 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 config Macros = 171, Sorted = 171, StringBytes = 6821, TablesBytes = 6260 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 CLASSAD_CACHING is ENABLED 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 Daemon Log is logging: D_ALWAYS D_ERROR 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 Daemoncore: Listening at <10.0.2.15:37573> on TCP (ReliSock). 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 DaemonCore: command socket at <10.0.2.15:37573?addrs=10.0.2.15-37573&noUDP> 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:12 DaemonCore: private command socket at <10.0.2.15:37573?addrs=10.0.2.15-37573> 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:13 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#1964190 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 VM-gahp server reported an internal error 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 VM universe will be tested to check if it is available 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 History file rotation is enabled. 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 Maximum history file size is: 20971520 bytes 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 Number of rotated history files is: 2 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2020-03-08 12:49:27 (920938): Guest Log: slot type 0: Cpus: 1.000000, Memory: 3000, Swap: 100.00%, Disk: 100.00% 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 New machine resource allocated 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 Setting up slot pairings 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 CronJobList: Adding job 'multicore' 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 CronJobList: Adding job 'mips' 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 CronJobList: Adding job 'kflops' 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 State change: IS_OWNER is false 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 Changing state: Owner -> Unclaimed 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 State change: RunBenchmarks is TRUE 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 Changing activity: Idle -> Benchmarking 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:19 BenchMgr:StartBenchmarks() 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:22 Initial update sent to collector(s) 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:22 Sending DC_SET_READY message to master <10.0.2.15:46449?addrs=10.0.2.15-46449> 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:39 State change: benchmarks completed 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:39:39 Changing activity: Benchmarking -> Idle 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 No resources have been claimed for 600 seconds 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Shutting down Condor on this machine. 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Got SIGTERM. Performing graceful shutdown. 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 shutdown graceful 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Killing job multicore 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Killing job mips 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Killing job kflops 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Deleting cron job manager 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Killing job multicore 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJob: 'multicore': Trying to kill illegal PID 0 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Killing job multicore 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJob: 'multicore': Trying to kill illegal PID 0 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJobList: Deleting all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJobList: Deleting job 'multicore' 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJob: 'multicore': Trying to kill illegal PID 0 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJobList: Deleting all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Deleting benchmark job mgr 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Killing job mips 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Killing job kflops 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Killing job mips 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Killing job kflops 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJobList: Deleting all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJobList: Deleting job 'mips' 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJobList: Deleting job 'kflops' 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 Cron: Killing all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 CronJobList: Deleting all jobs 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 All resources are free, exiting. 2020-03-08 12:49:27 (920938): Guest Log: 03/08/20 12:49:20 **** condor_startd (condor_STARTD) pid 4452 EXITING WITH STATUS 0 2020-03-08 12:49:27 (920938): Guest Log: [ERROR] No jobs were available to run. 2020-03-08 12:49:27 (920938): Guest Log: [INFO] Shutting Down. 2020-03-08 12:49:27 (920938): VM Completion File Detected. 2020-03-08 12:49:27 (920938): VM Completion Message: No jobs were available to run. . 2020-03-08 12:49:27 (920938): Powering off VM. 2020-03-08 12:49:28 (920938): Successfully stopped VM. 2020-03-08 12:49:28 (920938): Deregistering VM. (boinc_58d5bd76dfbcc271, slot#11) 2020-03-08 12:49:28 (920938): Removing network bandwidth throttle group from VM. 2020-03-08 12:49:29 (920938): Removing storage controller(s) from VM. 2020-03-08 12:49:29 (920938): Removing VM from VirtualBox. 2020-03-08 12:49:29 (920938): Removing virtual disk drive from VirtualBox. 12:49:35 (920938): called boinc_finish(207) </stderr_txt> ]]>
©2024 CERN