Name | CMS_2881292_1582356899.305107_0 |
Workunit | 1987969 |
Created | 22 Feb 2020, 7:35:01 UTC |
Sent | 26 Feb 2020, 21:13:01 UTC |
Report deadline | 4 Mar 2020, 21:13:01 UTC |
Received | 28 Feb 2020, 12:14:30 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 207 (0x000000CF) EXIT_NO_SUB_TASKS |
Computer ID | 3564 |
Run time | 18 min 19 sec |
CPU time | 20 min 22 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 0.54 GFLOPS |
Application version | CMS Simulation v49.00 (vbox64_mt_mcore_cms) x86_64-pc-linux-gnu |
Peak working set size | 668.28 MB |
Peak swap size | 2.29 GB |
Peak disk usage | 2.81 GB |
<core_client_version>7.16.3</core_client_version> <![CDATA[ <message> process exited with code 207 (0xcf, -49)</message> <stderr_txt> 2020-02-28 03:12:04 (18207): vboxwrapper (7.7.26196): starting 2020-02-28 03:12:05 (18207): Feature: Checkpoint interval offset (31 seconds) 2020-02-28 03:12:05 (18207): Detected: VirtualBox VboxManage Interface (Version: 6.1.2) 2020-02-28 03:12:05 (18207): Detected: Minimum checkpoint interval (600.000000 seconds) 2020-02-28 03:12:05 (18207): Detected: Heartbeat check (file: 'heartbeat' every 1200.000000 seconds) 2020-02-28 03:12:05 (18207): Successfully copied 'init_data.xml' to the shared directory. 2020-02-28 03:12:05 (18207): Create VM. (boinc_a6aa4125fb177b4c, slot#3) 2020-02-28 03:12:06 (18207): Setting Memory Size for VM. (1199MB) 2020-02-28 03:12:06 (18207): Setting CPU Count for VM. (1) 2020-02-28 03:12:06 (18207): Setting Chipset Options for VM. 2020-02-28 03:12:06 (18207): Setting Boot Options for VM. 2020-02-28 03:12:07 (18207): Setting Network Configuration for NAT. 2020-02-28 03:12:07 (18207): Enabling VM Network Access. 2020-02-28 03:12:07 (18207): Disabling USB Support for VM. 2020-02-28 03:12:07 (18207): Disabling COM Port Support for VM. 2020-02-28 03:12:07 (18207): Disabling LPT Port Support for VM. 2020-02-28 03:12:07 (18207): Disabling Audio Support for VM. 2020-02-28 03:12:07 (18207): Disabling Clipboard Support for VM. 2020-02-28 03:12:07 (18207): Disabling Drag and Drop Support for VM. 2020-02-28 03:12:07 (18207): Adding storage controller(s) to VM. 2020-02-28 03:12:08 (18207): Adding virtual disk drive to VM. (vm_image.vdi) 2020-02-28 03:12:08 (18207): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB) 2020-02-28 03:12:08 (18207): forwarding host port 41657 to guest port 80 2020-02-28 03:12:08 (18207): Enabling remote desktop for VM. 2020-02-28 03:12:08 (18207): Required extension pack not installed, remote desktop not enabled. 2020-02-28 03:12:08 (18207): Enabling shared directory for VM. 2020-02-28 03:12:08 (18207): Starting VM. (boinc_a6aa4125fb177b4c, slot#3) 2020-02-28 03:12:10 (18207): Successfully started VM. (PID = '18414') 2020-02-28 03:12:10 (18207): Reporting VM Process ID to BOINC. 2020-02-28 03:12:11 (18207): Guest Log: BIOS: VirtualBox 6.1.1 2020-02-28 03:12:11 (18207): Guest Log: CPUID EDX: 0x178bfbff 2020-02-28 03:12:11 (18207): Guest Log: BIOS: ata0-0: PCHS=16383/16/63 LCHS=1024/255/63 2020-02-28 03:12:11 (18207): VM state change detected. (old = 'poweroff', new = 'running') 2020-02-28 03:12:11 (18207): Detected: Web Application Enabled (http://localhost:41657) 2020-02-28 03:12:11 (18207): Preference change detected 2020-02-28 03:12:11 (18207): Setting CPU throttle for VM. (100%) 2020-02-28 03:12:12 (18207): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 60 seconds) or (Vbox_job.xml: 600 seconds)) 2020-02-28 03:12:13 (18207): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032 2020-02-28 03:12:13 (18207): Guest Log: BIOS: Booting from Hard Disk... 2020-02-28 03:12:15 (18207): Guest Log: BIOS: KBD: unsupported int 16h function 03 2020-02-28 03:12:15 (18207): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 2020-02-28 03:12:42 (18207): Guest Log: vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds 2020-02-28 03:12:42 (18207): Guest Log: vboxguest: misc device minor 56, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000) 2020-02-28 03:13:48 (18207): Guest Log: VBoxService 5.2.6 r120293 (verbosity: 0) linux.amd64 (Jan 15 2018 14:51:00) release log 2020-02-28 03:13:48 (18207): Guest Log: 00:00:00.000540 main Log opened 2020-02-28T07:32:47.548753000Z 2020-02-28 03:13:48 (18207): Guest Log: 00:00:00.007058 main OS Product: Linux 2020-02-28 03:13:48 (18207): Guest Log: 00:00:00.007616 main OS Release: 4.14.44-11.cernvm.x86_64 2020-02-28 03:13:48 (18207): Guest Log: 00:00:00.007782 main OS Version: #1 SMP Mon May 28 16:49:00 CEST 2018 2020-02-28 03:13:48 (18207): Guest Log: 00:00:00.008067 main Executable: /usr/share/vboxguest52/usr/sbin/VBoxService 2020-02-28 03:13:48 (18207): Guest Log: 00:00:00.008073 main Process ID: 2899 2020-02-28 03:13:48 (18207): Guest Log: 00:00:00.008074 main Package type: LINUX_64BITS_GENERIC 2020-02-28 03:13:48 (18207): Guest Log: 00:00:00.069199 main 5.2.6 r120293 started. Verbose level = 0 2020-02-28 06:29:11 (18207): Guest Log: 03:13:50.663641 timesync vgsvcTimeSyncWorker: Radical host time change: 11 491 343 000 000ns (HostNow=1 582 867 622 018 000 000 ns HostLast=1 582 856 130 675 000 000 ns) 2020-02-28 06:29:11 (18207): Guest Log: 03:13:50.672873 timesync vgsvcTimeSyncWorker: Radical guest time change: 11 527 507 106 000ns (GuestNow=1 582 867 658 117 269 000 ns GuestLast=1 582 856 130 610 163 000 ns fSetTimeLastLoop=false) 2020-02-28 06:47:13 (18207): Guest Log: [INFO] Mounting the shared directory 2020-02-28 06:47:14 (18207): Guest Log: [INFO] Shared directory mounted, enabling vboxmonitor 2020-02-28 06:47:14 (18207): Guest Log: [DEBUG] Testing network connection to cern.ch on port 80 2020-02-28 06:47:14 (18207): Guest Log: [DEBUG] Connection to cern.ch 80 port [tcp/http] succeeded! 2020-02-28 06:47:14 (18207): Guest Log: [DEBUG] 0 2020-02-28 06:47:14 (18207): Guest Log: [DEBUG] Testing VCCS connection to vccs.cern.ch on port 443 2020-02-28 06:47:14 (18207): Guest Log: [DEBUG] Connection to vccs.cern.ch 443 port [tcp/https] succeeded! 2020-02-28 06:47:15 (18207): Guest Log: [DEBUG] 0 2020-02-28 06:47:15 (18207): Guest Log: [DEBUG] Testing connection to Condor server on port 9618 2020-02-28 06:47:15 (18207): Guest Log: [DEBUG] Connection to vocms0840.cern.ch 9618 port [tcp/condor] succeeded! 2020-02-28 06:47:15 (18207): Guest Log: [DEBUG] 0 2020-02-28 06:48:21 (18207): VM state change detected. (old = 'running', new = 'paused') 2020-02-28 07:40:43 (18207): VM state change detected. (old = 'paused', new = 'running') 2020-02-28 07:40:44 (18207): Guest Log: [DEBUG] Probing CVMFS ... 2020-02-28 07:40:45 (18207): Guest Log: 03:34:33.255739 timesync vgsvcTimeSyncWorker: Radical host time change: 3 150 275 000 000ns (HostNow=1 582 872 040 569 000 000 ns HostLast=1 582 868 890 294 000 000 ns) 2020-02-28 07:40:45 (18207): Guest Log: Probing /cvmfs/grid.cern.ch... OK 2020-02-28 07:40:47 (18207): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE 2020-02-28 07:40:47 (18207): Guest Log: 2.4.4.0 3648 53 25828 11597 -48 1 1460701 10240001 2 65024 0 3 100 0 0 http://s1ral-cvmfs.openhtc.io/cvmfs/grid.cern.ch DIRECT 1 2020-02-28 07:40:55 (18207): Guest Log: 03:34:43.257845 timesync vgsvcTimeSyncWorker: Radical guest time change: 3 149 863 768 000ns (GuestNow=1 582 872 050 572 115 000 ns GuestLast=1 582 868 900 708 347 000 ns fSetTimeLastLoop=true ) 2020-02-28 07:41:29 (18207): Guest Log: [INFO] Reading volunteer information 2020-02-28 07:41:30 (18207): Guest Log: [INFO] Volunteer: 74861359908 (381) 2020-02-28 07:41:30 (18207): Guest Log: [INFO] VMID: c5ab4400-4ef6-44a9-aaed-bee78432355d 2020-02-28 07:41:30 (18207): Guest Log: [INFO] Requesting an X509 credential from LHC@home 2020-02-28 07:41:32 (18207): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev 2020-02-28 07:41:34 (18207): Guest Log: [INFO] Running the fast benchmark. 2020-02-28 07:43:25 (18207): Guest Log: [INFO] Machine performance 4.78 HEPSPEC06 2020-02-28 07:43:25 (18207): Guest Log: [INFO] CMS application starting. Check log files. 2020-02-28 07:43:28 (18207): Guest Log: [DEBUG] HTCondor ping 2020-02-28 07:43:30 (18207): Guest Log: [DEBUG] 0 2020-02-28 07:53:43 (18207): Guest Log: Did the tarball get created? 2020-02-28 07:53:43 (18207): Guest Log: /tmp/CMS_2881292_1582356899.305107_0.tgz 2020-02-28 07:53:43 (18207): Guest Log: Here is the upload output 2020-02-28 07:53:43 (18207): Guest Log: Here is the upload error 2020-02-28 07:53:43 (18207): Guest Log: Here is the condor directory 2020-02-28 07:53:43 (18207): Guest Log: MasterLog 2020-02-28 07:53:43 (18207): Guest Log: ProcLog 2020-02-28 07:53:43 (18207): Guest Log: StartdHistoryLog 2020-02-28 07:53:43 (18207): Guest Log: StarterLog 2020-02-28 07:53:43 (18207): Guest Log: StartLog 2020-02-28 07:53:43 (18207): Guest Log: XferStatsLog 2020-02-28 07:53:43 (18207): Guest Log: Here is the MasterLog 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ****************************************************** 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ** condor_master (CONDOR_MASTER) STARTING UP 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ** /usr/sbin/condor_master 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ** $CondorPlatform: x86_64_RedHat6 $ 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ** PID = 6393 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ** Log last touched time unavailable (No such file or directory) 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 ****************************************************** 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 Using config source: /etc/condor/condor_config 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 Using local config sources: 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/10_security.config 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/14_network.config 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/20_workernode.config 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/30_lease.config 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/35_cms.config 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/40_ccb.config 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 /etc/condor/config.d/62-benchmark.conf 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 /etc/condor/condor_config.local 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 config Macros = 170, Sorted = 170, StringBytes = 6777, TablesBytes = 6224 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 CLASSAD_CACHING is OFF 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 Daemon Log is logging: D_ALWAYS D_ERROR 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 Daemoncore: Listening at <10.0.2.15:36451> on TCP (ReliSock). 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 DaemonCore: command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451&noUDP> 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 DaemonCore: private command socket at <10.0.2.15:36451?addrs=10.0.2.15-36451> 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#121706 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:47 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 6613 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:57 Setting ready state 'Ready' for STARTD 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 10:51:48 Preen pid is 15974 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 10:51:48 DefaultReaper unexpectedly called on pid 15974, status 0. 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 11:19:49 Sent SIGQUIT to STARTD (pid 6613) 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 11:19:49 AllReaper unexpectedly called on pid 6613, status 0. 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 11:19:49 The STARTD (pid 6613) exited with status 0 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 11:19:49 All daemons are gone. Exiting. 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 11:19:49 **** condor_master (condor_MASTER) pid 6393 EXITING WITH STATUS 0 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ****************************************************** 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ** condor_master (CONDOR_MASTER) STARTING UP 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ** /usr/sbin/condor_master 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1) 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ** $CondorPlatform: x86_64_RedHat6 $ 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ** PID = 4458 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ** Log last touched 2/28 07:43:25 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 ****************************************************** 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 Using config source: /etc/condor/condor_config 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 Using local config sources: 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 /etc/condor/config.d/10_security.config 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 /etc/condor/config.d/14_network.config 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 /etc/condor/config.d/20_workernode.config 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 /etc/condor/config.d/30_lease.config 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 /etc/condor/config.d/35_cms.config 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 /etc/condor/config.d/40_ccb.config 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 /etc/condor/config.d/62-benchmark.conf 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 /etc/condor/condor_config.local 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 config Macros = 170, Sorted = 170, StringBytes = 6785, TablesBytes = 6224 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 CLASSAD_CACHING is OFF 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 Daemon Log is logging: D_ALWAYS D_ERROR 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 Daemoncore: Listening at <10.0.2.15:38329> on TCP (ReliSock). 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 DaemonCore: command socket at <10.0.2.15:38329?addrs=10.0.2.15-38329&noUDP> 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:25 DaemonCore: private command socket at <10.0.2.15:38329?addrs=10.0.2.15-38329> 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:29 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#1907639 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:29 Master restart (GRACEFUL) is watching /usr/sbin/condor_master (mtime:1520893905) 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:29 Started DaemonCore process "/usr/sbin/condor_startd", pid and pgroup = 4468 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:43:36 Setting ready state 'Ready' for STARTD 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:53:33 Got SIGTERM. Performing graceful shutdown. 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:53:33 Sent SIGTERM to STARTD (pid 4468) 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:53:33 AllReaper unexpectedly called on pid 4468, status 0. 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:53:33 The STARTD (pid 4468) exited with status 0 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:53:33 All daemons are gone. Exiting. 2020-02-28 07:53:43 (18207): Guest Log: 02/28/20 07:53:33 **** condor_master (condor_MASTER) pid 4458 EXITING WITH STATUS 0 2020-02-28 07:53:43 (18207): Guest Log: Here is the KernelTuning.log 2020-02-28 07:53:43 (18207): Guest Log: Here is the StartLog 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ****************************************************** 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ** condor_startd (CONDOR_STARTD) STARTING UP 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ** /usr/sbin/condor_startd 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ** SubsystemInfo: name=STARTD type=STARTD(7) class=DAEMON(1) 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ** Configuration: subsystem:STARTD local:<NONE> class:DAEMON 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ** $CondorPlatform: x86_64_RedHat6 $ 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ** PID = 6613 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ** Log last touched time unavailable (No such file or directory) 2020-02-28 07:53:43 (18207): Guest Log: 03/25/19 09:51:48 ****************************************************** 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 Maximum history file size is: 20971520 bytes 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 Number of rotated history files is: 2 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2020-02-28 07:53:44 (18207): Guest Log: slot type 0: Cpus: 1.000000, Memory: 3000, Swap: 100.00%, Disk: 100.00% 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 New machine resource allocated 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 Setting up slot pairings 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'multicore' 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'mips' 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 CronJobList: Adding job 'kflops' 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 Changing state: Owner -> Unclaimed 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 State change: RunBenchmarks is TRUE 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 Changing activity: Idle -> Benchmarking 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:54 BenchMgr:StartBenchmarks() 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:57 Initial update sent to collector(s) 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:51:57 Sending DC_SET_READY message to master <10.0.2.15:36451?addrs=10.0.2.15-36451> 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:01 Request accepted. 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:01 Remote owner is cmst1@cms 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:01 State change: claiming protocol successful 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:01 Changing state and activity: Unclaimed/Benchmarking -> Claimed/Idle 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:02 Got activate_claim request from shadow (137.138.52.94) 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:02 Remote job ID is 105057.6 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:02 Got universe "VANILLA" (5) from request classad 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:02 State change: claim-activation protocol successful 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:02 Changing activity: Idle -> Busy 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 09:52:16 State change: benchmarks completed 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:51:48 PERMISSION DENIED to gsi@unmapped from host 10.0.2.15 for command 448 (GIVE_STATE), access level READ: reason: READ authorization policy contains no matching ALLOW entry for this request; identifiers used for this host: 10.0.2.15, hostname size = 0, original ip address = 10.0.2.15 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:51:48 DC_AUTHENTICATE: Command not authorized, done! 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:35 Called deactivate_claim_forcibly() 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:35 Got activate claim while starter is still alive. 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:35 Telling shadow to try again later. 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:35 Starter pid 10357 exited with status 0 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:35 State change: starter exited 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:35 Changing activity: Busy -> Idle 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:36 Got activate_claim request from shadow (137.138.52.94) 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:36 Remote job ID is 105090.4 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:36 Got universe "VANILLA" (5) from request classad 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:36 State change: claim-activation protocol successful 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 10:55:36 Changing activity: Idle -> Busy 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Got SIGQUIT. Performing fast shutdown. 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 shutdown fast 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Killing job multicore 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Killing job mips 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Killing job kflops 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Changing state and activity: Claimed/Busy -> Preempting/Killing 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Got DEACTIVATE_CLAIM while in Preempting state, ignoring. 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Got RELEASE_CLAIM while in Preempting state, ignoring. 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 State change: starter exited 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 State change: No preempting claim, returning to owner 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Changing state and activity: Preempting/Killing -> Owner/Idle 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 State change: IS_OWNER is false 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Changing state: Owner -> Unclaimed 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Deleting cron job manager 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Killing job multicore 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Killing job multicore 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'multicore' 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Deleting benchmark job mgr 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Killing job mips 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Killing job kflops 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Killing job mips 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Killing job kflops 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'mips' 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting job 'kflops' 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 CronJobList: Deleting all jobs 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 All resources are free, exiting. 2020-02-28 07:53:44 (18207): Guest Log: 03/25/19 11:19:49 **** condor_startd (condor_STARTD) pid 6613 EXITING WITH STATUS 0 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ****************************************************** 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ** condor_startd (CONDOR_STARTD) STARTING UP 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ** /usr/sbin/condor_startd 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ** SubsystemInfo: name=STARTD type=STARTD(7) class=DAEMON(1) 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ** Configuration: subsystem:STARTD local:<NONE> class:DAEMON 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ** $CondorPlatform: x86_64_RedHat6 $ 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ** PID = 4468 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ** Log last touched 2/28 07:43:25 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 ****************************************************** 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 Using config source: /etc/condor/condor_config 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 Using local config sources: 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 /etc/condor/config.d/10_security.config 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 /etc/condor/config.d/14_network.config 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 /etc/condor/config.d/20_workernode.config 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 /etc/condor/config.d/30_lease.config 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 /etc/condor/config.d/35_cms.config 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 /etc/condor/config.d/40_ccb.config 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 /etc/condor/config.d/62-benchmark.conf 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 /etc/condor/condor_config.local 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 config Macros = 171, Sorted = 171, StringBytes = 6807, TablesBytes = 6260 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 CLASSAD_CACHING is ENABLED 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 Daemon Log is logging: D_ALWAYS D_ERROR 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 Daemoncore: Listening at <10.0.2.15:39163> on TCP (ReliSock). 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 DaemonCore: command socket at <10.0.2.15:39163?addrs=10.0.2.15-39163&noUDP> 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:29 DaemonCore: private command socket at <10.0.2.15:39163?addrs=10.0.2.15-39163> 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:31 CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#1907640 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 VM-gahp server reported an internal error 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 VM universe will be tested to check if it is available 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 History file rotation is enabled. 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 Maximum history file size is: 20971520 bytes 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 Number of rotated history files is: 2 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 Allocating auto shares for slot type 0: Cpus: auto, Memory: auto, Swap: auto, Disk: auto 2020-02-28 07:53:44 (18207): Guest Log: slot type 0: Cpus: 1.000000, Memory: 3000, Swap: 100.00%, Disk: 100.00% 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 New machine resource allocated 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 Setting up slot pairings 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 CronJobList: Adding job 'multicore' 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 CronJob: Initializing job 'multicore' (/usr/local/bin/multicore-shutdown) 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 CronJobList: Adding job 'mips' 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 CronJobList: Adding job 'kflops' 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 CronJob: Initializing job 'mips' (/usr/libexec/condor/condor_mips) 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 CronJob: Initializing job 'kflops' (/usr/libexec/condor/condor_kflops) 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 State change: IS_OWNER is false 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 Changing state: Owner -> Unclaimed 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 State change: RunBenchmarks is TRUE 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 Changing activity: Idle -> Benchmarking 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:33 BenchMgr:StartBenchmarks() 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:36 Initial update sent to collector(s) 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:36 Sending DC_SET_READY message to master <10.0.2.15:38329?addrs=10.0.2.15-38329> 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:47 State change: benchmarks completed 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:43:47 Changing activity: Benchmarking -> Idle 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 No resources have been claimed for 600 seconds 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Shutting down Condor on this machine. 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Got SIGTERM. Performing graceful shutdown. 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 shutdown graceful 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Killing job multicore 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Killing job mips 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Killing job kflops 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Deleting cron job manager 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Killing job multicore 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJob: 'multicore': Trying to kill illegal PID 0 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Killing job multicore 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJob: 'multicore': Trying to kill illegal PID 0 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJobList: Deleting all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJobList: Deleting job 'multicore' 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJob: Deleting job 'multicore' (/usr/local/bin/multicore-shutdown), timer 9 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJob: 'multicore': Trying to kill illegal PID 0 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJobList: Deleting all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Deleting benchmark job mgr 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Killing job mips 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Killing job kflops 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Killing job mips 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Killing job kflops 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJobList: Deleting all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJobList: Deleting job 'mips' 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJob: Deleting job 'mips' (/usr/libexec/condor/condor_mips), timer -1 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJobList: Deleting job 'kflops' 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJob: Deleting job 'kflops' (/usr/libexec/condor/condor_kflops), timer -1 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 Cron: Killing all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 CronJobList: Deleting all jobs 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 All resources are free, exiting. 2020-02-28 07:53:44 (18207): Guest Log: 02/28/20 07:53:33 **** condor_startd (condor_STARTD) pid 4468 EXITING WITH STATUS 0 2020-02-28 07:53:45 (18207): Guest Log: [ERROR] No jobs were available to run. 2020-02-28 07:53:45 (18207): Guest Log: [INFO] Shutting Down. 2020-02-28 07:53:45 (18207): VM Completion File Detected. 2020-02-28 07:53:45 (18207): VM Completion Message: No jobs were available to run. . 2020-02-28 07:53:45 (18207): Powering off VM. 2020-02-28 07:53:46 (18207): Successfully stopped VM. 2020-02-28 07:53:46 (18207): Deregistering VM. (boinc_a6aa4125fb177b4c, slot#3) 2020-02-28 07:53:46 (18207): Removing network bandwidth throttle group from VM. 2020-02-28 07:53:46 (18207): Removing storage controller(s) from VM. 2020-02-28 07:53:46 (18207): Removing VM from VirtualBox. 2020-02-28 07:53:46 (18207): Removing virtual disk drive from VirtualBox. 07:53:51 (18207): called boinc_finish(207) </stderr_txt> ]]>
©2024 CERN