Development for LHC@home

This new version has an updated CVMFS proxy configuration. It will hopefully make the VMs boot faster.

Have no figures from the old version, but this is how the task started on all 8 threads busy:

2017-12-01 06:51:36 (7300): Starting VM using VBoxManage interface. (boinc_60b16f3579b99c42, slot#6)
2017-12-01 06:51:41 (7300): Successfully started VM. (PID = '6624')
2017-12-01 06:51:42 (7300): Reporting VM Process ID to BOINC.
2017-12-01 06:51:42 (7300): Guest Log: BIOS: VirtualBox 5.2.2

2017-12-01 06:51:42 (7300): Guest Log: CPUID EDX: 0x078bfbff

2017-12-01 06:51:42 (7300): Guest Log: BIOS: ata0-0: PCHS=16383/16/63 LCHS=1024/255/63

2017-12-01 06:51:42 (7300): VM state change detected. (old = 'PoweredOff', new = 'Running')
2017-12-01 06:51:42 (7300): Detected: Web Application Enabled (http://localhost:60390)
2017-12-01 06:51:42 (7300): Detected: Remote Desktop Enabled (localhost:60391)
2017-12-01 06:51:42 (7300): Preference change detected
2017-12-01 06:51:42 (7300): Setting CPU throttle for VM. (100%)
2017-12-01 06:51:43 (7300): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 120 seconds) or (Vbox_job.xml: 600 seconds))
2017-12-01 06:51:44 (7300): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032

2017-12-01 06:51:44 (7300): Guest Log: BIOS: Booting from Hard Disk...

2017-12-01 06:51:46 (7300): Guest Log: BIOS: KBD: unsupported int 16h function 03

2017-12-01 06:51:46 (7300): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000

2017-12-01 06:52:05 (7300): Guest Log: vboxguest: misc device minor 56, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)

2017-12-01 06:52:23 (7300): Guest Log: VBoxService 4.3.28 r100309 (verbosity: 0) linux.amd64 (May 13 2015 17:11:31) release log

2017-12-01 06:52:23 (7300): Guest Log: 00:00:00.000103 main Log opened 2017-12-01T05:52:21.449940000Z

2017-12-01 06:52:23 (7300): Guest Log: 00:00:00.000315 main OS Product: Linux

2017-12-01 06:52:23 (7300): Guest Log: 00:00:00.000370 main OS Release: 4.1.37-26.cernvm.x86_64

2017-12-01 06:52:23 (7300): Guest Log: 00:00:00.000458 main OS Version: #1 SMP Thu Jan 5 15:23:42 CET 2017

2017-12-01 06:52:23 (7300): Guest Log: 00:00:00.000504 main OS Service Pack: #1 SMP Thu Jan 5 15:23:42 CET 2017

2017-12-01 06:52:23 (7300): Guest Log: 00:00:00.000550 main Executable: /usr/sbin/VBoxService

2017-12-01 06:52:23 (7300): Guest Log: 00:00:00.000552 main Process ID: 2728

2017-12-01 06:52:23 (7300): Guest Log: 00:00:00.000553 main Package type: LINUX_64BITS_GENERIC

2017-12-01 06:52:23 (7300): Guest Log: 00:00:00.002369 main 4.3.28 r100309 started. Verbose level = 0

2017-12-01 06:52:52 (7300): Guest Log: [INFO] Mounting the shared directory

2017-12-01 06:52:52 (7300): Guest Log: [INFO] Shared directory mounted, enabling vboxmonitor

2017-12-01 06:52:52 (7300): Guest Log: [DEBUG] Testing network connection to cern.ch on port 80

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] Connection to cern.ch 80 port [tcp/http] succeeded!

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] 0

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] Testing CVMFS connection to lhchomeproxy.cern.ch on port 3125

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] Connection to lhchomeproxy.cern.ch 3125 port [tcp/a13-an] succeeded!

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] 0

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] Testing VCCS connection to vccs.cern.ch on port 443

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] Connection to vccs.cern.ch 443 port [tcp/https] succeeded!

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] 0

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] Testing connection to Condor server on port 9618

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] Connection to vccondor01.cern.ch 9618 port [tcp/condor] succeeded!

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] 0

2017-12-01 06:52:53 (7300): Guest Log: [DEBUG] Probing CVMFS ...

2017-12-01 06:52:54 (7300): Guest Log: Probing /cvmfs/grid.cern.ch... OK

2017-12-01 06:53:06 (7300): Guest Log: Probing /cvmfs/cms.cern.ch... OK

2017-12-01 06:53:06 (7300): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE

2017-12-01 06:53:06 (7300): Guest Log: 2.2.0.0 3431 0 29972 5151 14 1 1689294 10240001 2 65024 0 20 95 20792 2 http://cvmfs-stratum-one.cern.ch/cvmfs/grid.cern.ch http://128.142.168.202:3125 1

2017-12-01 06:53:29 (7300): Guest Log: [INFO] Reading volunteer information

2017-12-01 06:53:29 (7300): Guest Log: [INFO] Volunteer: Crystal Pellet (38) Host: 37

2017-12-01 06:53:29 (7300): Guest Log: [INFO] VMID: e157435d-c4c6-41b0-bda1-b31c0f9afa17

2017-12-01 06:53:30 (7300): Guest Log: [INFO] Requesting an X509 credential from LHC@home

2017-12-01 06:53:31 (7300): Guest Log: [INFO] Requesting an X509 credential from vLHC@home-dev

2017-12-01 06:53:33 (7300): Guest Log: [INFO] Running the fast benchmark.

2017-12-01 06:55:22 (7300): Guest Log: [INFO] Machine performance 4.75 HEPSEC06

2017-12-01 06:55:22 (7300): Guest Log: [INFO] CMS application starting. Check log files.

2017-12-01 06:55:27 (7300): Guest Log: [DEBUG] HTCondor ping

2017-12-01 06:55:28 (7300): Guest Log: [DEBUG] 0

2017-12-01 06:55:55 (7300): Guest Log: [INFO] New Job Starting in slot1

2017-12-01 06:55:55 (7300): Guest Log: [INFO] Condor JobID: 229125.18 in slot1

2017-12-01 06:57:07 (7300): Guest Log: [INFO] WMAgent_JobID = 1135540 in slot1

From MasterLog:
12/01/17 06:55:24 ******************************************************
12/01/17 06:55:24 ** condor_master (CONDOR_MASTER) STARTING UP

From running.log:
Beginning CMSSW wrapper script
slc5_amd64_gcc462 scramv1 CMSSW
Performing SCRAM setup...
Completed SCRAM setup
Retrieving SCRAM project...
Completed SCRAM project
Executing CMSSW
cmsRun -j FrameworkJobReport.xml PSet.py

*------------------------------------------------------------------------------------*
| |
| *------------------------------------------------------------------------------* |
| | | |
| | | |
| | PPP Y Y TTTTT H H III A Welcome to the Lund Monte Carlo! | |
| | P P Y Y T H H I A A This is PYTHIA version 8.153 | |
| | PPP Y T HHHHH I AAAAA Last date of change: 10 Aug 2011 | |
| | P Y T H H I A A | |
| | P Y T H H III A A Now is 01 Dec 2017 at 06:00:41 | |

(3 - 4am)

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=372282

Several of these tonight making it hard to get all these up and running


2017-12-10 03:34:37 (8536): Guest Log: [DEBUG] HTCondor ping

2017-12-10 03:34:43 (8536): Guest Log: [DEBUG] 0

2017-12-10 03:46:48 (8536): Guest Log: [ERROR] Condor exited after 731s without running a job.

2017-12-10 03:46:48 (8536): Guest Log: [INFO] Shutting Down.

2017-12-10 03:46:48 (8536): VM Completion File Detected.
2017-12-10 03:46:48 (8536): VM Completion Message: Condor exited after 731s without running a job

Which means they are up and running and then after 33 minutes decide to do this and then I try another one......on several 8-core pc's

But this example covers all of them.

---

Mad Scientist For Life

We were out of jobs due to the new WMAgent failing. I'm keeping a small queue of jobs available via the old agent, and Laurence has just tickled job creation here back into life.

---