Development for LHC@home

I have just defined the variable. Let's see how far that gets us.

A new version (v5.15) is available that hopefully fixes all outstanding issues.

This job info (example from a task, where we still had several jobs in 1 task until 12 hours elapsed time was past):

2019-07-02 16:33:11 (372): Guest Log: [INFO] New Job Starting in slot1
2019-07-02 16:33:11 (372): Guest Log: [INFO] Condor JobID:  502264.4 in slot1
2019-07-02 16:33:16 (372): Guest Log: [INFO] MCPlots JobID: 50563426 in slot1
2019-07-02 16:33:22 (372): Guest Log: [INFO] ===> [runRivet] Tue Jul  2 16:33:08 CEST 2019 [boinc ee zhad 206 - - pythia6 6.427 358 100000 76]
2019-07-02 16:44:39 (372): Guest Log: [INFO] Job finished in slot1 with 0.

did not make it in the code so far (or it must be in v5.16)
The line ===> [runRivet] etc etc would suffice, when added to stderr.txt directly after runc has started.

I have just defined the variable. Let's see how far that gets us.

The VM now writes the local wpad file and the file contains the local proxy.
Nonetheless the settings are ignored, hence I checked the VM's /persistent/etc/cvmfs/ where the basic settings should be.

site.conf is present (should be deleted):

CVMFS_PAC_URLS="http://grid-wpad/wpad.dat;http://wpad/wpad.dat;http://wlcg-wpad.cern.ch/wpad.dat;http://wlcg-wpad.fnal.gov/wpad.dat"
CVMFS_HTTP_PROXY="auto;DIRECT"
CVMFS_PAC_URLS="http://grid-wpad/wpad.dat;http://wpad/wpad.dat;http://wlcg-wpad.fnal.gov/wpad.dat;http://wlcg-wpad.cern.ch/wpad.dat"
CVMFS_HTTP_PROXY="auto;DIRECT"
CVMFS_PAC_URLS="http://grid-wpad/wpad.dat;http://wpad/wpad.dat;http://wlcg-wpad.fnal.gov/wpad.dat;http://wlcg-wpad.cern.ch/wpad.dat"
CVMFS_HTTP_PROXY="auto;DIRECT"

This contains a proxy configuration that will only work for client IPs inside WLCG.
IPs from outside WLCG get an HTTP 400 instead of a wpad file.


default.local is missing.
Should be created with at least the following lines:

CVMFS_HTTP_PROXY="auto;DIRECT"
CVMFS_PAC_URLS="http://localhost/wpad.dat;http://lhchomeproxy.cern.ch/wpad.dat;http://lhchomeproxy.fnal.gov/wpad.dat"
CVMFS_SEND_INFO_HEADER=yes

All of that corresponds to the entries in my proxy log.

A new version (v5.15) is available that hopefully fixes all outstanding issues.

This job info (example from a task, where we still had several jobs in 1 task until 12 hours elapsed time was past):

2019-07-02 16:33:11 (372): Guest Log: [INFO] New Job Starting in slot1
2019-07-02 16:33:11 (372): Guest Log: [INFO] Condor JobID:  502264.4 in slot1
2019-07-02 16:33:16 (372): Guest Log: [INFO] MCPlots JobID: 50563426 in slot1
2019-07-02 16:33:22 (372): Guest Log: [INFO] ===> [runRivet] Tue Jul  2 16:33:08 CEST 2019 [boinc ee zhad 206 - - pythia6 6.427 358 100000 76]
2019-07-02 16:44:39 (372): Guest Log: [INFO] Job finished in slot1 with 0.

did not make it in the code so far (or it must be in v5.16)
The line ===> [runRivet] etc etc would suffice, when added to stderr.txt directly after runc has started.

Fixed in v5.18.

The changes are included in v5.18.

The line ===> [runRivet] etc etc would suffice, when added to stderr.txt directly after runc has started.

Fixed in v5.18.

It does. Thanks!

2019-10-02 09:15:36 (2032): Guest Log: 09:15:33 CEST +02:00 2019-10-02: cranky: [INFO] ===> [runRivet] Wed Oct  2 07:15:31 UTC 2019 [boinc pp z1j 7000 250 - herwig++ 2.5.2 default 100000 132]

The changes are included in v5.18.

CVMFS and proxy configuration looks fine in v5.18.

Some errors after 25 minutes
2832554
2832551
2832550
etc

1 (0x00000001) Unknown error code
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=2832395

I am planning to put v5.18 on the production server tomorrow. Any objections?

No objections.

I suppose the tasks will always run single core except when the user have setup in app_config.xml to run multi-core.
No influence from the Max # of CPUs set in the preferences.

As long as they are working and you give them the basics (such as cores and ram and maybe running time)
Then many more will be run over there.

I am planning to put v5.18 on the production server tomorrow. Any objections?

I will have to do this later as the 32bit app also needs to be updated.

I am planning to put v5.18 on the production server tomorrow. Any objections?

No.
What's new? Bugfix??

I am planning to put v5.18 on the production server tomorrow. Any objections?

A quick test produced:-
v5.18 failing on Linux (with CVMFS installed) and on Windows.

This is from Linux:-

2019-11-08 00:45:16 (3522): Guest Log: 00:45:14 GMT +00:00 2019-11-08: cranky: [INFO] Checking CVMFS.
2019-11-08 00:45:34 (3522): Guest Log: 00:45:34 GMT +00:00 2019-11-08: cranky: [WARNING] 'cvmfs_config probe sft.cern.ch' failed.
2019-11-08 00:45:34 (3522): Guest Log: 00:45:34 GMT +00:00 2019-11-08: cranky: [INFO] Creating local CVMFS repository.
2019-11-08 00:45:34 (3522): Guest Log: sed: can't read cvmfs-mini-0.1-amd64.tgz: No such file or directory
2019-11-08 00:45:34 (3522): Guest Log: tar: option requires an argument -- 'f'
2019-11-08 00:45:34 (3522): Guest Log: Try `tar --help' or `tar --usage' for more information.
2019-11-08 00:45:34 (3522): Guest Log: /home/boinc/cranky: line 62: ./cvmfs-mini-0.1-amd64/mount_cvmfs.sh: No such file or directory
2019-11-08 00:45:34 (3522): Guest Log: 00:45:34 GMT +00:00 2019-11-08: cranky: [WARNING] 'cvmfs_config probe sft.cern.ch' failed.

..and from Windows

2019-11-09 01:09:16 (288): Guest Log: 01:09:13 GMT +00:00 2019-11-09: cranky: [INFO] Checking CVMFS.
2019-11-09 01:09:38 (288): Guest Log: 01:09:34 GMT +00:00 2019-11-09: cranky: [WARNING] 'cvmfs_config probe sft.cern.ch' failed.
2019-11-09 01:09:38 (288): Guest Log: 01:09:34 GMT +00:00 2019-11-09: cranky: [INFO] Creating local CVMFS repository.
2019-11-09 01:09:38 (288): Guest Log: sed: can't read cvmfs-mini-0.1-amd64.tgz: No such file or directory
2019-11-09 01:09:38 (288): Guest Log: tar: option requires an argument -- 'f'
2019-11-09 01:09:38 (288): Guest Log: Try `tar --help' or `tar --usage' for more information.
2019-11-09 01:09:38 (288): Guest Log: /home/boinc/cranky: line 62: ./cvmfs-mini-0.1-amd64/mount_cvmfs.sh: No such file or directory
2019-11-09 01:09:38 (288): Guest Log: 01:09:34 GMT +00:00 2019-11-09: cranky: [WARNING] 'cvmfs_config probe sft.cern.ch' failed.

The startup messages are as CPs post here

This is via the local proxy
and this isn't so it doesn't seem to be a cache problem.

My wus are very variables (from 700 to 36000 seconds), but now i'm crunching a wu at 11% after 26hs.
Is it normal?

My wus are very variables (from 700 to 36000 seconds), but now i'm crunching a wu at 11% after 26hs.
Is it normal?

Finished!!!
2836069

A lot of errors
2840748
2840750
2840779
etc

A lot of errors
2840748
2840750
2840779
etc

All the errors are caused by: VM Heartbeat file specified, but missing file system status. (errno = '2')
That means the VirtualBox COM (VBoxSVC.exe) can't communicate fast enough with the wrapper, mostly caused by a too busy system.

That means the VirtualBox COM (VBoxSVC.exe) can't communicate fast enough with the wrapper, mostly caused by a too busy system.

That's strange. I crunch with my pc during the night, when i'm not working....