Message boards : Theory Application : New Version 5.40
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 325,950
RAC: 249
Message 7653 - Posted: 28 Jul 2022, 7:52:48 UTC

This update provides the latest version of the vboxwrapper.
ID: 7653 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 28 Jul 16
Posts: 467
Credit: 389,411
RAC: 449
Message 7654 - Posted: 28 Jul 2022, 8:30:19 UTC - in response to Message 7653.  

Looks fine.
My 1st task already processed 45k events out of 100k.
ID: 7654 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 660
Credit: 1,720,327
RAC: 2,947
Message 7655 - Posted: 28 Jul 2022, 9:10:17 UTC
Last modified: 28 Jul 2022, 10:00:54 UTC

grep: /etc/redhat-release: No such file or directory
shown also for Theory and CMS when task is starting.
-dev or Production.
Is this a normal info?

This task is broken from Virtualbox.
Last lines from stderr.txt
2022-07-28 11:41:55 (22340): Guest Log: [INFO] Detected local proxy http://10.241.124.14:3128 in init_data.xml
2022-07-28 11:41:55 (22340): Guest Log: [INFO] Testing connection to 10.241.124.14 on port 3128
2022-07-28 11:41:55 (22340): Guest Log: [INFO] Ncat: Version 7.50 ( https://nmap.org/ncat )
2022-07-28 11:41:55 (22340): Guest Log: Ncat: Connected to 10.241.124.14:3128.
2022-07-28 11:41:55 (22340): Guest Log: Ncat: 0 bytes sent, 0 bytes received in 0.02 seconds.
2022-07-28 11:41:55 (22340): Guest Log: [INFO] 0
2022-07-28 11:41:58 (22340): Guest Log: 11:41:52 CEST +02:00 2022-07-28: cranky: [INFO] Detected Theory App
2022-07-28 11:41:58 (22340): Guest Log: 11:41:52 CEST +02:00 2022-07-28: cranky: [INFO] Checking CVMFS.
2022-07-28 11:41:59 (22340): Guest Log: Probing /cvmfs/sft.cern.ch... OK
2022-07-28 11:41:59 (22340): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2022-07-28 11:41:59 (22340): Guest Log: 2.5.2.0 4110 0 26084 23466 3 1 265080 4096000 0 65024 0 0 n/a 0 0 http://s1cern-cvmfs.openhtc.io/cvmfs/sft.cern.ch http://10.241.124.14:3128 1
2022-07-28 11:41:59 (22340): Guest Log: Probing /cvmfs/grid.cern.ch... OK
2022-07-28 11:41:59 (22340): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2022-07-28 11:41:59 (22340): Guest Log: 2.5.2.0 4061 0 28492 18843 3 1 265080 4096000 0 65024 0 2 0 2138 6022 http://s1cern-cvmfs.openhtc.io/cvmfs/grid.cern.ch http://10.241.124.14:3128 1
2022-07-28 11:42:00 (22340): Guest Log: Probing /cvmfs/cernvm-prod.cern.ch... OK
2022-07-28 11:42:00 (22340): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2022-07-28 11:42:00 (22340): Guest Log: 2.5.2.0 4082 0 26084 268 3 1 265080 4096000 0 65024 0 0 n/a 0 0 http://s1cern-cvmfs.openhtc.io/cvmfs/cernvm-prod.cern.ch http://10.241.124.14:3128 1
2022-07-28 11:42:00 (22340): Guest Log: Probing /cvmfs/alice.cern.ch... OK
2022-07-28 11:42:01 (22340): Guest Log: VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
2022-07-28 11:42:01 (22340): Guest Log: 2.5.2.0 4038 0 37860 12923 3 1 265080 4096000 0 65024 0 0 n/a 0 0 http://s1cern-cvmfs.openhtc.io/cvmfs/alice.cern.ch http://10.241.124.14:3128 1
2022-07-28 11:42:01 (22340): Guest Log: 11:41:55 CEST +02:00 2022-07-28: cranky: [INFO] Checking runc.
2022-07-28 11:42:01 (22340): Guest Log: 11:41:55 CEST +02:00 2022-07-28: cranky: [INFO] Creating the filesystem.
2022-07-28 11:42:01 (22340): Guest Log: 11:41:55 CEST +02:00 2022-07-28: cranky: [INFO] Using /cvmfs/cernvm-prod.cern.ch/cvm3
2022-07-28 11:42:01 (22340): Guest Log: 11:41:55 CEST +02:00 2022-07-28: cranky: [INFO] Updating config.json.
2022-07-28 11:42:01 (22340): Guest Log: 11:41:55 CEST +02:00 2022-07-28: cranky: [INFO] Running Container 'runc'.
2022-07-28 11:42:04 (22340): Guest Log: job: htmld=/shared/html/job
2022-07-28 11:42:04 (22340): Guest Log: job: unpack exitcode=0
2022-07-28 11:42:05 (22340): Guest Log: 11:41:59 CEST +02:00 2022-07-28: cranky: [INFO] ===> [runRivet] Thu Jul 28 09:41:58 UTC 2022 [boinc pp jets 7000 20,-,360 - pythia8 8.244 tune-monash13 100000 271]
https://lhcathomedev.cern.ch/lhcathome-dev/workunit.php?wuid=2197795
was also errored out from wingman.
making a upgrade of Virtualbox (6.1.36) in the next few hours. Was planned.
After this will restart this task.
ID: 7655 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 660
Credit: 1,720,327
RAC: 2,947
Message 7659 - Posted: 28 Jul 2022, 14:40:28 UTC - in response to Message 7655.  

https://lhcathomedev.cern.ch/lhcathome-dev/workunit.php?wuid=2197795
making a upgrade of Virtualbox (6.1.36) in the next few hours. Was planned.
After this installation restart this task.

Now: alice.cern.ch waiting for the delivery of SIGUSR1
ID: 7659 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Ray Murray
Avatar

Send message
Joined: 13 Apr 15
Posts: 138
Credit: 2,945,852
RAC: 1
Message 7705 - Posted: 1 Aug 2022, 17:49:41 UTC
Last modified: 1 Aug 2022, 17:55:15 UTC

5.40 Theory -dev and Production Theory seem to have been playing nicely together overnight and today but I would still like to see if, on finishing, the last attached -dev allows the .vdi to be released. It was the transition where there was no -dev attached but the vdi was not released, and subsequent tasks could not re-attach to it, was where I previously had postponements. As is typical when I want to watch that, I have a task that is at 60% after 14hrs so it'll be tomorrow evening before I can watch what happens.

Win10
Boinc 7.20.2
VBox 6.1.36
ID: 7705 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1178
Credit: 810,985
RAC: 1,800
Message 7706 - Posted: 1 Aug 2022, 18:57:11 UTC - in response to Message 7705.  

.... but I would still like to see if, on finishing, the last attached -dev allows the .vdi to be released.
It's not BOINC or vboxwrapper not releasing the vdi.
It is VBoxSVC.exe keeping last used vdi's in memory.
As long as that process keeps running, because of other VM's running or the GUI of VirtualBox Manager open, the unused vdi's will be shown in Virtual Media Manager.

The last vboxwrapper v26205, in use now on LHC@home Development for all three vbox-apps, had no issues since released here as test.
ID: 7706 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Ray Murray
Avatar

Send message
Joined: 13 Apr 15
Posts: 138
Credit: 2,945,852
RAC: 1
Message 7707 - Posted: 1 Aug 2022, 20:18:19 UTC - in response to Message 7706.  

Ah, ok. I've not been paying attention recently, just been letting run with the VBox window closed.
Really we're waiting for VBox themselves for a proper fix.
ID: 7707 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 28 Jul 16
Posts: 467
Credit: 389,411
RAC: 449
Message 7708 - Posted: 2 Aug 2022, 5:18:58 UTC - in response to Message 7707.  

Really we're waiting for VBox themselves for a proper fix.

No, we don't.
Vboxwrapper now includes 2 workarounds:


1st workaround follows the advice given in the virtualbox ticket system years ago:
https://www.virtualbox.org/ticket/18296
As you can see there they don't plan to change something on their side.


2nd workaround takes care of a bug in virtualbox which occasionally writes the 'multiattach' attribute to a disk entry in the 'global media store' although that attribute is not allowed there.
This must be handled in vboxwrapper to make it work with widely distributed unpatched virtualbox versions.

Since at least 3 calls to vboxmanage in a row are required vboxwrapper tries to resolve this issue only once (per VM).
If it fails again during a 2nd run it will report this condition back and fail the task.
This is by intention and may happen very rarely on extremely loaded computers starting lots of VMs concurrently.
ID: 7708 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Ray Murray
Avatar

Send message
Joined: 13 Apr 15
Posts: 138
Credit: 2,945,852
RAC: 1
Message 7719 - Posted: 2 Aug 2022, 15:53:58 UTC - in response to Message 7708.  

Great, thanks for that clarification update 👍
ID: 7719 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 660
Credit: 1,720,327
RAC: 2,947
Message 7762 - Posted: 23 Aug 2022, 5:45:14 UTC
Last modified: 23 Aug 2022, 5:46:26 UTC

Laurence,
for native Theory, can we change from runc to apptainer Container?
https://apptainer.org/docs/admin/main/user_namespace.html
ID: 7762 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Theory Application : New Version 5.40


©2024 CERN