Message boards : ATLAS Application : ATLAS vbox v1.11
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1180
Credit: 815,336
RAC: 238
Message 7447 - Posted: 28 Jun 2022, 19:45:34 UTC - in response to Message 7446.  

LT1 is using the traditional method:
<HardDisk uuid="{08a2ffca-69a5-4a8f-ab20-c73b8e84b770}" location="D:/Boinc1/slots/1/vm_image.vdi" format="VDI" type="Normal">

Is it a task from prod?
Yes it is.

Meanwhile fished 44 ATLAS tasks from the development system. All Valid.

Strange is that in result log Checking CVMFS very often fails, but the job keeps on going!?
ID: 7447 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 28 Jul 16
Posts: 473
Credit: 389,411
RAC: 34
Message 7452 - Posted: 29 Jun 2022, 6:43:16 UTC

@CP

Please add the following lines to "ATLAS_vbox_job_1.11.xml" and run a couple of ATLAS tasks (on the 20-core computer):
<vm_disk_controller_model>PIIX4</vm_disk_controller_model>
<vm_disk_controller_type>ide</vm_disk_controller_type>


Does it affect the CVMFS probes?
ID: 7452 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 664
Credit: 1,807,614
RAC: 2,394
Message 7453 - Posted: 29 Jun 2022, 8:21:00 UTC

Two Atlas finished.
CMS and Theory using Squid 5.2 with CentOS9-VM, but
Atlas upload only with disconnect of Proxy.
ID: 7453 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 28 Jul 16
Posts: 473
Credit: 389,411
RAC: 34
Message 7454 - Posted: 29 Jun 2022, 8:44:15 UTC - in response to Message 7453.  

Roughly 3 weeks ago we had a discussion about Squid 4.x vs Squid 5.x starting here:
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5859&postid=46851

Based on that I thought you understood that it makes no sense to run tests with Squid 5.x here ATM.
Just be patient until v5.x (or maybe 6.x) is certified by CERN/Fermilab.

If you violate this and report problems nobody will be able to reliably find out where the problems come from.
ID: 7454 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1180
Credit: 815,336
RAC: 238
Message 7455 - Posted: 29 Jun 2022, 8:47:35 UTC - in response to Message 7452.  

@CP

Please add the following lines to "ATLAS_vbox_job_1.11.xml" and run a couple of ATLAS tasks (on the 20-core computer):
<vm_disk_controller_model>PIIX4</vm_disk_controller_model>
<vm_disk_controller_type>ide</vm_disk_controller_type>

Does it affect the CVMFS probes?
I put those lines in and fishing for tasks now . . .
ID: 7455 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 664
Credit: 1,807,614
RAC: 2,394
Message 7456 - Posted: 29 Jun 2022, 9:00:51 UTC - in response to Message 7454.  

If you violate this and report problems nobody will be able to reliably find out where the problems come from.

This is a -dev, no comment to your sight of the things.......
ID: 7456 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1180
Credit: 815,336
RAC: 238
Message 7457 - Posted: 29 Jun 2022, 9:32:09 UTC - in response to Message 7455.  

I put those lines in and fishing for tasks now . . .
I only got 1 task so far. No improvement.

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3096055

From the 44 tasks yesterday evening ~30 results had the same
Guest Log: Checking CVMFS...
Guest Log: Failed to check CVMFS, check output from cvmfs_config probe:
Guest Log: Probing /cvmfs/atlas.cern.ch... Failed!
Guest Log: Probing /cvmfs/atlas-condb.cern.ch... Failed!
Guest Log: Probing /cvmfs/grid.cern.ch... Failed!


2 results were OK, 8 checking cvmfs failed, but the 3 probings thereafter were OK and from the other 'Failed ones' 1 or 2 probings were OK.
ID: 7457 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 664
Credit: 1,807,614
RAC: 2,394
Message 7458 - Posted: 29 Jun 2022, 10:28:54 UTC - in response to Message 7457.  
Last modified: 29 Jun 2022, 10:58:56 UTC

2022-06-29 11:19:18 (7476): Guest Log: Checking CVMFS...
2022-06-29 11:19:26 (7476): Guest Log: Failed to check CVMFS, check output from cvmfs_config probe:
2022-06-29 11:19:28 (7476): Guest Log: Probing /cvmfs/atlas.cern.ch... OK
Is it possible to set the command:
cvmfs_config chksetup
and see what happens?
or setting before probe a cvmfs_wipecache?
namespace?
ID: 7458 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1180
Credit: 815,336
RAC: 238
Message 7459 - Posted: 29 Jun 2022, 11:29:42 UTC

The first task after adding the 2 lines in ATLAS_vbox_job_1.11.xml still got the 'cvmfs failed' . All later tasks got
Guest Log: Checking CVMFS...
Guest Log: CVMFS is ok


but now between those 2 loglines more guest log is displayed:

2022-06-29 12:50:04 (4740): Guest Log: Checking CVMFS...
2022-06-29 12:50:04 (4740): Guest Log: VBoxService 5.2.32 r132073 (verbosity: 0) linux.amd64 (Jul 12 2019 10:32:28) release log
2022-06-29 12:50:04 (4740): Guest Log: 00:00:00.000069 main Log opened 2022-06-29T12:50:02.783889000Z
2022-06-29 12:50:04 (4740): Guest Log: 00:00:00.000124 main OS Product: Linux
2022-06-29 12:50:04 (4740): Guest Log: 00:00:00.000146 main OS Release: 3.10.0-957.27.2.el7.x86_64
2022-06-29 12:50:04 (4740): Guest Log: 00:00:00.000163 main OS Version: #1 SMP Mon Jul 29 17:46:05 UTC 2019
2022-06-29 12:50:04 (4740): Guest Log: 00:00:00.000185 main Executable: /opt/VBoxGuestAdditions-5.2.32/sbin/VBoxService
2022-06-29 12:50:04 (4740): Guest Log: 00:00:00.000186 main Process ID: 1485
2022-06-29 12:50:04 (4740): Guest Log: 00:00:00.000186 main Package type: LINUX_64BITS_GENERIC
2022-06-29 12:50:04 (4740): Guest Log: 00:00:00.001025 main 5.2.32 r132073 started. Verbose level = 0
2022-06-29 12:50:08 (4740): Guest Log: CVMFS is ok


Another thing I noticed:
When using the F3 Console, I never see 2 athena.py's running 99%.
The Console F2 never shows workers processing below "Status of last event per worker thread".
Also "preparing HITS-file" is not shown.
ID: 7459 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
computezrmle
Volunteer moderator
Project tester
Volunteer developer
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 28 Jul 16
Posts: 473
Credit: 389,411
RAC: 34
Message 7460 - Posted: 29 Jun 2022, 11:33:35 UTC - in response to Message 7459.  

There might be an issue in the VM's bootstrap that is under investigation.
Makes no sense to continue here until that is clarified.
Please wait for further posts.
ID: 7460 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1180
Credit: 815,336
RAC: 238
Message 7461 - Posted: 29 Jun 2022, 11:49:57 UTC - in response to Message 7460.  

There might be an issue in the VM's bootstrap that is under investigation.
Makes no sense to continue here until that is clarified.
Please wait for further posts.

One post from me yet.
It looks like 'only 1 athena.py is running as a worker and doing the 2 events consecutively.
ID: 7461 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
David Cameron
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 20 Apr 16
Posts: 180
Credit: 1,355,327
RAC: 0
Message 7463 - Posted: 30 Jun 2022, 10:23:43 UTC - in response to Message 7461.  

Please try again with version 1.13. There was a bug in the bootstrapping mechanism that may have caused your CVMFS issues that is now fixed.
ID: 7463 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : ATLAS Application : ATLAS vbox v1.11


©2024 CERN