Message boards : CMS Application : New Version 60.40
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 647
Credit: 10,234,351
RAC: 11,074
Message 7217 - Posted: 6 Jul 2021, 2:17:41 UTC
Last modified: 6 Jul 2021, 2:18:08 UTC

1.31GB vdi d/l
ID: 7217 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
computezrmle
Avatar

Send message
Joined: 28 Jul 16
Posts: 382
Credit: 369,221
RAC: 32
Message 7218 - Posted: 6 Jul 2021, 4:29:32 UTC - in response to Message 7217.  

That's the compressed size.

The img has a prefilled CVMFS cache (~19200 files using ~2500 MiB).
All of them are required to run the CMS app.

Sending a small img with an empty cache (~400 MiB uncompressed) would mean that all those files would have to be downloaded at the beginning of the first CMS subtask.
This would need additional 35-40 min per task compared to 2-5 min once for downloading the large vdi.
The values are typical for my internet connection.
ID: 7218 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 586
Credit: 1,286,811
RAC: 143
Message 7219 - Posted: 6 Jul 2021, 8:31:34 UTC - in response to Message 7217.  

1.31GB vdi d/l

Not everyone have a big ISP-Connection like computezrmle.
ID: 7219 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 647
Credit: 10,234,351
RAC: 11,074
Message 7221 - Posted: 6 Jul 2021, 19:29:57 UTC

Yes I am just mentioning the size of the original .vdi for each new version in case anyone wonders since I watch every one load and mine was just over 60 minutes this time.

Of course after that the next tasks take seconds and start seconds after that.
After they get running I check the running log to see when they are actually running jobs.
That can take one or two hours.

100 events processed
dumping histograms...
200 events processed
dumping histograms...
300 events processed
dumping histograms...
400 events processed............
ID: 7221 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 647
Credit: 10,234,351
RAC: 11,074
Message 7223 - Posted: 6 Jul 2021, 20:54:06 UTC

Ok my first task finished Valid and it was a single core just for my first test and I saw Ivan also had one Valid with Linux so that is how I usually have to compare here since.......

So now I have a 2-core started to see if it actually run 2 at a time.
Some of us noticed that it wasn't actually running 2 tasks before BUT it did claim two cores and would even suspend running tasks so it could have those 2 cores.........including right from the start with those bad birds .


I will watch the running log to see how this goes and still let it run even if it doesn't run the 2 tasks
ID: 7223 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 647
Credit: 10,234,351
RAC: 11,074
Message 7224 - Posted: 6 Jul 2021, 22:44:02 UTC

Started running after about 1 hour
INFO:root:CMSSW configured for 1 cores and 0 event streams
Begin processing the 1st record. Run 1, Event 13610001, LumiSection 27221 on stream 0 at 07-Jul-2021 00:18:11.099 CEST

But it looks like it is still running a one-core task even though my Boinc Man. says it is using 2 cores and VB man. says 00:00:02.995182 PcBios: [SMP] BIOS with 2 CPUs

I guess I will find out when it is finished how much CPU time it has compared to Run time.
ID: 7224 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 647
Credit: 10,234,351
RAC: 11,074
Message 7227 - Posted: 7 Jul 2021, 20:44:20 UTC

Well this is what I got with the first 2-core
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=2996164

The run time is 17 hours 41 min and CPU time 14 hours 52 min
So the only thing that looks multi-core is the Credit 1,198
ID: 7227 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 586
Credit: 1,286,811
RAC: 143
Message 7228 - Posted: 8 Jul 2021, 6:10:04 UTC - in response to Message 7227.  

This Task you had running wrote:
2021-07-06 13:37:58 (3776): Setting CPU Count for VM. (2)
ID: 7228 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 586
Credit: 1,286,811
RAC: 143
Message 7229 - Posted: 8 Jul 2021, 11:06:24 UTC

Virtualbox 5.2.44, Windows 10pro(10.00.19043.00)
https://lhcathomedev.cern.ch/lhcathome-dev/workunit.php?wuid=2101510
Task with 2 CPU's running only with one CPU.
When 2 CPU's are active there are two running.log's shown: Running1.log and running2.log.
Only running.log is shown.
ID: 7229 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : CMS Application : New Version 60.40


©2022 CERN