Message boards : CMS Application : CMS multi-core
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 781
Credit: 12,422,653
RAC: 3,337
Message 8339 - Posted: 24 Mar 2024, 1:30:48 UTC

Tried the ones here and at production and none of them actually ran multi-core
Still the same here set at 4 core and over at prod. they still say they are single core.

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310659
https://lhcathome.cern.ch/lhcathome/result.php?resultid=408133515


ID: 8339 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 677
Credit: 2,002,766
RAC: 0
Message 8340 - Posted: 24 Mar 2024, 5:06:00 UTC

Do you have this line seen:
2024-03-22 17:00:07 (43864): Setting CPU Count for VM. (4)
For me it seem so, only the first job inside the task is running with four Core.
ID: 8340 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 781
Credit: 12,422,653
RAC: 3,337
Message 8341 - Posted: 24 Mar 2024, 5:19:02 UTC - in response to Message 8340.  
Last modified: 24 Mar 2024, 5:23:20 UTC

Yes I have had mine set for 4 (and at times 8) since it started in November 2022 here.

I tried that setting at production it doesn't say it is 4 cores and is just 1 core as always



It has only actually worked here once a few months ago (I have those saved here)
Here is one of the 3 that worked last December
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3279982
(this one was 8 cores)

The CPU time has to be longer than the Run time or it isn't actually running the 4 core
ID: 8341 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 781
Credit: 12,422,653
RAC: 3,337
Message 8342 - Posted: 25 Mar 2024, 0:48:02 UTC

One finally decided to work here with 4 cores
Cheapskates as usual with mine and I see others get 2000 credits and I get 328


https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310748

Run time 12 hours 56 min 19 sec
CPU time 16 hours 0 min 17 sec
Validate state Valid
Credit 326.47

I have some more running right now 4 core and 8 core
ID: 8342 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
tazzduke

Send message
Joined: 19 Apr 15
Posts: 4
Credit: 71,032
RAC: 0
Message 8343 - Posted: 25 Mar 2024, 3:24:45 UTC - in response to Message 8342.  

Here is one I recently completed

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310730

Run time and cpu time different.

Indicates 4 cores in the above workunit output.

Cheers
ID: 8343 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1188
Credit: 862,257
RAC: 25
Message 8344 - Posted: 25 Mar 2024, 8:36:42 UTC - in response to Message 8343.  

@ Magic Quantum Mechanic and tazzduke:

I suppose your both mentioned results are probably from before the dual-core CMS-batch was submitted later on the 24th of March.

When a 4- or 8-core VM is running these dual-core test-tasks, the CPU will be more than twice the runtime (wall-clock).

See: https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310818 (Setting CPU Count for VM. (8)) and
within an hour:or so: https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310951 (Setting CPU Count for VM. (2))
ID: 8344 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 677
Credit: 2,002,766
RAC: 0
Message 8345 - Posted: 25 Mar 2024, 9:22:05 UTC - in response to Message 8344.  
Last modified: 25 Mar 2024, 9:23:54 UTC

Crystal,
on this PC running 4-Core Tasks since a few days, without problems.
https://lhcathomedev.cern.ch/lhcathome-dev/results.php?hostid=5116
Maximale Anzahl Aufgaben 1
Maximale Anzahl CPUs 4
ID: 8345 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 781
Credit: 12,422,653
RAC: 3,337
Message 8352 - Posted: 25 Mar 2024, 19:37:06 UTC - in response to Message 8344.  

This is all I got so far CP
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311172
8 core
Run time 3 hours 25 min 33 sec
CPU time 3 hours 45 min 43 sec

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310977
4 core
Run time 12 hours 43 min 59 sec
CPU time 14 hours 57 min 21 sec

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310748
4 core
Run time 12 hours 56 min 19 sec
CPU time 16 hours 0 min 17 sec

One other is running now 8 core and I will run a few more 4-core tonight
ID: 8352 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
kotenok2000
Avatar

Send message
Joined: 22 Aug 22
Posts: 22
Credit: 63,680
RAC: 0
Message 8356 - Posted: 26 Mar 2024, 15:55:58 UTC
Last modified: 26 Mar 2024, 16:07:45 UTC

When i set it to 3 cores it for some reason uses two cores.

It also doesn't show job output in second tty.
Only "Running job output should appear here."
ID: 8356 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 781
Credit: 12,422,653
RAC: 3,337
Message 8360 - Posted: 26 Mar 2024, 19:16:48 UTC

Well the first 4 of the 6 I started yesterday are finished and worked this time but they didn't give me 12,000 credits each

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311770
Run time 16 hours 44 min 26 sec
CPU time 2 days 10 hours 0 min 28 sec
Validate state Valid
Credit 263.29 (4-core)

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311727
Run time 16 hours 44 min 20 sec
CPU time 2 days 11 hours 59 min 53 sec
Validate state Valid
Credit 208.94 (4 core)

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311743
Run time 16 hours 58 min 47 sec
CPU time 2 days 11 hours 34 min 11 sec
Validate state Valid
Credit 211.49 (4 core)

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311664
Run time 17 hours 0 min 49 sec
CPU time 1 days 21 hours 35 min 42 sec
Validate state Valid
Credit 537.69 (8 core)

2 more running but if the credits are like that in production you won't get many of those Atlas crunchers to run many of these but just checking others I see some of these getting 2 or 3 thousand credits for shorter runs of these so as usual there is no standard credits for these CMS multi's
ID: 8360 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 781
Credit: 12,422,653
RAC: 3,337
Message 8361 - Posted: 27 Mar 2024, 8:57:23 UTC
Last modified: 27 Mar 2024, 9:05:05 UTC

Todays results
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312334

Run time 16 hours 48 min 47 sec
CPU time 2 days 11 hours 56 min 19 sec
Validate state Valid
Credit 238.41 - (4 core)

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312412

Run time 17 hours 3 min 0 sec
CPU time 2 days 12 hours 29 min 0 sec
Validate state Valid
Credit 236.24 - (4 core)

as usual I get those but magically I am the only one that doesn't get these
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312106

Started up 4 more
ID: 8361 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 677
Credit: 2,002,766
RAC: 0
Message 8362 - Posted: 27 Mar 2024, 9:37:48 UTC - in response to Message 8361.  

What you can do is a benchmark in Boinc.
Those PC's with high Creditpoints have more than 20 GFlops.
Your PC's show 16-17 GFops.
ID: 8362 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 781
Credit: 12,422,653
RAC: 3,337
Message 8363 - Posted: 27 Mar 2024, 10:10:03 UTC - in response to Message 8362.  

That still isn't 10 times better and I of course have compared all of the computers to see the entire differences.
I could use my 24 core pc here but it is busy doing something else right now
(I have ran the benchmarks here many many times) and I even did a reset and reinstall of a vdi for my Theory pc over at prod. about 90 minutes ago.

3am I guess I better pretend I am asleep since tomorrow is another long day.........
ID: 8363 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 781
Credit: 12,422,653
RAC: 3,337
Message 8364 - Posted: 27 Mar 2024, 10:17:25 UTC - in response to Message 8362.  
Last modified: 27 Mar 2024, 10:22:13 UTC

3am I guess I better pretend I am asleep since tomorrow is another long day.........
(not that I want to GFlops = (CPU speed in GHz) x (number of CPU cores) x (CPU instruction per cycle) x (number of CPUs per node) while I am asleep
ID: 8364 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1188
Credit: 862,257
RAC: 25
Message 8365 - Posted: 27 Mar 2024, 11:01:06 UTC

After I tested the 4-core VM (not really a success with doing 4 cms jobs in almost 18 hours),
I requested a dual core task. That task did 3 jobs within 4.5 hours, but now I don't get a new sub-job, so VM almost idling.
ID: 8365 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1188
Credit: 862,257
RAC: 25
Message 8366 - Posted: 27 Mar 2024, 15:23:11 UTC - in response to Message 8365.  

I requested a dual core task. That task did 3 jobs within 4.5 hours, but now I don't get a new sub-job, so VM almost idling.
I'm not so sure any longer that the VM is not processing events.
No process cmsRun with up to 200% cpu or any other process with high CPU usage is shown in Console ALT-F3 (top),
but the total CPU used by the VM since beginning is ~184% (incl. init phase) and there is also data transfered.
At the start of the first three seen jobs at 27-mar-2024 05:38:10.10, 27-mar-2024 07:41:24.24 and 27-mar-2024 10:01:54.54
The last two jobs where I did not see a cmsRun data downloaded at 27-mar-2024 12:27:03.03 and 27-mar-2024 15:03:15.15
ID: 8366 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivan
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 20 Jan 15
Posts: 1139
Credit: 8,310,612
RAC: 123
Message 8367 - Posted: 27 Mar 2024, 19:16:12 UTC - in response to Message 8366.  

I requested a dual core task. That task did 3 jobs within 4.5 hours, but now I don't get a new sub-job, so VM almost idling.
I'm not so sure any longer that the VM is not processing events.
No process cmsRun with up to 200% cpu or any other process with high CPU usage is shown in Console ALT-F3 (top),
but the total CPU used by the VM since beginning is ~184% (incl. init phase) and there is also data transfered.
At the start of the first three seen jobs at 27-mar-2024 05:38:10.10, 27-mar-2024 07:41:24.24 and 27-mar-2024 10:01:54.54
The last two jobs where I did not see a cmsRun data downloaded at 27-mar-2024 12:27:03.03 and 27-mar-2024 15:03:15.15

Update
ID: 8367 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
tazzduke

Send message
Joined: 19 Apr 15
Posts: 4
Credit: 71,032
RAC: 0
Message 8368 - Posted: 27 Mar 2024, 20:59:15 UTC - in response to Message 8367.  

Here is a 4 core I just completed.

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312968

Run time 14 hours 4 min 45 sec
CPU time 2 days 4 hours 10 min 24 sec

Regards
ID: 8368 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
kotenok2000
Avatar

Send message
Joined: 22 Aug 22
Posts: 22
Credit: 63,680
RAC: 0
Message 8369 - Posted: 27 Mar 2024, 21:03:02 UTC

How hard would it be to make native version of CMS?
ID: 8369 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 781
Credit: 12,422,653
RAC: 3,337
Message 8370 - Posted: 28 Mar 2024, 4:36:05 UTC

Todays results
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3313039
Run time 17 hours 28 min 36 sec
CPU time 2 days 14 hours 6 min 14 sec
Validate state Valid
Credit 227.64 ( 4 core)

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312975
Run time 18 hours 1 min 26 sec
CPU time 5 days 4 hours 20 min 53 sec
Validate state Valid
Credit 376.20 (8 core)

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312988
Run time 16 hours 47 min 53 sec
CPU time 2 days 11 hours 35 min 7 sec
Validate state Valid
Credit 215.85 (4 core)
ID: 8370 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · Next

Message boards : CMS Application : CMS multi-core


©2024 CERN