Message boards :
CMS Application :
CMS multi-core
Message board moderation
Author | Message |
---|---|
Send message Joined: 8 Apr 15 Posts: 781 Credit: 12,422,653 RAC: 3,337 |
Tried the ones here and at production and none of them actually ran multi-core Still the same here set at 4 core and over at prod. they still say they are single core. https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310659 https://lhcathome.cern.ch/lhcathome/result.php?resultid=408133515 |
Send message Joined: 22 Apr 16 Posts: 677 Credit: 2,002,766 RAC: 0 |
Do you have this line seen: 2024-03-22 17:00:07 (43864): Setting CPU Count for VM. (4) For me it seem so, only the first job inside the task is running with four Core. |
Send message Joined: 8 Apr 15 Posts: 781 Credit: 12,422,653 RAC: 3,337 |
Yes I have had mine set for 4 (and at times 8) since it started in November 2022 here. I tried that setting at production it doesn't say it is 4 cores and is just 1 core as always It has only actually worked here once a few months ago (I have those saved here) Here is one of the 3 that worked last December https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3279982 (this one was 8 cores) The CPU time has to be longer than the Run time or it isn't actually running the 4 core |
Send message Joined: 8 Apr 15 Posts: 781 Credit: 12,422,653 RAC: 3,337 |
One finally decided to work here with 4 cores Cheapskates as usual with mine and I see others get 2000 credits and I get 328 https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310748 Run time 12 hours 56 min 19 sec CPU time 16 hours 0 min 17 sec Validate state Valid Credit 326.47 I have some more running right now 4 core and 8 core |
Send message Joined: 19 Apr 15 Posts: 4 Credit: 71,032 RAC: 0 |
Here is one I recently completed https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310730 Run time and cpu time different. Indicates 4 cores in the above workunit output. Cheers |
Send message Joined: 13 Feb 15 Posts: 1188 Credit: 862,257 RAC: 25 |
@ Magic Quantum Mechanic and tazzduke: I suppose your both mentioned results are probably from before the dual-core CMS-batch was submitted later on the 24th of March. When a 4- or 8-core VM is running these dual-core test-tasks, the CPU will be more than twice the runtime (wall-clock). See: https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310818 (Setting CPU Count for VM. (8)) and within an hour:or so: https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310951 (Setting CPU Count for VM. (2)) |
Send message Joined: 22 Apr 16 Posts: 677 Credit: 2,002,766 RAC: 0 |
Crystal, on this PC running 4-Core Tasks since a few days, without problems. https://lhcathomedev.cern.ch/lhcathome-dev/results.php?hostid=5116 Maximale Anzahl Aufgaben 1 Maximale Anzahl CPUs 4 |
Send message Joined: 8 Apr 15 Posts: 781 Credit: 12,422,653 RAC: 3,337 |
This is all I got so far CP https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311172 8 core Run time 3 hours 25 min 33 sec CPU time 3 hours 45 min 43 sec https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310977 4 core Run time 12 hours 43 min 59 sec CPU time 14 hours 57 min 21 sec https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3310748 4 core Run time 12 hours 56 min 19 sec CPU time 16 hours 0 min 17 sec One other is running now 8 core and I will run a few more 4-core tonight |
Send message Joined: 22 Aug 22 Posts: 22 Credit: 63,680 RAC: 0 |
When i set it to 3 cores it for some reason uses two cores. It also doesn't show job output in second tty. Only "Running job output should appear here." |
Send message Joined: 8 Apr 15 Posts: 781 Credit: 12,422,653 RAC: 3,337 |
Well the first 4 of the 6 I started yesterday are finished and worked this time but they didn't give me 12,000 credits each https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311770 Run time 16 hours 44 min 26 sec CPU time 2 days 10 hours 0 min 28 sec Validate state Valid Credit 263.29 (4-core) https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311727 Run time 16 hours 44 min 20 sec CPU time 2 days 11 hours 59 min 53 sec Validate state Valid Credit 208.94 (4 core) https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311743 Run time 16 hours 58 min 47 sec CPU time 2 days 11 hours 34 min 11 sec Validate state Valid Credit 211.49 (4 core) https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3311664 Run time 17 hours 0 min 49 sec CPU time 1 days 21 hours 35 min 42 sec Validate state Valid Credit 537.69 (8 core) 2 more running but if the credits are like that in production you won't get many of those Atlas crunchers to run many of these but just checking others I see some of these getting 2 or 3 thousand credits for shorter runs of these so as usual there is no standard credits for these CMS multi's |
Send message Joined: 8 Apr 15 Posts: 781 Credit: 12,422,653 RAC: 3,337 |
Todays results https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312334 Run time 16 hours 48 min 47 sec CPU time 2 days 11 hours 56 min 19 sec Validate state Valid Credit 238.41 - (4 core) https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312412 Run time 17 hours 3 min 0 sec CPU time 2 days 12 hours 29 min 0 sec Validate state Valid Credit 236.24 - (4 core) as usual I get those but magically I am the only one that doesn't get these https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312106 Started up 4 more |
Send message Joined: 22 Apr 16 Posts: 677 Credit: 2,002,766 RAC: 0 |
What you can do is a benchmark in Boinc. Those PC's with high Creditpoints have more than 20 GFlops. Your PC's show 16-17 GFops. |
Send message Joined: 8 Apr 15 Posts: 781 Credit: 12,422,653 RAC: 3,337 |
That still isn't 10 times better and I of course have compared all of the computers to see the entire differences. I could use my 24 core pc here but it is busy doing something else right now (I have ran the benchmarks here many many times) and I even did a reset and reinstall of a vdi for my Theory pc over at prod. about 90 minutes ago. 3am I guess I better pretend I am asleep since tomorrow is another long day......... |
Send message Joined: 8 Apr 15 Posts: 781 Credit: 12,422,653 RAC: 3,337 |
3am I guess I better pretend I am asleep since tomorrow is another long day......... (not that I want to GFlops = (CPU speed in GHz) x (number of CPU cores) x (CPU instruction per cycle) x (number of CPUs per node) while I am asleep |
Send message Joined: 13 Feb 15 Posts: 1188 Credit: 862,257 RAC: 25 |
After I tested the 4-core VM (not really a success with doing 4 cms jobs in almost 18 hours), I requested a dual core task. That task did 3 jobs within 4.5 hours, but now I don't get a new sub-job, so VM almost idling. |
Send message Joined: 13 Feb 15 Posts: 1188 Credit: 862,257 RAC: 25 |
I requested a dual core task. That task did 3 jobs within 4.5 hours, but now I don't get a new sub-job, so VM almost idling.I'm not so sure any longer that the VM is not processing events. No process cmsRun with up to 200% cpu or any other process with high CPU usage is shown in Console ALT-F3 (top), but the total CPU used by the VM since beginning is ~184% (incl. init phase) and there is also data transfered. At the start of the first three seen jobs at 27-mar-2024 05:38:10.10, 27-mar-2024 07:41:24.24 and 27-mar-2024 10:01:54.54 The last two jobs where I did not see a cmsRun data downloaded at 27-mar-2024 12:27:03.03 and 27-mar-2024 15:03:15.15 |
Send message Joined: 20 Jan 15 Posts: 1139 Credit: 8,310,612 RAC: 123 |
I requested a dual core task. That task did 3 jobs within 4.5 hours, but now I don't get a new sub-job, so VM almost idling.I'm not so sure any longer that the VM is not processing events. Update |
Send message Joined: 19 Apr 15 Posts: 4 Credit: 71,032 RAC: 0 |
Here is a 4 core I just completed. https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312968 Run time 14 hours 4 min 45 sec CPU time 2 days 4 hours 10 min 24 sec Regards |
Send message Joined: 22 Aug 22 Posts: 22 Credit: 63,680 RAC: 0 |
How hard would it be to make native version of CMS? |
Send message Joined: 8 Apr 15 Posts: 781 Credit: 12,422,653 RAC: 3,337 |
Todays results https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3313039 Run time 17 hours 28 min 36 sec CPU time 2 days 14 hours 6 min 14 sec Validate state Valid Credit 227.64 ( 4 core) https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312975 Run time 18 hours 1 min 26 sec CPU time 5 days 4 hours 20 min 53 sec Validate state Valid Credit 376.20 (8 core) https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312988 Run time 16 hours 47 min 53 sec CPU time 2 days 11 hours 35 min 7 sec Validate state Valid Credit 215.85 (4 core) |
©2024 CERN