Message boards : CMS Application : CMS multi-core
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · Next

AuthorMessage
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1188
Credit: 854,677
RAC: 15
Message 8371 - Posted: 28 Mar 2024, 7:10:23 UTC

The 2 tasks I requested this morning created 2 dual core VM's, but both are running 1 single core job.
ID: 8371 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 674
Credit: 1,956,866
RAC: 871
Message 8372 - Posted: 28 Mar 2024, 7:36:54 UTC - in response to Message 8371.  

4-Core CMS-Task, on a Win11pro-Workstation.
https://lhcathomedev.cern.ch/lhcathome-dev/results.php?userid=378
ID: 8372 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8373 - Posted: 28 Mar 2024, 18:40:44 UTC
Last modified: 28 Mar 2024, 18:43:18 UTC

I have a couple more running and finished late tonight
ID: 8373 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8374 - Posted: 28 Mar 2024, 18:41:33 UTC

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3313349
Run time 17 hours 16 min 10 sec
CPU time 2 days 11 hours 43 min 19 sec
Validate state Valid
Credit 243.77 (4 core)
ID: 8374 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivan
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 20 Jan 15
Posts: 1138
Credit: 8,055,278
RAC: 3,236
Message 8375 - Posted: 28 Mar 2024, 20:44:33 UTC - in response to Message 8369.  

How hard would it be to make native version of CMS?

Not that easy. To my knowledge we have running versions of CMSSW on x64, NVidia (CUDA), XeonPhi (Kights Landing), and Arm. The original idea to run in VirtualBox was because the x64 architecture existed in Windows, Linux, and MacOS, so we could deploy to those environments with minimal additional effort. Given that the effort for years has been mostly Laurence (on the BOINC side), me from CMS, and lately Federica from CMS, I don't think we can support a large number of environments. You also have to realise that there are a heck of a lot of other things running behind the scenes, CVMFS and containerisation to name but two, so that folding them into a VM rather than expecting Volunteers to maintain them as well makes participation rather easier for Joe Average.
ID: 8375 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 674
Credit: 1,956,866
RAC: 871
Message 8376 - Posted: 28 Mar 2024, 21:38:25 UTC

Ivan,
we have 4-Core CMS and 1-Core CMS.
When this is transfered to production and running well, it's ok.
ID: 8376 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Fardringle

Send message
Joined: 31 Jul 22
Posts: 11
Credit: 4,125,854
RAC: 12,186
Message 8377 - Posted: 29 Mar 2024, 4:58:52 UTC - in response to Message 8339.  
Last modified: 29 Mar 2024, 5:12:40 UTC

My i7-8650U laptop and i7-4790 desktop both seem to be using between 3.5 and 4 CPU cores on their 4-core MT tasks. These computers are not running anything else.

My Xeon E5-2699 v3 is using almost exactly 4 CPU cores pretty consistently on its 4-core MT tasks. I do have other BOINC projects running on the other CPU cores on this computer.
ID: 8377 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8378 - Posted: 29 Mar 2024, 6:35:16 UTC - in response to Message 8377.  

My i7-8650U laptop and i7-4790 desktop both seem to be using between 3.5 and 4 CPU cores on their 4-core MT tasks. These computers are not running anything else.

My Xeon E5-2699 v3 is using almost exactly 4 CPU cores pretty consistently on its 4-core MT tasks. I do have other BOINC projects running on the other CPU cores on this computer.


Fardringle you need to go in your account here under *Preferences for this project* and set your CMS tasks to run with 4 cores per task because all of the ones you have been running are only using one core per task.

You can see that when you check your tasks STDERR where it says * Setting CPU Count for VM. (1)*
And when you do that and run a task here you will see that the CPU time is much longer than the Run time when you check your finished tasks.

They will then say they finish in close to 17hrs Run time and the CPU time will be over 2 days
ID: 8378 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8379 - Posted: 29 Mar 2024, 6:49:48 UTC - in response to Message 8375.  

Given that the effort for years has been mostly Laurence (on the BOINC side), me from CMS, and lately Federica from CMS, I don't think we can support a large number of environments. You also have to realise that there are a heck of a lot of other things running behind the scenes, CVMFS and containerisation to name but two, so that folding them into a VM rather than expecting Volunteers to maintain them as well makes participation rather easier for Joe Average.


Well here at -dev we have a few of us with plenty of VB and GPU experience that will be happy to test doing that here in the future Ivan.

Of course we do have members here that might be on that Average Joe list so you could just ask a few of us to do that or even make another url like the one we used to have for Atlas-Test if this is ever made possible to run tests for since that is how we did it with Atlas.......and CMS when we used call this place CERN CMS-dev
And of course way back in the beginning with T4T
ID: 8379 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8380 - Posted: 30 Mar 2024, 1:25:25 UTC

Todays results (looks like they are ready)
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3313414
Run time 16 hours 54 min 2 sec
CPU time 2 days 11 hours 39 min 50 sec
Validate state Valid
Credit 216.70
Device peak FLOPS 16.68 GFLOPS

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3313433
Run time 17 hours 15 min 29 sec
CPU time 2 days 13 hours 9 min 30 sec
Validate state Valid
Credit 278.10
Device peak FLOPS 16.63 GFLOPS

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3313421
Run time 17 hours 49 min 7 sec
CPU time 2 days 13 hours 13 min 46 sec
Validate state Valid
Credit 228.52
Device peak FLOPS 16.68 GFLOPS
ID: 8380 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Fardringle

Send message
Joined: 31 Jul 22
Posts: 11
Credit: 4,125,854
RAC: 12,186
Message 8381 - Posted: 30 Mar 2024, 3:34:50 UTC - in response to Message 8378.  

I think you are looking at older tasks. I switched to 4 thread tasks about 2 days ago, and all tasks since then are registering and using 4 threads. And the result logs and actual CPU usage confirm that.

If you are looking at my task history, everything returned after 29 Mar 2024, 8:38:12 UTC is running the new 4-thread CMS tasks.
ID: 8381 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8382 - Posted: 30 Mar 2024, 11:06:30 UTC - in response to Message 8381.  
Last modified: 30 Mar 2024, 11:08:17 UTC

Yes as you can see your first ones are after I posted that so all I could see were the ones that you finished before that time on the 29th

I see the ones you now have finished as multi-core
Mad Scientist For Life
ID: 8382 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8383 - Posted: 30 Mar 2024, 20:14:51 UTC

https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3313451


Yeah the Credits after all these years here are still a joke BUT I'm sure if it is like this in production you will get all of the members to jump on this one.
ID: 8383 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 674
Credit: 1,956,866
RAC: 871
Message 8384 - Posted: 31 Mar 2024, 5:33:44 UTC - in response to Message 8383.  

hoping to be the first with 20k ;-).
ID: 8384 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8385 - Posted: 31 Mar 2024, 7:35:41 UTC - in response to Message 8384.  
Last modified: 31 Mar 2024, 7:40:04 UTC

hoping to be the first with 20k ;-).

You better hurry Axel and it looks like it takes 32 cores for over 19K
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3312030

But then if you are lucky you can get 17K with only 4 cores
https://lhcathomedev.cern.ch/lhcathome-dev/result.php?resultid=3313663
ID: 8385 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
maeax

Send message
Joined: 22 Apr 16
Posts: 674
Credit: 1,956,866
RAC: 871
Message 8386 - Posted: 31 Mar 2024, 9:39:48 UTC - in response to Message 8385.  

It would be nice to change the Limit of 10 days to get this 25k (+5k) ;-)
Ivan, have your Team more of this CMS-Tasks?
https://home.cern/news/news/physics/first-observation-photons-taus-proton-proton-collisions-cms
ID: 8386 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8388 - Posted: 31 Mar 2024, 18:30:46 UTC



My personal record goal is 4000 Valid CMS here with less than 475 Credits each
ID: 8388 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8392 - Posted: 6 Apr 2024, 23:03:22 UTC

It looks like our new batch of CMS are back to the old version without actually running multi-core so far.
ID: 8392 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Magic Quantum Mechanic
Avatar

Send message
Joined: 8 Apr 15
Posts: 774
Credit: 11,944,427
RAC: 1,567
Message 8403 - Posted: 9 Apr 2024, 20:22:30 UTC

https://lhcathomedev.cern.ch/lhcathome-dev/server_status.php

New batch of CMS so lets see if it will run multi-core or not.
ID: 8403 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
kotenok2000
Avatar

Send message
Joined: 22 Aug 22
Posts: 22
Credit: 54,833
RAC: 18
Message 8405 - Posted: 10 Apr 2024, 13:06:58 UTC

It doesn't
ID: 8405 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · Next

Message boards : CMS Application : CMS multi-core


©2024 CERN