Message boards : Theory Application : Multicore settings for 20 cor machine
Message board moderation

To post messages, you must log in.

AuthorMessage
Toby Broom

Send message
Joined: 19 Aug 15
Posts: 46
Credit: 3,564,533
RAC: 228
Message 3876 - Posted: 30 Jul 2016, 8:15:24 UTC

The settings of the VM don't seem correctly applied.

I see my VM is set for 20 CPU's but the memory setting is still 630MB

The CPU load on my computer is about 25%
ID: 3876 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 327,341
RAC: 138
Message 3879 - Posted: 30 Jul 2016, 11:38:28 UTC - in response to Message 3876.  
Last modified: 30 Jul 2016, 11:38:44 UTC

I have to add some extra configuration to make it add extra memory for each additional core. For now you can set it manually in the app_config.xml
ID: 3879 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ben Segal
Volunteer moderator
Volunteer developer
Volunteer tester

Send message
Joined: 12 Sep 14
Posts: 65
Credit: 544
RAC: 0
Message 3885 - Posted: 30 Jul 2016, 13:31:50 UTC - in response to Message 3879.  
Last modified: 30 Jul 2016, 13:53:40 UTC

Just FYI, with my MacBook Pro (i7, 4 CPUs, 8 threads) and:

- no app_config.xml file
- the new project preference options set to 1 task max, 3 CPUs max
- only the Theory app checked

and with the latest updated server code, I get (YES!):

1 task (Theory) and a 3 CPU VM

and it works correctly so far… I will check for progress today, including some suspends/resumes.

Ben

EDIT: So far all goes well:
4 jobs run to completion, all 3 Condor job threads active. Suspend for now (15:50 CET)
ID: 3885 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1180
Credit: 815,336
RAC: 358
Message 3889 - Posted: 30 Jul 2016, 13:59:32 UTC - in response to Message 3885.  
Last modified: 30 Jul 2016, 14:06:21 UTC

- the new project preference options set to 1 task max, 3 CPUs max

Is this setting only for (ex-)CERN-employees??

I only see a new "Limit the number of tasks per host?" with a tick-box

I got at least 3 tasks with this option set to yes.
ID: 3889 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ben Segal
Volunteer moderator
Volunteer developer
Volunteer tester

Send message
Joined: 12 Sep 14
Posts: 65
Credit: 544
RAC: 0
Message 3890 - Posted: 30 Jul 2016, 14:17:28 UTC - in response to Message 3889.  

- the new project preference options set to 1 task max, 3 CPUs max

Is this setting only for (ex-)CERN-employees??

I only see a new "Limit the number of tasks per host?" with a tick-box

I got at least 3 tasks with this option set to yes.

Aaaargh!!! Looks like Laurence is doing development under our feet. Those preferences were set by me yesterday, before today's testing. The page with them displayed was still on my screen but I'd not refreshed it today. Now, as you say, they aren't shown any more. But hopefully they are still active somewhere..

Laurence, what goes ???
ID: 3890 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1180
Credit: 815,336
RAC: 358
Message 3891 - Posted: 30 Jul 2016, 14:53:10 UTC - in response to Message 3890.  

At least without app_config and no tasks, an empty cache and asking 0 days of work, I got 8 tasks for my 8 threaded (4 core HT) machine.
1 task started, created a VM with 8 processors, running 8 jobs with far too low memory. At least the swap is now used ;)
ID: 3891 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ben Segal
Volunteer moderator
Volunteer developer
Volunteer tester

Send message
Joined: 12 Sep 14
Posts: 65
Credit: 544
RAC: 0
Message 3892 - Posted: 30 Jul 2016, 15:28:47 UTC - in response to Message 3891.  

At least without app_config and no tasks, an empty cache and asking 0 days of work, I got 8 tasks for my 8 threaded (4 core HT) machine.
1 task started, created a VM with 8 processors, running 8 jobs with far too low memory. At least the swap is now used ;)

Yes, looks like Work In Progress (:-))
ID: 3892 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toby Broom

Send message
Joined: 19 Aug 15
Posts: 46
Credit: 3,564,533
RAC: 228
Message 3894 - Posted: 30 Jul 2016, 16:45:04 UTC

I to cp's 2Gb limit in my app config for 2 tasks, I have 64gb of ram on that machine so no problem.
ID: 3894 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 327,341
RAC: 138
Message 3895 - Posted: 30 Jul 2016, 20:05:39 UTC - in response to Message 3890.  

Laurence, what goes ???


Those options are just cosmetic, see this post. They will not do anything until the scheduler has been updated by David. See this post for the short term plan.

I changed the page while preparing this pull request. Feel free to add comments.
ID: 3895 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Theory Application : Multicore settings for 20 cor machine


©2024 CERN