Message boards : Theory Application : Task startup issue
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1067
Credit: 329,531
RAC: 199
Message 3823 - Posted: 26 Jul 2016, 21:27:55 UTC - in response to Message 3822.  
Last modified: 26 Jul 2016, 21:28:38 UTC

The new attributes in the project preferences are just cosmetic for now. Nothing acts upon them. Some of the possibilities are being discussed in this thread.

EDIT: I don't understand why BOINC assigns 1.5 cores.
ID: 3823 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivan
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 20 Jan 15
Posts: 1129
Credit: 7,901,648
RAC: 2,120
Message 3824 - Posted: 26 Jul 2016, 22:00:42 UTC - in response to Message 3822.  

What do you gave in your cc_config.xml in the BOINC directory? I've sometimes had to play with that to get BOINC to "simulate" the proper number of cores.
ID: 3824 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1185
Credit: 846,901
RAC: 2,193
Message 3825 - Posted: 27 Jul 2016, 5:36:44 UTC - in response to Message 3823.  

EDIT: I don't understand why BOINC assigns 1.5 cores.

It's configured by Rasputin in his app_config.xml.

In principle the partial use of a core was designed for supporting GPU's.

Example: you could have 3 GPU's or 3 tasks on 1 GPU claiming 1 CPU-core.

Claiming for 3 tasks 3 times 1.5 cores is rounded down to 4.
ID: 3825 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 3826 - Posted: 27 Jul 2016, 6:18:38 UTC - in response to Message 3825.  

It's configured by Rasputin in his app_config.xml.


No, it is not. It does that, even when i reset the project.
ID: 3826 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rom Walton (BOINC)

Send message
Joined: 20 Mar 15
Posts: 14
Credit: 5,132
RAC: 0
Message 3827 - Posted: 27 Jul 2016, 6:25:27 UTC - in response to Message 3823.  

The new attributes in the project preferences are just cosmetic for now. Nothing acts upon them. Some of the possibilities are being discussed in this thread.

EDIT: I don't understand why BOINC assigns 1.5 cores.


If you haven't been using the XML plan class stuff it is probably falling back to some hard coded values in the compiled server scheduler dating back years at this point.

See:
https://github.com/BOINC/boinc/blob/master/sched/sched_customize.cpp#L888

If you all want to switch over to the XML based plan-class we can go ahead and remove the hard-coded stuff put in for the theory app.

I guess we always assumed the intuitional knowledge about what was added for the various CERN projects would be passed on from one generation to the next.

----- Rom
ID: 3827 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 3828 - Posted: 27 Jul 2016, 6:34:04 UTC

I have a case, where i am running a 4 core tasks. For whatever reason, it decided after 3h or so, to discontinue 3 of them and runs only on one.
( as if it had hit the 12h mark, which it has not.)
ID: 3828 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ben Segal
Volunteer moderator
Volunteer developer
Volunteer tester

Send message
Joined: 12 Sep 14
Posts: 65
Credit: 544
RAC: 0
Message 3829 - Posted: 27 Jul 2016, 8:04:31 UTC - in response to Message 3828.  

I have a case, where i am running a 4 core tasks. For whatever reason, it decided after 3h or so, to discontinue 3 of them and runs only on one.
( as if it had hit the 12h mark, which it has not.)

I had the same thing yesterday with a 2 core task when one of the two job streams went quiet while the other continued to run jobs.
ID: 3829 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1185
Credit: 846,901
RAC: 2,193
Message 3830 - Posted: 27 Jul 2016, 8:55:35 UTC - in response to Message 3829.  
Last modified: 27 Jul 2016, 8:56:15 UTC

I have a case, where i am running a 4 core tasks. For whatever reason, it decided after 3h or so, to discontinue 3 of them and runs only on one.
( as if it had hit the 12h mark, which it has not.)

I had the same thing yesterday with a 2 core task when one of the two job streams went quiet while the other continued to run jobs.

I had that this morning, but no multi-core VM's.
I had 4 single core VM's running. 2 of them out of jobs, but they were not killed after 5 minutes idling.
Looking into the results, I see something has change to the logging (DEBUG-info) too.
http://lhcathomedev.cern.ch/vLHCathome-dev/result.php?resultid=229639
http://lhcathomedev.cern.ch/vLHCathome-dev/result.php?resultid=229103
The other 2 single core VM's still running and getting jobs.
ID: 3830 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rom Walton (BOINC)

Send message
Joined: 20 Mar 15
Posts: 14
Credit: 5,132
RAC: 0
Message 3831 - Posted: 27 Jul 2016, 16:36:24 UTC - in response to Message 3827.  

The new attributes in the project preferences are just cosmetic for now. Nothing acts upon them. Some of the possibilities are being discussed in this thread.

EDIT: I don't understand why BOINC assigns 1.5 cores.


If you haven't been using the XML plan class stuff it is probably falling back to some hard coded values in the compiled server scheduler dating back years at this point.

See:
https://github.com/BOINC/boinc/blob/master/sched/sched_customize.cpp#L888

If you all want to switch over to the XML based plan-class we can go ahead and remove the hard-coded stuff put in for the theory app.

I guess we always assumed the intuitional knowledge about what was added for the various CERN projects would be passed on from one generation to the next.

----- Rom


Just to be clear, removing line:
https://github.com/BOINC/boinc/blob/master/sched/sched_customize.cpp#L894

Should setup a multi-threaded VM to use as many cores as preferences allow and not cap it at 1.5 CPU(s).

----- Rom
ID: 3831 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rom Walton (BOINC)

Send message
Joined: 20 Mar 15
Posts: 14
Credit: 5,132
RAC: 0
Message 3832 - Posted: 27 Jul 2016, 17:41:00 UTC - in response to Message 3831.  

The new attributes in the project preferences are just cosmetic for now. Nothing acts upon them. Some of the possibilities are being discussed in this thread.

EDIT: I don't understand why BOINC assigns 1.5 cores.


If you haven't been using the XML plan class stuff it is probably falling back to some hard coded values in the compiled server scheduler dating back years at this point.

See:
https://github.com/BOINC/boinc/blob/master/sched/sched_customize.cpp#L888

If you all want to switch over to the XML based plan-class we can go ahead and remove the hard-coded stuff put in for the theory app.

I guess we always assumed the intuitional knowledge about what was added for the various CERN projects would be passed on from one generation to the next.

----- Rom


Just to be clear, removing line:
https://github.com/BOINC/boinc/blob/master/sched/sched_customize.cpp#L894

Should setup a multi-threaded VM to use as many cores as preferences allow and not cap it at 1.5 CPU(s).

----- Rom


I've gone ahead and removed the old CERN Theory policy from the stock source code.

See:
https://github.com/BOINC/boinc/commit/eac15d6982fc34ca3c781e0580d45b8f32039c22

----- Rom
ID: 3832 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 3833 - Posted: 27 Jul 2016, 18:00:09 UTC - in response to Message 3832.  

Thanks, Rom.
How is determined now, how many cores to be used?
By the project preference file? What if it is undefined?

ID: 3833 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rom Walton (BOINC)

Send message
Joined: 20 Mar 15
Posts: 14
Credit: 5,132
RAC: 0
Message 3834 - Posted: 27 Jul 2016, 18:20:12 UTC - in response to Message 3833.  

Thanks, Rom.
How is determined now, how many cores to be used?
By the project preference file? What if it is undefined?



I believe g_req->effective_ncpus is calculated from the global_prefs.

See:
http://lhcathomedev.cern.ch/vLHCathome-dev/prefs.php?subset=global

I would need to hunt down where exactly, I don't have a Visual Studio project for the server code. So I cannot easily cheat by having Visual Studio do all the hunting.

----- Rom
ID: 3834 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ben Segal
Volunteer moderator
Volunteer developer
Volunteer tester

Send message
Joined: 12 Sep 14
Posts: 65
Credit: 544
RAC: 0
Message 3850 - Posted: 29 Jul 2016, 9:18:08 UTC - in response to Message 3833.  

Thanks, Rom.
How is determined now, how many cores to be used?
By the project preference file? What if it is undefined?

...

Anyway be careful as Laurence hasn't yet fully implemented the new project preferences for number of cores and tasks… You may not get what you ask for until he's finished coding it.
ID: 3850 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 3852 - Posted: 29 Jul 2016, 9:33:36 UTC - in response to Message 3850.  

I know, it isn't functional, yet.

Would be nice, to get a message, when it is.
ID: 3852 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : Theory Application : Task startup issue


©2024 CERN