Message boards : News : Project Configuration Update 2
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 325,950
RAC: 278
Message 3200 - Posted: 3 May 2016, 19:22:10 UTC
Last modified: 3 May 2016, 19:23:19 UTC

Some project configuration parameters have been changed to help avoid hosts being swamped with tasks and to back off problem hosts.

<daily_result_quota> 2 </daily_result_quota>

<max_wus_in_progress> 1 </max_wus_in_progress>

<max_wus_to_send> 1 </max_wus_to_send>

<min_sendwork_interval> 60 </min_sendwork_interval>


Note that the values are multiplied by the number of cores and we estimate tasks lasting for at least 12 hours.

Ref: https://boinc.berkeley.edu/trac/wiki/ProjectOptions

Please post if this causes any problems for anyone.
ID: 3200 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1178
Credit: 810,985
RAC: 2,009
Message 3204 - Posted: 3 May 2016, 20:05:53 UTC

Not sure, if this is the cause of the error I get:

vLHCathome-dev 03 May 22:03:39 update requested by user
vLHCathome-dev 03 May 22:03:42 Sending scheduler request: Requested by user.
vLHCathome-dev 03 May 22:03:42 Reporting 2 completed tasks
vLHCathome-dev 03 May 22:03:42 Not requesting tasks: "no new tasks" requested via Manager
vLHCathome-dev 03 May 22:03:43 Scheduler request completed
vLHCathome-dev 03 May 22:03:43 Server can't open log file (../log_boincai05/scheduler.log)


The project update fails.
ID: 3204 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 325,950
RAC: 278
Message 3205 - Posted: 3 May 2016, 20:12:11 UTC - in response to Message 3204.  

Thanks for the report. I have fixed this.
ID: 3205 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1178
Credit: 810,985
RAC: 2,009
Message 3207 - Posted: 3 May 2016, 20:25:22 UTC

Error gone and update successful. Thanks!
ID: 3207 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 3211 - Posted: 3 May 2016, 20:57:06 UTC

When there was a credentials problem, the tasks errored out after a few minutes.
This would very quickly ruin the daily quota, resulting in not being able to get work.

Would "abandoned task" count as error towards the daily quota?
ID: 3211 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 325,950
RAC: 278
Message 3217 - Posted: 3 May 2016, 21:47:39 UTC - in response to Message 3211.  

As far as I understand the documentation, tasks aborted by the user don't count but the credential problem would have done. The idea being that if there are issues, it is better that the host backs off and looks for work elsewhere. If there is a general infrastructure issue, these values can be reset on the server.
ID: 3217 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 3220 - Posted: 3 May 2016, 21:56:37 UTC - in response to Message 3217.  

<min_sendwork_interval> 60 </min_sendwork_interval>


I suggest to set this higher(maybe 900sec)

This would also have the benefit of spacing off CMS-tasks, that they do not upload at the same time. I know, there is no guarantee,but if tasks are started with an offset to each other, there is a better chance.
ID: 3220 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1178
Credit: 810,985
RAC: 2,009
Message 3225 - Posted: 4 May 2016, 5:33:18 UTC - in response to Message 3220.  

<min_sendwork_interval> 60 </min_sendwork_interval>

The way I always understood this setting, it does not separate tasks to start, but an request for more work will be refused by the server during this period.
The update will restart the interval period.
When you're allowed to request new work, the server will send enough to fill your cache, except when there is a limit task set on the server per host or per core.
ID: 3225 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 3272 - Posted: 5 May 2016, 16:44:59 UTC
Last modified: 5 May 2016, 16:46:34 UTC

Good news: The daily quota works.

Bad news: i already hit it.
ID: 3272 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivan
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 20 Jan 15
Posts: 1128
Credit: 7,870,419
RAC: 595
Message 3280 - Posted: 6 May 2016, 7:36:51 UTC - in response to Message 3272.  

Good news: The daily quota works.

Bad news: i already hit it.

Is that glass half-full or half-empty?
ID: 3280 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 3281 - Posted: 6 May 2016, 8:17:49 UTC - in response to Message 3280.  

As long as i can fill it up again, half full.
ID: 3281 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile tullio

Send message
Joined: 17 Aug 15
Posts: 62
Credit: 296,695
RAC: 0
Message 3312 - Posted: 12 May 2016, 3:13:26 UTC

After cleaning all tasks running and installed the Windows 10 update, I restarted BOINC Manager and dowwnloaded 4 vLHCathome-dev tasks. But only one is running, the other three are ready to start. I have 4 cores and there are no other tasks running, except two Einstein@home GPU tasks, one of which is running.
Tullio
ID: 3312 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1178
Credit: 810,985
RAC: 2,009
Message 3313 - Posted: 12 May 2016, 5:24:37 UTC - in response to Message 3312.  

... and dowwnloaded 4 vLHCathome-dev tasks. But only one is running, the other three are ready to start. I have 4 cores and there are no other tasks running, ...
Tullio

Is this just information or do you have a question?
ID: 3313 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile tullio

Send message
Joined: 17 Aug 15
Posts: 62
Credit: 296,695
RAC: 0
Message 3314 - Posted: 12 May 2016, 6:43:49 UTC - in response to Message 3313.  

Yes, why only one has started? If I download Atlas@home all 4 tasks start. Is this related to the app_config.xml file which was downloaded?
Tullio
ID: 3314 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ben Segal
Volunteer moderator
Volunteer developer
Volunteer tester

Send message
Joined: 12 Sep 14
Posts: 65
Credit: 544
RAC: 0
Message 3315 - Posted: 12 May 2016, 7:11:48 UTC - in response to Message 3314.  

Yes, why only one has started? If I download Atlas@home all 4 tasks start. Is this related to the app_config.xml file which was downloaded?
Tullio

Yes, that is the reason.
ID: 3315 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile tullio

Send message
Joined: 17 Aug 15
Posts: 62
Credit: 296,695
RAC: 0
Message 3317 - Posted: 12 May 2016, 7:40:44 UTC - in response to Message 3315.  
Last modified: 12 May 2016, 7:42:33 UTC

Thanks Ben. So vLHCathome-dev gets at most one core, the other 3 of my AMD A10-6700 are free for other projects, plus one GPU task, either Einstein@home or SETI@home, which offer GPU tasks both on the Nvidia board of the Windows PC and the AMD/ATI board of the older Linux box, nicknamed "Old Faithful". Only the 32-bit HP Linux box is still getting vLHC@home tasks and contributing to MCPLOTS.
Tullio
ID: 3317 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivan
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 20 Jan 15
Posts: 1128
Credit: 7,870,419
RAC: 595
Message 3318 - Posted: 12 May 2016, 7:48:13 UTC - in response to Message 3314.  

Yes, why only one has started? If I download Atlas@home all 4 tasks start. Is this related to the app_config.xml file which was downloaded?
Tullio

Yes, that's to avoid overloading hosts without resources to run several tasks at once. You can edit the file to allow more, and then reload config files to bring it into effect.
ID: 3318 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
zombie67 [MM]
Avatar

Send message
Joined: 26 Feb 15
Posts: 26
Credit: 4,101,356
RAC: 0
Message 3469 - Posted: 22 May 2016, 20:51:48 UTC - in response to Message 3318.  

Yes, that's to avoid overloading hosts without resources to run several tasks at once. You can edit the file to allow more, and then reload config files to bring it into effect.


By resources, are you talking only about memory? Or also CPU threads?

What are the maximum resources any give task could require? That will help us decide the maximum number of tasks to run at a time.

Thanks!
Reno, NV
Team: SETI.USA
ID: 3469 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivan
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 20 Jan 15
Posts: 1128
Credit: 7,870,419
RAC: 595
Message 3474 - Posted: 23 May 2016, 11:29:49 UTC - in response to Message 3469.  

Yes, that's to avoid overloading hosts without resources to run several tasks at once. You can edit the file to allow more, and then reload config files to bring it into effect.


By resources, are you talking only about memory? Or also CPU threads?

What are the maximum resources any give task could require? That will help us decide the maximum number of tasks to run at a time.

Thanks!

For CMS@Home, mainly memory. The VM is nominally 2 GB. E.g., if I try to run four on my 8 GB Linux box, then I start to swap memory and performance drops so much that I can't get any keyboard response to kill one off. :-( On the other hand, I'm happily running five on a 12-core 64 GB host, together with seven SETI@Home jobs.
ID: 3474 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Keiken

Send message
Joined: 2 Jul 15
Posts: 15
Credit: 140,962
RAC: 0
Message 3549 - Posted: 10 Jun 2016, 12:00:35 UTC

Every time BOINC starts I get four notices from it:
Your app_config.xml file refers to an unknown application 'LHCb'. Known applications: 'CMS'

The other three are for ALICE, ATLAS and Theory.

This is my app_config:
<app_config>
<project_max_concurrent>2</project_max_concurrent>
<app>
<name>ATLAS</name>
<max_concurrent>2</max_concurrent>
</app>
<app>
<name>ALICE</name>
<max_concurrent>2</max_concurrent>
</app>
<app>
<name>CMS</name>
<max_concurrent>2</max_concurrent>
</app>
<app>
<name>LHCb</name>
<max_concurrent>2</max_concurrent>
</app>
<app>
<name>Theory</name>
<max_concurrent>2</max_concurrent>
</app>
</app_config>
ID: 3549 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : News : Project Configuration Update 2


©2024 CERN