Message boards : News : Project Configuration Update
Message board moderation

To post messages, you must log in.

Previous · 1 · 2

AuthorMessage
Phil

Send message
Joined: 9 Apr 15
Posts: 57
Credit: 230,221
RAC: 0
Message 2849 - Posted: 19 Apr 2016, 13:04:55 UTC - in response to Message 2848.  

Have put the limit to 5 tasks in progress.

Yep, thats about the limit for a 16GB host.

Aww, but what about my 128 GB host (with 20 cores...)?

It seems to have a terrible performance:
State: All (66) · In progress (0) · Validation pending (0) · Validation inconclusive (0) · Valid (16) · Invalid (0) · Error (50)
ID: 2849 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile PDW

Send message
Joined: 20 May 15
Posts: 217
Credit: 5,470,383
RAC: 11,784
Message 2850 - Posted: 19 Apr 2016, 13:11:57 UTC - in response to Message 2849.  

Have put the limit to 5 tasks in progress.

Yep, thats about the limit for a 16GB host.

Aww, but what about my 128 GB host (with 20 cores...)?

It seems to have a terrible performance:
State: All (66) · In progress (0) · Validation pending (0) · Validation inconclusive (0) · Valid (16) · Invalid (0) · Error (50)

That's probably due to the Fibre internet connection he has.
Shame the Fibre in question is a piece of damp string ;-)
ID: 2850 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivan
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 20 Jan 15
Posts: 1129
Credit: 7,874,101
RAC: 172
Message 2852 - Posted: 19 Apr 2016, 13:18:19 UTC - in response to Message 2849.  
Last modified: 19 Apr 2016, 13:21:43 UTC

There were no jobs available when I fired it up just now; looks like I've downloaded ten since.
[Edit] Ah no, five. The other five are on my Linux desktop. [/Edit]
ID: 2852 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Phil

Send message
Joined: 9 Apr 15
Posts: 57
Credit: 230,221
RAC: 0
Message 2853 - Posted: 19 Apr 2016, 13:28:44 UTC - in response to Message 2850.  

That's probably due to the Fibre internet connection he has.
Shame the Fibre in question is a piece of damp string ;-)

I've seen it actually. On the roof of the Howell Centre you can just see a Heinz Soup can, with a long piece of string that runs to one of those tiny top-floor windows of Tower D.
ID: 2853 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Crystal Pellet
Volunteer tester

Send message
Joined: 13 Feb 15
Posts: 1180
Credit: 815,336
RAC: 431
Message 2856 - Posted: 19 Apr 2016, 14:58:50 UTC - in response to Message 2848.  

Have put the limit to 5 tasks in progress.

Yep, thats about the limit for a 16GB host.

Aww, but what about my 128 GB host (with 20 cores...)?

Easy! In the early days T4T doesn't want to overload volunteer machines and restricted 1 task per host and the 32bit-Linux VM only used 256MB.
Now it's limited to 2 per host. I created multiple BOINC-clients to start for my needs to separate projects, subprojects, limiting resource share problems etc.
ID: 2856 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile tullio

Send message
Joined: 17 Aug 15
Posts: 62
Credit: 296,695
RAC: 0
Message 2859 - Posted: 19 Apr 2016, 15:26:45 UTC
Last modified: 19 Apr 2016, 15:29:45 UTC

My AMD A10-6700 has 4 cores. I have now 4 vLHCathome-dev tasks running, one is a CMS, two are Theory 0.01 and one LHCb 0.05. Only GPU tasks, both SETI@home and Einstein@home run beyond the 4 cores limit.
Tullio
ID: 2859 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 327,073
RAC: 133
Message 2898 - Posted: 21 Apr 2016, 14:02:25 UTC - in response to Message 2841.  
Last modified: 21 Apr 2016, 14:03:00 UTC

I tried creating an app_config.xml file in the projects/lhcathomedev.cern.ch_vLHCathome-dev directory with the following content.

<app_config>
  <project_max_concurrent>1</project_max_concurrent>
</app_config>


However my client still get 5 tasks. What I am doing wrong?
ID: 2898 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 327,073
RAC: 133
Message 2899 - Posted: 21 Apr 2016, 14:17:18 UTC - in response to Message 2898.  

To answer my own question, this attribute is new in 7.4.9 and I have 7.2.42

https://boinc.berkeley.edu/wiki/Client_configuration#Application_configuration
ID: 2899 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 327,073
RAC: 133
Message 2900 - Posted: 21 Apr 2016, 14:24:18 UTC - in response to Message 2899.  

From what I can see, I can add this file for the project so that novice users will only get one task but advanced users can find it and tune it. Suggestions welcome for a good default version.
ID: 2900 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 2901 - Posted: 21 Apr 2016, 14:45:09 UTC - in response to Message 2900.  

When a user requests work, he requests a certain amount of seconds.
I believe, the server has a wrong setting, not knowing how long the tasks are.
The server needs to be told, that a task has a lenght of x seconds.
That way, boinc will only download the number of tasks with a total lenght,specified in the work buffer settings.
Currently, that is not the case.
ID: 2901 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Laurence
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 12 Sep 14
Posts: 1064
Credit: 327,073
RAC: 133
Message 2902 - Posted: 21 Apr 2016, 15:13:15 UTC - in response to Message 2901.  

Thanks any idea what and where that setting is on the sever?
ID: 2902 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 2904 - Posted: 21 Apr 2016, 16:00:22 UTC - in response to Message 2902.  
Last modified: 21 Apr 2016, 16:01:02 UTC

My guess: estimated computation size (GFlops).For a tasks.

The current time remaining of an unstarted task is 7h38min (on my computer)
This value will be corrected gradually, the more tasks i am doing.
However, it helps, if it is close to the real value.(more like 14h, in my case)


There must be other poeple, who know more about boinc server settings.
ID: 2904 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
m
Volunteer tester

Send message
Joined: 20 Mar 15
Posts: 243
Credit: 886,442
RAC: 486
Message 2905 - Posted: 21 Apr 2016, 16:13:06 UTC - in response to Message 2898.  

Also, if the "project" max behaves as the "app" max does, you may still download tasks up to the number of available cores, but only the number specified will run, the others will wait.
ID: 2905 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
m
Volunteer tester

Send message
Joined: 20 Mar 15
Posts: 243
Credit: 886,442
RAC: 486
Message 2906 - Posted: 21 Apr 2016, 16:20:10 UTC - in response to Message 2902.  
Last modified: 21 Apr 2016, 16:21:50 UTC

Thanks any idea what and where that setting is on the sever?

You might get some ideas from here
ID: 2906 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivan
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 20 Jan 15
Posts: 1129
Credit: 7,874,101
RAC: 172
Message 2907 - Posted: 21 Apr 2016, 16:28:46 UTC - in response to Message 2906.  

Thanks any idea what and where that setting is on the sever?

You might get some ideas from here

"Last modified 5 years ago" -- I think CreditScrew is more recent than that, isn't it?
ID: 2907 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 2908 - Posted: 21 Apr 2016, 16:41:40 UTC
Last modified: 21 Apr 2016, 17:17:02 UTC

The task properties show estimated 1,000,000GFLPOPs.
I would set that at least to 50,000,000 GFLOPs. EDIT: would not help
There is still a chance, that some other setting like (max tasks) will disable that function.
ID: 2908 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
m
Volunteer tester

Send message
Joined: 20 Mar 15
Posts: 243
Credit: 886,442
RAC: 486
Message 2909 - Posted: 21 Apr 2016, 16:44:46 UTC - in response to Message 2907.  

Thanks any idea what and where that setting is on the sever?

You might get some ideas from here

"Last modified 5 years ago" -- I think CreditScrew is more recent than that, isn't it?

Yes but this is about job size estimation rather than credit.
The credit stuff is here
ID: 2909 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 2910 - Posted: 21 Apr 2016, 16:53:29 UTC

I found this:

https://boinc.berkeley.edu/boinc.pdf

It is a bit old, but it still applies (i think)

Chapter 11 and 12 is quite interesting.
ID: 2910 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Toby Broom

Send message
Joined: 19 Aug 15
Posts: 46
Credit: 3,564,533
RAC: 274
Message 3273 - Posted: 5 May 2016, 19:49:07 UTC

Can you make it not over write the appconfig frequently?
ID: 3273 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rasputin42
Volunteer tester

Send message
Joined: 16 Aug 15
Posts: 966
Credit: 1,211,816
RAC: 0
Message 3274 - Posted: 5 May 2016, 20:04:14 UTC - in response to Message 3273.  
Last modified: 5 May 2016, 20:05:35 UTC

Please see message from Crystal Pellet:

Yes, cause from BOINC client configuration (cc_config.xml in BOINC Data-directory):

<dont_check_file_sizes>0|1</dont_check_file_sizes>
Normally, the size of application and input files are compared with the project-supplied values after the files are downloaded and just before starting an application.
If this flag is set, this check is skipped. Use it if you need to modify files locally for some reason.

I restarted BOINC and had no problems with my modified and extended app_config.xml. Project size 411 bytes, my size 594 bytes.
But I already had the flag <dont_check_file_sizes> set to true (1) in my cc_config.xml.
Yes, cause from BOINC client configuration (cc_config.xml in BOINC Data-directory):

<dont_check_file_sizes>0|1</dont_check_file_sizes>
Normally, the size of application and input files are compared with the project-supplied values after the files are downloaded and just before starting an application.
If this flag is set, this check is skipped. Use it if you need to modify files locally for some reason.

I restarted BOINC and had no problems with my modified and extended app_config.xml. Project size 411 bytes, my size 594 bytes.
But I already had the flag <dont_check_file_sizes> set to true (1) in my cc_config.xml.
ID: 3274 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2

Message boards : News : Project Configuration Update


©2024 CERN