Welcome to MilkyWay@home

Option in project preferences to set max CPUs

Message boards : Number crunching : Option in project preferences to set max CPUs
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Searching to find the meaning ...
Avatar

Send message
Joined: 5 Dec 15
Posts: 4
Credit: 869,839
RAC: 9
Message 76820 - Posted: 26 Jan 2024, 22:49:43 UTC

Other DC (boinc) projects [e.g., Amicable numbers] which potentially tie up all the CPUs on one's PC have a mechanism where the max number of CPUs that can be used by any task is set by the user... and this is a straight-forward option within the Project preferences without any monkeying around:
Preferences for this project	Amicable Numbers preferences
                         ^ You can set a limit on the number of CPU cores used

LLP
ID: 76820 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Finn the Human
Avatar

Send message
Joined: 23 Dec 18
Posts: 23
Credit: 10,211,388
RAC: 768
Message 76821 - Posted: 27 Jan 2024, 0:32:26 UTC - in response to Message 76820.  

Yes, I believe the highest number of cpus a wu can use right now is 16
Everything stays
But it still changes
Ever so slightly
Daily and nightly
In little ways
When everything stays...

ID: 76821 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3323
Credit: 520,701,264
RAC: 34,007
Message 76822 - Posted: 27 Jan 2024, 11:38:48 UTC - in response to Message 76820.  

Other DC (boinc) projects [e.g., Amicable numbers] which potentially tie up all the CPUs on one's PC have a mechanism where the max number of CPUs that can be used by any task is set by the user... and this is a straight-forward option within the Project preferences without any monkeying around:
Preferences for this project	Amicable Numbers preferences
                         ^ You can set a limit on the number of CPU cores used

LLP


I use this app_config.xml file to make mine only use 2 cpu's per task

<app_config>


<app_version>
<app_name>milkyway_nbody</app_name>
<plan_class>mt</plan_class>
<avg_ncpus>2</avg_ncpus>
<cmdline>--nthreads 2</cmdline>
</app_version>

<project_max_concurrent>2</project_max_concurrent>

</app_config>

It tells the pc to only use 2 cpu's per task and then to only run 2 tasks max, I adjust the last line based on the pc it's on, this one is from my laptop but my 5950X is running 15 tasks at a time when it runs them.
ID: 76822 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Finn the Human
Avatar

Send message
Joined: 23 Dec 18
Posts: 23
Credit: 10,211,388
RAC: 768
Message 76825 - Posted: 27 Jan 2024, 22:38:41 UTC - in response to Message 76822.  

Thanks, I've set mine to also run multiple lower CPU count WUs. Is there any performance increase you see for doing this?
Everything stays
But it still changes
Ever so slightly
Daily and nightly
In little ways
When everything stays...

ID: 76825 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3323
Credit: 520,701,264
RAC: 34,007
Message 76826 - Posted: 27 Jan 2024, 22:45:09 UTC - in response to Message 76825.  

Thanks, I've set mine to also run multiple lower CPU count WUs. Is there any performance increase you see for doing this?


No I do it because MilkyWay isn't my prime focus right now and I can adjust the tasks up and down easily and quickly depending on when my other projects have the tasks I want.
ID: 76826 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
xii5ku

Send message
Joined: 1 Jan 17
Posts: 36
Credit: 100,894,732
RAC: 285,605
Message 76842 - Posted: 29 Jan 2024, 15:38:58 UTC - in response to Message 76825.  

Finn the Human wrote:
Thanks, I've set mine to also run multiple lower CPU count WUs. Is there any performance increase you see for doing this?
CPU utilization at high thread counts per task is not very good, therefore it occurs to me that host utilization is better with lower thread counts per task and higher number of concurrent tasks on a host. I am considering to eventually measure whether or not there is merit to my assumption, but haven't taken the time yet to set up a respective experiment, which would involve running a fixed workunit outside of BOINC for hopefully direct and precise comparison of different threads/tasks settings.
ID: 76842 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Finn the Human
Avatar

Send message
Joined: 23 Dec 18
Posts: 23
Credit: 10,211,388
RAC: 768
Message 76910 - Posted: 10 Feb 2024, 22:11:13 UTC - in response to Message 76842.  

Just eyeballing the numbers, I see higher CPU utilization and more WUs being crunched. Probably because now I can run 6x (4core) WUs and saturate all 24 threads of my CPU. Individual WUs suffer less run time increase than the number of cores removed per WU.
Everything stays
But it still changes
Ever so slightly
Daily and nightly
In little ways
When everything stays...

ID: 76910 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Magiceye04

Send message
Joined: 14 Feb 10
Posts: 14
Credit: 109,874,855
RAC: 2,621
Message 77036 - Posted: 5 Apr 2024, 20:14:55 UTC - in response to Message 76842.  

Finn the Human wrote:
Thanks, I've set mine to also run multiple lower CPU count WUs. Is there any performance increase you see for doing this?
CPU utilization at high thread counts per task is not very good, therefore it occurs to me that host utilization is better with lower thread counts per task and higher number of concurrent tasks on a host. I am considering to eventually measure whether or not there is merit to my assumption, but haven't taken the time yet to set up a respective experiment, which would involve running a fixed workunit outside of BOINC for hopefully direct and precise comparison of different threads/tasks settings.


I have also noticed that.
On my 16core CPU I had to use 3x15Threads to get around 100% CPU load.
Now I try with 4x10Threads which is also running fine.
I have told my CPU to be a 45core via cc_config.xml.

With 2x16Threads I only saw about 50% load. The first minute only one Thread is under load and the second minute 12 Threads were loaded. This is really bad efficiency.
ID: 77036 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : Option in project preferences to set max CPUs

©2024 Astroinformatics Group