Welcome to MilkyWay@home

Ideal number of concurrent tasks.


Advanced search

Message boards : Number crunching : Ideal number of concurrent tasks.
Message board moderation

To post messages, you must log in.

AuthorMessage
MindCrime

Send message
Joined: 5 Mar 14
Posts: 20
Credit: 201,197,446
RAC: 108,788
200 million credit badge7 year member badge
Message 70562 - Posted: 9 Feb 2021, 19:19:07 UTC
Last modified: 9 Feb 2021, 19:37:18 UTC

On the higher FP64 cards like the tahitis, and radeon vii, some Titans, it seems better to run more than one task at once, but how many is optimal?
ID: 70562 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Holdolin

Send message
Joined: 9 Dec 11
Posts: 33
Credit: 1,041,621,794
RAC: 0
1 billion credit badge9 year member badge
Message 70563 - Posted: 9 Feb 2021, 21:20:49 UTC

It really depends on *which* high end card you're actually talking about. In my dealings 'round the DC circles it's been said that Nvidia cards see little gain in running multiple concurrent WUs. The AMD cards are a different story. I can only personally speak to the Vega64, RX580, and Pro VII. I run both the RX580s and Vega64s with 2 concurrent WUs each. My Pro VIIs run 4 concurrent tasks. I think i may be able to squeeze more out of the Vegas and VIIs but I just haven't gotten around to it. I believe part of the equation is the High Bandwidth Memory those cards use. The best way to figure it out is either talk to somebody with your specific card(s) or take notes on runtimes for single WU operation, then set it to double and see if your WU/time rate improves.
ID: 70563 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Vester
Avatar

Send message
Joined: 30 Dec 14
Posts: 33
Credit: 907,367,162
RAC: 4,462
500 million credit badge6 year member badge
Message 70564 - Posted: 9 Feb 2021, 23:16:20 UTC

I have four Radeon HD 7990 cards (2 GPU each card) running 5 WU/GPU. My CPU is a 4 core Intel i5 7600 (no hyperthreading), so I have 0.20 GPU and 0.01 CPU in my app_config.xml file.
ID: 70564 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Vester
Avatar

Send message
Joined: 30 Dec 14
Posts: 33
Credit: 907,367,162
RAC: 4,462
500 million credit badge6 year member badge
Message 70565 - Posted: 9 Feb 2021, 23:16:36 UTC
Last modified: 9 Feb 2021, 23:19:10 UTC

duplicate
ID: 70565 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
MindCrime

Send message
Joined: 5 Mar 14
Posts: 20
Credit: 201,197,446
RAC: 108,788
200 million credit badge7 year member badge
Message 70566 - Posted: 10 Feb 2021, 0:21:18 UTC - in response to Message 70564.  
Last modified: 10 Feb 2021, 0:59:48 UTC

I have four Radeon HD 7990 cards (2 GPU each card) running 5 WU/GPU. My CPU is a 4 core Intel i5 7600 (no hyperthreading), so I have 0.20 GPU and 0.01 CPU in my app_config.xml file.


I'm running two 7970s in one machine with a 3770k @ 3x WU each, 6 total. I can run 5-6 threads of universe and not slow down the MW tasks, at 7 threads it holds for cpu every once in a while. MW uses very little cpu, way less than the default suggests. I've dabbled with anywhere from 3-5 per 7970 over the years. my reasoning is mostly I wanted to reduce time in between WUs because at 1x they finish so fast that the couple seconds between wus becomes meaningful credit loss, imo.

seems like i get about 440k per day on the ghz one and 420k on the reference one @ 3 each. ill go to 5 and see if i squeeze any more out.

not sure why but after i set my app config to 0.20 i only got a total of 9 wus total, i switched to 0.19 and got 10 wus total, hopefully 5 each.
ID: 70566 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Holdolin

Send message
Joined: 9 Dec 11
Posts: 33
Credit: 1,041,621,794
RAC: 0
1 billion credit badge9 year member badge
Message 70567 - Posted: 10 Feb 2021, 1:44:16 UTC - in response to Message 70566.  



not sure why but after i set my app config to 0.20 i only got a total of 9 wus total, i switched to 0.19 and got 10 wus total, hopefully 5 each.


Ya, I noticed something similar. You post got me to get off my duff and set mine from .25 to .20. Until I read your reply I thought it was odd that some of my WUs were still completing in the time they were at .25, yet others were taking a tad longer.
ID: 70567 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
wb8ili

Send message
Joined: 18 Jul 10
Posts: 75
Credit: 453,834,040
RAC: 209,926
300 million credit badge11 year member badgeextraordinary contributions badge
Message 70568 - Posted: 10 Feb 2021, 14:45:52 UTC

I monitor the GPU processor usage. GPU memory usage has never been an issue for me. There are various ways to accomplish this based on your operating system and video card.

I figure if the GPU processor usage is substantially over 50% with one task, it probably doesn't make sense to run more than one task concurrently.

If the GPU processor usage is less than 50%, running additional tasks would increase my throughput.
ID: 70568 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
MindCrime

Send message
Joined: 5 Mar 14
Posts: 20
Credit: 201,197,446
RAC: 108,788
200 million credit badge7 year member badge
Message 70569 - Posted: 10 Feb 2021, 21:13:32 UTC - in response to Message 70568.  
Last modified: 10 Feb 2021, 21:16:15 UTC


I monitor the GPU processor usage. GPU memory usage has never been an issue for me. There are various ways to accomplish this based on your operating system and video card.

I figure if the GPU processor usage is substantially over 50% with one task, it probably doesn't make sense to run more than one task concurrently.

If the GPU processor usage is less than 50%, running additional tasks would increase my throughput.


Ive tested 3x 4x and 5x and seem to get pretty consistent credit. i could go down to two but im confident i wont get better credit. with higher concurrency i collect more WUprop hours.
ID: 70569 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dunx

Send message
Joined: 13 Feb 11
Posts: 31
Credit: 1,398,530,958
RAC: 261,518
1 billion credit badge10 year member badge
Message 70698 - Posted: 26 Mar 2021, 15:41:38 UTC
Last modified: 26 Mar 2021, 15:48:14 UTC

I'm running 8x on my Radeon VII but the real problem....

is the "Project" is not willing to keep it fed with work 24/7 !

I should sell it to some Bitcoin nut-job and scalp the hell out of them....

Grumpy old man,

dunx
ID: 70698 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
shift
Avatar

Send message
Joined: 21 Feb 18
Posts: 3
Credit: 1,505,183
RAC: 4
1 million credit badge3 year member badge
Message 70699 - Posted: 26 Mar 2021, 22:57:48 UTC - in response to Message 70698.  
Last modified: 26 Mar 2021, 23:00:18 UTC

I'm running 8x on my Radeon VII but the real problem....

is the "Project" is not willing to keep it fed with work 24/7 !


You probably know more about this than I do, but I've heard there is a way to run multiple clients on the one PC so that you don't hit limits imposed by the project. Or are you saying the project is running out of work? You could also crunch additional GPU project if you wanted.
ID: 70699 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileKeith Myers
Avatar

Send message
Joined: 24 Jan 11
Posts: 451
Credit: 348,461,976
RAC: 421,615
300 million credit badge10 year member badgeextraordinary contributions badge
Message 70700 - Posted: 27 Mar 2021, 0:52:47 UTC - in response to Message 70699.  

there is a way to run multiple clients on the one PC so that you don't hit limits imposed by the project

This is correct. Just run multiple clients and double, triple or quadruple the number of tasks you get per day because you are telling the scheduler you have 2X. 3X or 4X the number of gpus so the scheduler knows it has to feed more than your one R7.

Or spoof the number of cards in your coproc_info.xml file to tell the client you more than one R7.

Here is somebody's recipe for creating a multi-client host.

https://www.overclock.net/threads/guide-setting-up-multiple-boinc-instances.1628924/
ID: 70700 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profilemikey
Avatar

Send message
Joined: 8 May 09
Posts: 2543
Credit: 462,666,679
RAC: 64
300 million credit badge12 year member badgeextraordinary contributions badge
Message 70701 - Posted: 27 Mar 2021, 10:46:15 UTC - in response to Message 70568.  

I monitor the GPU processor usage. GPU memory usage has never been an issue for me. There are various ways to accomplish this based on your operating system and video card.

I figure if the GPU processor usage is substantially over 50% with one task, it probably doesn't make sense to run more than one task concurrently.

If the GPU processor usage is less than 50%, running additional tasks would increase my throughput.


Generally speaking, it really depends on memory after one unit at a time, but if it under 85 to 90% usage for one task trying running another task, 50% is leaving ALOT of crunching ability on the table. Now crunching more than one unit at a time also pushes the gpu towards it's upper limits and doing so can lower the life span of the gpu, miners do that all the time which is often why gpu's on the aftermarket that were used for mining don't do nearly as well as we had hoped they would. Like all those 30XX gpu's that were gobbled up before we crunchers had a chance to get them that will be coming back onto the market once there is something better or the bitcoin price goes too low, be careful of what you are buying.
ID: 70701 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dunx

Send message
Joined: 13 Feb 11
Posts: 31
Credit: 1,398,530,958
RAC: 261,518
1 billion credit badge10 year member badge
Message 70781 - Posted: 7 May 2021, 14:15:17 UTC

Thanks, for the info guys....

I was of the opinion that multiple clients wouldn't be allowed.

The project sends 900 tasks which process in about 10 seconds each, then it sits for 15 minutes to pass, before sending more.

At my desk I can poke it into action quite easily, but all day whilst at work it's on autopilot.

Must investigate further !

Regards,

Dunx
ID: 70781 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : Ideal number of concurrent tasks.

©2021 Astroinformatics Group