Welcome to MilkyWay@home

Why is it so hard to get work?


Advanced search

Message boards : Number crunching : Why is it so hard to get work?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 12 · Next

AuthorMessage
ProfilePhil
Avatar

Send message
Joined: 13 Feb 08
Posts: 1124
Credit: 46,740
RAC: 0
10 thousand credit badge13 year member badge
Message 21309 - Posted: 5 May 2009, 0:54:49 UTC - in response to Message 21308.  

I've gotten quite a bit of work lately....not a ton but a healthy amnt...

I managed to DL a 12 unit set this weekend. I almost threw a party in honor of the occasion.

Do that every day to get the 5,000 jackpot!
ID: 21309 · Rating: 0 · rate: Rate + / Rate - Report as offensive
James Nunley

Send message
Joined: 29 Nov 07
Posts: 39
Credit: 74,300,629
RAC: 0
50 million credit badge13 year member badge
Message 21317 - Posted: 5 May 2009, 4:27:51 UTC
Last modified: 5 May 2009, 4:28:15 UTC

What is really weird is that I have one machine that seems to get work all the time and the rest just get a few units now and again.
ID: 21317 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Profileverstapp
Avatar

Send message
Joined: 26 Jan 09
Posts: 589
Credit: 497,834,261
RAC: 0
300 million credit badge12 year member badge
Message 21318 - Posted: 5 May 2009, 5:01:16 UTC

I have one machine that has never run out, but that takes 40min to run a WU using Cluster's optimised [CPU] client.
My radeons [on other machines] spend 99% of their time idle.
Cheers,

PeterV

.
ID: 21318 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Van Durrett

Send message
Joined: 9 Jan 09
Posts: 1
Credit: 8,183,213
RAC: 0
5 million credit badge12 year member badge
Message 21504 - Posted: 7 May 2009, 14:15:37 UTC

Why is there throttling at all?
Why is there a shortage of workunit generation? Is there a limit of some kind that prevents new workunits from being created? (such as a lack of server/CPU/memory power-capacity to create said WUs?)

Sorry, I'm just getting a little frustrated seeing that "Milkyway@home: Message from server: No work available" message I keep seeing in my BOINC manager, that's all.
ID: 21504 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
100 million credit badge13 year member badge
Message 21507 - Posted: 7 May 2009, 14:31:15 UTC - in response to Message 21504.  

Why is there throttling at all?

There is no throttling. Just ways of accelerating (optimized apps).

Why is there a shortage of workunit generation? Is there a limit of some kind that prevents new workunits from being created? (such as a lack of server/CPU/memory power-capacity to create said WUs?)


Apparently, the number of WUs is not the problem. The problem, I hear, is the bottleneck at the distribution point made by the hammering of gimme, gimme, gimme requests. So they say.




ID: 21507 · Rating: 0 · rate: Rate + / Rate - Report as offensive
BarryAZ

Send message
Joined: 1 Sep 08
Posts: 519
Credit: 286,267,947
RAC: 17,748
200 million credit badge12 year member badgeextraordinary contributions badge
Message 21525 - Posted: 7 May 2009, 16:41:15 UTC - in response to Message 21507.  

I suspect there may be a bit of egg/chicken here. That is, with the release of the optimized .19 application and then the optimized ATI GPU application, the demand for work units skyrocketed. Back in the fall, the optimized CPU application by itself pushed the project hard. Then with the ATI application being deployed, the demands in terms of workunits went over the top. The first constraint appears to be at the distribution point so you see on the server status page 500 to 900 workunits available at any given time. The second and I believe core constraint is at the workunit creation process -- if that wasn't the case you would see an increasing number of workunits as being available on the server status page -- you don't -- it remains at 500 to 900.

In addition the vastly increased work unit productivity of both the CPU and ATI GPU optimized clients, there has also been a significant increase in the number of users here. There were under 6000 users back in September, there are more than 18000 users today. Thus, the release of the optimized clients, plus the tripling of users within about 8 months means there is a HUGE increase in number of work units being requested (script or no script).

It wouldn't surprise me to see the number of workunits processed to have increased by 10 times or more in the past 8 months -- certainly the user level capacity for procesing work has increased by that much.

I doubt the project has seen an infusion of hardware resources to match this, and so we are seeing bottlenecks.

In theory, the setting up of a formal MilkyWay GPU project (first with CUDA support and then critically with an Optimized ATI GPU application) will draw away a large portion of load on the MilkyWay (nominally) CPU project here.

Personally, I sort of wonder if the folks back at the project have adequate work creation resources and for that matter science analysis resources to cope with the work going on now, let alone the traffic for two related and separate projects (Milkyway and Milkyway GPU). The delay between the posting on the home page regarding the GPU project, and any subsequent follow up information suggests they are very much resource constrained at the moment -- I suspect that resource constraint will not be going away any time soon.






Apparently, the number of WUs is not the problem. The problem, I hear, is the bottleneck at the distribution point made by the hammering of gimme, gimme, gimme requests. So they say.




ID: 21525 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Brian Silvers

Send message
Joined: 21 Aug 08
Posts: 625
Credit: 558,425
RAC: 0
500 thousand credit badge12 year member badge
Message 21577 - Posted: 8 May 2009, 0:24:13 UTC - in response to Message 21525.  

I suspect that resource constraint will not be going away any time soon.


Final exams should be in 1-3 weeks...
ID: 21577 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Beau

Send message
Joined: 3 Jan 09
Posts: 270
Credit: 124,346
RAC: 0
100 thousand credit badge12 year member badge
Message 21578 - Posted: 8 May 2009, 0:57:51 UTC - in response to Message 21577.  

I suspect that resource constraint will not be going away any time soon.


Final exams should be in 1-3 weeks...



Will that be about the same time that we are able to get more workunits?

ID: 21578 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Brian Silvers

Send message
Joined: 21 Aug 08
Posts: 625
Credit: 558,425
RAC: 0
500 thousand credit badge12 year member badge
Message 21629 - Posted: 8 May 2009, 15:48:15 UTC - in response to Message 21578.  

I suspect that resource constraint will not be going away any time soon.


Final exams should be in 1-3 weeks...



Will that be about the same time that we are able to get more workunits?



My name is not "Claire Voyant"... ;-)
ID: 21629 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Beau

Send message
Joined: 3 Jan 09
Posts: 270
Credit: 124,346
RAC: 0
100 thousand credit badge12 year member badge
Message 21659 - Posted: 8 May 2009, 20:51:04 UTC - in response to Message 21629.  

I suspect that resource constraint will not be going away any time soon.


Final exams should be in 1-3 weeks...



Will that be about the same time that we are able to get more workunits?



My name is not "Claire Voyant"... ;-)


LOL
ID: 21659 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Odd-Rod

Send message
Joined: 7 Sep 07
Posts: 444
Credit: 2,919,198
RAC: 6,316
2 million credit badge13 year member badge
Message 21787 - Posted: 10 May 2009, 12:43:11 UTC - in response to Message 21629.  

I suspect that resource constraint will not be going away any time soon.


Final exams should be in 1-3 weeks...



Will that be about the same time that we are able to get more workunits?



My name is not "Claire Voyant"... ;-)


Perhaps we'll get somewhere if cross Claire Voyant's palm with 'Silver' ;-)
ID: 21787 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileThe Gas Giant
Avatar

Send message
Joined: 24 Dec 07
Posts: 1947
Credit: 240,884,648
RAC: 0
200 million credit badge13 year member badge
Message 22196 - Posted: 14 May 2009, 0:04:01 UTC

I got me a 4870 while I was at the computer shop getting my 4850 back.

Now I have 2 starving beasts to feed. No matter how hard I pound the feeder it's not giving me anything! ;)

How are the top users getting so much work?!


ID: 22196 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGavin Shaw
Avatar

Send message
Joined: 16 Jan 08
Posts: 98
Credit: 1,371,299
RAC: 0
1 million credit badge13 year member badge
Message 22202 - Posted: 14 May 2009, 0:55:49 UTC - in response to Message 22196.  

I got me a 4870 while I was at the computer shop getting my 4850 back.

Now I have 2 starving beasts to feed. No matter how hard I pound the feeder it's not giving me anything! ;)

How are the top users getting so much work?!




Some probably have script files that request work every x secs/mins, regardless of whether they get any or not.

Never surrender and never give up. In the darkest hour there is always hope.

ID: 22202 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileManfred_Boinc@Goettingen
Avatar

Send message
Joined: 1 Dec 08
Posts: 1
Credit: 7,109,767
RAC: 0
5 million credit badge12 year member badge
Message 22210 - Posted: 14 May 2009, 4:58:22 UTC

*.*
ID: 22210 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileuBronan
Avatar

Send message
Joined: 9 Feb 09
Posts: 166
Credit: 27,520,813
RAC: 0
20 million credit badge12 year member badge
Message 22218 - Posted: 14 May 2009, 9:38:11 UTC

Well yes it must be some kinda program hammering the server for units reporting they don't have any but since these cards finish them in like 12 seconds or so they must get a huge amount.
The only way to stop them is to release a new application which probably will happen when the new gpu app gets released, then it will take some time before the ati cards
ID: 22218 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileMartin Chartrand
Avatar

Send message
Joined: 25 Mar 09
Posts: 65
Credit: 53,099,671
RAC: 0
50 million credit badge12 year member badge
Message 22281 - Posted: 14 May 2009, 22:04:36 UTC

I tell you what.
Those MWGPU WU are really slowing my computer to a crawl..
Seem I get stuck with all the VLAR...
Aw well in the name of science.!!!
@ Misfit you said you "purged" thoose from your system and will not get anymore?
Is there a script to avoid getting those??


Martin
ID: 22281 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileMartin Chartrand
Avatar

Send message
Joined: 25 Mar 09
Posts: 65
Credit: 53,099,671
RAC: 0
50 million credit badge12 year member badge
Message 22282 - Posted: 14 May 2009, 22:10:08 UTC - in response to Message 22281.  

Blah!
Ignore the below comment.
I meant S@H Beta NOT MWGPU.
Wrong forum. Wrong Thread!
Too many forum reading = Brain confusion.

Martin
ID: 22282 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Misfit
Avatar

Send message
Joined: 27 Aug 07
Posts: 915
Credit: 1,503,319
RAC: 0
1 million credit badge13 year member badge
Message 22289 - Posted: 14 May 2009, 23:00:51 UTC - in response to Message 22281.  

@ Misfit you said you "purged" thoose from your system and will not get anymore?
Is there a script to avoid getting those??

You will get what they send you. Not a script, but a modified .exe that aborts them. Also I've discovered the slow down in my video and increased crunch time was because of workunits getting suspended in the GPU memory while it crunched other units. That happens when BOINC DLs more work with an earlier deadline and switches tasks.
PM me on SETI if you need specific info. I'm only crunching MB CUDA units with my GPU. No AP and no CPU usage so my app_info will be different than the typical optimized setup.
me@rescam.org
ID: 22289 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileuBronan
Avatar

Send message
Joined: 9 Feb 09
Posts: 166
Credit: 27,520,813
RAC: 0
20 million credit badge12 year member badge
Message 22292 - Posted: 14 May 2009, 23:14:43 UTC - in response to Message 22289.  

Let him download the new installer from kwsn ;)
ID: 22292 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileMartin Chartrand
Avatar

Send message
Joined: 25 Mar 09
Posts: 65
Credit: 53,099,671
RAC: 0
50 million credit badge12 year member badge
Message 22302 - Posted: 15 May 2009, 2:57:57 UTC - in response to Message 22289.  

@ Misfit

Thank you so very much for the help.
You have been great and I am extremely thankful!

I propose a toast to you!

Martin Chartrand
ID: 22302 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 . . . 12 · Next

Message boards : Number crunching : Why is it so hard to get work?

©2021 Astroinformatics Group