Welcome to MilkyWay@home

new workunit limit


Advanced search

Message boards : Number crunching : new workunit limit
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 7062 - Posted: 30 Nov 2008, 22:02:08 UTC - in response to Message 7060.  

Detached my first quad and reattached. The system automatically downloaded the new client and the 8 WUs-per-core limit and got on crunching.

The WUs are labled as - Milkyway@Home optimised 0.04. I assume 0.04 WUs go with the 0.5 client?

These WUs are definitely slower than the Milksop client, which was being crunching on an average of 200 - 205 seconds.

Looking at the first 4 crunched on the rig I type from, the average time is 505 - 514 seconds. That means they are about 2.5 times as long.



WUs from nm_testX and nm_stripeX (not nm_stripeX_1) don't have as much work as the nm_stripeX_1s. I've left those searches generating more work because they're almost completed and i want to see what the final results are. After those are done the WUs should be about 4x longer than what they are right now.
ID: 7062 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 7063 - Posted: 30 Nov 2008, 22:05:27 UTC - in response to Message 7061.  

Detached my first quad and reattached. The system automatically downloaded the new client and the 8 WUs-per-core limit and got on crunching.

The WUs are labled as - Milkyway@Home optimised 0.04. I assume 0.04 WUs go with the 0.5 client?

These WUs are definitely slower than the Milksop client, which was being crunching on an average of 200 - 205 seconds.

Looking at the first 4 crunched on the rig I type from, the average time is 505 - 514 seconds. That means they are about 2.5 times as long.



Hmmm...

Well one thing to keep in mind here, is that the detach and or reset will dump the app_info file (and opti) from the project directory.

What isn't clear so far is; Are the Astronomy searches (gs series) completed now?

If not, then you need to build the custom app_info I mentioned in another thread or you are going to have a TDCF mess if and when the CC picks up an Astronomy task and runs it with the stock version.

Alinator


We won't be generating any more work for the old application. So the gs series that's out there right now is done. I'll probably be starting up some more gs WUs using the new app after i get some results with the nm ones.

GS is doing a genetic search server side, while NM is doing an asynchronous newton method. GS is more of a global search, while the newton method we're testing is local search with a fast convergence rate. Right now we're trying to get some very accurate numbers on stripes 79, 82 and 86 for an upcoming publication.

ID: 7063 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
50 million credit badge10 year member badge
Message 7064 - Posted: 30 Nov 2008, 22:06:09 UTC - in response to Message 7062.  
Last modified: 30 Nov 2008, 22:09:54 UTC

AHHHH....

Thanks for that extra info about just what the different series are targeting! Cool.

So the next question is if you still have old GS tasks hanging around on hosts, is there any point in running them, or can we just dump them at this point?

Alinator
ID: 7064 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileKevint
Avatar

Send message
Joined: 22 Nov 07
Posts: 285
Credit: 1,076,786,368
RAC: 0
1 billion credit badge10 year member badge
Message 7065 - Posted: 30 Nov 2008, 22:06:56 UTC - in response to Message 7047.  



5 was too low, 8 is too low - Travis, your network, and servers were having a hard time keeping up with the demand at 20?

If you feel you need to lower it, do so, but make it reasonable - 10-15 would be a much better figure.

My hosts are constantly asking for more work, and if this is causing my network trouble, I am sure it is causing your systems to cry out in pain.



This should be a non-issue now that we're moving over to the new application. WUs for that should be quite a bit longer.


Yep, Just noticed that you are moving to the new app - very good. Ignore my previous comment :)

I guess we will see how the new app performs with the cache settings and server load.. Hope this fixes a bunch of things.


ID: 7065 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profilealijay

Send message
Joined: 15 Apr 08
Posts: 55
Credit: 24,047
RAC: 0
10 thousand credit badge10 year member badge
Message 7067 - Posted: 30 Nov 2008, 22:25:55 UTC - in response to Message 7065.  

When you increse the length of the wu please ensure that the check-point error that has been showing up is fixed. With the shorter wu's it is not a problem with longer wu's and particularly on a slower machine if an error occurs because of a fault in the check-pointing a cruncher loses the credits for an hours work it is annoying.
ID: 7067 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
50 million credit badge10 year member badge
Message 7068 - Posted: 30 Nov 2008, 22:28:12 UTC - in response to Message 7067.  

When you increse the length of the wu please ensure that the check-point error that has been showing up is fixed. With the shorter wu's it is not a problem with longer wu's and particularly on a slower machine if an error occurs because of a fault in the check-pointing a cruncher loses the credits for an hours work it is annoying.


Yep, that needs to be fixed, but keeping them in memory is a partial workaround.

Alinator
ID: 7068 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
BarryAZ

Send message
Joined: 1 Sep 08
Posts: 519
Credit: 282,749,632
RAC: 80
200 million credit badge10 year member badgeextraordinary contributions badge
Message 7069 - Posted: 30 Nov 2008, 23:10:38 UTC - in response to Message 7060.  

Same here -- about 2.5 times the processing time. The new work units take about 12 minutes to process. The 8 wu queue is still short (under 2 hours), a 20 work unit queue would yield a full 4 hour queue, still short, but workable I guess. (I'd love to see 30 minute WU's with the 20 unit queue).

On the 'keep the BOINC world happy front' -- Dave Anderson should be pleased with the lower awards. The older workunits running the optimized client on the same workstation got me something like 108 credits per hour per core (assuming that they always processed Milkyway which they never could for various reasons discussed all over the place). That would have gotten a RAC of over 10K on an AMD quad core 9850 (the system I am using here). The new version WU's, take just under 12 minutes to process and get 9.7 credits. That slides out to under 50 credits per hour for a RAC of around 4700 on the same system. That number is much closer in line with what SETI offers using their readily available optimized client. With SETI on the same system, fully running, instead of a RAC of 4500, I would get something like 3900. So Milkyway is still offering a 'premium' but it is clearly in the neighborhood.


Detached my first quad and reattached. The system automatically downloaded the new client and the 8 WUs-per-core limit and got on crunching.

The WUs are labled as - Milkyway@Home optimised 0.04. I assume 0.04 WUs go with the 0.5 client?

These WUs are definitely slower than the Milksop client, which was being crunching on an average of 200 - 205 seconds.

Looking at the first 4 crunched on the rig I type from, the average time is 505 - 514 seconds. That means they are about 2.5 times as long.



ID: 7069 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 7073 - Posted: 30 Nov 2008, 23:24:30 UTC - in response to Message 7068.  

When you increse the length of the wu please ensure that the check-point error that has been showing up is fixed. With the shorter wu's it is not a problem with longer wu's and particularly on a slower machine if an error occurs because of a fault in the check-pointing a cruncher loses the credits for an hours work it is annoying.


Yep, that needs to be fixed, but keeping them in memory is a partial workaround.

Alinator


v0.6 has the code to fix the checkpointing problems, so it should be ok.
ID: 7073 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileSorceress
Avatar

Send message
Joined: 30 Nov 08
Posts: 22
Credit: 63,967
RAC: 0
10 thousand credit badge10 year member badge
Message 7110 - Posted: 1 Dec 2008, 10:20:25 UTC

OK.I seem to be having a problem. Newbie to Milky Way here. The WUs I downloaded says time to completion is 00:08:20 but after 03:33:18 hours of crunching, I'm only 19.87% completed and time to completion is 02:13:24 and increasing. My computer is - GenuineIntel
Intel(R) Core(TM)2 Duo CPU E4500 @ 2.20GHz [x86 Family 6 Model 15 Stepping 13]. OS is- Microsoft Windows XP Professional x86 Editon, Service Pack 3, (05.01.2600.00). Completion date is 12/3/08. At this rate, I might get 3 WU done out of the 16 WU I downloaded on top of the other 9 projects I am crunching for. Same goes for my 2nd older AMD machine. What's happening here?


ID: 7110 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
50 million credit badge10 year member badge
Message 7133 - Posted: 1 Dec 2008, 15:54:20 UTC
Last modified: 1 Dec 2008, 16:18:58 UTC

Don't worry about it at this point. MW is a tight deadline project for almost all host with the stock apps. This often drives the tasks into HP when you first attach (due to no TDCF data for the project), or running several projects and/or low Resource Share for MW on hosts which have been around awhile.

Give it a week or so and things should settle down.

Alinator
ID: 7133 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileGalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
100 million credit badge10 year member badge
Message 7135 - Posted: 1 Dec 2008, 16:12:39 UTC - in response to Message 7133.  

Don't worry about it at this point. MW is a tight deadline project for almost all host with the stock apps. This often drives the tasks into HP when you first attach (due to TDCF data for the project), or running several projects and/or low Resource Share for MW on hosts which have been around awhile.

Give it a week or so and things should settle down.

Alinator

I think I need a week or so to settle down after the personal attention required to MW over the last week or so to keep the milk chocolate crunching ;) I can't complain though - my RAC is still flyin' :)

Welcome Sorceress - nice avatar...

ID: 7135 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profilebanditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
500 thousand credit badge10 year member badge
Message 7136 - Posted: 1 Dec 2008, 16:17:17 UTC

I don't think it has ever run in normal mode for me. Not that it's a big deal, I manually get work from the project I want to do, when I want to.
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 7136 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
50 million credit badge10 year member badge
Message 7137 - Posted: 1 Dec 2008, 16:21:22 UTC - in response to Message 7135.  

I think I need a week or so to settle down after the personal attention required to MW over the last week or so to keep the milk chocolate crunching ;) I can't complain though - my RAC is still flyin' :)

Welcome Sorceress - nice avatar...


LOL...

I feel your pain.

Now if we can get off of InstaPurge and back to something a little more user friendly, I'll be a Happy Camper again! ;-)

Alinator
ID: 7137 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileGalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
100 million credit badge10 year member badge
Message 7160 - Posted: 1 Dec 2008, 18:44:28 UTC - in response to Message 7137.  


LOL...

I feel your pain.

Now if we can get off of InstaPurge and back to something a little more user friendly, I'll be a Happy Camper again! ;-)

Alinator

Yes it can be a pain not only to supply a free PC or two to a project like this, but then to try and work out what to do to keep up with it all.

But then there are good people like you Alinator to help out the likes of me, so thanks very much for that. And also thanks to Travis and MW mod/science staff here - you're doing a fine job - and thanks!


ID: 7160 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileSorceress
Avatar

Send message
Joined: 30 Nov 08
Posts: 22
Credit: 63,967
RAC: 0
10 thousand credit badge10 year member badge
Message 7161 - Posted: 1 Dec 2008, 18:45:53 UTC - in response to Message 7135.  

Thanks Ice. I just got home and noticed MW is running w/high priority on both machines. Don't know what happened, but its working much better. Noticed also the 'time to completion' is more accurate. I still won't be able to complete much of the WU I recieved. I take my projects seriously and get irritated when I can't get my work done. My older machine trashed the graphics card and it took a while to get a new one. I was hesitant to use my newer machine on boinc but then I said what the heck. Now Im cruching on TWO! Thanks all for the help! Glad to be aboard.
Sorceress


ID: 7161 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Bigred
Avatar

Send message
Joined: 23 Nov 07
Posts: 33
Credit: 300,042,542
RAC: 0
300 million credit badge10 year member badge
Message 7170 - Posted: 1 Dec 2008, 19:32:14 UTC - in response to Message 7161.  

Thanks Ice. I just got home and noticed MW is running w/high priority on both machines. Don't know what happened, but its working much better. Noticed also the 'time to completion' is more accurate. I still won't be able to complete much of the WU I recieved. I take my projects seriously and get irritated when I can't get my work done. My older machine trashed the graphics card and it took a while to get a new one. I was hesitant to use my newer machine on boinc but then I said what the heck. Now Im cruching on TWO! Thanks all for the help! Glad to be aboard.
Sorceress


Try enabling experimental apps in the Milkyway settings for your account. That will allow you to get some work with the optimized app for shorter crunch times.
ID: 7170 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 7180 - Posted: 1 Dec 2008, 20:40:16 UTC - in response to Message 7170.  

Thanks Ice. I just got home and noticed MW is running w/high priority on both machines. Don't know what happened, but its working much better. Noticed also the 'time to completion' is more accurate. I still won't be able to complete much of the WU I recieved. I take my projects seriously and get irritated when I can't get my work done. My older machine trashed the graphics card and it took a while to get a new one. I was hesitant to use my newer machine on boinc but then I said what the heck. Now Im cruching on TWO! Thanks all for the help! Glad to be aboard.
Sorceress


Try enabling experimental apps in the Milkyway settings for your account. That will allow you to get some work with the optimized app for shorter crunch times.


Should have to do that as the stock app is now the new optimized version. It should download automatically. Also, no WUs are being generated for the old version anymore.
ID: 7180 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileSorceress
Avatar

Send message
Joined: 30 Nov 08
Posts: 22
Credit: 63,967
RAC: 0
10 thousand credit badge10 year member badge
Message 7193 - Posted: 1 Dec 2008, 22:51:19 UTC - in response to Message 7170.  

That option is not available in Milky Way preferences, Bigred.


ID: 7193 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profilecaspr
Avatar

Send message
Joined: 22 Mar 08
Posts: 90
Credit: 501,728
RAC: 0
500 thousand credit badge10 year member badge
Message 7195 - Posted: 1 Dec 2008, 23:11:22 UTC - in response to Message 7193.  

That option is not available in Milky Way preferences, Bigred.



Just checked and it is there, "run test applications"?
A clear conscience is usually the sign of a bad memory



ID: 7195 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Brian Silvers

Send message
Joined: 21 Aug 08
Posts: 625
Credit: 558,425
RAC: 0
500 thousand credit badge10 year member badge
Message 7197 - Posted: 1 Dec 2008, 23:16:09 UTC - in response to Message 7195.  

That option is not available in Milky Way preferences, Bigred.



Just checked and it is there, "run test applications"?


However, it is not needed to check that now.

The "test application" was promoted to the "stock application". As of today, that setting will not cause a change for any of us...but you could potentially regret it later if they release a buggy application that was marked as "test", but you had forgotten that you had enabled it...
ID: 7197 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · Next

Message boards : Number crunching : new workunit limit

©2019 Astroinformatics Group