Welcome to MilkyWay@home

Server Updates and Status


Advanced search

Message boards : Number crunching : Server Updates and Status
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 7 · Next

AuthorMessage
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 16843 - Posted: 25 Mar 2009, 20:34:15 UTC

This is for discussion of the latest news item. We're going to be splitting MilkyWay@Home into two separate applications/backends, one for GPUs and one for regular processors.

We've been having some complaints from RPI about our bandwidth usage (it's up to around 250gb/week), so this is in part to address that, but also to make sure work stays smoothly flowing and the server doesn't get bogged down.

We're going to keep the regular milkyway application doing what it has been -- global optimization methods such as particle swarm, genetic search, etc.

The GPU version of milkyway is going to farm more complex calculations to the application (gradient/hessian/line search calculations) which will let them do more "local" searches. This should increase the WU size of the GPU application by 300-1000 times what they currently are, significantly decrease server load, and also reduce the network usage of these clients.
ID: 16843 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profilebanditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
500 thousand credit badge10 year member badge
Message 16846 - Posted: 25 Mar 2009, 20:49:48 UTC

Sounds good. This is still going to share the current server but run as 2 different functions then?
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 16846 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 16848 - Posted: 25 Mar 2009, 20:56:16 UTC - in response to Message 16846.  

Sounds good. This is still going to share the current server but run as 2 different functions then?


Yeah I think that's how we're going to do it. The server should be able to handle it if the GPU request are significantly cut down.
ID: 16848 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile[AF>Occitania] Meteore31

Send message
Joined: 11 Dec 07
Posts: 11
Credit: 95,037,645
RAC: 0
50 million credit badge10 year member badge
Message 16850 - Posted: 25 Mar 2009, 20:57:46 UTC

good news !
ID: 16850 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 16854 - Posted: 25 Mar 2009, 21:07:07 UTC - in response to Message 16848.  
Last modified: 25 Mar 2009, 21:07:25 UTC

One thing we'd like to do, in a sense have it as a separate project (but with the same home page and forums), that way we could have top lists for milkyway regular and milkyway GPU, without them stepping on each others toes.

I'm not sure if we can do this having GPU milkyway as just a separate application or not.
ID: 16854 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Emanuel

Send message
Joined: 18 Nov 07
Posts: 280
Credit: 2,442,757
RAC: 0
2 million credit badge10 year member badge
Message 16861 - Posted: 25 Mar 2009, 22:08:54 UTC - in response to Message 16843.  
Last modified: 25 Mar 2009, 22:09:09 UTC

The GPU version of milkyway is going to farm more complex calculations to the application (gradient/hessian/line search calculations) which will let them do more "local" searches. This should increase the WU size of the GPU application by 300-1000 times what they currently are, significantly decrease server load, and also reduce the network usage of these clients.

While it's good to hear that you'll be offloading the servers, could you comment on the science impact of these changes?
ID: 16861 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileArion
Avatar

Send message
Joined: 10 Aug 08
Posts: 218
Credit: 41,846,854
RAC: 0
30 million credit badge10 year member badge
Message 16862 - Posted: 25 Mar 2009, 22:10:00 UTC - in response to Message 16854.  
Last modified: 25 Mar 2009, 22:12:20 UTC

I'm not sure if we can do this having GPU milkyway as just a separate application or not.


Your plan sounds good and maybe the answer. One thing though, will you have any controls in place to avoid those using GPU's to only do those particular workunits? With the way things are now its a free-for-all trying to get work.

I guess what I am trying to say is that will your backend be able to tell that the client is running the GPU application and only send work appropriate as well as knowing that the CPU applications are requesting their work specific loads?


PS.. While you were away there were some suggestions that some of the participants would like to donate necessary equpiment, etc to help the project out. Maybe you can look into this and see whether or not it is feasible.


Glad to see you back and feeling better after your bout with the flu and everything.
ID: 16862 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileLord Tedric
Avatar

Send message
Joined: 9 Nov 07
Posts: 151
Credit: 8,391,608
RAC: 0
5 million credit badge10 year member badge
Message 16865 - Posted: 25 Mar 2009, 22:20:22 UTC - in response to Message 16854.  

One thing we'd like to do, in a sense have it as a separate project (but with the same home page and forums), that way we could have top lists for milkyway regular and milkyway GPU, without them stepping on each others toes.

I'm not sure if we can do this having GPU milkyway as just a separate application or not.


I think this approach would satisfy a lot of users!
Lets hope it can be done.
ID: 16865 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 16868 - Posted: 25 Mar 2009, 22:31:49 UTC - in response to Message 16862.  

I guess what I am trying to say is that will your backend be able to tell that the client is running the GPU application and only send work appropriate as well as knowing that the CPU applications are requesting their work specific loads?


We're probably going to have a separate project so only GPU clients can sign up for the GPU version, and we can keep credits separate.

PS.. While you were away there were some suggestions that some of the participants would like to donate necessary equpiment, etc to help the project out. Maybe you can look into this and see whether or not it is feasible.


The project PIs are looking into this, funding things are really not in my job description :)
ID: 16868 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileKevint
Avatar

Send message
Joined: 22 Nov 07
Posts: 285
Credit: 1,076,786,368
RAC: 0
1 billion credit badge10 year member badge
Message 16869 - Posted: 25 Mar 2009, 22:53:10 UTC



I run both host types, GPU and CPU -

If I understand correctly, this will effectively separate out to 2 different projects? But one main project page.

.
ID: 16869 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileKWSN imcrazynow
Avatar

Send message
Joined: 22 Nov 08
Posts: 136
Credit: 319,414,799
RAC: 0
300 million credit badge10 year member badge
Message 16870 - Posted: 25 Mar 2009, 22:54:42 UTC

Will we be able to do GPU and CPU work on the same system?

4870 GPU
4870 GPU
ID: 16870 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileKWSN imcrazynow
Avatar

Send message
Joined: 22 Nov 08
Posts: 136
Credit: 319,414,799
RAC: 0
300 million credit badge10 year member badge
Message 16872 - Posted: 25 Mar 2009, 23:10:13 UTC - in response to Message 16843.  
Last modified: 25 Mar 2009, 23:31:28 UTC

This should increase the WU size of the GPU application by 300-1000 times what they currently are, significantly decrease server load, and also reduce the network usage of these clients.


With the granted credit be 300-1000 times more per work unit.
;) I knew it was going to be asked. I wanted to do it first.
<EDIT>
I guess I should have read the news first. You've already answered this..

4870 GPU
4870 GPU
ID: 16872 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 16874 - Posted: 26 Mar 2009, 0:15:37 UTC - in response to Message 16870.  

Will we be able to do GPU and CPU work on the same system?


Should be able to, yes. That's our goal at any rate.
ID: 16874 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTravis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
10 thousand credit badge10 year member badge
Message 16875 - Posted: 26 Mar 2009, 0:15:57 UTC - in response to Message 16869.  



I run both host types, GPU and CPU -

If I understand correctly, this will effectively separate out to 2 different projects? But one main project page.


Something like that, yes.
ID: 16875 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Divide Overflow
Avatar

Send message
Joined: 16 Feb 09
Posts: 109
Credit: 11,089,510
RAC: 0
10 million credit badge10 year member badge
Message 16876 - Posted: 26 Mar 2009, 0:21:33 UTC
Last modified: 26 Mar 2009, 0:22:43 UTC

That’s an exciting idea. It could go a long way towards keeping different types of volunteers supplied with work. I’m sure that the extra science to be done on the new GPU app will be a welcome benefit too.

Any time frame on implementing this?
ID: 16876 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Lloyd M.

Send message
Joined: 1 Dec 08
Posts: 139
Credit: 8,721,208
RAC: 0
5 million credit badge10 year member badge
Message 16899 - Posted: 26 Mar 2009, 4:39:35 UTC - in response to Message 16843.  

Travis wrote:
The GPU version of milkyway is going to farm more complex calculations to the application (gradient/hessian/line search calculations) which will let them do more "local" searches. This should increase the WU size of the GPU application by 300-1000 times what they currently are, significantly decrease server load, and also reduce the network usage of these clients.


Sounds like a fine (and very clever) idea!

ID: 16899 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfilePaul D. Buck

Send message
Joined: 12 Apr 08
Posts: 621
Credit: 161,934,067
RAC: 0
100 million credit badge10 year member badge
Message 16908 - Posted: 26 Mar 2009, 7:45:50 UTC - in response to Message 16868.  

We're probably going to have a separate project so only GPU clients can sign up for the GPU version, and we can keep credits separate.

It would almost certainly be easier to have two separate projects with two URLs. Otherwise I do not see how you would be able to keep all the "stuff" separated.

I mean, you could then have the Milky Way project and the Andromeda project ... :)

Or maybe the Large Magellanic Cloud project?
ID: 16908 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
John Clark

Send message
Joined: 4 Oct 08
Posts: 1734
Credit: 64,228,409
RAC: 0
50 million credit badge10 year member badge
Message 16912 - Posted: 26 Mar 2009, 9:02:50 UTC
Last modified: 26 Mar 2009, 9:03:24 UTC

An excellent idea Travis, and it would relieve the server load.

The new GPU client and WU would, I assume, be looking for much more fine detail in the science than the MW broad based structures the CPU client looks for?
Go away, I was asleep


ID: 16912 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
cdb

Send message
Joined: 2 Feb 09
Posts: 1
Credit: 1,143,453
RAC: 0
1 million credit badge10 year member badge
Message 16915 - Posted: 26 Mar 2009, 9:19:47 UTC - in response to Message 16874.  
Last modified: 26 Mar 2009, 9:21:02 UTC

Will we be able to do GPU and CPU work on the same system?


Should be able to, yes. That's our goal at any rate.


My machine has a two Nvidia and one AMD graphics cards. Currently I crunch MW on the HD3870 and the CPU, and crunch GPUGRID on the GTX260s. Will it become possible for me to crunch MW on both types of GPU at the same time, and the CPU as well?
ID: 16915 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
SATAN
Avatar

Send message
Joined: 27 Feb 09
Posts: 45
Credit: 305,963
RAC: 0
100 thousand credit badge10 year member badge
Message 16926 - Posted: 26 Mar 2009, 14:04:52 UTC

Nice to see I can use my measly nVidia card for this project especially in OSX.
Mars rules this confectionery war!
ID: 16926 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · 4 . . . 7 · Next

Message boards : Number crunching : Server Updates and Status

©2019 Astroinformatics Group