Welcome to MilkyWay@home

Overall progress on server status?


Advanced search

Message boards : Number crunching : Overall progress on server status?
Message board moderation

To post messages, you must log in.

AuthorMessage
Mr P Hucker
Avatar

Send message
Joined: 5 Jul 11
Posts: 741
Credit: 335,910,904
RAC: 164,036
300 million credit badge11 year member badge
Message 71624 - Posted: 20 Jan 2022, 1:46:53 UTC

On Einstein at Home, we can see overall progress of each application on the server status page. Is such a thing here or possible to create?
ID: 71624 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
alanb1951

Send message
Joined: 16 Mar 10
Posts: 151
Credit: 85,659,809
RAC: 56,644
50 million credit badge12 year member badgeextraordinary contributions badge
Message 71625 - Posted: 20 Jan 2022, 5:18:49 UTC - in response to Message 71624.  
Last modified: 20 Jan 2022, 5:32:58 UTC

Peter,

The Server Status page here only reflects work that hasn't been assimilated yet; I suspect that's the BOINC server default, and I don't know how much extra work would be needed for something like the Einstein output!

Bear in mind that, unlike Einstein, there is no exact number of work-units required to complete a given analysis, so progress measurement would be tricky! New jobs are produced based on the outcome of previous jobs until some sort of convergence criterion is met. Perhaps Tom can tell us how close the current stripes seem to be to that point?

Cheers - Al.

P.S. I notice MilkyWay appears to have a new "intern" who might be in a position to look into this once he's learnt the ropes! However, I can think of more important things to fix, such as the 7-job work-unit issue...

[Edit - re-wording]
ID: 71625 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 5 Jul 11
Posts: 741
Credit: 335,910,904
RAC: 164,036
300 million credit badge11 year member badge
Message 71628 - Posted: 20 Jan 2022, 13:43:30 UTC

What's the 7 job work unit issue?

Two other things I can think of are:
1) the impossible task of making the server hand out new GPU tasks while taking ones back - note to intern, don't bother, Eric and Tom both failed.
2) changing the settings so I can put N-body on a CPU and Seperation on a GPU on the same computer. Currently the CPU also gets seperation, which the GPU could be doing much quicker.
ID: 71628 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
alanb1951

Send message
Joined: 16 Mar 10
Posts: 151
Credit: 85,659,809
RAC: 56,644
50 million credit badge12 year member badgeextraordinary contributions badge
Message 71629 - Posted: 20 Jan 2022, 15:12:10 UTC - in response to Message 71628.  

What's the 7 job work unit issue?

There have been multiple times when significant numbers of work units got created that appeared to contain 7 jobs. Trying to deal with the results returned for these tasks could crash the validator, and some of the jobs weren't genuine anyway. There's lots of threads in various places related to the issue; Tom's explanation can be found in the thread Validator Outage in the News section...

Two other things I can think of are:
1) the impossible task of making the server hand out new GPU tasks while taking ones back - note to intern, don't bother, Eric and Tom both failed.
2) changing the settings so I can put N-body on a CPU and Seperation on a GPU on the same computer. Currently the CPU also gets seperation, which the GPU could be doing much quicker.

I didn't mention the first one because it is probably related to BOINC Server configuration and the issue may or may not disappear if/when the latest BOINC software is installed as per Dylan's introductory message.

Your second one is a valid point -- if a science application has both CPU and GPU versions, one should be able to pick one or both... (There's a similar issue at WCG with OPN1/OPNG, though there are workarounds suggested there...)

And if we're on the subject of work downloads, those of us who do multiple projects would probably welcome a "Send me no more than..." facility like the one at WCG. I'd especially appreciate that at Einstein!!!

At least with Dylan in place there's a chance some of the issues can/may/will be addressed at last :-)

Cheers - Al.
ID: 71629 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileKeith Myers
Avatar

Send message
Joined: 24 Jan 11
Posts: 642
Credit: 497,563,895
RAC: 191,529
300 million credit badge11 year member badgeextraordinary contributions badge
Message 71633 - Posted: 20 Jan 2022, 17:10:01 UTC - in response to Message 71625.  

I added a request for the bugs he is intending to work on in my welcome post. I agree, the 7-job task bundles are top of the list to squash.
ID: 71633 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 372
Credit: 97,364,253
RAC: 131,978
50 million credit badge3 year member badge
Message 71634 - Posted: 20 Jan 2022, 17:20:49 UTC
Last modified: 20 Jan 2022, 17:21:02 UTC

Hey everyone,

I'm actually in the process of preparing new data to put up. I want to take down the runs that are currently up and replace them with other stripes in the southern sky.

We are also in the middle of some extensive analysis of the previous results, but it's slow going because we have many projects. There was a talk that I gave on this project at a conference in 2020 (https://ui.adsabs.harvard.edu/abs/2021DDA....5240303D/abstract), although this information is somewhat outdated and I am not able to find the recording of the talk. I might dig around further if I have some spare time.
ID: 71634 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileKeith Myers
Avatar

Send message
Joined: 24 Jan 11
Posts: 642
Credit: 497,563,895
RAC: 191,529
300 million credit badge11 year member badgeextraordinary contributions badge
Message 71642 - Posted: 21 Jan 2022, 2:15:23 UTC - in response to Message 71634.  

Thanks for some project update news Tom. Will be nice to look at new stripe data. Hope it all works out.
ID: 71642 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : Overall progress on server status?

©2022 Astroinformatics Group