Welcome to MilkyWay@home

New MilkyWay Separation Modified Fit Runs

Message boards : News : New MilkyWay Separation Modified Fit Runs
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 580
Credit: 94,200,158
RAC: 0
Message 60154 - Posted: 15 Oct 2013, 21:33:51 UTC

Hi all,

I would like to test the modified background fit again. This means I will be starting new runs:

de_modfit_15_3s_bpl_128wrap_1
ps_modfit_15_3s_bpl_128wrap_1

This should hopefully be seamless to users. Also, the run time of these compared to previous runs may be different, we will monitor this and treat it appropriately. If there are any issues with these runs, as usual post them here.

As a side note, I am taking down Windows 32 bit applications for the duration of these runs as the MilkyWay Separation Modified Fit application does not seem to be running smoothly on this platform for a large group of users.

Jake W.
ID: 60154 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Mumak
Avatar

Send message
Joined: 8 Apr 13
Posts: 89
Credit: 517,085,245
RAC: 0
Message 60156 - Posted: 16 Oct 2013, 11:15:36 UTC
Last modified: 16 Oct 2013, 11:18:23 UTC

Seems to run OK, just the credit doesn't seem to be properly adjusted, e.g:

Task WU Comp RunTime CPU Credit
587712756 442558397 511651 64.15 4.29 267.19
587711138 442557308 511651 81.47 4.34 213.76

Task (ps_modfit_15_3s_bpl_128wrap_1_1380741004_2337650_0) takes longer, but gets lower credit.
ID: 60156 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile KeithBriggs

Send message
Joined: 28 Apr 11
Posts: 29
Credit: 256,264,372
RAC: 32,061
Message 60158 - Posted: 17 Oct 2013, 17:51:53 UTC - in response to Message 60156.  

When you run 4 simultaneous tasks per GPU it kind of makes more sense based on credit and time to complete:

http://milkyway.cs.rpi.edu/milkyway/results.php?hostid=517443&offset=0&show_names=0&state=4&appid=

but when you run just 1 task per gpu, I'm seeing the same discrepancy:

http://milkyway.cs.rpi.edu/milkyway/results.php?hostid=518108&offset=0&show_names=0&state=4&appid=

Different machines but both have a pair of Sapphire HD 7870's
ID: 60158 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Mumak
Avatar

Send message
Joined: 8 Apr 13
Posts: 89
Credit: 517,085,245
RAC: 0
Message 60162 - Posted: 18 Oct 2013, 12:35:35 UTC

That would make sense if the GPU usage of these new tasks would be lower, but I just checked and it's rock solid at 98-99%.
So I think the credit is not assigned properly.
ID: 60162 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 580
Credit: 94,200,158
RAC: 0
Message 60163 - Posted: 18 Oct 2013, 15:28:53 UTC

Thanks for the feedback. We will monitor the situation over the next couple days and have a discussion about potentially adjusting the credits awarded for completing these work units.

Jake W.
ID: 60163 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[boinc.at] Nowi

Send message
Joined: 22 Mar 09
Posts: 99
Credit: 503,422,495
RAC: 0
Message 60164 - Posted: 18 Oct 2013, 18:28:17 UTC - in response to Message 60163.  

Thanks Jake for your answer.

One remark in front of your discussion. My credits/day dropped significantly for three tasks per GPU.

According to boincstats:
15.10.: 102,058,125 credits/day
16.10.: 101,192,925 credits/day
17.10.: 94,074,934 credits/day

So IMHO, a adjustment of the credits/WU is absolutely necessary.
ID: 60164 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
greg_be

Send message
Joined: 18 Aug 09
Posts: 122
Credit: 20,694,647
RAC: 4,385
Message 60169 - Posted: 18 Oct 2013, 23:30:17 UTC

Jake, I just quickly read your post ( did not see the no win32 sentence in the scan) and then downloaded some win32 stuff which crapped out like usual. You might want to check your queue for any leftover win32 stuff.
ID: 60169 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[boinc.at] Nowi

Send message
Joined: 22 Mar 09
Posts: 99
Credit: 503,422,495
RAC: 0
Message 60172 - Posted: 19 Oct 2013, 5:39:02 UTC

I think one explanation is necessary to my last post.

The credits I got form boincstats were not mine, but the credits of the whole M@H community. So the credit for the whole community dropped.
ID: 60172 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Link
Avatar

Send message
Joined: 19 Jul 10
Posts: 578
Credit: 18,845,239
RAC: 856
Message 60173 - Posted: 19 Oct 2013, 8:41:19 UTC - in response to Message 60164.  

Thanks Jake for your answer.

One remark in front of your discussion. My credits/day dropped significantly for three tasks per GPU.

According to boincstats:
15.10.: 102,058,125 credits/day
16.10.: 101,192,925 credits/day
17.10.: 94,074,934 credits/day

So IMHO, a adjustment of the credits/WU is absolutely necessary.

You should not look just at the last 3 days, that's not enough. If you look at the last 60 days here, the credit generated by all users was dropping at about constant speed since the 1st October, so long before those WUs were introduced. And we are still higher than 1st September, where a constant increase started.

So my guess would be, that around 1st September new runs were started, which payed better than usual (or performed better than avarage, and that resulted in higher credit per day). Those runs probably were finished recently, the current runs pay "normal", so we are returning to normal credit per day.
ID: 60173 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[boinc.at] Nowi

Send message
Joined: 22 Mar 09
Posts: 99
Credit: 503,422,495
RAC: 0
Message 60179 - Posted: 20 Oct 2013, 6:27:14 UTC

I cannot second that. I am crunching only modified fit wu and i couldn't notice any increase of credits after first of September. What I really notice is a significant drop of my RAC since the start of the new runs. Look here:
against

The credits dropped to about 75 % measured against the start of the new run.
ID: 60179 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Mumak
Avatar

Send message
Joined: 8 Apr 13
Posts: 89
Credit: 517,085,245
RAC: 0
Message 60186 - Posted: 20 Oct 2013, 17:10:31 UTC

My MW@H RAC has dropped by ~40k during the past few days, it's definitively because of the lower credit for these tasks.
ID: 60186 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Link
Avatar

Send message
Joined: 19 Jul 10
Posts: 578
Credit: 18,845,239
RAC: 856
Message 60187 - Posted: 20 Oct 2013, 17:39:25 UTC - in response to Message 60179.  
Last modified: 20 Oct 2013, 17:40:56 UTC

I cannot second that. I am crunching only modified fit wu and i couldn't notice any increase of credits after first of September.

From what I can see on the picture you posted you took a break from Milkyway untill the 3rd September, which makes it of course impossible to see some small changes in credits per day, specially if you look at your RAC and not credits/day. The stats I posted clearly show increase in awarded credit per day for the entire project (that's what you have been talking about in your message 60172) starting around the 1st September and ending around the 1st October, since when it was decreasing again.



What I really notice is a significant drop of my RAC since the start of the new runs. Look here:
(...)
The credits dropped to about 75 % measured against the start of the new run.

Yeah, that's another thing, however looking just at your computer or only higher-end GPUs like yours might lead to wrong conclusions, on the "normal" separation we also had runs which apeared to give less credit/time simply because they were not able to push those GPUs as hard as other runs (on slower GPUs there was no difference in credit/time, they were pushed hard enough). Might be something like that again, since untill now only owners of "7870/7950/7970" complained. Unfortunately I can't run modified fit on my GPU to check.
ID: 60187 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Link
Avatar

Send message
Joined: 19 Jul 10
Posts: 578
Credit: 18,845,239
RAC: 856
Message 60191 - Posted: 21 Oct 2013, 11:20:47 UTC - in response to Message 60187.  

Found that old thread, looks like that was you with your 7950 at that time too: click.
On my 3850 and as reported in that thread on a 5850 there was no difference.
ID: 60191 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile (retired account)
Avatar

Send message
Joined: 22 Oct 11
Posts: 9
Credit: 21,438,521
RAC: 0
Message 60240 - Posted: 28 Oct 2013, 15:11:32 UTC

Two work packages failed, not only on my rigs:

ps_modfit_16_3s_128wrap_1_1382698503_393776 (this is, however, a _16_3s already)
de_modfit_15_3s_bpl_128wrap_2_1382698503_420968
ID: 60240 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 580
Credit: 94,200,158
RAC: 0
Message 60255 - Posted: 30 Oct 2013, 17:14:17 UTC

Hey all,

Looks like the server took care of the credit allocation issue. It just needed a couple days to average out the FLOPS to give good credits. You will notice that you get the same number of credits for any modified fit runs, but if you compare this to the MilkyWay_Separation flagship application it is about 33% higher. In average, this will account for the increase in computation time for the new background. If anyone has any questions feel free to post them here.

Thanks for Bearing With Us,

Jake W.
ID: 60255 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile valterc

Send message
Joined: 28 Aug 09
Posts: 23
Credit: 1,266,104,622
RAC: 127,638
Message 60263 - Posted: 31 Oct 2013, 16:47:04 UTC
Last modified: 31 Oct 2013, 16:51:41 UTC

I made some statistics on my 7970 http://milkyway.cs.rpi.edu/milkyway/results.php?hostid=100828

MilkyWay@Home v1.02 (standard)
average runtime: 28.27, credit per day: 334,636.29

Milkyway@Home Separation (Modified Fit) v1.28 Here I get two different type of workunit, same credit and runtimes of ~84s or ~55s with the following figures
average runtime: 74.03, credit per day: 249,476.42
ID: 60263 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3315
Credit: 519,950,233
RAC: 22,029
Message 60273 - Posted: 2 Nov 2013, 11:06:47 UTC

I do nothing but MilkyWay cpu units on my laptop and have gone from a high of 10k credits per day on 15 Oct 2013 to a current low of still dipping downwards towards 8k per day today. I crunch all the different kinds of cpu units, but my rac IS DROPPING!!! NOTHING has changed on the laptop, except my rac has dropped dramatically.

I have several other pc's also crunching cpu units here and have gone from a high of just over 63k per day to a current 45k yesterday! So while things may be 'good' on your end, my end is not seeing it that way!!!
ID: 60273 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 580
Credit: 94,200,158
RAC: 0
Message 60279 - Posted: 2 Nov 2013, 19:25:39 UTC

Thanks for bringing it up, it is curious that modified fit without the new background takes much longer than regular separation. I will look into it.

Jake W.
ID: 60279 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3315
Credit: 519,950,233
RAC: 22,029
Message 60292 - Posted: 3 Nov 2013, 15:45:38 UTC - in response to Message 60279.  

Thanks for bringing it up, it is curious that modified fit without the new background takes much longer than regular separation. I will look into it.

Jake W.


Thank you.
ID: 60292 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Werinbert

Send message
Joined: 30 Dec 12
Posts: 7
Credit: 10,011,100
RAC: 0
Message 60358 - Posted: 11 Nov 2013, 8:14:15 UTC

I just started a run of MW Separation (Modified fit) for cpus. I am still seeing the problem of varying run times but granting the same credits.

The _bpl_ tasks taking nearly twice as long as the other tasks (15.6ksec vs 8.7ksec).
ID: 60358 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : News : New MilkyWay Separation Modified Fit Runs

©2024 Astroinformatics Group