Welcome to MilkyWay@home

GFLOPS backwards

Message boards : Number crunching : GFLOPS backwards
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
benscott

Send message
Joined: 23 May 23
Posts: 1
Credit: 12,074,282
RAC: 17,174
Message 76938 - Posted: 21 Feb 2024, 21:06:46 UTC

A problem I have seen for a long time is the GFLOPS number for each work unit. The more GFLOPS the faster the unit runs!
For example:
4079 GFLOPS about 3 hours 30 minutes run time.
65284 GFLOPS about 20 minutes run time.

A side effect of this is that when one of those 65284 GFLOP work units is downloaded BOINC thinks it will take a full day to run and doesn't download anything else until it finishes.
ID: 76938 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 24 Jan 11
Posts: 738
Credit: 565,020,458
RAC: 19,016
Message 76939 - Posted: 22 Feb 2024, 0:42:47 UTC - in response to Message 76938.  
Last modified: 22 Feb 2024, 0:58:12 UTC

A problem I have seen for a long time is the GFLOPS number for each work unit. The more GFLOPS the faster the unit runs!
For example:
4079 GFLOPS about 3 hours 30 minutes run time.
65284 GFLOPS about 20 minutes run time.

A side effect of this is that when one of those 65284 GFLOP work units is downloaded BOINC thinks it will take a full day to run and doesn't download anything else until it finishes.

You are correct. I've got one of each type running. The estimated GFLOPS/sec is the same for both tasks at 0.92 GFLOPS/sec.
But the 4079 GFLOPS task is going to run for 1 hour 50 minutes and the 65,284 GFLOPS task is only estimated to run 22 minutes.

[Edit] I pinged Kevin to this thread for his attention.
[Edit2] This is backwards from standard BOINC client convention that the task property of estimated GFLOPs reflects the total amount of computation power needed to crunch the task.

Disregarding BOINC's broken ability to properly calculate GFLOPS for gpus, it should get this correct for cpu computation power based on the benchmark profile capability of each host.
ID: 76939 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 107
Credit: 18,271,281
RAC: 3,594
Message 76940 - Posted: 24 Feb 2024, 10:23:30 UTC

I had not been able to put my finger on what I was seeing different in my downloads. My four PC's as they are downloading work ... but yes it is in smaller amounts Hopefully this will be the answer and it can easily be corrected.
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 76940 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Kevin Roux
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Avatar

Send message
Joined: 9 Aug 22
Posts: 96
Credit: 4,474,690
RAC: 13
Message 76941 - Posted: 26 Feb 2024, 7:53:48 UTC

I will put it on the list of things to look at this week.
ID: 76941 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 24 Jan 11
Posts: 738
Credit: 565,020,458
RAC: 19,016
Message 76942 - Posted: 27 Feb 2024, 1:42:54 UTC - in response to Message 76941.  

Thanks Kevin, appreciated.
ID: 76942 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 107
Credit: 18,271,281
RAC: 3,594
Message 77224 - Posted: 5 Sep 2024, 20:05:18 UTC

Once the GFLOPS issue is resolved Volunteers that process multiple projects on a system may see an increase in the number of MW tasks that download when their system does a MW task request.

Perhaps after the current application rework and testing is complete Kevin will be able to work this issue into his schedule.

Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 77224 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 107
Credit: 18,271,281
RAC: 3,594
Message 77241 - Posted: 29 Sep 2024, 19:28:31 UTC

Kevin

Have you been able to set aside any time to re-visit the GFLOPS calculation issue for the project ?

Thanks
Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 77241 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 24 Jan 11
Posts: 738
Credit: 565,020,458
RAC: 19,016
Message 77247 - Posted: 30 Oct 2024, 18:43:09 UTC - in response to Message 77241.  

+1
ID: 77247 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Tuba Jim

Send message
Joined: 8 Sep 21
Posts: 11
Credit: 26,268,636
RAC: 17,353
Message 77248 - Posted: 31 Oct 2024, 3:18:15 UTC - in response to Message 76940.  

and us slow guys get them done in two days or so..Kinda comes in groups that lasts for a couple weeks or so then gets back to normal for a week or so. My average looks like a curved sawtooth. Well, it doesn't cost me anything I suppose.
ID: 77248 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 107
Credit: 18,271,281
RAC: 3,594
Message 77264 - Posted: 5 Nov 2024, 4:48:37 UTC - in response to Message 77248.  

Well if the Project did a better job of estimating the CPU power of each Client system. And did a better job of estimating how many Tasks to give each client system ... (GFLOPS Fixed ...)
Then some of the saw tooth might not be so extreme.
ID: 77264 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
alanb1951

Send message
Joined: 16 Mar 10
Posts: 217
Credit: 110,351,906
RAC: 1,937
Message 77266 - Posted: 5 Nov 2024, 13:22:55 UTC

Just a thought -- isn't the problem with the GFLOPS estimate that it is based in some way on the number of "particles" in the data being analyzed but it doesn't (or cannot) take account of where they are relative to the main area of computational focus? (I may be phrasing that badly...)

If the vast majority of a calculation involves "empty space" it probably runs a lot quicker. If it takes a lot of effort at workunit generation time to decide whether that might happen, that could be a problem :-) -- however, the consistency of the inverse relationship between GFLOPS estimates and actual run time suggests that a simpler fix would actually cover most cases...

Cheers - Al.
ID: 77266 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 107
Credit: 18,271,281
RAC: 3,594
Message 77270 - Posted: 5 Nov 2024, 20:05:57 UTC - in response to Message 77266.  

Nope ... I think that you might be thinking of a different Science Estimate not GFLOPS which is not science related in anyway.

GFLOPS is a calculation that the BOINC Project (MilkyWay@home) makes regarding the processing power of each Client system's power.

Is it an old slow system with few cores or ... is it a new powerful system with lots of cores and speed ? The calculated estimate is used by the Project to send more work to a power system and less to the older slower old systems. The thought is that more work for those who can handle it and less to those who might struggle to complete by the task deadline.

Bill F
ID: 77270 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
alanb1951

Send message
Joined: 16 Mar 10
Posts: 217
Credit: 110,351,906
RAC: 1,937
Message 77272 - Posted: 7 Nov 2024, 1:58:24 UTC - in response to Message 77270.  
Last modified: 7 Nov 2024, 2:04:11 UTC

BillF,

You are quite right; I was thinking of the "Estimated computation size" (which it cites in GFLOPs [note the small 's'] when it reports it in the BOINC Manager's task properties. I should've either called it something else or got the capitalization right :-) -- I'll plead that I paid more attention to the thread title than I should have done.

I seem to recall (possibly a couple of "admins" ago) that it was explained that the likely computation size was based on a [simplistic] knowledge of where in the complete data stream the WU was targetting and the nature of the stream at that point. Hence my [poorly labelled] observations.

Cheers - Al.
ID: 77272 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 107
Credit: 18,271,281
RAC: 3,594
Message 77295 - Posted: 13 Dec 2024, 4:00:42 UTC

I believe that Kevin is looking at the coding .... which once he fixes it will improve the calculated download capacities (per system) so that for users like myself that crunch for over 36 Projects .... when my BOINC client says "Lets go get some Milkyway tasks" it will get probably a lot more .... this is based on the current broken backwards GFLOPS which is saying ..."send less tasks"

As of today it looks like there are about 6,100 Active Milkyway users working about 13,000 active systems.

The "'Fix" when implemented will bump the production of the Milkyway project.

Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 77295 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 107
Credit: 18,271,281
RAC: 3,594
Message 77537 - Posted: 3 Jul 2025, 21:23:50 UTC

Kevin

Can you update the GFLOP.s status for those following this thread

Thanks
Billl
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 77537 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 107
Credit: 18,271,281
RAC: 3,594
Message 77644 - Posted: 21 Sep 2025, 19:59:55 UTC - in response to Message 77537.  

Kevin

Can you update the GFLOP.s status for those following this thread

Thanks
Billl



Kevin now that the current application is in and running and largely stable can you revisit the GFLOPS backwards calculation issue ?

This could result in a positive improvement to the Project with improved task distribution.

Respectfully
Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 77644 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
gimmyk
Volunteer moderator
Project administrator
Project developer
Project scientist

Send message
Joined: 11 Sep 24
Posts: 10
Credit: 10,421
RAC: 0
Message 77676 - Posted: 23 Oct 2025, 23:48:52 UTC

We have changed our gflops calculation to be much more accurate than what it was. The new calculation will be included in upcoming updates.
ID: 77676 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Purest Green

Send message
Joined: 5 Oct 25
Posts: 2
Credit: 1,957
RAC: 15
Message 77677 - Posted: 24 Oct 2025, 13:29:26 UTC

With a lack of work units for my three other BOINC projects, and not long after I installed Podman, apparently successfully, at BOINC's suggestion, I added MilkyWay@home. I'm running 3 cores of my Ryzen 9 5900X at 20% of CPU time in order to keep its temperatures (and my electricity bill) within reasonable limits.
Unlike my other projects (when running: climateprediction.net, LHC@home and Rosetta@home), MilkyWay vastly overruns its anticipated calculation time, to the extent that most of my first batch were aborted while waiting even to start due to overrunning the start date. I am currently running my second unit which has been running for about two weeks and has a deadline of a week ago, yet the Elapsed Time is claimed to be 1 day, 17:10:36, with 1:6:53 to go.
Am I doing something wrong? I notice another thread, now a few months old, referring to miscalculated time estimates. Even BOINC is now recommending the unit be aborted.
ID: 77677 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 107
Credit: 18,271,281
RAC: 3,594
Message 77678 - Posted: 24 Oct 2025, 18:01:49 UTC - in response to Message 77676.  

We have changed our gflops calculation to be much more accurate than what it was. The new calculation will be included in upcoming updates.



Thank you..... This issue has been hanging a very long time and your fix will aid in improved download amounts that more closely match the System's capabilities and loading.

You mentioned upcoming updates. Would this be an upgrade to the applications or something else ?

Respectfully

Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 77678 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 24 Jan 11
Posts: 738
Credit: 565,020,458
RAC: 19,016
Message 77679 - Posted: 25 Oct 2025, 1:28:14 UTC

A new app that fixes this long running problem will be most appreciated.
ID: 77679 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : GFLOPS backwards

©2025 Astroinformatics Group