Message boards :
Number crunching :
Validation inconclusive
Message board moderation
Previous · 1 . . . 7 · 8 · 9 · 10 · 11 · 12 · 13 . . . 18 · Next
Author | Message |
---|---|
Send message Joined: 8 Nov 11 Posts: 205 Credit: 2,900,464 RAC: 0 |
Unless I am being silly I am confused as to why the Nbody unsent are not dropping very quickly. I have completed over 200 today that were validated. There are 4300 users on currently so assuming they are similar to me that could be 860,000 completed. The unsents have dropped by around 20,000 in the last 24 hours , not what I would expect. My validation inconclusive backlog has not changed at all, in fact it has grown very slightly. At the present rate I estimate it will take 550 days to clear the backlog.. Hope I am wrong. |
Send message Joined: 16 Mar 10 Posts: 213 Credit: 108,314,058 RAC: 4,166 |
Unless I am being silly I am confused as to why the Nbody unsent are not dropping very quickly. I have completed over 200 today that were validated. There are 4300 users on currently so assuming they are similar to me that could be 860,000 completed. The unsents have dropped by around 20,000 in the last 24 hours , not what I would expect. My validation inconclusive backlog has not changed at all, in fact it has grown very slightly. At the present rate I estimate it will take 550 days to clear the backlog..I've been tracking this as well and can confirm that observation. For what it's worth, over 90% of the tasks I've seen recently are second tries which get validated more or less instantly, so the work units should be getting thinned out a bit! I can think of three possibilities for the count staying high, not mutually exclusive:
|
Send message Joined: 8 Nov 11 Posts: 205 Credit: 2,900,464 RAC: 0 |
Thanks alanb 1951, very reassuring. |
Send message Joined: 16 Mar 10 Posts: 213 Credit: 108,314,058 RAC: 4,166 |
I can think of three possibilities for the count staying high, not mutually exclusive:Correction -- option 1 shouldn't apply; I had another look at the PHP, and provided the "Didn't need" tasks are flagged properly they shouldn't be counted. So I'm at [more of] a loss to explain the increasing count if the generator isn't adding new work units! (And I sincerely hope it isn't...) Cheers - Al. Observation: it's a bit difficult trying to investigate/"debug" something {in order to explain it] from the opposite side of the Atlantic, especially without detailed access to data. :-) |
Send message Joined: 8 May 09 Posts: 3339 Credit: 524,010,781 RAC: 0 |
I can think of three possibilities for the count staying high, not mutually exclusive:Correction -- option 1 shouldn't apply; I had another look at the PHP, and provided the "Didn't need" tasks are flagged properly they shouldn't be counted. So I'm at [more of] a loss to explain the increasing count if the generator isn't adding new work units! (And I sincerely hope it isn't...) And Tom the Admin is out of town as well so the Server could be doing things 'on it's own' again, 'on it's own' being what's is supposed to do but not exactly what Tom thinks it's supposed to be doing. MW certainly needs to get Tom some more help in the form of some IT grad student or someone like that that can help decipher the complexities of Boinc. |
Send message Joined: 8 Nov 11 Posts: 205 Credit: 2,900,464 RAC: 0 |
Did a spot check from yesterday against today and NBody unsents have risen by almost 120,000. Still no movement up or down on my backlog of inconclusives . |
Send message Joined: 23 Sep 13 Posts: 19 Credit: 36,223,867 RAC: 0 |
I can tell you that my Validation Inconclusive has gone down by over 400 in the last 2 days and I still have another 14,306 that are still listed as Validation Inconclusive so it's going to take awhile to get my Validation Inconclusive down to 0.I predict if World Community Grid comes back on May 9th as it's scheduled that some of the people will go back to World Community Grid which will make the number of NBody work units to be validated take even longer |
Send message Joined: 11 Mar 22 Posts: 42 Credit: 21,902,543 RAC: 0 |
I can tell you that my Validation Inconclusive has gone down by over 400 in the last 2 days and I still have another 14,306 that are still listed as Validation Inconclusive so it's going to take awhile to get my Validation Inconclusive down to 0.I predict if World Community Grid comes back on May 9th as it's scheduled that some of the people will go back to World Community Grid which will make the number of NBody work units to be validated take even longer +1 |
Send message Joined: 13 Oct 21 Posts: 44 Credit: 226,914,018 RAC: 2,349 |
One of the reasons validation seems slow moving (and the queue) is because of tasks like this: https://milkyway.cs.rpi.edu/milkyway/workunit.php?wuid=391645869. There are probably thousands of them maybe even a few million (from the 14 million that were created after disk reconstruction). Eventually things will get cleared up but it will take time. |
Send message Joined: 20 Nov 07 Posts: 54 Credit: 2,663,789 RAC: 0 |
I predict if World Community Grid comes back on May 9th as it's scheduled that some of the people will go back to World Community Grid which will make the number of NBody work units to be validated take even longer The damage has already been done. I stopped crunching late March after seeing my inconclusives flatline without improvement. I'm sure I'm not alone. Moved to universe@home and now check only irregularly here just to see what WU's remain. |
Send message Joined: 8 May 09 Posts: 3339 Credit: 524,010,781 RAC: 0 |
One of the reasons validation seems slow moving (and the queue) is because of tasks like this: https://milkyway.cs.rpi.edu/milkyway/workunit.php?wuid=391645869. There are probably thousands of them maybe even a few million (from the 14 million that were created after disk reconstruction). Eventually things will get cleared up but it will take time. Yes alot of people have no clue about how to reduce the cache size when they reduce the amount of time their pc can run full speed, so end up with sooooo many units that can't finish in time and yet still let them just expire instead of aborting them. |
Send message Joined: 8 May 09 Posts: 3339 Credit: 524,010,781 RAC: 0 |
I predict if World Community Grid comes back on May 9th as it's scheduled that some of the people will go back to World Community Grid which will make the number of NBody work units to be validated take even longer I'm sure your Team is liking your contribution to the Boinc Pentathlon assuming they signed up for it. |
Send message Joined: 12 Nov 21 Posts: 236 Credit: 575,038,236 RAC: 0 |
MW certainly needs to get Tom some more help in the form of some IT grad student or someone like that that can help decipher the complexities of Boinc. Amen. And Amen. |
Send message Joined: 11 Mar 22 Posts: 42 Credit: 21,902,543 RAC: 0 |
We will provide an update on the result of our efforts to resolve the issue Sunday evening. I predict if World Community Grid comes back on May 9th as it's scheduled that some of the people will go back to World Community Grid which will make the number of NBody work units to be validated take even longer Sunday evening passed by, no news. But the didn't say which Sunday ... |
Send message Joined: 8 May 09 Posts: 3339 Credit: 524,010,781 RAC: 0 |
We will provide an update on the result of our efforts to resolve the issue Sunday evening. Guessing that means they ran into more problems |
Send message Joined: 8 Nov 11 Posts: 205 Credit: 2,900,464 RAC: 0 |
Think the validator has stopped, waiting for validation has shotup to over 35,000 |
Send message Joined: 16 Mar 10 Posts: 213 Credit: 108,314,058 RAC: 4,166 |
Think the validator has stopped, waiting for validation has shotup to over 35,000 The validator is still working -- I've just checked my N-Body tasks flagged valid, and there are plenty returned since your post... However, there is an explanation for why the "Waiting for validation" is rising... A lot of the N-Body work units that were stalled had no successful result returned when they were put on hold; As N=Body doesn't seem to be using adaptive replication, when someone returns the first successful unit it'll end up "Inconclusive" until a wingman returns a result, and as the request for a second result ends up at the back of the [over-large] queue those work units are going to push up the "Waiting for validation" count for quite a while :-( For what it's worth, at the moment about 10% of the tasks my systems process each day are flagged inconclusive because of this. I have no idea how that compares with what other users are seeing, but if it's typical then (given the rate at which the unsent tasks count is being reduced) the "Waiting for validation" count could keep increasing by 20,000 or more per day until we get round to much more recent work units. Cheers - Al. |
Send message Joined: 8 Nov 11 Posts: 205 Credit: 2,900,464 RAC: 0 |
Thank you. |
Send message Joined: 16 Mar 10 Posts: 213 Credit: 108,314,058 RAC: 4,166 |
Oops = sleep-deprived misread of source code, and too late to edit the original... Whilst the above was right regarding how long it might take for inconclusive status to be resolved, it wasn't right about the validation count!!!Think the validator has stopped, waiting for validation has shotup to over 35,000 I note that the waiting for validation count has dropped back again -- I wonder if it was actually a rush of Separation tasks all being returned at once... Sorry about that - Al. |
Send message Joined: 8 May 09 Posts: 3339 Credit: 524,010,781 RAC: 0 |
Think the validator has stopped, waiting for validation has shotup to over 35,000 I have taken my machines off of MilkyWay for right now but the last tasks I finished up yesterday were all _2 tasks, no _0 or _1 tasks at all, I wonder if that means we are getting to a batch of validator tasks or if Tom found a way to send out the validator tasks sooner than the end of the database? |
©2024 Astroinformatics Group