Welcome to MilkyWay@home

Validation inconclusive

Message boards : Number crunching : Validation inconclusive
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 6 · 7 · 8 · 9 · 10 · 11 · 12 . . . 18 · Next

AuthorMessage
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3315
Credit: 519,943,543
RAC: 22,328
Message 73145 - Posted: 28 Apr 2022, 2:35:54 UTC - in response to Message 73142.  

I also get this problem. Now there are 1000+ unvalidated tasks on my page
It seems that NBody tasks are not getting validated at all these days.
You are not alone in wondering! However, it's just NBody tasks with the most recent result marked as "Don't need" that aren't getting validated or, at least, that's my experience (and [it appears] that of several other users who have posted...)

There are lots of other messages in both this thread and the "NBody WU Flush" thread in the News forum that discuss this in more detail, so both an explanation and speculation on when (if ever) those stuck work units will unblock can be found :-) (I posted a longer reply on this topic earlier today, and others have contributed too.)

It will sort out eventually, either by the work-units unsticking (because the system eventually creates another retry...) or by them being discarded completely. We have no choice but to wait and see, no matter how frustrating that might be :-( ...

Cheers -- Al.


Discarding them completely would be totally demoralizing, hopefully that is not the choice! I got a dollar here that sez that almost all of the so called 'don't need' work will convert to validated, if Tom can get wing men assigned. Or force the server to deal with it some how. I think I have at least 11,000 in that state, and I am sure there are others with large amounts as well, probably even larger. It would be an absolute shame to throw the good results down the toilette! It's not the credit, which is minuscule compared to separation work, it's the science.
It was the galaxy collision video that got me hooked on MW in the first place, and that was an n body product. MW is the only project I work on.


I agree with your hopes and aspirations but it might be beyond Tom's control, I mean he "flushed" all the workunits out of the system does that mean they are now orphaned and have to be brought with new names or that they can be recycled as 2nd and 3rd tasks as opposed to initial tasks so your 11K and everyone elses can validate.
ID: 73145 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
San-Fernando-Valley

Send message
Joined: 13 Apr 17
Posts: 256
Credit: 604,411,638
RAC: 0
Message 73148 - Posted: 28 Apr 2022, 6:20:08 UTC - in response to Message 73136.  

I also get this problem. Now there are 1000+ unvalidated tasks on my page
It seems that NBody tasks are not getting validated at all these days.

I was wondering about this also, so I stopped all crunching and "watched" the task page for a couple of hours.
The result being, that about 10 tasks "disappear" from the "validation inconclusive" queue over a timespan of around two hours.
Hope they went to the "valid" queue.
ID: 73148 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 20 Nov 07
Posts: 54
Credit: 2,663,789
RAC: 0
Message 73203 - Posted: 30 Apr 2022, 16:31:37 UTC - in response to Message 73126.  

My validation inconclusive's haven't dropped in 4 days now. I had hopes for improvement.


I checked some of yours and they said that you are not waiting on a wingman just for the Server to do it's thing to process your tasks and give you the credits for them. I wonder if Tom needs to kick that part of the Server or you are just waiting thru a few Million other tasks just like yours? If so people still doing tasks is the problem as the list never grows shorter although yours should be heading to top of the queue.


It's been a week now without any further validated inconclusive's. I stopped crunching 5 weeks ago.
ID: 73203 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3315
Credit: 519,943,543
RAC: 22,328
Message 73213 - Posted: 1 May 2022, 3:02:41 UTC - in response to Message 73203.  

My validation inconclusive's haven't dropped in 4 days now. I had hopes for improvement.


I checked some of yours and they said that you are not waiting on a wingman just for the Server to do it's thing to process your tasks and give you the credits for them. I wonder if Tom needs to kick that part of the Server or you are just waiting thru a few Million other tasks just like yours? If so people still doing tasks is the problem as the list never grows shorter although yours should be heading to top of the queue.


It's been a week now without any further validated inconclusive's. I stopped crunching 5 weeks ago.


Are yours zero tasks or 1, 2 or more tasks? Look at the number at the end of your task for the number. The zero task is the original task while the 1, 2 3 etc is other copies of the same task sent out to validate the task if needed.
ID: 73213 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 20 Nov 07
Posts: 54
Credit: 2,663,789
RAC: 0
Message 73223 - Posted: 1 May 2022, 17:10:31 UTC - in response to Message 73213.  

My validation inconclusive's haven't dropped in 4 days now. I had hopes for improvement.


I checked some of yours and they said that you are not waiting on a wingman just for the Server to do it's thing to process your tasks and give you the credits for them. I wonder if Tom needs to kick that part of the Server or you are just waiting thru a few Million other tasks just like yours? If so people still doing tasks is the problem as the list never grows shorter although yours should be heading to top of the queue.


It's been a week now without any further validated inconclusive's. I stopped crunching 5 weeks ago.


Are yours zero tasks or 1, 2 or more tasks? Look at the number at the end of your task for the number. The zero task is the original task while the 1, 2 3 etc is other copies of the same task sent out to validate the task if needed.


Not sure what you're referring to but my tasks are viewable for scrutiny.
ID: 73223 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 20 Nov 07
Posts: 54
Credit: 2,663,789
RAC: 0
Message 73224 - Posted: 1 May 2022, 17:14:29 UTC - in response to Message 73223.  

Not sure what you're referring to but my tasks are viewable for scrutiny.


Ok just looked again. They all end in 0.
ID: 73224 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 20 Nov 07
Posts: 54
Credit: 2,663,789
RAC: 0
Message 73225 - Posted: 1 May 2022, 23:29:53 UTC - in response to Message 73213.  

Are yours zero tasks or 1, 2 or more tasks? Look at the number at the end of your task for the number. The zero task is the original task while the 1, 2 3 etc is other copies of the same task sent out to validate the task if needed.


Since it was determined they all end in 0 what exactly does that mean?
ID: 73225 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 24 Jan 11
Posts: 696
Credit: 540,021,505
RAC: 86,739
Message 73226 - Posted: 2 May 2022, 0:09:29 UTC - in response to Message 73225.  

The tasks haven't been replicated yet for any wingmen. So you are waiting until somebody else crunches the tasks and get validated.
ID: 73226 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 20 Nov 07
Posts: 54
Credit: 2,663,789
RAC: 0
Message 73227 - Posted: 2 May 2022, 0:31:35 UTC - in response to Message 73226.  

The tasks haven't been replicated yet for any wingmen. So you are waiting until somebody else crunches the tasks and get validated.


Thanks, the vast number were submitted at my end between March 16 - 24. Assume I'm waiting because the server hasn't sent them to others despite the time lag. Just how much longer, or has this already been addressed by the admin that I'm not seeing?
ID: 73227 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
alanb1951

Send message
Joined: 16 Mar 10
Posts: 208
Credit: 105,443,293
RAC: 36,711
Message 73228 - Posted: 2 May 2022, 2:33:52 UTC - in response to Message 73227.  

The tasks haven't been replicated yet for any wingmen. So you are waiting until somebody else crunches the tasks and get validated.


Thanks, the vast number were submitted at my end between March 16 - 24. Assume I'm waiting because the server hasn't sent them to others despite the time lag. Just how much longer, or has this already been addressed by the admin that I'm not seeing?
I presume all your stalled tasks have a second entry with status "Didn't need" - other work units seem to be processing as normal now...

In summary, those "Didn't need" tasks are the result of what Tom did to try to reduce the backlog of NBody work to a level that gave it a chance to get back to normal (for some value of normal...); a lot of those work units were from mid-March, like yours. Those work units are effectively stalled until the transitioner decides that they've been inactive for an over-long period, at which point a new task might be created to get each work unit moving again -- what constitutes over-long is based on a parameter visible only to the server system (so no clarity of information there...).

This has been discussed before in both this thread (here, for instance) and the "NBody WU Flush" thread in the News forum (if you can find it amongst the noise there!), including some "what happens next" ideas that haven't been confirmed (or refuted) yet.

I realize that counselling patience doesn't reduce the irritation factor :-) but waiting is all we can do at present...

Cheers - Al.
ID: 73228 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3315
Credit: 519,943,543
RAC: 22,328
Message 73240 - Posted: 2 May 2022, 10:27:24 UTC - in response to Message 73227.  

The tasks haven't been replicated yet for any wingmen. So you are waiting until somebody else crunches the tasks and get validated.


Thanks, the vast number were submitted at my end between March 16 - 24. Assume I'm waiting because the server hasn't sent them to others despite the time lag. Just how much longer, or has this already been addressed by the admin that I'm not seeing?


Waaaay down in the News, Nbody Flush section Tom the Admin said 30 days after the original task is returned.
ID: 73240 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Tom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 408
Credit: 120,203,200
RAC: 0
Message 73244 - Posted: 2 May 2022, 14:15:26 UTC

Yeah, it's looking like when I flushed all the WUs that "hadn't been sent yet," it also terminated all of the tasks that had previously been returned but hadn't sent out the wingman WUs. So now there are a bunch of WUs that won't be validated that are floating around, which is frustrating for people.

For the record, I was led to believe that I was only cancelling WUs that had never been sent to anyone or already had one result crunched by someone. Maybe that is why the automatic BOINC WU cancellation tool didn't remove very many tasks, because they all had been crunched once but the validator wasn't able to get everything sent back out?

So, apologies for that. There's an option to "revalidate WUs" but I don't know enough about it at the moment to recognize whether it would just overload the server with tasks again, or worst case, if it would even try to revalidate EVERY WU that's floating around, which includes a lot of very old WUs.
ID: 73244 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 20 Nov 07
Posts: 54
Credit: 2,663,789
RAC: 0
Message 73245 - Posted: 2 May 2022, 14:50:36 UTC - in response to Message 73244.  

So now there are a bunch of WUs that won't be validated that are floating around, which is frustrating for people.

Finally! A statement suggesting those WU's may never be validated and may be permanently listed in our accounts as pending.

My sympathies to those who have thousands outstanding. I only have 603.
ID: 73245 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3315
Credit: 519,943,543
RAC: 22,328
Message 73252 - Posted: 2 May 2022, 20:56:18 UTC - in response to Message 73245.  

So now there are a bunch of WUs that won't be validated that are floating around, which is frustrating for people.

Finally! A statement suggesting those WU's may never be validated and may be permanently listed in our accounts as pending.

My sympathies to those who have thousands outstanding. I only have 603.


My condolences but Tom has said in the past he MAY resort to stopping everything and letting all outstanding tasks come back in and then reset the database so all those are gone too, it's pretty draconian but if they keep climbing, I think i have less than 10, it just may come to that to finally get MW back on it's feet and in fighting shape again.
ID: 73252 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 4 Jul 09
Posts: 85
Credit: 16,692,188
RAC: 4,497
Message 73254 - Posted: 3 May 2022, 0:18:43 UTC - in response to Message 73252.  

So now there are a bunch of WUs that won't be validated that are floating around, which is frustrating for people.

Finally! A statement suggesting those WU's may never be validated and may be permanently listed in our accounts as pending.

My sympathies to those who have thousands outstanding. I only have 603.


My condolences but Tom has said in the past he MAY resort to stopping everything and letting all outstanding tasks come back in and then reset the database so all those are gone too, it's pretty draconian but if they keep climbing, I think i have less than 10, it just may come to that to finally get MW back on it's feet and in fighting shape again.


My inconclusive count has dropped by a very very small amount for the first time in weeks from 907 to 899.

Bill F
ID: 73254 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
alanb1951

Send message
Joined: 16 Mar 10
Posts: 208
Credit: 105,443,293
RAC: 36,711
Message 73255 - Posted: 3 May 2022, 0:59:51 UTC - in response to Message 73245.  
Last modified: 3 May 2022, 1:29:06 UTC

So now there are a bunch of WUs that won't be validated that are floating around, which is frustrating for people.

Finally! A statement suggesting those WU's may never be validated and may be permanently listed in our accounts as pending.

My sympathies to those who have thousands outstanding. I only have 603.

Actually, that probably meant "won't be validated because they can't get another wingman at present...", not "may never be validated" -- isn't English wonderfully precise (not!)?...

And to back that up, I note that whatever happened a few hours ago has created over 7 million tasks waiting to be sent, and a lot of your stuck work units are now unstuck with a new task sent out and in progress. Whether that's due to something Tom has done or whether the system hit its "safety net" on these work units, the effect is quite dramatic!

As mentioned several times before, it just needed something to kick the transitioner into looking at the stalled work units again...

Cheers - Al.

[Edited to rephrase second paragraph...]
ID: 73255 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3315
Credit: 519,943,543
RAC: 22,328
Message 73259 - Posted: 3 May 2022, 11:35:53 UTC - in response to Message 73255.  

So now there are a bunch of WUs that won't be validated that are floating around, which is frustrating for people.

Finally! A statement suggesting those WU's may never be validated and may be permanently listed in our accounts as pending.

My sympathies to those who have thousands outstanding. I only have 603.

Actually, that probably meant "won't be validated because they can't get another wingman at present...", not "may never be validated" -- isn't English wonderfully precise (not!)?...

And to back that up, I note that whatever happened a few hours ago has created over 7 million tasks waiting to be sent, and a lot of your stuck work units are now unstuck with a new task sent out and in progress. Whether that's due to something Tom has done or whether the system hit its "safety net" on these work units, the effect is quite dramatic!

As mentioned several times before, it just needed something to kick the transitioner into looking at the stalled work units again...

Cheers - Al.

[Edited to rephrase second paragraph...]


I just looked at your pc's and 2 of the tasks on the first one had this as the ending after the name of the file "_2" meaning hopefully Tom forced the Server to send out those validation tasks now instead of hanging onto them soooo long. You still have 12 days to send them back but at least they are sending them out!!
ID: 73259 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Tom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 408
Credit: 120,203,200
RAC: 0
Message 73261 - Posted: 3 May 2022, 12:54:38 UTC

Looks like everything got dredged back to the surface. I'm going to let things run normally and see if all those Nbody WUs can get processed so people can get their credit.

If you stop being able to regularly get credit again, I will have to cancel some Nbody WUs (in a smarter way this time)
ID: 73261 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 20 Nov 07
Posts: 54
Credit: 2,663,789
RAC: 0
Message 73268 - Posted: 3 May 2022, 18:08:53 UTC - in response to Message 73255.  

As mentioned several times before, it just needed something to kick the transitioner into looking at the stalled work units again...


And it 'just' started happening after discussing this. What a coincidence!
ID: 73268 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mikey
Avatar

Send message
Joined: 8 May 09
Posts: 3315
Credit: 519,943,543
RAC: 22,328
Message 73294 - Posted: 4 May 2022, 11:15:42 UTC - in response to Message 73268.  

As mentioned several times before, it just needed something to kick the transitioner into looking at the stalled work units again...


And it 'just' started happening after discussing this. What a coincidence!


Squeaky wheel and all that probably
ID: 73294 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 6 · 7 · 8 · 9 · 10 · 11 · 12 . . . 18 · Next

Message boards : Number crunching : Validation inconclusive

©2024 Astroinformatics Group