Welcome to MilkyWay@home

Insta-Purge

Message boards : Number crunching : Insta-Purge
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · Next

AuthorMessage
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 10731 - Posted: 14 Feb 2009, 22:03:41 UTC - in response to Message 10730.  

Shouldn't that be enough to extend the time to atleast an hour?


It makes it a lot harder (or impossible) to tell if the WUs I'm looking at in the database are ones that will be deleted after the hour or not at all.

With the insta-purge, if something sticks around I know it's problematic.

And are you still seeing things hanging about?


What's happening is that when a WU errors out, the server sends out another result for it (even though it's set to not re-issue errored WUs).

Before, some of these were getting their transition time set += 10 days. That's not happening any more, which is a good thing :) I'm just trying to make sure that when the 2nd result comes back the WU and all it's results get cleaned up correctly.
ID: 10731 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile speedimic
Avatar

Send message
Joined: 22 Feb 08
Posts: 260
Credit: 57,387,048
RAC: 0
Message 10918 - Posted: 15 Feb 2009, 18:49:03 UTC

Travis, looking at my tasklist, I just found 2 Wus reported on the 13th which aren't insta-purged...

Click

mic.


ID: 10918 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 10967 - Posted: 16 Feb 2009, 1:41:40 UTC - in response to Message 10918.  

Travis, looking at my tasklist, I just found 2 Wus reported on the 13th which aren't insta-purged...

Click


yuck. It looks like some WUs are getting their transition time set to never... looks like not everything is fixed :P
ID: 10967 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 10969 - Posted: 16 Feb 2009, 2:03:37 UTC - in response to Message 10967.  

Travis, looking at my tasklist, I just found 2 Wus reported on the 13th which aren't insta-purged...

Click


yuck. It looks like some WUs are getting their transition time set to never... looks like not everything is fixed :P


I looked at the link a few hours ago and they didn't show up.
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 10969 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
The Naja

Send message
Joined: 14 Feb 09
Posts: 5
Credit: 1,022,977
RAC: 0
Message 11146 - Posted: 17 Feb 2009, 12:58:34 UTC

Hello Travis,

I don't know if this could help you, but due to a mistake I made when I joined this project, something like 40 WU in my list are due for today and will not be processed (I already slapped myself for that, don't worry :p), but in case you would like to follow their 'second life' after they are re-issued...

Here some links just in case:

http://milkyway.cs.rpi.edu/milkyway/workunit.php?wuid=2583318
http://milkyway.cs.rpi.edu/milkyway/workunit.php?wuid=2583464
http://milkyway.cs.rpi.edu/milkyway/workunit.php?wuid=2583477

Hope it helps
Cheers
ID: 11146 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
Message 11162 - Posted: 17 Feb 2009, 15:19:57 UTC - in response to Message 11146.  

Well, the real test is to see if they go away on their own (like they're supposed to). ;-)

Alinator
ID: 11162 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
Message 11231 - Posted: 17 Feb 2009, 20:26:25 UTC

Things are looking good so far from this end.

So can we please add some delay to the purge? Even just 1 hour would be a tremendous help. ;-)

Alinator
ID: 11231 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 11325 - Posted: 18 Feb 2009, 4:27:14 UTC - in response to Message 11231.  
Last modified: 18 Feb 2009, 4:41:24 UTC

Things are looking good so far from this end.

So can we please add some delay to the purge? Even just 1 hour would be a tremendous help. ;-)

Alinator


Gonna try the purge at 3 hours tonight. Should be going shortly.

Purge should be at 3 hours now. Here's to hoping it doesn't break the server :)
ID: 11325 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
Message 11328 - Posted: 18 Feb 2009, 5:05:04 UTC - in response to Message 11325.  
Last modified: 18 Feb 2009, 5:05:22 UTC

OK, thanks, and I'll keep my fingers crossed. :-)

If the backend can make it through the next couple of days, then I guess I can go back onto full autopilot. ;-)

Alinator
ID: 11328 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Misfit
Avatar

Send message
Joined: 27 Aug 07
Posts: 915
Credit: 1,503,319
RAC: 0
Message 11337 - Posted: 18 Feb 2009, 5:45:02 UTC - in response to Message 11325.  

Gonna try the purge at 3 hours tonight. Should be going shortly.

Purge should be at 3 hours now. Here's to hoping it doesn't break the server :)

Bulimia@home.
me@rescam.org
ID: 11337 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
John Clark

Send message
Joined: 4 Oct 08
Posts: 1734
Credit: 64,228,409
RAC: 0
Message 11344 - Posted: 18 Feb 2009, 6:16:16 UTC

Holding up so far
ID: 11344 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Odd-Rod

Send message
Joined: 7 Sep 07
Posts: 444
Credit: 5,712,451
RAC: 0
Message 11443 - Posted: 18 Feb 2009, 15:49:23 UTC - in response to Message 11337.  

Gonna try the purge at 3 hours tonight. Should be going shortly.

Purge should be at 3 hours now. Here's to hoping it doesn't break the server :)

Bulimia@home.


LOL
ID: 11443 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile speedimic
Avatar

Send message
Joined: 22 Feb 08
Posts: 260
Credit: 57,387,048
RAC: 0
Message 13372 - Posted: 28 Feb 2009, 18:56:32 UTC - in response to Message 10918.  

Travis, looking at my tasklist, I just found 2 Wus reported on the 13th which aren't insta-purged...

Click


BTW: those are still there... ;)

1641784
1635911


mic.


ID: 13372 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 13374 - Posted: 28 Feb 2009, 19:05:31 UTC - in response to Message 13372.  

Travis, looking at my tasklist, I just found 2 Wus reported on the 13th which aren't insta-purged...

Click


BTW: those are still there... ;)

1641784
1635911



blarg. ok
ID: 13374 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
Message 13511 - Posted: 1 Mar 2009, 18:33:34 UTC

OK...

We seem to be out of meltdown mode again...

So can we please have at least 1 hour of purge delay back?

Alinator
ID: 13511 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 13515 - Posted: 1 Mar 2009, 19:01:27 UTC - in response to Message 13511.  

OK...

We seem to be out of meltdown mode again...

So can we please have at least 1 hour of purge delay back?

Alinator


How about 6 hours? :)
ID: 13515 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
Message 13516 - Posted: 1 Mar 2009, 19:05:32 UTC - in response to Message 13515.  

LOL...

Works for me! Just didn't want to seem to be greedy when making the request.

You know, beggars can't be choosers! :-)

Alinator
ID: 13516 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Kevint
Avatar

Send message
Joined: 22 Nov 07
Posts: 285
Credit: 1,076,786,368
RAC: 0
Message 13519 - Posted: 1 Mar 2009, 19:40:30 UTC - in response to Message 13511.  

OK...

We seem to be out of meltdown mode again...

So can we please have at least 1 hour of purge delay back?

Alinator



And start increasing the cache settings... you can move it in 2's from 6 to 8, wait 24 hours, then from 8 to 12 to 14 etc... until you reach the optimum WU return time you are looking for.

But jumping around in quick jumps like you have done has caused nothing but trouble.. as you can now see.

Baby steps, baby steps....



.
ID: 13519 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 13522 - Posted: 1 Mar 2009, 20:15:15 UTC - in response to Message 13519.  

And start increasing the cache settings... you can move it in 2's from 6 to 8, wait 24 hours, then from 8 to 12 to 14 etc... until you reach the optimum WU return time you are looking for.



The cache settings are going to have to wait until we get the scheduler working right.
ID: 13522 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Lloyd M.

Send message
Joined: 1 Dec 08
Posts: 139
Credit: 8,721,208
RAC: 0
Message 13534 - Posted: 1 Mar 2009, 21:01:51 UTC - in response to Message 10729.  

With the insta-purge, if something sticks around I know it's problematic.


Oh, OK. That explains a lot. I was wondering where in the world my results were.

ID: 13534 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · Next

Message boards : Number crunching : Insta-Purge

©2024 Astroinformatics Group