| log in |
Message boards : Number crunching : Clearing results from database quickly?
| Author | Message |
|---|---|
|
Since the change to the longer units I have been noticing a few things that are a little strange. Firstly, in my results I am seeing a lot of tasks supposedly not returned by deadline, but I have not seen any evidence of this actually happening on my machines. Indeed, one machine supposedly had 17 results not returned by deadline, but it had been set to no new work for several weeks and hasn't had anything to return! The others have all been going through work steadily and returning promptly, yet all are shown as having work not returned by deadline. I cannot work it out. | |
| ID: 4208 | Rating: 0 | rate:
| |
Since the change to the longer units I have been noticing a few things that are a little strange. Firstly, in my results I am seeing a lot of tasks supposedly not returned by deadline, but I have not seen any evidence of this actually happening on my machines. Indeed, one machine supposedly had 17 results not returned by deadline, but it had been set to no new work for several weeks and hasn't had anything to return! The others have all been going through work steadily and returning promptly, yet all are shown as having work not returned by deadline. I cannot work it out. G'Day Wang Solutions, From what I have seen and timed, you will get about 5 minutes from the time you return your result till they are purged from the database. So you will have to be quick. I have not seen evidence of the first part of the problem you have reported with any of my computers, no results that are reporting past deadline. ____________ | |
| ID: 4210 | Rating: 0 | rate:
| |
|
I'd like to see the results being available for more than a few minutes too, like many here, i run several projects and not being able to analyse the results to make the best use of my systems by assigning them to more appropriate projects is a bit of a headache at the moment.......no point having machines crunching when they'll return the work after the deadline is up!! | |
| ID: 4218 | Rating: 0 | rate:
| |
I'd like to see the results being available for more than a few minutes too, like many here, i run several projects and not being able to analyse the results to make the best use of my systems by assigning them to more appropriate projects is a bit of a headache at the moment.......no point having machines crunching when they'll return the work after the deadline is up!! BoincView and BoincLogX can both log results. Stats sites like BOINCstats can also give you data about your recent results about 24 hr after they were returned. ____________ | |
| ID: 4220 | Rating: 0 | rate:
| |
|
The only problem is you don't get the Granted Credit for the tasks, be able to review the stderr data (if any and may not apply to BoincLogX.), and have no simple way to relate what's in the logs to what is shown on the Host Summary. | |
| ID: 4227 | Rating: 0 | rate:
| |
|
I think when Travis is back he will change the purge time....the only reason it is so fast now was the load on the server when they were short.....Travis is the only person with permissions to change this and other parameters so we are just waiting for him to get back and adjust the server to the new task length ;) | |
| ID: 4228 | Rating: 0 | rate:
| |
|
I have now had time to look into the first problem a little more, and I still cannot explain it. According to the host record here: | |
| ID: 4232 | Rating: 0 | rate:
| |
|
Most likely they are just 'ghosts'. | |
| ID: 4236 | Rating: 0 | rate:
| |
|
Thanks, I was not really worried about it from my point of view, but just wondering if anyone else was experiencing it and if in fact it needed to be checked on for reasons of data integrity. | |
| ID: 4240 | Rating: 0 | rate:
| |
|
Hi, I'm new to Milky Way. | |
| ID: 4246 | Rating: 0 | rate:
| |
|
*burp* ... erm, I mean *bump* | |
| ID: 4636 | Rating: 0 | rate:
| |
|
I also noticed completed work disappearing from the work unit list in less than 5 min... As others have said would be nice to have them be available for 24/48 hrs. | |
| ID: 4657 | Rating: 0 | rate:
| |
|
Okay, I've held off on commenting about this and a few other subjects because I figured that eventually Travis would come along, read and take care of the many outstanding issues, but... | |
| ID: 4658 | Rating: 0 | rate:
| |
Hi, I'm new to Milky Way. Hi and welcome, but to what I'm not sure now ;) A brief history of what happenend before you joined. This project use to have very short WUs - my 3GHz P4 completed them in about 10m33s and another host of mine in around 7min. These short WUs meant that the database had many (many!) entries and this caused problems. I think they were related to the purging process. (Sorry, don't know the programming side, but the forums will have it all). In an effort to to sort this out, settings were changed to what we have now - I think the WUs remain for a maximum of 5min. Since then, the WU duration was increased, initially by about 60 times, and soon afterwards by about 30 times the original duration. My P4: 10h17m and 5h32m. Now at this point the database purging could have been returned to its old setting, but at the same time the admins have disappeared. So, the real problem here is the lack of admins, which is a pity as this project had very responsive admins until that moment. Hoping this sheds some light on the situation, and that people realize that there's not much point in complaining about the problems here until there someone to respond to it. One thing's for sure, no response will lose a lot of crunchers. I'll stay while the project works, in the hope for a return of the admins. (Good movie title that: "Return of the Admins") :) Rod | |
| ID: 4659 | Rating: 0 | rate:
| |
So, the real problem here is the lack of admins, which is a pity as this project had very responsive admins until that moment. I guess a lot of us are out and about looking for either a new primary or secondary project to crunch on with all the change overs/updates on equipment, server versions, kredit kops, etc. Is this a normal policy with the admins here to just go missing? Whose minding the store when the servers go down, etc.? [edit] I don't know why I bothered to post this even after looking through the messages for an hour. So... Does this mean that we are part of the experiment titled "How to Attract and Lose Participants!"? One more thing, I've seen a lot of information about the computing aspects of the project. Is there any publications or anything to show what's actually been done along the astronomy aspect yet? [/edit] ____________ | |
| ID: 4667 | Rating: 0 | rate:
| |
Is this a normal policy with the admins here to just go missing? Whose minding the store when the servers go down, etc.? It's quite normal @ a lot of the projects once they've been running for awhile, especially during the summer month's, maybe this fall things will pick up as far as communications from the Dev's goes, but who knows ... ???? | |
| ID: 4668 | Rating: 0 | rate:
| |
Is this a normal policy with the admins here to just go missing? Not at this project. This project was one of the nicest projects with regular responses from the admins. This strange disappearance has really got me puzzled! Oh well, lets hope they'll be back, because it doesn't take long for the Boinc community to turn against a project. Rod | |
| ID: 4676 | Rating: 0 | rate:
| |
|
Some projects are run by grad students who disappear on summer vacation. | |
| ID: 4691 | Rating: 0 | rate:
| |
Some projects are run by grad students who disappear on summer vacation. If they are on summer vacation when would they likely to be back? Our summer vacation here in South Africa is over Christmas, so I've no idea when their vacation ends. But still very strange that they would suddenly vanish after being so active, without at least saying goodbye... Rod | |
| ID: 4692 | Rating: 0 | rate:
| |
Some projects are run by grad students who disappear on summer vacation. shh. school starts back up in 3 weeks or so. we're clearing results from the database quickly because the server would get overloaded and things would come to a screeching halt. it seems that having the purge running constantly was the only way to fix that. on another note, nate and i have been pretty busy working on a new version of the application and assimilator, which will mean even more serious workunits; and hopefully less server load. there'll be more about this in the next week or two when we start it up. ____________ | |
| ID: 4693 | Rating: 0 | rate:
| |
|
Wow, you're back, but so unannounced! we're clearing results from the database quickly because the server would get overloaded and things would come to a screeching halt. it seems that having the purge running constantly was the only way to fix that. But with longer WUs would it still get overloaded?
Can we read 'serious' as 'longer' ? ;) there'll be more about this in the next week or two when we start it up. Great. It feels like the light at the end of the tunnel has just been switched back on. Regards Rod | |
| ID: 4696 | Rating: 0 | rate:
| |
Wow, you're back, but so unannounced! I've just set the server to keep WUs in the database for a day, mostly to figure out whats happening with a certain credit issue. If the server doesn't get overloaded i'll leave it that way.
Definitely :D WUs will be able to do multiple areas of the sky among other things, which should really up the compute rate. Also, the new assimilator will give us the ability to run a whole slew of new search methods.
Hopefully the light isn't an oncoming train :D ____________ | |
| ID: 4697 | Rating: 0 | rate:
| |
But with longer WUs would it still get overloaded? Lets hope you can leave it.
:D :D :D | |
| ID: 4698 | Rating: 0 | rate:
| |
Hopefully the light isn't an oncoming train :D Under Siege 2: Dark Territory. Make sure you're on the correct side of the ghost town. ____________ | |
| ID: 4700 | Rating: 0 | rate:
| |
I've just set the server to keep WUs in the database for a day, mostly to figure out whats happening with a certain credit issue. If the server doesn't get overloaded i'll leave it that way. Thanks for making this change Travis! Sorry if I sounded overly grouchy in my post about the subject, but the classic BOINC "amazing disappearing admin" is one of my pet peeves. It sounds like you've been hard at work all of this time, but of course from the volunteer perspective, when we don't see anything posted for over a month, we make the assumption that you're on a beach somewhere sipping mai tais. :-\ ____________ | |
| ID: 4725 | Rating: 0 | rate:
| |
I've just set the server to keep WUs in the database for a day, mostly to figure out whats happening with a certain credit issue. If the server doesn't get overloaded i'll leave it that way. i wish! :D it's just been a busy summer and i was off traveling at a conference and had assumed that Nate was manning the forums (because he had been informing me of any problems)... i guess thats what i get for assuming :P either way school is right around the corner so we should have some undergrads back at work manning the forums and the server (instead of just me), so things should be a lot better in terms of response time. ____________ | |
| ID: 4726 | Rating: 0 | rate:
| |
shh. Hey, what did you do with Dave? Last seen making lightbulbs in Pennsylvania I believe. I know he liked Swedish neo-classical heavy metal, but even so, that's no excuse to dump him ;) Al. | |
| ID: 4728 | Rating: 0 | rate:
| |
shh. He had a summer internship so he didn't have any time to work on the project. i think he'll be back with us this fall. ____________ | |
| ID: 4729 | Rating: 0 | rate:
| |
Message boards :
Number crunching :
Clearing results from database quickly?