Welcome to MilkyWay@home

Site goes very slow at times?

Message boards : Number crunching : Site goes very slow at times?
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 5264 - Posted: 30 Sep 2008, 14:57:40 UTC

Mainly while the main page is loading it takes awhile. Any problems?
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 5264 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Dave Przybylo
Avatar

Send message
Joined: 5 Feb 08
Posts: 236
Credit: 49,648
RAC: 0
Message 5265 - Posted: 30 Sep 2008, 15:03:58 UTC - in response to Message 5264.  

Mainly while the main page is loading it takes awhile. Any problems?


i think the web server has trouble sometimes when the server is really busy validating workunits and such. In the future we may move the web server to a separate machine.
Dave Przybylo
MilkyWay@home Developer
Department of Computer Science
Rensselaer Polytechnic Institute
ID: 5265 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 5266 - Posted: 30 Sep 2008, 15:06:59 UTC

Ok.
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 5266 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 6566 - Posted: 24 Nov 2008, 14:28:41 UTC

Been extremely slow last 36 hours. Most of the time it takes a few refresh's to get a page to load. But do get little bursts of speed.
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 6566 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
John Clark

Send message
Joined: 4 Oct 08
Posts: 1734
Credit: 64,228,409
RAC: 0
Message 6567 - Posted: 24 Nov 2008, 14:41:26 UTC - in response to Message 6566.  

Been extremely slow last 36 hours. Most of the time it takes a few refresh's to get a page to load. But do get little bursts of speed.


I would support this comment by banditwolf - very slow and multiple refreshes
ID: 6567 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 6570 - Posted: 24 Nov 2008, 15:19:35 UTC - in response to Message 6567.  

We're having a problem where the harddrive of milkyway isn't quite big enough, so stuff is spilling over to the NFS server, which is slowing things down. We've ordered a bunch more hard drives which should fix the problem.
ID: 6570 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 7037 - Posted: 30 Nov 2008, 18:56:26 UTC

For atleast 18+ hours now the site has been going very slow. Doesn't seem to have benifitted from the recent changes. I can't even get this to post. (3rd try,(can't beat copy/paste))
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 7037 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
Message 7038 - Posted: 30 Nov 2008, 20:02:16 UTC - in response to Message 6570.  

We're having a problem where the harddrive of milkyway isn't quite big enough, so stuff is spilling over to the NFS server, which is slowing things down. We've ordered a bunch more hard drives which should fix the problem.


Hmmm...

I wonder if some of the feeder queue is spilling over to NFS. I've had task DL's balking initially from time to time since the quota adjustment.

Alinator
ID: 7038 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 7039 - Posted: 30 Nov 2008, 20:07:04 UTC - in response to Message 7038.  

We're having a problem where the harddrive of milkyway isn't quite big enough, so stuff is spilling over to the NFS server, which is slowing things down. We've ordered a bunch more hard drives which should fix the problem.


Hmmm...

I wonder if some of the feeder queue is spilling over to NFS. I've had task DL's balking initially from time to time since the quota adjustment.

Alinator


Yea, could be. Going fast at the moment.
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 7039 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
Message 7040 - Posted: 30 Nov 2008, 20:10:42 UTC

Well, it looks like Travis is tweaking things. :-)

I just got a down for maintenance 1 hour buzz off when one of my hosts tried to report right after he posted. ;-)

Alinator
ID: 7040 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 7051 - Posted: 30 Nov 2008, 20:33:21 UTC - in response to Message 7040.  

Well, it looks like Travis is tweaking things. :-)

I just got a down for maintenance 1 hour buzz off when one of my hosts tried to report right after he posted. ;-)

Alinator


I think part of it is i stopped the old assimilator from generating new workunits and moved the new app out of test mode. The daemons for the new app are a lot faster. I wrote a custom assimilator for what we're doing which is a lot faster and memory friendly than the old one. The WUs being generated now should also take more time which should hopefully keep the server and all the WU hungry cpus out there happy.
ID: 7051 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 9665 - Posted: 4 Feb 2009, 14:23:08 UTC

The last day especially, the site is slow most of the time. At times I can't get the page to load. My guess is due to more users looking for new apps, or just more users & wu's out at a time, is being slowed when groups are returned at the same time.
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 9665 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile [AF>Libristes>Archlinux]...

Send message
Joined: 5 Jan 09
Posts: 2
Credit: 39,786
RAC: 0
Message 9667 - Posted: 4 Feb 2009, 14:52:05 UTC

I think it's currently related to the bug I'm encountering, if it's widespread : since my computers think that every WU take a very little time (about 10 min), they try to ask the server for WUs, again and again (even if the server replies that there's already too much WU for this computer)

If widespread, I think it could make a heavy load on the server.

http://milkyway.cs.rpi.edu/milkyway/forum_thread.php?id=606
ID: 9667 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Paul D. Buck

Send message
Joined: 12 Apr 08
Posts: 621
Credit: 161,934,067
RAC: 0
Message 9668 - Posted: 4 Feb 2009, 15:30:59 UTC

Well, the note on the front page indicated that there was a miscalculation on the "size" of the tasks and this will throw off BOINC until it can get it sorted out again. I just did a manual change to the client state so that I can get all my long list in before the deadline, a kind of forced "push" as BOINC did not seem to be noticing yet that all the tasks were in deadline peril ...

Anyway, I am clearing my backlog at 6 per cycle with at least 3 hours to get them all ... then hopefully it will settle in to doing them in the small streams that it should ... :)
ID: 9668 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 9670 - Posted: 4 Feb 2009, 16:01:21 UTC - in response to Message 9668.  

Well, the note on the front page indicated that there was a miscalculation on the "size" of the tasks and this will throw off BOINC until it can get it sorted out again. I just did a manual change to the client state so that I can get all my long list in before the deadline, a kind of forced "push" as BOINC did not seem to be noticing yet that all the tasks were in deadline peril ...

Anyway, I am clearing my backlog at 6 per cycle with at least 3 hours to get them all ... then hopefully it will settle in to doing them in the small streams that it should ... :)


That has to do with the size not being changed in a long time, since the wu's have changed it gives much larger run times initially. Now the 'size' given is too small to start with. Though so have said there is wu's that give 200+ hours as the run time.
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 9670 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
msattler

Send message
Joined: 15 Jul 08
Posts: 288
Credit: 5,474,012
RAC: 0
Message 9673 - Posted: 4 Feb 2009, 17:51:42 UTC
Last modified: 4 Feb 2009, 18:31:16 UTC

I have noticed very slow webpage response especially for the last couple of days as well....
I am the Kittyman.

Please visit and give a Click for Seti City.




ID: 9673 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Dave Przybylo
Avatar

Send message
Joined: 5 Feb 08
Posts: 236
Credit: 49,648
RAC: 0
Message 9674 - Posted: 4 Feb 2009, 17:59:49 UTC - in response to Message 9673.  

Yes the page is very slow to load at times. It has something to do with what a previous user said about the boinc application querying the server repeatedly and causing excess load i believe.
Dave Przybylo
MilkyWay@home Developer
Department of Computer Science
Rensselaer Polytechnic Institute
ID: 9674 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 9675 - Posted: 4 Feb 2009, 18:21:38 UTC - in response to Message 9674.  

Yes the page is very slow to load at times. It has something to do with what a previous user said about the boinc application querying the server repeatedly and causing excess load i believe.


This should get better as the boinc clients get adjusted to the new fpops estimate in the workunits.
ID: 9675 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile speedimic
Avatar

Send message
Joined: 22 Feb 08
Posts: 260
Credit: 57,387,048
RAC: 0
Message 9695 - Posted: 5 Feb 2009, 0:07:57 UTC - in response to Message 9675.  

Yes the page is very slow to load at times. It has something to do with what a previous user said about the boinc application querying the server repeatedly and causing excess load i believe.


This should get better as the boinc clients get adjusted to the new fpops estimate in the workunits.


I don't think so, if the cache is set to more days than the 12/core last, the client will request more every couple of minutes.

mic.


ID: 9695 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Alinator

Send message
Joined: 7 Jun 08
Posts: 464
Credit: 56,639,936
RAC: 0
Message 9707 - Posted: 5 Feb 2009, 5:10:13 UTC - in response to Message 9695.  

Yes the page is very slow to load at times. It has something to do with what a previous user said about the boinc application querying the server repeatedly and causing excess load i believe.


This should get better as the boinc clients get adjusted to the new fpops estimate in the workunits.


I don't think so, if the cache is set to more days than the 12/core last, the client will request more every couple of minutes.


True, but I don't think a host which is exceeding the in progress limit triggers a DB query. The scheduler looks to see if it would even be eligible for more work, and if not gives it a come back later 'dust off'.

Of course, some of the big gun battleships are knocking off the bandits every ten minutes of so, and thus need more targets to shoot at frequently. ;-)

Alinator
ID: 9707 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · Next

Message boards : Number crunching : Site goes very slow at times?

©2026 Astroinformatics Group