Welcome to MilkyWay@home

Server Downtime 3/21 1PM EST

Message boards : News : Server Downtime 3/21 1PM EST
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · Next

AuthorMessage
Profile Tom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 408
Credit: 120,203,200
RAC: 0
Message 72125 - Posted: 21 Mar 2022, 15:40:07 UTC

Hello Everyone,

We will be taking the server down at 1PM NY time to do a reboot and ensure that the replacement drive is rebuilding correctly. We plan on being out for a couple hours at most.

Best,
Tom
ID: 72125 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
San-Fernando-Valley

Send message
Joined: 13 Apr 17
Posts: 256
Credit: 604,411,638
RAC: 0
Message 72126 - Posted: 21 Mar 2022, 15:58:20 UTC - in response to Message 72125.  

I guess that would be

17:00 UTC

respective

5 PM UTC

?????
ID: 72126 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Tom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 408
Credit: 120,203,200
RAC: 0
Message 72127 - Posted: 21 Mar 2022, 16:04:21 UTC
Last modified: 21 Mar 2022, 16:04:47 UTC

Yes, that's correct. I should say UTC in the future when I do this.
ID: 72127 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mike.Gibson

Send message
Joined: 5 Oct 09
Posts: 25
Credit: 2,357,990
RAC: 0
Message 72129 - Posted: 21 Mar 2022, 17:33:17 UTC - in response to Message 72127.  

Or in English GMT.
ID: 72129 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
FurryGuy

Send message
Joined: 1 Aug 11
Posts: 10
Credit: 51,374,490
RAC: 0
Message 72136 - Posted: 21 Mar 2022, 21:32:25 UTC - in response to Message 72125.  

Hello Everyone,

We will be taking the server down at 1PM NY time to do a reboot and ensure that the replacement drive is rebuilding correctly. We plan on being out for a couple hours at most.

Best,
Tom

Regardless of the time zone referenced, thank you, Mr. Donlon, for letting us know what is going on behind the scene. The push notification in the Boinc Manager was a very nice gesture for letting us WU crunchers know hat is going on.
ID: 72136 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 5 Jul 11
Posts: 990
Credit: 376,142,956
RAC: 2
Message 72138 - Posted: 21 Mar 2022, 21:45:12 UTC - in response to Message 72129.  
Last modified: 21 Mar 2022, 21:49:41 UTC

Or in English GMT.
No no no, there's a 1 billionth of a second difference, that's very important! :-)
ID: 72138 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Tom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 408
Credit: 120,203,200
RAC: 0
Message 72139 - Posted: 21 Mar 2022, 21:53:42 UTC

Sorry, it's taking longer than I expected to clear the transitioner backlog. But everything is fine otherwise! The drive is currently rebuilding, and that will probably take a while because the DB is active while it is rebuilding.
ID: 72139 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Tom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 408
Credit: 120,203,200
RAC: 0
Message 72140 - Posted: 21 Mar 2022, 22:15:51 UTC

Okay, now everything is up and running again, although things will still be somewhat slow while the drive rebuilds.
ID: 72140 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Kiska

Send message
Joined: 31 Mar 12
Posts: 94
Credit: 151,905,682
RAC: 12,362
Message 72147 - Posted: 22 Mar 2022, 2:29:33 UTC - in response to Message 72140.  

Okay, now everything is up and running again, although things will still be somewhat slow while the drive rebuilds.


I am guessing you'll keep server stats(*) exports on a 12 hourly export while the server is running a bit behind?

*ie server_status.php and /stats/ dir
ID: 72147 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Wisesooth

Send message
Joined: 2 Oct 14
Posts: 43
Credit: 54,798,641
RAC: 1,607
Message 72148 - Posted: 22 Mar 2022, 5:43:31 UTC - in response to Message 72147.  

Pass this on to Tom.
I discovered a way to clear the multiple-core wait lock issue. Suspend the task to park it in cache. That clears both the real and virtual core's locked wait state.. Another task grabs the cores. Next, resume the task in the cache. That action puts it in a pending state. It finishes the task when it becomes active and finishes normally. Roger O
ID: 72148 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 5 Jul 11
Posts: 990
Credit: 376,142,956
RAC: 2
Message 72154 - Posted: 22 Mar 2022, 18:06:42 UTC - in response to Message 72140.  

Okay, now everything is up and running again, although things will still be somewhat slow while the drive rebuilds.
Come on Tom, please admit what century this server was made in. Rebuilds should be a couple of hours. List some specs, I dare you.
ID: 72154 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 20 Nov 07
Posts: 54
Credit: 2,663,789
RAC: 0
Message 72155 - Posted: 22 Mar 2022, 20:40:35 UTC - in response to Message 72154.  

Okay, now everything is up and running again, although things will still be somewhat slow while the drive rebuilds.
Come on Tom, please admit what century this server was made in. Rebuilds should be a couple of hours. List some specs, I dare you.


Kettle calling the pot black.

Be patient!

https://milkyway.cs.rpi.edu/milkyway/forum_thread.php?id=4842&postid=72121

I don't see why you're getting so upset about it. Join more than one project then you won't even care when one isn't available. It's not like they're supplying your wages or food.

https://milkyway.cs.rpi.edu/milkyway/forum_thread.php?id=4842&postid=72065
ID: 72155 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 5 Jul 11
Posts: 990
Credit: 376,142,956
RAC: 2
Message 72156 - Posted: 22 Mar 2022, 20:56:17 UTC - in response to Message 72155.  

Okay, now everything is up and running again, although things will still be somewhat slow while the drive rebuilds.
Come on Tom, please admit what century this server was made in. Rebuilds should be a couple of hours. List some specs, I dare you.


Kettle calling the pot black.

Be patient!

https://milkyway.cs.rpi.edu/milkyway/forum_thread.php?id=4842&postid=72121

I don't see why you're getting so upset about it. Join more than one project then you won't even care when one isn't available. It's not like they're supplying your wages or food.

https://milkyway.cs.rpi.edu/milkyway/forum_thread.php?id=4842&postid=72065
I'm not annoyed the MW tasks are not available, I can do work for Einstein instead. But I want to know why Tom is using outdated equipment and why he won't reveal what the specs are. A server which is this slow is absurd.
ID: 72156 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Max_Pirx

Send message
Joined: 13 Dec 17
Posts: 46
Credit: 2,421,362,376
RAC: 0
Message 72159 - Posted: 22 Mar 2022, 21:09:06 UTC - in response to Message 72155.  

I don't see why you're getting so upset about it. Join more than one project then you won't even care when one isn't available. It's not like they're supplying your wages or food.

Well, it's the other way around (more or less) - we (at least some of us) are spending our money/resources to help with their research and it's only fair to get the best possible use of our resources and not waste our money.
I do MW@H because I like that kind of science and I am interested in the broader topic (cosmology). However, if my machine time and money are going to waste here I'd like to know that so that I can rearrange my priorities.
The only updates from the admins are very vague - 'just going to switch this and that off... going to purge whatever... things are going to be slow for a bit... the server is a bit unstable... etc.' which is not very helpful. Besides, whatever they do on their end, does not improve things on our end so far. The server keeps limping with erratic WU supply and, as far as I can tell, wasting our money and resources.
I'd like to see more detailed updates on what is wrong with the server, are there any plans on how to fix it, what is the time scale, etc. Even if the admins have no idea what is wrong and how to fix it (nothing wrong if this is the case), it is only fair to inform us so that we can plan accordingly.

The number of tasks pending validation dropped quite a bit recently (from 6+ million some time ago to less than 2.5 million now), yet my RAC keeps plummeting and the last validated tasks are from more than a week ago. For all I know, most of my work in the last 3 weeks has been a complete waste.
ID: 72159 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 5 Jul 11
Posts: 990
Credit: 376,142,956
RAC: 2
Message 72165 - Posted: 23 Mar 2022, 7:18:07 UTC - in response to Message 72159.  

Well, it's the other way around (more or less) - we (at least some of us) are spending our money/resources to help with their research and it's only fair to get the best possible use of our resources and not waste our money.
I do MW@H because I like that kind of science and I am interested in the broader topic (cosmology). However, if my machine time and money are going to waste here I'd like to know that so that I can rearrange my priorities.
The only updates from the admins are very vague - 'just going to switch this and that off... going to purge whatever... things are going to be slow for a bit... the server is a bit unstable... etc.' which is not very helpful. Besides, whatever they do on their end, does not improve things on our end so far. The server keeps limping with erratic WU supply and, as far as I can tell, wasting our money and resources.
I'd like to see more detailed updates on what is wrong with the server, are there any plans on how to fix it, what is the time scale, etc. Even if the admins have no idea what is wrong and how to fix it (nothing wrong if this is the case), it is only fair to inform us so that we can plan accordingly.

The number of tasks pending validation dropped quite a bit recently (from 6+ million some time ago to less than 2.5 million now), yet my RAC keeps plummeting and the last validated tasks are from more than a week ago. For all I know, most of my work in the last 3 weeks has been a complete waste.
I'm not too upset, I can just turn Einstein/Universe on aswell to keep everything doing something. But I agree that communication is nice. I'd love to know the specs of the server (Rosetta has them openly displayed on the webpage), what device failed, how much it would cost to buy something better, and if we should perhaps have a whip-round for some cash to get it. Clearly this server is just on the limit of managing, and with one disk missing it collapses in a heap. Faster hardware would make everything run smoothly all the time.
ID: 72165 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
San-Fernando-Valley

Send message
Joined: 13 Apr 17
Posts: 256
Credit: 604,411,638
RAC: 0
Message 72168 - Posted: 23 Mar 2022, 9:16:23 UTC - in response to Message 72159.  


...
The number of tasks pending validation dropped quite a bit recently (from 6+ million some time ago to less than 2.5 million now), yet my RAC keeps plummeting and the last validated tasks are from more than a week ago. For all I know, most of my work in the last 3 weeks has been a complete waste.

I don't see why your work would be or is a complete "waiste"?
The tasks completed will be sent back and validated (whenever the servers will do it).
And the credits for your work/efforts will not disappear in thin air.

So, who cares about RAC?
We are here to crunch for science!
We are achieving results,
they are being received at milkyway (sooner or later)
and you will get credits.

I don't get this griping ...
ID: 72168 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 5 Jul 11
Posts: 990
Credit: 376,142,956
RAC: 2
Message 72169 - Posted: 23 Mar 2022, 9:33:58 UTC - in response to Message 72168.  

I don't see why your work would be or is a complete "waste"?
The tasks completed will be sent back and validated (whenever the servers will do it).
And the credits for your work/efforts will not disappear in thin air.

So, who cares about RAC?
We are here to crunch for science!
We are achieving results,
they are being received at milkyway (sooner or later)
and you will get credits.

I don't get this griping ...
+1
ID: 72169 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Max_Pirx

Send message
Joined: 13 Dec 17
Posts: 46
Credit: 2,421,362,376
RAC: 0
Message 72170 - Posted: 23 Mar 2022, 10:10:04 UTC - in response to Message 72168.  


So, who cares about RAC?
We are here to crunch for science!

Exactly, for science, not just because I fancy wasting my money and resources. But where is the science output from the completed tasks in the last 3-4 weeks?
We are achieving results, they are being received at milkyway (sooner or later) and you will get credits.

According to the server stats, nearly 4 million tasks got validated recently (at least they disappeared from the validation pending stock), but did not materialize as valid tasks with credit... where are they?
ID: 72170 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Wailing Angus Beef

Send message
Joined: 24 Dec 07
Posts: 33
Credit: 1,918,711,579
RAC: 3,343
Message 72172 - Posted: 23 Mar 2022, 10:56:34 UTC - in response to Message 72170.  


So, who cares about RAC?
We are here to crunch for science!

Exactly, for science, not just because I fancy wasting my money and resources. But where is the science output from the completed tasks in the last 3-4 weeks?
We are achieving results, they are being received at milkyway (sooner or later) and you will get credits.

According to the server stats, nearly 4 million tasks got validated recently (at least they disappeared from the validation pending stock), but did not materialize as valid tasks with credit... where are they?

I've been getting credit. May your completed WUs are still in the validation queue
ID: 72172 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 5 Jul 11
Posts: 990
Credit: 376,142,956
RAC: 2
Message 72173 - Posted: 23 Mar 2022, 11:06:20 UTC - in response to Message 72170.  

Exactly, for science, not just because I fancy wasting my money and resources. But where is the science output from the completed tasks in the last 3-4 weeks?
It will be somewhere, they aren't going to just discard the useful data.

According to the server stats, nearly 4 million tasks got validated recently (at least they disappeared from the validation pending stock), but did not materialize as valid tasks with credit... where are they?
Give it time, perhaps the credits take longer. Once they've been validated, the work will be used.
ID: 72173 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · 3 · Next

Message boards : News : Server Downtime 3/21 1PM EST

©2024 Astroinformatics Group