Welcome to MilkyWay@home

Server Downtime March 25, 2022 (24 hours starting 17:00 UTC)


Advanced search

Message boards : News : Server Downtime March 25, 2022 (24 hours starting 17:00 UTC)
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
ProfileTom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 372
Credit: 97,434,168
RAC: 132,059
50 million credit badge3 year member badge
Message 72212 - Posted: 23 Mar 2022, 21:31:59 UTC

Hey Everyone,

I'm going to be turning the project off for roughly 24 hours starting at 1 PM EST (17:00 UTC) on March 25th. This time will do three things: 1) It will allow me to clear the transitioner backlog, 2) It will temporarily stop generating new WUs, so we can work on the backlog of WUs waiting for validation, and 3) It will help the server rebuild the replacement drive that we put into the machine on Monday.

There will probably be at least 12 hours of downtime during this where you will not be able to contact the upload or download servers.

Best,
Tom
ID: 72212 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Speedy51

Send message
Joined: 12 Jun 10
Posts: 27
Credit: 4,400,473
RAC: 3,376
3 million credit badge12 year member badge
Message 72213 - Posted: 23 Mar 2022, 21:46:08 UTC

Thanks Tom for letting us know what's happening. This will certainly help the backlog progress faster
ID: 72213 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Skillz

Send message
Joined: 28 May 17
Posts: 21
Credit: 1,860,064,373
RAC: 18,036,692
1 billion credit badge5 year member badge
Message 72216 - Posted: 23 Mar 2022, 22:28:09 UTC

Thanks for the heads up.
ID: 72216 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
alanb1951

Send message
Joined: 16 Mar 10
Posts: 151
Credit: 85,690,839
RAC: 56,498
50 million credit badge12 year member badgeextraordinary contributions badge
Message 72218 - Posted: 24 Mar 2022, 1:05:09 UTC

Thanks, Tom!

Hope it all sorts out within 24 hours, but if it needs a bit longer so be it...

Good luck - Al.
ID: 72218 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileBull Schuck

Send message
Joined: 20 Feb 22
Posts: 10
Credit: 10,455,285
RAC: 19,871
10 million credit badge
Message 72219 - Posted: 24 Mar 2022, 2:02:32 UTC - in response to Message 72212.  

Thanks for the head's up and good luck!
ID: 72219 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Luciferius Infernalis Vel Tohu

Send message
Joined: 3 May 18
Posts: 6
Credit: 41,621
RAC: 30
10 thousand credit badge4 year member badge
Message 72227 - Posted: 24 Mar 2022, 14:14:02 UTC - in response to Message 72212.  

Thank you for the info. Good Luck Tom.
ID: 72227 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
poppinfresh99

Send message
Joined: 28 Feb 22
Posts: 14
Credit: 1,646,386
RAC: 10,768
1 million credit badge
Message 72228 - Posted: 24 Mar 2022, 15:46:14 UTC - in response to Message 72227.  

Hi Tom, perhaps the project could send out larger tasks? Then there would be fewer tasks for the transitioner and other daemons to process. This is a cheaper option than hardware such as SSDs.

I only do the N-Body Simulation, but it could easily have 10 times more work per task---unless there is another reason why there is so little work per task.

This downtime might be a great time to make these changes since downtime may reduce "clashing" between versions of the application??
ID: 72228 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 372
Credit: 97,434,168
RAC: 132,059
50 million credit badge3 year member badge
Message 72230 - Posted: 24 Mar 2022, 17:25:23 UTC - in response to Message 72228.  

I'm not sure what the deal is with Nbody (that's Eric's job), but I know that with Separation we can only bundle so many WUs in a single task before we overflow some command lines.
ID: 72230 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
.clair.

Send message
Joined: 3 Mar 13
Posts: 54
Credit: 767,012,830
RAC: 14,191
500 million credit badge9 year member badge
Message 72237 - Posted: 24 Mar 2022, 20:39:27 UTC
Last modified: 24 Mar 2022, 20:42:40 UTC

I still have many Separation tasks from 30 Jan 2021 on my tasks page , either `Completed and validated` or `Completed, validation inconclusive`
I have hundreds of them , if others have the same this may clog up the database a bit ,
I don't know what it would take to clear them out , though it may help .
ID: 72237 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 372
Credit: 97,434,168
RAC: 132,059
50 million credit badge3 year member badge
Message 72238 - Posted: 24 Mar 2022, 22:32:34 UTC - in response to Message 72237.  

Those are due to the DB work that we did in February 2021, where we re-sorted the WUs in the DB because we ran out of useable WU IDs. They would go away if we completely reset the DB (which is something that we are considering at some point), but I don't think that they clog up any server time. I could be wrong though.
ID: 72238 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
dhrosier

Send message
Joined: 9 Sep 09
Posts: 4
Credit: 11,851,403
RAC: 2,128
10 million credit badge13 year member badge
Message 72239 - Posted: 25 Mar 2022, 4:06:39 UTC - in response to Message 72212.  

Is not 1700 UTC 2 PM EST? or 3 PM EDT?
ID: 72239 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
San-Fernando-Valley

Send message
Joined: 13 Apr 17
Posts: 215
Credit: 131,314,815
RAC: 15,424
100 million credit badge5 year member badgeextraordinary contributions badge
Message 72240 - Posted: 25 Mar 2022, 7:04:25 UTC - in response to Message 72239.  
Last modified: 25 Mar 2022, 7:19:40 UTC

Is not 1700 UTC 2 PM EST? or 3 PM EDT?

check it on:

https://www.worldtimebuddy.com

Maybe this explains it better:

EDT or EST?
Eastern Daylight Time (EDT) is a North American time zone in use from the second Sunday in March to the first Sunday in November during Daylight Saving Time (DST). Eastern Standard Time (EST) is used during the remainder of the year.
Found at https://www.timeanddate.com
ID: 72240 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Baja Sandor
Avatar

Send message
Joined: 4 Mar 20
Posts: 10
Credit: 10,775,413
RAC: 238
10 million credit badge2 year member badge
Message 72242 - Posted: 25 Mar 2022, 8:58:41 UTC

Thanks for the information. All the best !
ID: 72242 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Baja Sandor
Avatar

Send message
Joined: 4 Mar 20
Posts: 10
Credit: 10,775,413
RAC: 238
10 million credit badge2 year member badge
Message 72243 - Posted: 25 Mar 2022, 9:00:38 UTC - in response to Message 72240.  

Hi. where ( and how) can i make a donation to Millkyway@home ? Thanks.
ID: 72243 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Max_Pirx

Send message
Joined: 13 Dec 17
Posts: 46
Credit: 1,975,311,009
RAC: 2,659,988
1 billion credit badge4 year member badge
Message 72244 - Posted: 25 Mar 2022, 9:44:06 UTC - in response to Message 72243.  
Last modified: 25 Mar 2022, 9:44:54 UTC

Hi. where ( and how) can i make a donation to Millkyway@home ? Thanks.

Previously Tom posted this link https://securelb.imodules.com/s/1225/giving/index.aspx?sid=1225&gid=1&pgid=3676 for donations.
ID: 72244 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
San-Fernando-Valley

Send message
Joined: 13 Apr 17
Posts: 215
Credit: 131,314,815
RAC: 15,424
100 million credit badge5 year member badgeextraordinary contributions badge
Message 72245 - Posted: 25 Mar 2022, 14:31:36 UTC - in response to Message 72243.  

Hi. where ( and how) can i make a donation to Millkyway@home ? Thanks.

... you have a private message ...
ID: 72245 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profilephilhoey

Send message
Joined: 30 Dec 09
Posts: 2
Credit: 24,184,294
RAC: 6,285
20 million credit badge12 year member badge
Message 72246 - Posted: 25 Mar 2022, 17:57:35 UTC - in response to Message 72212.  

Thanks for the update. Having spent most of my career in DBMS - good luck!!!
ID: 72246 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileBull Schuck

Send message
Joined: 20 Feb 22
Posts: 10
Credit: 10,455,285
RAC: 19,871
10 million credit badge
Message 72247 - Posted: 25 Mar 2022, 23:26:18 UTC - in response to Message 72212.  

It looks like the server is back up and running, but the transitioner backlog is at 46 hours. Did the server rebuild the drive already?

Again, thanks for all the work that's being done for this project! It's fun for us to be able to support it.
ID: 72247 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profilemikey
Avatar

Send message
Joined: 8 May 09
Posts: 2983
Credit: 497,549,899
RAC: 194,223
300 million credit badge13 year member badgeextraordinary contributions badge
Message 72248 - Posted: 26 Mar 2022, 10:07:31 UTC - in response to Message 72247.  
Last modified: 26 Mar 2022, 10:08:14 UTC

It looks like the server is back up and running, but the transitioner backlog is at 46 hours. Did the server rebuild the drive already?

Again, thanks for all the work that's being done for this project! It's fun for us to be able to support it.


It's down to a bit over 15 hours right now so YES it seems to be working!!
Well done Team MilkyWay!!!
ID: 72248 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProfileTom Donlon
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 10 Apr 19
Posts: 372
Credit: 97,434,168
RAC: 132,059
50 million credit badge3 year member badge
Message 72249 - Posted: 26 Mar 2022, 16:07:26 UTC

I don't know if the drive is rebuilt yet, but I did turn off the WU generators. I'm going to try to give the server a chance to catch its breath.
ID: 72249 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : News : Server Downtime March 25, 2022 (24 hours starting 17:00 UTC)

©2022 Astroinformatics Group