Running Modfit on MilkyWay@home

Message boards : News : Running Modfit on MilkyWay@home
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
Profile Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 525
Credit: 43,134,699
RAC: 109,027
Message 64749 - Posted: 24 Jun 2016, 19:05:37 UTC

Hey Thunder,

This is the next thing on my list to try to figure out. I will start playing around with the config files again on the server on Monday.

In other news I just released the new Mac application which should run much faster than the old version. I only released it on the MilkyWay@home official project since we are phasing out the other project soon.

Jake
ID: 64749 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile khryl

Send message
Joined: 11 Feb 11
Posts: 57
Credit: 69,474,961
RAC: 573
Message 64753 - Posted: 26 Jun 2016, 14:52:59 UTC
Last modified: 26 Jun 2016, 14:58:58 UTC

just would like to state that i m having the problem of no work as well,

my 2x280x are running out of work every 4th - give or take - scheduler request. is there possibly a way to increase the maximum tasks users can receive per 1 request?
ID: 64753 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dartanian

Send message
Joined: 18 Jan 15
Posts: 23
Credit: 150,312,324
RAC: 0
Message 64758 - Posted: 26 Jun 2016, 21:16:05 UTC

The only thing I am seeing on my end is a severe drop in "average credits" across the board on all of my computers. But all 5 computers are still pushing hard on the work units just fine for MW@H. I am not experiencing any slowdowns or waiting for work units to arrive. Although I was having a problem with my network end which contributed to the loss in "average credits". "Average credits have stabilized on two of my computers and are going back up.....the other three are still dropping even though there pumping out the work units given to them madly. If this continues I will try to do a project reset on them and see if anything changes.

Dartanian.
ID: 64758 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile JohnMD
Avatar

Send message
Joined: 11 Jul 08
Posts: 5
Credit: 1,029,636
RAC: 744
Message 64759 - Posted: 26 Jun 2016, 23:33:48 UTC
Last modified: 26 Jun 2016, 23:42:07 UTC

Hi Jake,
Have you any idea how many 32-bit Intel Core 2 machines there are out here ?
Many upgraded to Windows 10.
I would hardly call them
extremely old systems

If it's XP you can't support, so filter on NT 6 or higher instead of 64-bit.
Do-it-yourself solutions are NOT the aim of BOINC.
ID: 64759 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 525
Credit: 43,134,699
RAC: 109,027
Message 64761 - Posted: 27 Jun 2016, 13:48:22 UTC

Hey,

I made some tweaks to the number of work units you can request. Let me know if this has made any difference on your.

Jake
ID: 64761 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Thunder
Avatar

Send message
Joined: 9 Jul 08
Posts: 85
Credit: 44,842,651
RAC: 4
Message 64762 - Posted: 27 Jun 2016, 14:33:46 UTC
Last modified: 27 Jun 2016, 14:42:47 UTC

Looks like the total tasks allowed to have on-hand was increased from 40 to 60.

Unfortunately it's still only allowing 25 tasks per request, so for machines that are running multiple projects, they'll still only likely get the same (25 if they're available) per hour.

I fully appreciate making small changes and waiting to see their real-world effect, so could you next try increasing the amount of tasks per request a bit to say, 30? (Ultimately I'm hoping for much more, but let's not get crazy just yet)

Edit: Also, you still need most of all to figure out why the server has no tasks available to send so often. Here was an automatic (not prompted by me hitting update) request that just happened:

3860 Milkyway@Home 6/27/2016 9:35:08 AM Reporting 45 completed tasks
3861 Milkyway@Home 6/27/2016 9:35:08 AM Requesting new tasks for AMD/ATI GPU
3862 Milkyway@Home 6/27/2016 9:35:09 AM Scheduler request completed: got 0 new tasks

Same machine, trying a few minutes later:

3870 Milkyway@Home 6/27/2016 9:39:05 AM Reporting 3 completed tasks
3871 Milkyway@Home 6/27/2016 9:39:05 AM Requesting new tasks for AMD/ATI GPU
3872 Milkyway@Home 6/27/2016 9:39:07 AM Scheduler request completed: got 12 new tasks

(12 tasks were available, but I'm sure it requested much more)
ID: 64762 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
GlennG

Send message
Joined: 17 Nov 08
Posts: 18
Credit: 130,645,031
RAC: 59
Message 64763 - Posted: 27 Jun 2016, 20:42:58 UTC

With the current change, it appears that most of my linux machines (80 processors total) are now unusable.

<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)
</message>
<stderr_txt>
../../projects/milkyway.cs.rpi.edu_milkyway/milkyway_1.36_x86_64-pc-linux-gnu: /lib64/libc.so.6: version `GLIBC_2.8' not found (required by ../../projects/milkyway.cs.rpi.edu_milkyway/milkyway_1.36_x86_64-pc-linux-gnu)
../../projects/milkyway.cs.rpi.edu_milkyway/milkyway_1.36_x86_64-pc-linux-gnu: /lib64/libc.so.6: version `GLIBC_2.7' not found (required by ../../projects/milkyway.cs.rpi.edu_milkyway/milkyway_1.36_x86_64-pc-linux-gnu)
../../projects/milkyway.cs.rpi.edu_milkyway/milkyway_1.36_x86_64-pc-linux-gnu: /lib64/libc.so.6: version `GLIBC_2.11' not found (required by ../../projects/milkyway.cs.rpi.edu_milkyway/milkyway_1.36_x86_64-pc-linux-gnu)

</stderr_txt>
]]>

In years past, when problems like this occurred, compiling with static libraries appeared to solve the problem at the expense of making the applications slightly bigger.

Glenn
ID: 64763 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Thunder
Avatar

Send message
Joined: 9 Jul 08
Posts: 85
Credit: 44,842,651
RAC: 4
Message 64764 - Posted: 27 Jun 2016, 22:18:40 UTC - in response to Message 64763.  

Glenn, are those 32-bit installations? If not, what distro of linux?

I'm not having any trouble on 64-bit Ubuntu 15.10 or 16.04.
ID: 64764 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 525
Credit: 43,134,699
RAC: 109,027
Message 64765 - Posted: 28 Jun 2016, 12:27:20 UTC

Hey GlennG,

I will recompile them as static by Friday.

Jake
ID: 64765 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
DT3105

Send message
Joined: 22 May 16
Posts: 1
Credit: 50,144,676
RAC: 0
Message 64766 - Posted: 28 Jun 2016, 12:46:16 UTC
Last modified: 28 Jun 2016, 13:37:34 UTC

Hi Jake,

I tried to add Milkyway project into BOINC but no files are returned from the host. My Milkyway directory (ProgramData/BOINC/Project) is empty. Where can I get the files manually if your server doesn't upload them to my PC
Thanks
ID: 64766 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Sebastian*

Send message
Joined: 8 Apr 09
Posts: 64
Credit: 6,102,492,547
RAC: 1,648,600
Message 64777 - Posted: 29 Jun 2016, 21:12:32 UTC

Jake Weiss

I still only get 25 WUs per computer, and i run out of them quickly. Even now and then the time to the next request goes up, and i have to wait several minutes until the next request is done.

Could you set the server so hold 3000 to 5000 WUs ready for sending?

I have set my computing preferences:

Maintain enough tasks to keep busy for at least "1 day"

... and up to an additional "1 day"

I think holding "only" 1000 workunits is not enough for such short WUs Milkyway@Home provides.
ID: 64777 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 525
Credit: 43,134,699
RAC: 109,027
Message 64780 - Posted: 30 Jun 2016, 12:46:42 UTC

Hey Sebastian,

As soon as I figure out how I will try to do that. Some of the deeper parts of the server configuration are still beyond my working knowledge. I also have a few other things I am working on too so bear with me. Maybe by the end of the day Monday or Tuesday. Depends if I can get the Linux 32-bit application recompiled today as static without errors.

If anyone is curious what I have been/am going to be working on please take a quick look at my dev blog under the application code discussion section. I will be making an update to it today.

Jake
ID: 64780 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 525
Credit: 43,134,699
RAC: 109,027
Message 64782 - Posted: 30 Jun 2016, 19:25:03 UTC

GlennG,

I have the new static binaries for Linux 32-bit compiled and they seem to run well. I will be running some last minute tests on them tomorrow morning and then I will release them pending the results of the tests.

Happy Crunching,

Jake
ID: 64782 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Sebastian*

Send message
Joined: 8 Apr 09
Posts: 64
Credit: 6,102,492,547
RAC: 1,648,600
Message 64783 - Posted: 30 Jun 2016, 23:17:25 UTC

Thanks for the reply Jake :)

Good luck with the Linux binary.

I hope you find a useful documentary about the server config :)

Take your time, i can still remember the time when Milkyway@home was one of the very unstable and unreliable projects.

We have come a long way, keep up the good work :)
ID: 64783 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Zanth
Avatar

Send message
Joined: 18 Feb 09
Posts: 158
Credit: 65,638,323
RAC: 23,752
Message 64789 - Posted: 2 Jul 2016, 4:18:55 UTC - in response to Message 64759.  

Hi Jake,
Have you any idea how many 32-bit Intel Core 2 machines there are out here ?
Many upgraded to Windows 10.
I would hardly call them
extremely old systems

If it's XP you can't support, so filter on NT 6 or higher instead of 64-bit.
Do-it-yourself solutions are NOT the aim of BOINC.


All of my Core 2 processors are 64-bit...
ID: 64789 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile khryl

Send message
Joined: 11 Feb 11
Posts: 57
Credit: 69,474,961
RAC: 573
Message 64794 - Posted: 2 Jul 2016, 20:57:03 UTC

why is it that after every failed request (failed as in zero work received) milkyway stops fetching work and I have to manually request to receive workunits again?

my pc keeps running out of work every 15 or so minutes and just stops fetching work thereafter ..
ID: 64794 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 525
Credit: 43,134,699
RAC: 109,027
Message 64809 - Posted: 5 Jul 2016, 13:40:41 UTC

Hey khryl,

I am working on that problem now. Will have more to report back in a day or two.

Jake
ID: 64809 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 525
Credit: 43,134,699
RAC: 109,027
Message 64852 - Posted: 8 Jul 2016, 19:29:04 UTC

Hey Guys,

Just doubled the number of workunits available to the scheduler at any given time. Let me know if this seems to help keep your super-crunchers fed. Even if its only an incremental change let me know and I will increase it more if we need.

Jake
ID: 64852 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Thunder
Avatar

Send message
Joined: 9 Jul 08
Posts: 85
Credit: 44,842,651
RAC: 4
Message 64857 - Posted: 11 Jul 2016, 11:49:53 UTC

Jake,

That made a substantial difference! I'm still seeing rare scheduler requests that will only return a handful tasks, but overall it looks like 40-45 tasks are sent on most of them. (previously, it was typical to get 10-20)

If you're not seeing any negative impacts to the server (and I'd suspect you're seeing a reduced workload on it since it's probably having to handle fewer scheduler requests) and can increase it more, I would be in favor.

If you go ahead and dial the number of tasks available up, it would also be beneficial to increase the limit on maximum tasks on hand from the current 60. By all means, start small on that. Perhaps 90?

Thanks. :-)
ID: 64857 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jake Weiss
Volunteer moderator
Project developer
Project tester
Project scientist

Send message
Joined: 25 Feb 13
Posts: 525
Credit: 43,134,699
RAC: 109,027
Message 64858 - Posted: 11 Jul 2016, 13:15:37 UTC

Hey Thunder,

I am only going to continue to increase it if you guys are still running out of work units too quickly. If we increase it too much, it makes it easier for rogue computers to send a lot of errors to the server and cause problems with our optimizations (also more invalid work units for you guys which means fewer credits). Let me know though because I can still increase it more.

Jake
ID: 64858 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · Next

Message boards : News : Running Modfit on MilkyWay@home

©2019 Astroinformatics Group