windows intelx86 and x86_64 binaries added for the nbody simulations
log in

Advanced search

Message boards : News : windows intelx86 and x86_64 binaries added for the nbody simulations

1 · 2 · Next
Author Message
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0

Message 41543 - Posted: 18 Aug 2010, 3:18:52 UTC

Let us know how they're working here.
____________

(retired account)
Avatar
Send message
Joined: 17 Oct 08
Posts: 36
Credit: 411,744
RAC: 0

Message 41544 - Posted: 18 Aug 2010, 5:03:57 UTC
Last modified: 18 Aug 2010, 5:13:37 UTC

Ok, I got twelve MilkyWay@Home N-Body Simulation v0.03 workunits for the x86_64 platform. The application file size is approx. 4.5 MB and it is a 32bit executable. Runtime was very short, between 0.5 and 2.5 minutes on a 3,2 GHz Phenom II X4. No screensaver / graphics included apparently.

Strange thing: No upload seen, but finished without error acc. to BOINC manager. Maybe very small result files?

All twelve are now listed as pending with status 'Completed, validation inconclusive'.

EDIT: Two results are now validated! Fine.

Computer ID=152604
List of Tasks

That's it for now. Comments?

Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0

Message 41545 - Posted: 18 Aug 2010, 5:44:39 UTC - in response to Message 41544.

Ok, I got twelve MilkyWay@Home N-Body Simulation v0.03 workunits for the x86_64 platform. The application file size is approx. 4.5 MB and it is a 32bit executable. Runtime was very short, between 0.5 and 2.5 minutes on a 3,2 GHz Phenom II X4. No screensaver / graphics included apparently.

Strange thing: No upload seen, but finished without error acc. to BOINC manager. Maybe very small result files?

All twelve are now listed as pending with status 'Completed, validation inconclusive'.

EDIT: Two results are now validated! Fine.

Computer ID=152604
List of Tasks

That's it for now. Comments?


There's no upload because we're passing the fitness back to the server in the standard error, which gets put right into the database. This saves the server having to download and read a file for every result, which should really reduce the server load.

The validation inconclusive is for the same reason as the separation code, we got your result and are waiting for it to be verified against another result before we insert it into our population of valid results.

The runtimes are short for now just because we want to test how well the search can find the correct solution, and see if any issues come up for any of the different binaries (without people having to lose credit for running something for a couple hours only for it to result in a bug and them not getting credit).

Once we're a bit satisfied as to how things are running and the current search has come up with a good solution, we'll start to ramp up the workunit times.
____________

(retired account)
Avatar
Send message
Joined: 17 Oct 08
Posts: 36
Credit: 411,744
RAC: 0

Message 41546 - Posted: 18 Aug 2010, 5:55:02 UTC

Thanks for the reply, Travis. And understood. :-)

(retired account)
Avatar
Send message
Joined: 17 Oct 08
Posts: 36
Credit: 411,744
RAC: 0

Message 41550 - Posted: 18 Aug 2010, 14:42:52 UTC

Two workunits with errors here and also on the other hosts, that got them so far:

de_nbody_test_10_9674_1282101611
de_nbody_test_10_10314_1282103078

Btw, if anyone has a working app_info.xml which excludes the milkyway 0.19 workunits from being downloaded, it would be appreciated, if you would share it here. ;-)

Tim Norton
Send message
Joined: 28 May 10
Posts: 8
Credit: 439,056
RAC: 0

Message 41551 - Posted: 18 Aug 2010, 15:04:43 UTC - in response to Message 41550.

try this one - its for 64bit though

its opp apps for both cpu and gpu

if what you are after is gPU only then set that in you account preferences or delete out the cpu refernce block below - but boinc will show errors if you do

<app_info> <app> <name>milkyway</name> </app> <file_info> <name>astronomy_0.21_x64_SSE3.exe</name> <executable/> </file_info> <app_version> <app_name>milkyway</app_name> <version_num>21</version_num> <file_ref> <file_name>astronomy_0.21_x64_SSE3.exe</file_name> <main_program/> </file_ref> </app_version> <app_version> <app_name>milkyway</app_name> <version_num>20</version_num> <file_ref> <file_name>astronomy_0.21_x64_SSE3.exe</file_name> <main_program/> </file_ref> </app_version> <app> <name>milkyway</name> </app> <file_info> <name>milkyway_0.24_windows_intelx86__cuda23.exe</name> <executable/> </file_info> <file_info> <name>cudart.dll</name> <executable/> </file_info> <file_info> <name>cutil32.dll</name> <executable/> </file_info> <app_version> <app_name>milkyway</app_name> <version_num>24</version_num> <plan_class>cuda23</plan_class> <avg_ncpus>0.040000</avg_ncpus> <max_ncpus>0.040000</max_ncpus> <coproc> <type>CUDA</type> <count>1</count> </coproc> <file_ref> <file_name>milkyway_0.24_windows_intelx86__cuda23.exe</file_name> <main_program/> </file_ref> <file_ref> <file_name>cudart.dll</file_name> </file_ref> <file_ref> <file_name>cutil32.dll</file_name> </file_ref> </app_version> </app_info>

(retired account)
Avatar
Send message
Joined: 17 Oct 08
Posts: 36
Credit: 411,744
RAC: 0

Message 41553 - Posted: 18 Aug 2010, 16:34:20 UTC - in response to Message 41551.

thx a lot

I'd like to have only CPU and only the new nbody sim not the former app.

I see that the older CPU app - 0.21 SSE3 in your case, stock 0.19 in mine - does not need any other file references than to the executable itself.

My first try was as follows, but it failed to do the job:

<app_info> <app> <name>milkyway</name> </app> <file_info> <name>milkyway_nbody_0.03_windows_x86_64.exe</name> <executable/> </file_info> <app_version> <app_name>milkyway</app_name> <version_num>3</version_num> <file_ref> <file_name>milkyway_nbody_0.03_windows_x86_64.exe</file_name> <main_program/> </file_ref> </app_version> </app_info>


I'm not sure about the content of the <name> and <app_name> tags and that of the <version_num> tags.

And the first download included some more files

    orphan_test_4096_bodies.js
    histogram_4096_bodies
    p-12-3s-free.txt
    p-14-3s-free.txt



Is it necessary to include a reference to some of those as well?

Arjan Scholl
Send message
Joined: 22 Feb 09
Posts: 6
Credit: 1,458,115
RAC: 0

Message 41561 - Posted: 18 Aug 2010, 19:37:15 UTC - in response to Message 41550.
Last modified: 18 Aug 2010, 19:59:13 UTC

Two workunits with errors here and also on the other hosts, that got them so far:

de_nbody_test_10_9674_1282101611
de_nbody_test_10_10314_1282103078

Btw, if anyone has a working app_info.xml which excludes the milkyway 0.19 workunits from being downloaded, it would be appreciated, if you would share it here. ;-)



Hello Alexander, i tried a few different app_info.xml's myself and i've come up with this one:

&lt;app_info&gt; &lt;app&gt; &lt;name&gt;milkyway_nbody&lt;/name&gt; &lt;/app&gt; &lt;file_info&gt; &lt;name&gt;milkyway_nbody_0.03_windows_x86_64.exe&lt;/name&gt; &lt;executable/&gt; &lt;/file_info&gt; &lt;app_version&gt; &lt;app_name&gt;milkyway_nbody&lt;/app_name&gt; &lt;version_num&gt;3&lt;/version_num&gt; &lt;file_ref&gt; &lt;file_name&gt;milkyway_nbody_0.03_windows_x86_64.exe&lt;/file_name&gt; &lt;main_program/&gt; &lt;/file_ref&gt; &lt;/app_version&gt; &lt;/app_info&gt;


Let me know if this works for you

* I have a bug to report as well, even the X86-64 version runs in 32bit mode on my machine.

Matt Arsenault
Volunteer moderator
Project developer
Project tester
Project scientist
Send message
Joined: 8 May 10
Posts: 576
Credit: 15,979,383
RAC: 0

Message 41562 - Posted: 18 Aug 2010, 20:38:38 UTC - in response to Message 41561.


* I have a bug to report as well, even the X86-64 version runs in 32bit mode on my machine.


There isn't a 64 bit binary yet. Windows is a pain, and I need to do some work to get an actual 64 bit version. It will be 64 bit eventually; it's quite a bit faster for this.

Profile Cori
Avatar
Send message
Joined: 27 Aug 07
Posts: 647
Credit: 27,592,547
RAC: 0

Message 41563 - Posted: 18 Aug 2010, 20:45:12 UTC - in response to Message 41562.


* I have a bug to report as well, even the X86-64 version runs in 32bit mode on my machine.


There isn't a 64 bit binary yet. Windows is a pain, and I need to do some work to get an actual 64 bit version. It will be 64 bit eventually; it's quite a bit faster for this.

Hm, then why do we have two apps for Windos now?
It's a bit misleading if one is called x86_64 when it's in fact a 32-bit app... ;-)
____________
Lovely greetings, Cori

Profile Werkstatt
Send message
Joined: 19 Feb 08
Posts: 350
Credit: 123,760,875
RAC: 1,243

Message 41564 - Posted: 18 Aug 2010, 21:00:02 UTC - in response to Message 41561.



Hello Alexander, i tried a few different app_info.xml's myself and i've come up with this one:

&lt;app_info&gt; &lt;app&gt; &lt;name&gt;milkyway_nbody&lt;/name&gt; &lt;/app&gt; &lt;file_info&gt; &lt;name&gt;milkyway_nbody_0.03_windows_x86_64.exe&lt;/name&gt; &lt;executable/&gt; &lt;/file_info&gt; &lt;app_version&gt; &lt;app_name&gt;milkyway_nbody&lt;/app_name&gt; &lt;version_num&gt;3&lt;/version_num&gt; &lt;file_ref&gt; &lt;file_name&gt;milkyway_nbody_0.03_windows_x86_64.exe&lt;/file_name&gt; &lt;main_program/&gt; &lt;/file_ref&gt; &lt;/app_version&gt; &lt;/app_info&gt;


Let me know if this works for you



Hi Arjan,
did you try this with yout ati-machine? If yes, did your gpu continue to crunch?

I tried it right now and all my gpu-wu's failed immediate. Since the last code-update (HD58xx-series) there is no longer a app_info.xml included. So I copied the last distributed one to the work-directory, changed the names, copied your code into it and restarted boinc. Crashed in the moment of starting it.

Alexander

(retired account)
Avatar
Send message
Joined: 17 Oct 08
Posts: 36
Credit: 411,744
RAC: 0

Message 41566 - Posted: 18 Aug 2010, 21:39:46 UTC - in response to Message 41563.
Last modified: 18 Aug 2010, 21:47:53 UTC


There isn't a 64 bit binary yet. Windows is a pain, and I need to do some work to get an actual 64 bit version. It will be 64 bit eventually; it's quite a bit faster for this.

Hm, then why do we have two apps for Windos now?
It's a bit misleading if one is called x86_64 when it's in fact a 32-bit app... ;-)


Well, that's not too unusual. Quite a number of projects send 32bit apps to the x86_64 system, for example Rosetta, LHC, Docking, RCN, Spinhenge...

I wouldn't bother if I get a 32bit app as something_x86.exe or something_x86_64.exe. ;-)

However, the possibility to have a real 64bit app later with some performance gain, is promising. :-)

(retired account)
Avatar
Send message
Joined: 17 Oct 08
Posts: 36
Credit: 411,744
RAC: 0

Message 41567 - Posted: 18 Aug 2010, 21:46:25 UTC - in response to Message 41564.
Last modified: 18 Aug 2010, 22:19:47 UTC



Hello Alexander, i tried a few different app_info.xml's myself and i've come up with this one:



(...)

I tried it right now and all my gpu-wu's failed immediate. Since the last code-update (HD58xx-series) there is no longer a app_info.xml included. So I copied the last distributed one to the work-directory, changed the names, copied your code into it and restarted boinc. Crashed in the moment of starting it.


Alexander,

if you want to crunch on your ATI and on the CPU you have to build an app_info.xml which includes both sections. Take a look an the xml which was posted by Tim Norton here. It was, however, for the 'old' opt. CPU app and for a NVIDIA GPU, so yours would look different. You have to combine Arjans CPU part and another part for the ATI. Can't help you on the last, cause I have only a single-precision ATI GPU, but I'm sure others can.

P.S.: Arjan, thanks so far, I'm coming back after I've tested it. Have to empty my cache first a bit, have tons of SIMAP and some QuantumFire burning. :-)

EDIT:

So I copied the last distributed one to the work-directory, changed the names, copied your code into it and restarted boinc.


Uhmm.. ok, I should read better, sorry, my bad. Maybe you should try first to get only the GPU part working, might be easier to find an error that way.

EDIT:

Hello Arjan,

your app_info.xml works like a charm! Great, thanks a lot.

Arjan Scholl
Send message
Joined: 22 Feb 09
Posts: 6
Credit: 1,458,115
RAC: 0

Message 41568 - Posted: 18 Aug 2010, 23:03:43 UTC - in response to Message 41564.

No i didn't try this on my machine with the ATI card but rather on my laptop, i will try tomorrow to get it working on my core i7 with the ATI card as well.

(retired account)
Avatar
Send message
Joined: 17 Oct 08
Posts: 36
Credit: 411,744
RAC: 0

Message 41571 - Posted: 18 Aug 2010, 23:29:24 UTC

Still some errors from time to time:

de_nbody_test_10_14620_1282140181
de_nbody_test_10_14642_1282140181
de_nbody_test_10_14717_1282140181
de_nbody_test_10_28566_1282168828
de_nbody_test_10_28643_1282168828

I noticed that the runtimes of the error results are quite similar on my box, all around 932 seconds. And I got none pending or valid which ran longer. Some kind of timeout?

Arjan Scholl
Send message
Joined: 22 Feb 09
Posts: 6
Credit: 1,458,115
RAC: 0

Message 41572 - Posted: 19 Aug 2010, 0:02:02 UTC

If there's anyone interested here is the nbody simulation on CPU combined with the ATI GPU program:

&lt;app_info&gt; &lt;app&gt; &lt;name&gt;milkyway&lt;/name&gt; &lt;user_friendly_name&gt;MilkyWay@Home&lt;/user_friendly_name&gt; &lt;/app&gt; &lt;file_info&gt; &lt;name&gt;milkyway_0.23_windows_x86_64__ati13ati.exe&lt;/name&gt; &lt;executable/&gt; &lt;/file_info&gt; &lt;file_info&gt; &lt;name&gt;brook64a_ati.dll&lt;/name&gt; &lt;executable/&gt; &lt;/file_info&gt; &lt;app_version&gt; &lt;app_name&gt;milkyway&lt;/app_name&gt; &lt;version_num&gt;23&lt;/version_num&gt; &lt;file_ref&gt; &lt;file_name&gt;milkyway_0.23_windows_x86_64__ati13ati.exe&lt;/file_name&gt; &lt;main_program/&gt; &lt;/file_ref&gt; &lt;file_ref&gt; &lt;file_name&gt;brook64a_ati.dll&lt;/file_name&gt; &lt;open_name&gt;brook64.dll&lt;/open_name&gt; &lt;copy_file/&gt; &lt;/file_ref&gt; &lt;platform&gt;windows_x86_64&lt;/platform&gt; &lt;plan_class&gt;ati13ati&lt;/plan_class&gt; &lt;avg_ncpus&gt;0.050000&lt;/avg_ncpus&gt; &lt;max_ncpus&gt;0.100000&lt;/max_ncpus&gt; &lt;coproc&gt; &lt;type&gt;ATI&lt;/type&gt; &lt;count&gt;1.000000&lt;/count&gt; &lt;/coproc&gt; &lt;/app_version&gt; &lt;app&gt; &lt;name&gt;milkyway_nbody&lt;/name&gt; &lt;user_friendly_name&gt;MilkyWay@Home nbody Simulation&lt;/user_friendly_name&gt; &lt;/app&gt; &lt;file_info&gt; &lt;name&gt;milkyway_nbody_0.03_windows_x86_64.exe&lt;/name&gt; &lt;executable/&gt; &lt;/file_info&gt; &lt;app_version&gt; &lt;app_name&gt;milkyway_nbody&lt;/app_name&gt; &lt;version_num&gt;3&lt;/version_num&gt; &lt;file_ref&gt; &lt;file_name&gt;milkyway_nbody_0.03_windows_x86_64.exe&lt;/file_name&gt; &lt;main_program/&gt; &lt;/file_ref&gt; &lt;platform&gt;windows_x86_64&lt;/platform&gt; &lt;/app_version&gt; &lt;/app_info&gt;


GPU processing is slowed down a bit though, about 20% slower.

(retired account)
Avatar
Send message
Joined: 17 Oct 08
Posts: 36
Credit: 411,744
RAC: 0

Message 41574 - Posted: 19 Aug 2010, 0:38:14 UTC

For comparison I started a test on an old system of mine. This is a dual socket Athlon XP running Windows 2000 SP4 (32bit of course). This CPU supports SSE but nothing higher. It appears the nbody simulation does not run at all on such a system.

There are two types of errors:

1. The application crashes almost in an instant and progress bar jumps to 100%. See here for example: de_nbody_test_10_31110_1282174646_0


2. The application runs for approx. 20 minutes, elapsed time is increasing, remaining time is decreasing, progress bar is not running at all, CPU load is full. See here for example: de_nbody_test_10_31094_1282174646_0

Don't get me wrong here. It is not a big deal, if you intend not to support such old hardware and/or operating system.

Regards

Matt Arsenault
Volunteer moderator
Project developer
Project tester
Project scientist
Send message
Joined: 8 May 10
Posts: 576
Credit: 15,979,383
RAC: 0

Message 41575 - Posted: 19 Aug 2010, 1:04:41 UTC - in response to Message 41574.

For comparison I started a test on an old system of mine. This is a dual socket Athlon XP running Windows 2000 SP4 (32bit of course). This CPU supports SSE but nothing higher. It appears the nbody simulation does not run at all on such a system.

There are two types of errors:

1. The application crashes almost in an instant and progress bar jumps to 100%. See here for example: de_nbody_test_10_31110_1282174646_0


2. The application runs for approx. 20 minutes, elapsed time is increasing, remaining time is decreasing, progress bar is not running at all, CPU load is full. See here for example: de_nbody_test_10_31094_1282174646_0

Don't get me wrong here. It is not a big deal, if you intend not to support such old hardware and/or operating system.

Regards


Right now the issues with the progress bar and the maximum time expired should be because the current total FLOPs estimate which BOINC bases the maximum allowed time on is really terrible. It also appears to crash (on Windows at least) after BOINC kills off the long running job. I'm trying to come up with a way to predict it better. The actual time it will take can vary greatly depending on the settings of the simulation. It kind of depends on the positions the bodies end up in at each timestep, so it's kind of hard to predict. If the bodies stay tightly clustered, the simulation tries to be more precise and tends towards O(n^2) behaviour. As more bodies become unbound from the dwarf galaxy model's core and get pulled into the tidal stream, the simulation will tend to speed up. As more bodies get farther apart, more approximations can be made and things run faster. Optimally the simulation should run in O(n log n).

Old hardware that doesn't have SSE2 won't be supported because of precision difficulties related the x87 FPU which I won't go into now. However, currently nothing is stopping it from being sent out to those really old systems (like the Athlon XP) although that should be fixed at some point.

Profile Werkstatt
Send message
Joined: 19 Feb 08
Posts: 350
Credit: 123,760,875
RAC: 1,243

Message 41578 - Posted: 19 Aug 2010, 5:51:57 UTC - in response to Message 41572.

If there's anyone interested here is the nbody simulation on CPU combined with the ATI GPU program:


<avg_ncpus>0.050000</avg_ncpus>
<max_ncpus>0.100000</max_ncpus>


GPU processing is slowed down a bit though, about 20% slower.


Hi Arjan,

many many thanks for your effort, I'm shure, many people will be happy with it!

Two things are left to say:
I compared your app_info with the one I tried to compose. The original one, which was deliverd with the older apps, had the line
<max_ncpus>0.100000</max_ncpus>
different. They used <max_ncpus>1.00000</max_ncpus>
I changed this and found that there is no speed difference now.

The other thing is: MW doesn't download the milkyway_nbody_0.03_windows_x86_64-exe. It permanently reports project delay and Wiederhole in xxxxx.

How do I get this file?

Regards,
Alexander

Starfire
Send message
Joined: 19 Feb 09
Posts: 32
Credit: 32,843,308
RAC: 0

Message 41579 - Posted: 19 Aug 2010, 6:26:52 UTC - in response to Message 41578.

How do I get this file?


This should do it: Link
____________
Starfire

1 · 2 · Next
Post to thread

Message boards : News : windows intelx86 and x86_64 binaries added for the nbody simulations


Main page · Your account · Message boards


Copyright © 2018 AstroInformatics Group