Welcome to MilkyWay@home

3rd.in - optimized apps


Advanced search

Message boards : Number crunching : 3rd.in - optimized apps
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 40 · Next

AuthorMessage
Cluster Physik

Send message
Joined: 26 Jul 08
Posts: 627
Credit: 94,940,203
RAC: 0
50 million credit badge10 year member badgeextraordinary contributions badge
Message 11080 - Posted: 17 Feb 2009, 0:13:48 UTC - in response to Message 11074.  

Are there optimized apps for 64 bit Windows?

Besides the GPU app (which is Win64 only), no.
Just use the 32 bit ones, they run also with Win64. I doubt there would be much of a gain for going 64bit in case of MW.
ID: 11080 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGavin Shaw
Avatar

Send message
Joined: 16 Jan 08
Posts: 98
Credit: 1,371,299
RAC: 0
1 million credit badge10 year member badge
Message 11083 - Posted: 17 Feb 2009, 0:41:09 UTC - in response to Message 11063.  

I have put together new versions of the windows apps compiled for specific instruction sets (x87/SSE/2/3/4.1/4.2/SSSE3) with the version number bumped to 0.19. The computation is exactly the same as before (the stock app had to move ;) and so is the performance. But I've put some additional features in:

  • user configurable version number in the output file (will explain how it works if it is needed)
  • diagnostic information in stderr.txt (visible under task details when instapurge gets turned off) like

    • CPU detection
    • output of the crunch time (both CPU time and wall clock time) to recognize demanding background processes when comparing the times


Hope it works like intended.



Well it appears to display more info in the stderr output. Identifies CPU and processing time(s).

Thanks.

Never surrender and never give up. In the darkest hour there is always hope.

ID: 11083 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Cluster Physik

Send message
Joined: 26 Jul 08
Posts: 627
Credit: 94,940,203
RAC: 0
50 million credit badge10 year member badgeextraordinary contributions badge
Message 11089 - Posted: 17 Feb 2009, 1:08:08 UTC - in response to Message 11083.  

Well it appears to display more info in the stderr output. Identifies CPU and processing time(s).

It appears to work. On your notebook one can see such a case of a background process eating quite some cycles during the computation
WU completed. It took 515.578 seconds CPU time and 581.424 seconds wall clock time @ 1.995 GHz.


And here some complete sample output for another machine:
Running Milkyway@home version 0.19 by Gipsel
CPU: Intel(R) Core(TM)2 Quad CPU Q9550 @ 2.83GHz (4 cores/threads) 3.50207 GHz (407ms)
WU completed. It took 210.484 seconds CPU time and 210.727 seconds wall clock time @ 3.5021 GHz.
ID: 11089 · Rating: 0 · rate: Rate + / Rate - Report as offensive
John Clark

Send message
Joined: 4 Oct 08
Posts: 1734
Credit: 64,228,409
RAC: 0
50 million credit badge10 year member badge
Message 11091 - Posted: 17 Feb 2009, 1:15:40 UTC

As you say Cluster Physik, much information -

<stderr_txt>

Running Milkyway@home version 0.19 by Gipsel

CPU: Intel(R) Core(TM)2 Extreme CPU X9650 @ 3.00GHz (4 cores/threads) 3.79986 GHz (302ms)

WU completed. It took 193.047 seconds CPU time and 195.293 seconds wall clock time @ 3.79988 GHz.

</stderr_txt>
ID: 11091 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGavin Shaw
Avatar

Send message
Joined: 16 Jan 08
Posts: 98
Credit: 1,371,299
RAC: 0
1 million credit badge10 year member badge
Message 11092 - Posted: 17 Feb 2009, 1:18:10 UTC - in response to Message 11089.  

Well it appears to display more info in the stderr output. Identifies CPU and processing time(s).

It appears to work. On your notebook one can see such a case of a background process eating quite some cycles during the computation
WU completed. It took 515.578 seconds CPU time and 581.424 seconds wall clock time @ 1.995 GHz.



Well the notebook is also my primary work computer so I use it a lot for my research etc. And the virus scanner at times can take a bit of processing, especially when it is trying to update its AV files...


Never surrender and never give up. In the darkest hour there is always hope.

ID: 11092 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Divide Overflow
Avatar

Send message
Joined: 16 Feb 09
Posts: 109
Credit: 11,089,510
RAC: 0
10 million credit badge10 year member badge
Message 11110 - Posted: 17 Feb 2009, 4:48:03 UTC - in response to Message 11079.  
Last modified: 17 Feb 2009, 4:54:21 UTC

Are there optimized apps for 64 bit Windows?


The 32-bit Windows apps work fine with 64-bit Windows, and will run much faster than the stock app on all platforms.


Indeed. I found the appropriate optimized win32 app to be at least twice as fast as the stock v.19 x64 one on my system. Thanks!
ID: 11110 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
100 million credit badge10 year member badge
Message 11255 - Posted: 17 Feb 2009, 21:38:58 UTC

zslip now contains Windows and Linux optimized apps from version 0.16 onwards.

I have created a mirror so that zslip.com is hosted on a Linux server in the USA and zslip.net is hosted on a Windows server in the UK.

Both have the Windows and Linux apps of course ;)



ID: 11255 · Rating: 0 · rate: Rate + / Rate - Report as offensive
WimTea

Send message
Joined: 16 Nov 07
Posts: 23
Credit: 4,774,710
RAC: 0
3 million credit badge10 year member badge
Message 11264 - Posted: 17 Feb 2009, 22:04:59 UTC

Had to abort a WU that ran on a host running the SSE2 zslip.com code after 6.155 seconds...

It was the second one in two days. If anyone is interested, I caught the stderrout this time:
<core_client_version>6.1.0</core_client_version>
<![CDATA[
<message>
aborted by user
</message>
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x7C901230

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.3.11


Dump Timestamp : 02/17/09 22:52:31
Install Directory : C:\Program Files\BOINC\
Data Directory : C:\Program Files\BOINC
Project Symstore :
Loaded Library : C:\Program Files\BOINC\\dbghelp.dll
Loaded Library : C:\Program Files\BOINC\\symsrv.dll
Loaded Library : C:\Program Files\BOINC\\srcsrv.dll
LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126
Loaded Library : version.dll
Debugger Engine : 4.0.5.0
Symbol Search Path: C:\Program Files\BOINC\slots\0;C:\Program Files\BOINC\projects\milkyway.cs.rpi.edu_milkyway;srv*C:\WINDOWS\TEMP\symbols*http://msdl.microsoft.com/download/symbols;srv*C:\WINDOWS\TEMP\symbols*http://boinc.berkeley.edu/symstore


ModLoad: 00400000 000eb000 C:\Program Files\BOINC\projects\milkyway.cs.rpi.edu_milkyway\astronomy_0.16_SSE2.exe (-nosymbols- Symbols Loaded)

ModLoad: 7c900000 000b6000 C:\WINDOWS\system32\ntdll.dll (5.1.2600.2180) (-exported- Symbols Loaded)
File Version : 5.1.2600.2180 (xpsp_sp2_rtm.040803-2158)
Company Name : Microsoft Corporation
Product Name : Besturingssysteem Microsoft? Windows?
Product Version : 5.1.2600.2180

ModLoad: 7c800000 000ff000 C:\WINDOWS\system32\kernel32.dll (5.1.2600.3119) (-exported- Symbols Loaded)
File Version : 5.1.2600.3119 (xpsp_sp2_gdr.070416-1301)
Company Name : Microsoft Corporation
Product Name : Besturingssysteem Microsoft? Windows?
Product Version : 5.1.2600.3119

ModLoad: 7e390000 00090000 C:\WINDOWS\system32\USER32.dll (5.1.2600.3099) (-exported- Symbols Loaded)
File Version : 5.1.2600.3099 (xpsp_sp2_gdr.070308-0222)
Company Name : Microsoft Corporation
Product Name : Besturingssysteem Microsoft? Windows?
Product Version : 5.1.2600.3099

ModLoad: 77e40000 00048000 C:\WINDOWS\system32\GDI32.dll (5.1.2600.3466) (-exported- Symbols Loaded)
File Version : 5.1.2600.3466 (xpsp_sp2_gdr.081022-1254)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 5.1.2600.3466

ModLoad: 77f40000 000ab000 C:\WINDOWS\system32\ADVAPI32.dll (5.1.2600.2180) (-exported- Symbols Loaded)
File Version : 5.1.2600.2180 (xpsp_sp2_rtm.040803-2158)
Company Name : Microsoft Corporation
Product Name : Besturingssysteem Microsoft? Windows?
Product Version : 5.1.2600.2180

ModLoad: 77da0000 00092000 C:\WINDOWS\system32\RPCRT4.dll (5.1.2600.3173) (-exported- Symbols Loaded)
File Version : 5.1.2600.3173 (xpsp_sp2_gdr.070709-0051)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 5.1.2600.3173

ModLoad: 77f10000 00011000 C:\WINDOWS\system32\Secur32.dll (5.1.2600.2180) (-exported- Symbols Loaded)
File Version : 5.1.2600.2180 (xpsp_sp2_rtm.040803-2158)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 5.1.2600.2180

ModLoad: 03000000 00115000 C:\Program Files\BOINC\dbghelp.dll (6.6.7.5) (-exported- Symbols Loaded)
File Version : 6.6.0007.5 (debuggers(dbg).051021-1446)
Company Name : Microsoft Corporation
Product Name : Debugging Tools for Windows(R)
Product Version : 6.6.0007.5

ModLoad: 77be0000 00058000 C:\WINDOWS\system32\msvcrt.dll (7.0.2600.2180) (-exported- Symbols Loaded)
File Version : 7.0.2600.2180 (xpsp_sp2_rtm.040803-2158)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 7.0.2600.2180

ModLoad: 01d00000 00083000 C:\Program Files\BOINC\symsrv.dll (6.6.7.5) (-exported- Symbols Loaded)
File Version : 6.6.0007.5 (debuggers(dbg).051021-1446)
Company Name : Microsoft Corporation
Product Name : Debugging Tools for Windows(R)
Product Version : 6.6.0007.5

ModLoad: 01000000 0003a000 C:\Program Files\BOINC\srcsrv.dll (6.6.7.5) (-exported- Symbols Loaded)
File Version : 6.6.0007.5 (debuggers(dbg).051021-1446)
Company Name : Microsoft Corporation
Product Name : Debugging Tools for Windows(R)
Product Version : 6.6.0007.5

ModLoad: 77bd0000 00008000 C:\WINDOWS\system32\version.dll (5.1.2600.2180) (-exported- Symbols Loaded)
File Version : 5.1.2600.2180 (xpsp_sp2_rtm.040803-2158)
Company Name : Microsoft Corporation
Product Name : Microsoft? Windows? Operating System
Product Version : 5.1.2600.2180



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 479, Write: 0, Other 91

- I/O Transfers Counters -
Read: 0, Write: 309, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 16272, QuotaPeakPagedPoolUsage: 16444
QuotaNonPagedPoolUsage: 1592, QuotaPeakNonPagedPoolUsage: 1592

- Virtual Memory Usage -
VirtualSize: 20119552, PeakVirtualSize: 20119552

- Pagefile Usage -
PagefileUsage: 3788800, PeakPagefileUsage: 3788800

- Working Set Size -
WorkingSetSize: 4300800, PeakWorkingSetSize: 4300800, PageFaultCount: 1046

*** Dump of thread ID 1356 (state: Ready): ***

- Information -
Status: Base Priority: Unknown, Priority: Unknown, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 51884712.000000

- Unhandled Exception Record -
Reason: Breakpoint Encountered (0x80000003) at address 0x7C901230

- Registers -
eax=00000001 ebx=00000000 ecx=0044722e edx=0000613c esi=00000000 edi=00000000
eip=7c901230 esp=00b3fb90 ebp=00b3ffec
cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000202

- Callstack -
ChildEBP RetAddr Args to Child
00b3ffec 00000000 00408ee0 00000000 00000000 00000008 ntdll!DbgBreakPoint+0x0

*** Dump of thread ID 3168 (state: Ready): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 2031250.000000, User Time: 61555781632.000000, Wait Time: 51884712.000000

- Registers -
eax=0012f8e0 ebx=003d6ea1 ecx=18bc12ab edx=00915b88 esi=ffffffff edi=c0c3a3c8
eip=0044081e esp=0012f8dc ebp=0012fd78
cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000286

- Callstack -
ChildEBP RetAddr Args to Child
0012fd78 00401482 00408ee0 00000000 7c90e64e 7c80c136 astronomy_0.16_SSE2!+0x0
0012fd84 7c90e64e 7c80c136 00000000 3ff00000 00d48ea0 astronomy_0.16_SSE2!+0x0
00000000 00000000 00000000 00000000 00000000 00000000 ntdll!NtSetInformationThread+0x0


*** Debug Message Dump ****


*** Foreground Window Data ***
Window Name :
Window Class :
Window Process ID: 0
Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
ID: 11264 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Misfit
Avatar

Send message
Joined: 27 Aug 07
Posts: 915
Credit: 1,503,319
RAC: 0
1 million credit badge10 year member badge
Message 11304 - Posted: 18 Feb 2009, 2:01:04 UTC - in response to Message 11264.  

Say is that Crunch3r's BOINC client?
me@rescam.org
ID: 11304 · Rating: 0 · rate: Rate + / Rate - Report as offensive
John Clark

Send message
Joined: 4 Oct 08
Posts: 1734
Credit: 64,228,409
RAC: 0
50 million credit badge10 year member badge
Message 11339 - Posted: 18 Feb 2009, 5:47:23 UTC - in response to Message 11304.  

Say is that Crunch3r's BOINC client?


Looks like it.

The one with CPU lock for each WU and report after 1 minute.
ID: 11339 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
100 million credit badge10 year member badge
Message 11359 - Posted: 18 Feb 2009, 7:21:57 UTC - in response to Message 11304.  

Say is that Crunch3r's BOINC client?

I am not hosting any of Crunch3r's BOINC clients or anything of Crunch3r's on zslip.


ID: 11359 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
100 million credit badge10 year member badge
Message 11481 - Posted: 18 Feb 2009, 19:07:53 UTC

I've used some welcome coding from Exar Kun to improve the layout of zslip which hopefully will make it easier to use. I still need to tidy it up a bit, but the latest Windows and Linus apps are there. Just some historical Linux to add.

Thanks for your help Exar Kun, much appreciated ;)



ID: 11481 · Rating: 0 · rate: Rate + / Rate - Report as offensive
WimTea

Send message
Joined: 16 Nov 07
Posts: 23
Credit: 4,774,710
RAC: 0
3 million credit badge10 year member badge
Message 11504 - Posted: 18 Feb 2009, 21:14:54 UTC

The Boinc client works just fine for quite a while now on that single core host. It's still Crunch3rs v6.1.0 as it ran on my dual core comps and I wanted all comps to run the same CC. Reminds me it's time to synchronize all of them one of these days...
Anyway I just took a look at the particular host and it happens to run another abnormally long WU. It's at 1:45 now, where they usually take 15 to 20 mins. I'll keep an eye on it. Looking at the resultlust for the host I found another one. Took 1:20, validated OK though.
ID: 11504 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Profilespeedimic
Avatar

Send message
Joined: 22 Feb 08
Posts: 260
Credit: 57,387,048
RAC: 0
50 million credit badge10 year member badge
Message 11505 - Posted: 18 Feb 2009, 21:19:14 UTC - in response to Message 11481.  

looks much better now!

I doubt those old Linux versions are of any than historical interest...


mic.


ID: 11505 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileConan
Avatar

Send message
Joined: 2 Jan 08
Posts: 105
Credit: 65,685,040
RAC: 2,181
50 million credit badge10 year member badge
Message 11509 - Posted: 18 Feb 2009, 22:02:22 UTC - in response to Message 11504.  

Nothing wrong with that client as I also use it on one of my machines due to a BOINC benchmarking issue (and no it does not give inflated benchmarks, quite the opposite really, it actually lowered it).

I did get a few errors a while back, but I just re-downloaded another version and all is now ok.
ID: 11509 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
100 million credit badge10 year member badge
Message 11511 - Posted: 18 Feb 2009, 22:16:27 UTC - in response to Message 11505.  

looks much better now!

I doubt those old Linux versions are of any than historical interest...


OK, I'll remove them then. I'd rather just have what is usable than confuse.

Hmmmm, I see 0.18d MK II need to go up ;)


ID: 11511 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
100 million credit badge10 year member badge
Message 11523 - Posted: 19 Feb 2009, 0:05:52 UTC

Thanks to speedimic, zslip now offers Intel optimized apps for Linux 32 and 64 bit. These are still based on version 0.18d and I've marked them as 0.18d mkII

zslip USA ........... zslip UK





ID: 11523 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Profilespeedimic
Avatar

Send message
Joined: 22 Feb 08
Posts: 260
Credit: 57,387,048
RAC: 0
50 million credit badge10 year member badge
Message 11526 - Posted: 19 Feb 2009, 0:15:53 UTC - in response to Message 11523.  

Thanks to speedimic, zslip now offers Intel optimized apps for Linux 32 and 64 bit. These are still based on version 0.18d and I've marked them as 0.18d mkII

zslip USA ........... zslip UK



Can you you please mark everything up to and including sse3 as Intel and AMD compatible...
mic.


ID: 11526 · Rating: 0 · rate: Rate + / Rate - Report as offensive
ProfileGalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
100 million credit badge10 year member badge
Message 11533 - Posted: 19 Feb 2009, 0:30:43 UTC - in response to Message 11526.  

Thanks to speedimic, zslip now offers Intel optimized apps for Linux 32 and 64 bit. These are still based on version 0.18d and I've marked them as 0.18d mkII

zslip USA ........... zslip UK



Can you you please mark everything up to and including sse3 as Intel and AMD compatible...

No problem - it's done ;)


ID: 11533 · Rating: 0 · rate: Rate + / Rate - Report as offensive
barsanuphe

Send message
Joined: 19 Oct 08
Posts: 19
Credit: 1,463,876
RAC: 0
1 million credit badge10 year member badge
Message 11534 - Posted: 19 Feb 2009, 0:32:53 UTC

linux links are broken. why is their extension .tar.tar? i also tried tar.gz, tar, or zip.
ID: 11534 · Rating: 0 · rate: Rate + / Rate - Report as offensive
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 40 · Next

Message boards : Number crunching : 3rd.in - optimized apps

©2020 Astroinformatics Group