Welcome to MilkyWay@home

search progress visualization

Message boards : Number crunching : search progress visualization
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · Next

AuthorMessage
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 11605 - Posted: 19 Feb 2009, 10:47:50 UTC - in response to Message 11596.  

As of this morning (feb 19) we started using Mersenne twister instead of drand48() to generate the random numbers for our particle swarm optimization. I'm hoping that this will improve the results a little bit, by adding some more variety to the random numbers we're generating.
ID: 11605 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Emanuel

Send message
Joined: 18 Nov 07
Posts: 280
Credit: 2,442,757
RAC: 0
Message 11613 - Posted: 19 Feb 2009, 11:51:48 UTC

Good call.
ID: 11613 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 11633 - Posted: 19 Feb 2009, 14:50:59 UTC - in response to Message 11613.  

I also added median values to the output and graphs. It'll probably take them awhile to catch up with the median values however.
ID: 11633 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
EigenState

Send message
Joined: 19 Apr 08
Posts: 13
Credit: 151,588
RAC: 0
Message 11671 - Posted: 19 Feb 2009, 20:31:38 UTC - in response to Message 11494.  

What we have in this post is pretty much preliminary work, so we'd really like to hear your ideas and suggestions as to what you'd like to know is going on server-side, and what we're doing as a whole.

Right now we would like to get these graphs (and some other ones) automatically generated in their own webpage, with information like what users have given us the best fitness and things like that.

Pretty much we could have whatever information you guys think would be interesting, and we'll also have things we're interested about and looking into on their for our own benefit.

Basically, we'd like a webpage we could check to easily know the status of our different searches, and I thought it would be more interesting with some user input, so we could make that information more interesting to you guys, and also add things you'd be interested in as crunchers.


I would suggest, no urge that the project utilize this new webpage as a means to provide a vastly greater educational opportunity for the volunteer participants. Thus, I believe it should provide information on both the fundamental physics and the computational aspects of the project. By computational aspects, I most certainly do not mean any discussion of credits or who has the bigger, faster hardware--such discussions are all too prevalent as it is on the forum. Some suggested reading materials on both subject matters would be excellent additions.

Allow your volunteers to learn if they so choose. The lack of such learning resources is, in my opinion, a great weakness in the BOINC concept.

Best regards,
EigenState
ID: 11671 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Emanuel

Send message
Joined: 18 Nov 07
Posts: 280
Credit: 2,442,757
RAC: 0
Message 12245 - Posted: 22 Feb 2009, 0:00:17 UTC

The current situation in ps_s21_9 looks interesting. Is this a case of the particles moving from one local maximum to another, or are we seeing some outliers?
ID: 12245 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 12345 - Posted: 22 Feb 2009, 12:03:47 UTC - in response to Message 12245.  

The current situation in ps_s21_9 looks interesting. Is this a case of the particles moving from one local maximum to another, or are we seeing some outliers?


Not quite sure :) That's why I'm letting it keep running.
ID: 12345 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Emanuel

Send message
Joined: 18 Nov 07
Posts: 280
Credit: 2,442,757
RAC: 0
Message 12368 - Posted: 22 Feb 2009, 13:58:10 UTC
Last modified: 22 Feb 2009, 14:04:29 UTC

Hehe, that's cool. What about ps_s23_9? You can still just about see when the 'best' values shot up. I'm still not sure what you're aiming for - do you want the worst values to converge to the best ones, while finding the highest average overall? (if so, why aren't you showing the worst values in your graph?)
ID: 12368 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Emanuel

Send message
Joined: 18 Nov 07
Posts: 280
Credit: 2,442,757
RAC: 0
Message 12468 - Posted: 23 Feb 2009, 0:36:09 UTC
Last modified: 23 Feb 2009, 0:36:32 UTC

By the way, if the goal is for the particles to converge (i.e. all of them moving toward the global maximum?), could you add the mean absolute deviation or the interquartile range? (I guess if you add them at the bottom of the graphs you'd need a second range for the vertical axis, which could go on the right)
ID: 12468 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 12478 - Posted: 23 Feb 2009, 2:32:45 UTC

I would suggest that the bottom line of numbers be made X10000, to eliminate the mess of 0's.
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 12478 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 12513 - Posted: 23 Feb 2009, 12:43:22 UTC - in response to Message 12368.  

Hehe, that's cool. What about ps_s23_9? You can still just about see when the 'best' values shot up. I'm still not sure what you're aiming for - do you want the worst values to converge to the best ones, while finding the highest average overall? (if so, why aren't you showing the worst values in your graph?)


I just was playing around and took out the worst values because you could see a bit better how the best was progressing that way. It would be nice for the worst values to converge to the best, because that's an indication that the search is over, but it's not really necessary. We're just looking to find the highest fitness

By the way, if the goal is for the particles to converge (i.e. all of them moving toward the global maximum?), could you add the mean absolute deviation or the interquartile range? (I guess if you add them at the bottom of the graphs you'd need a second range for the vertical axis, which could go on the right)


Yeah I have our searches generate standard deviation and a few other values to the logs but haven't made a graph for that yet. It should be pretty easy to add one :)
ID: 12513 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Paul D. Buck

Send message
Joined: 12 Apr 08
Posts: 621
Credit: 161,934,067
RAC: 0
Message 12776 - Posted: 24 Feb 2009, 21:57:03 UTC

With regard to a screensaver, I have to admit that at times it is nice to be able to look at the data, but, with the runtimes so short now it does not seem to make much sense. My "slowest" system when I was running it last week I think was down to 10 minutes per task ... that is not much time to do much of anything of interest...

and the high end at 12 seconds, well, blink and you missed it all ...
ID: 12776 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Emanuel

Send message
Joined: 18 Nov 07
Posts: 280
Credit: 2,442,757
RAC: 0
Message 13051 - Posted: 27 Feb 2009, 14:26:47 UTC

Looks like the graphs haven't been updated in a few days - I thought they were scripted to run automatically.. Perhaps you could add a timestamp to the bottom of the post so we know when it was last updated.
ID: 13051 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 13055 - Posted: 27 Feb 2009, 16:20:30 UTC - in response to Message 13051.  

Looks like the graphs haven't been updated in a few days - I thought they were scripted to run automatically.. Perhaps you could add a timestamp to the bottom of the post so we know when it was last updated.


Dave was supposed to have gotten them run automatically :P I guess he didn't... I'm going to bug him some more.
ID: 13055 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 13091 - Posted: 27 Feb 2009, 18:46:51 UTC - in response to Message 13055.  

Dave was supposed to have gotten them run automatically :P I guess he didn't... I'm going to bug him some more.


Keep that cattle prod handy!
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 13091 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Phil
Avatar

Send message
Joined: 13 Feb 08
Posts: 1124
Credit: 46,740
RAC: 0
Message 13097 - Posted: 27 Feb 2009, 19:21:00 UTC - in response to Message 13091.  
Last modified: 27 Feb 2009, 19:21:16 UTC

Dave was supposed to have gotten them run automatically :P I guess he didn't... I'm going to bug him some more.


Keep that cattle prod handy!


I'll click the Red X on him.
ID: 13097 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Misfit
Avatar

Send message
Joined: 27 Aug 07
Posts: 915
Credit: 1,503,319
RAC: 0
Message 13125 - Posted: 27 Feb 2009, 22:46:58 UTC - in response to Message 13097.  

Dave was supposed to have gotten them run automatically :P I guess he didn't... I'm going to bug him some more.

Keep that cattle prod handy!

I'll click the Red X on him.

Dave will blame it on a freshman.
me@rescam.org
ID: 13125 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile GalaxyIce
Avatar

Send message
Joined: 6 Apr 08
Posts: 2018
Credit: 100,142,856
RAC: 0
Message 13126 - Posted: 27 Feb 2009, 22:52:59 UTC - in response to Message 13125.  

Dave was supposed to have gotten them run automatically :P I guess he didn't... I'm going to bug him some more.

Keep that cattle prod handy!

I'll click the Red X on him.

Dave will blame it on a freshman.

I think you have something there. A freshman prodding Dave with a cattle prod. Now that's an idea for a screensaver :P


ID: 13126 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Misfit
Avatar

Send message
Joined: 27 Aug 07
Posts: 915
Credit: 1,503,319
RAC: 0
Message 13128 - Posted: 27 Feb 2009, 22:55:39 UTC - in response to Message 13126.  

Dave was supposed to have gotten them run automatically :P I guess he didn't... I'm going to bug him some more.

Keep that cattle prod handy!

I'll click the Red X on him.

Dave will blame it on a freshman.

I think you have something there. A freshman prodding Dave with a cattle prod. Now that's an idea for a screensaver :P

I might have to enroll.
me@rescam.org
ID: 13128 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile banditwolf
Avatar

Send message
Joined: 12 Nov 07
Posts: 2425
Credit: 524,164
RAC: 0
Message 13136 - Posted: 27 Feb 2009, 23:00:48 UTC - in response to Message 13128.  

Dave was supposed to have gotten them run automatically :P I guess he didn't... I'm going to bug him some more.

Keep that cattle prod handy!

I'll click the Red X on him.

Dave will blame it on a freshman.

I think you have something there. A freshman prodding Dave with a cattle prod. Now that's an idea for a screensaver :P

I might have to enroll.


The next hit internet game. Prod Dave & the sequel Prod Dave Again!!
Doesn't expecting the unexpected make the unexpected the expected?
If it makes sense, DON'T do it.
ID: 13136 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Travis
Volunteer moderator
Project administrator
Project developer
Project tester
Project scientist

Send message
Joined: 30 Aug 07
Posts: 2046
Credit: 26,480
RAC: 0
Message 13160 - Posted: 27 Feb 2009, 23:21:16 UTC - in response to Message 13136.  

Updated these to the newer searches which are using some limited redundancy to check new local/global best particles ;) Hopefully these should improve better than the last set.
ID: 13160 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · Next

Message boards : Number crunching : search progress visualization

©2024 Astroinformatics Group