HOWTO Puppy supercomputer !!!
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
HOWTO Puppy supercomputer !!!
http://www.petur.eu./
i got pdf about supercomputer from above site few month, now i try to apply to puppy knowing that puppy has significant speed advantage over ubuntuy.
i try to apply, but always has error, regarding port...
(.deb package is not working, get the slackware instead on page 2)
is anyone know how apply this to puppy ?
thank
i got pdf about supercomputer from above site few month, now i try to apply to puppy knowing that puppy has significant speed advantage over ubuntuy.
i try to apply, but always has error, regarding port...
(.deb package is not working, get the slackware instead on page 2)
is anyone know how apply this to puppy ?
thank
Last edited by Master_wrong on Sat 01 Jan 2011, 15:00, edited 3 times in total.
Cluster-Pup v.2-Puppy Beowulf Cluster
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
- Lobster
- Official Crustacean
- Posts: 15522
- Joined: Wed 04 May 2005, 06:06
- Location: Paradox Realm
- Contact:
You need mad geniuses who like nothing better thanis anyone know how apply this to puppy ?
turning a glut of clutter into a Turing Cluster
This seems a worthy project as we can have
a thread 'my cluster is faster than yours'
and 'my cluster has more nodes than yours'
. . . now it is true we can join internet clusters
but to have a supercomputer in ones basement
computing the emergence of time anomalies
- sounds essential to me . . .
Puppy Linux
Supercomputer fodder
Last edited by Lobster on Mon 20 Dec 2010, 13:46, edited 1 time in total.
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
no, its not, the pdf was straightforward easy to follow.You need mad geniuses who like nothing better than
turning a glut of clutter into a Turing Cluster
its setting the port or python in puppy confuse me.
thank you.This seems a worthy project as we can have
a thread 'my cluster is faster than yours'
ans 'my cluster has more nodes than yours'
errrr...... . . now it is true we can join internet clusters
but to have a supercomputer in ones basement
computing the emergence of time anomalies
- sounds essential to me . . .
i was thinking about lesser goal, to understand more about supercomputing.
anyway thanks for your comment.
BTW :
I found what is wrong, for root, mpd.conf shoud be in /etc instead of home.
mpdboot now run without problem.
mpdtrace still has problem, i need to put password into mpd.conf, how i put password for puppy ?
- Attachments
-
- mpd.png
- (8.44 KiB) Downloaded 1456 times
Cluster-Pup v.2-Puppy Beowulf Cluster
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
DONE !
here is the step needed
1. install package
2. install tinylogin.pet (http://distro.ibiblio.org/pub/linux/dis ... ackages-2/)
3. edit /etc/hosts on each computer attached according to its address
sample:
from
127.0.0.1 localhost puppypc
192.168.1.1 pc2
192.168.1.2 pc3
192.168.1.3 pc4
to
127.0.0.1 localhost puppypc
10.0.2.15 superwoof1 -------------->set according to computer
192.168.1.1 pc2
192.168.1.2 pc3
192.168.1.3 pc4
4. create /home
5. run terminal type
tinylogin adduser superwoof
password
password
6. inside /home/superwoof ---->create mpd.host(list of all computer attached----> address:processor ----> 10.0.2.15:1 )
7. inside /home/superwoof ---->create .mpd.conf (secretword=password)
8. set user of .mpd.conf ---->type in terminal : chown superwoof .mpd.conf also make only user can open it from properties
9. inside /home/superwoof ---->create /home/superwoof/bin ---->for program, set path too
10. in terminal type
login superwoof
mpdboot
mpdtrace
mpdrun
mpdallexit
have a nice day...
here is the step needed
1. install package
2. install tinylogin.pet (http://distro.ibiblio.org/pub/linux/dis ... ackages-2/)
3. edit /etc/hosts on each computer attached according to its address
sample:
from
127.0.0.1 localhost puppypc
192.168.1.1 pc2
192.168.1.2 pc3
192.168.1.3 pc4
to
127.0.0.1 localhost puppypc
10.0.2.15 superwoof1 -------------->set according to computer
192.168.1.1 pc2
192.168.1.2 pc3
192.168.1.3 pc4
4. create /home
5. run terminal type
tinylogin adduser superwoof
password
password
6. inside /home/superwoof ---->create mpd.host(list of all computer attached----> address:processor ----> 10.0.2.15:1 )
7. inside /home/superwoof ---->create .mpd.conf (secretword=password)
8. set user of .mpd.conf ---->type in terminal : chown superwoof .mpd.conf also make only user can open it from properties
9. inside /home/superwoof ---->create /home/superwoof/bin ---->for program, set path too
10. in terminal type
login superwoof
mpdboot
mpdtrace
mpdrun
mpdallexit
have a nice day...
- Attachments
-
- superpuppy.png
- (1.21 KiB) Downloaded 1427 times
Cluster-Pup v.2-Puppy Beowulf Cluster
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
Thank lobster
wait...wait i see somethin...
designing new nuclear warhead ?
btw i'm still trying to keep my /home folder after remaster, it seem they were not copied into new iso.
perhaps i should create my puplet...
superwoof, cluster puppy ?
let me see....I am not 100% sure what we can do now . . .
Any plans?
wait...wait i see somethin...
designing new nuclear warhead ?
btw i'm still trying to keep my /home folder after remaster, it seem they were not copied into new iso.
perhaps i should create my puplet...
superwoof, cluster puppy ?
Cluster-Pup v.2-Puppy Beowulf Cluster
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
ok,
i just want to clarify...
puppy didnt have sshd installed, and the ssh in the package is wrong, cannot use it.
btw i already try installing sshd, set using root and try for real, it is running now.
see there is 2 cluster
i just want to clarify...
puppy didnt have sshd installed, and the ssh in the package is wrong, cannot use it.
btw i already try installing sshd, set using root and try for real, it is running now.
see there is 2 cluster
- Attachments
-
- successsmall.png
- (22.61 KiB) Downloaded 1407 times
Cluster-Pup v.2-Puppy Beowulf Cluster
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
- RetroTechGuy
- Posts: 2947
- Joined: Tue 15 Dec 2009, 17:20
- Location: USA
I love it!...Lobster wrote:Go for it!
http://www.youtube.com/watch?v=7KfbizHyGsE
[url=http://murga-linux.com/puppy/viewtopic.php?t=58615]Add swapfile[/url]
[url=http://wellminded.net63.net/]WellMinded Search[/url]
[url=http://puppylinux.us/psearch.html]PuppyLinux.US Search[/url]
[url=http://wellminded.net63.net/]WellMinded Search[/url]
[url=http://puppylinux.us/psearch.html]PuppyLinux.US Search[/url]
Suggest an application for your SuperComputer
@Master_wrong. I have read much over the years about Clusters from an architectural standpoint. All seems within reason, architecturally.
My missing understanding is in how it manages, dispatches, and then displays workloads. This comes from my base where I come from an Multi-Processor (MP) world with a single OS into a cluster world from an application(s) standpoint. MPs such as Intel/AMD/PowerPC etc sit within a single frame where the bus in integrated for the MPs operation.
Where I get a little tussle is when trying to describe to a Windows/X-desktop user, how work is accomplished in a disparate configuration. Maybe you can help by describing
P.S. Recognizing that the answers might take up a lot of space in this post, you are welcome to PM me with the answers
My missing understanding is in how it manages, dispatches, and then displays workloads. This comes from my base where I come from an Multi-Processor (MP) world with a single OS into a cluster world from an application(s) standpoint. MPs such as Intel/AMD/PowerPC etc sit within a single frame where the bus in integrated for the MPs operation.
Where I get a little tussle is when trying to describe to a Windows/X-desktop user, how work is accomplished in a disparate configuration. Maybe you can help by describing
- whether the cluster console is or can be an X-windows desktop session?
- Whether X-windows Linux applications are currently designed for cluster environments?
- Whether Puppy OS "sees" all processors in such a way that if I ran TOP (the application) it would report/manage "all combined tasks" running across the cluster?
- And, finally, can I run a multiuser X-windows sessions on a cluster system for as many users as I have logging in?
P.S. Recognizing that the answers might take up a lot of space in this post, you are welcome to PM me with the answers
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
@gcmartin
thanks for asking me, i didnt know myself, all i did was read pdf for ubuntu which i try to do in puppy linux.
but i can answer some of your question
- whether the cluster console is or can be an X-windows desktop session?
sorry i have no idea
- Whether X-windows Linux applications are currently designed for cluster environments?
not all but yes, dvd::rip is gui and can use cluster, but very few gui application have cluster capabilities http://www.exit1.org/dvdrip/doc/cluster.cipp
- Whether Puppy OS "sees" all processors in such a way that if I ran TOP (the application) it would report/manage "all combined tasks" running across the cluster?
i wonder that too
- And, finally, can I run a multiuser X-windows sessions on a cluster system for as many users as I have logging in?
the point of cluster is using networked computer to assist doing 1 task on the server, the idea is if 1 task is done 1 hour with 1 computer then i can be done 0.5 hour with 2 computer, 0.25 hour with 4 computer. etc
for your question... i dont know
the problem is i got too excited last night and run remaster before closing cluster which makes the remaster fail. so i have to do it all over again.... grrrrr
thanks for asking me, i didnt know myself, all i did was read pdf for ubuntu which i try to do in puppy linux.
but i can answer some of your question
- whether the cluster console is or can be an X-windows desktop session?
sorry i have no idea
- Whether X-windows Linux applications are currently designed for cluster environments?
not all but yes, dvd::rip is gui and can use cluster, but very few gui application have cluster capabilities http://www.exit1.org/dvdrip/doc/cluster.cipp
- Whether Puppy OS "sees" all processors in such a way that if I ran TOP (the application) it would report/manage "all combined tasks" running across the cluster?
i wonder that too
- And, finally, can I run a multiuser X-windows sessions on a cluster system for as many users as I have logging in?
the point of cluster is using networked computer to assist doing 1 task on the server, the idea is if 1 task is done 1 hour with 1 computer then i can be done 0.5 hour with 2 computer, 0.25 hour with 4 computer. etc
for your question... i dont know
the problem is i got too excited last night and run remaster before closing cluster which makes the remaster fail. so i have to do it all over again.... grrrrr
Cluster-Pup v.2-Puppy Beowulf Cluster
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
Finally i can remaster...
i will set my puplet soon
sshd i used is found here,
after all files installed
then only thing important is setting
/etc/hosts
/etc/mpd.conf ---->for user root
/home/user/mpd.hosts
/home/user/.mpd.conf ---->for user non root
as mpd has strict rules:
1. all .conf files in all computer has to be private only file (rw access only to owner)
2. setting address inside /etc/hosts and mpd.hosts files in all computer has to be arranged similiar :
address:nameserver
address:node1
address:node2
if any of them is not correct you will get error 415, 407, 420, and headache because sometimes you cannot trace error.
btw:
Whether Puppy OS "sees" all processors in such a way that if I ran TOP (the application) it would report/manage "all combined tasks" running across the cluster?
YES,memory was doubled too, interesting...
but it stay that way even after i disconnect, maybe false report
have a nice day
i will set my puplet soon
sshd i used is found here,
on first post.
after all files installed
then only thing important is setting
/etc/hosts
/etc/mpd.conf ---->for user root
/home/user/mpd.hosts
/home/user/.mpd.conf ---->for user non root
as mpd has strict rules:
1. all .conf files in all computer has to be private only file (rw access only to owner)
2. setting address inside /etc/hosts and mpd.hosts files in all computer has to be arranged similiar :
address:nameserver
address:node1
address:node2
if any of them is not correct you will get error 415, 407, 420, and headache because sometimes you cannot trace error.
btw:
Whether Puppy OS "sees" all processors in such a way that if I ran TOP (the application) it would report/manage "all combined tasks" running across the cluster?
YES,memory was doubled too, interesting...
but it stay that way even after i disconnect, maybe false report
have a nice day
Cluster-Pup v.2-Puppy Beowulf Cluster
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
- Lobster
- Official Crustacean
- Posts: 15522
- Joined: Wed 04 May 2005, 06:06
- Location: Paradox Realm
- Contact:
One of the exciting Puppy places is pioneering and leading edge. Docs and pics and stories of your setup and experience are always of great interest. What will you call your first Puppy Supercomputer? Will you put a Puppy sticker on each node. How many nodes do you need to appear on this list? http://www.top500.org/ You might start with the worlds smallest supercomputer but what will you inspire . . .HOWTO on what to do with a Puppy supercomputer?
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
Damm i was wrong, my comp is dual core and the increase might be swap afterall, sorrybtw:
Whether Puppy OS "sees" all processors in such a way that if I ran TOP (the application) it would report/manage "all combined tasks" running across the cluster?
YES,memory was doubled too, interesting...
but it stay that way even after i disconnect, maybe false report
Thank CoroneIN, for now the best idea i can think is to learn cluster programming with it... @ reduced hassle and difficult setting-uphave 4 computers at home 5 if i count the 386 they gave me in for my work... I wanna try try try! uhmm.. what can i do with it ?
awaiting the puplet
http://www.cis.udel.edu/~pollock/367/manual/node18.html
well.....That's what was in my mind, and surely it's the point?
HOWTO on what to do with a Puppy supercomputer?
for ppl who need to learn about supercomputing or programming and many of them may need distro which easy to boot and setup so they can just learn just to program or even need help to setup one themself, that's what to do with puppy on supercomputer.
surely this will not help casual user, but every distro has its great point, and i find puppy has a great advantage on this sector... at least for a learning tool.
Thank lobster,One of the exciting Puppy places is pioneering and leading edge. Docs and pics and stories of your setup and experience are always of great interest. Smile
yes I think puppy is perfect for future computing, just few decades ago ram was just barely megabyte... so next few decades who know how much terrabyte ram we will have, and most of that ram will surely goes unused by todays program.
just simple luci245 look, atm.What will you call your first Puppy Supercomputer? Will you put a Puppy sticker on each node. How many nodes do you need to appear on this list? http://www.top500.org/ You might start with the worlds smallest supercomputer but what will you inspire . . . Very Happy
i wont even dream of entering top500 cmon lobster...
but maybe you can learn to program them using puppy
i'm still try to create small luci245, it really has great adventage...
1. setting hostname at bootup that's really really great thing you know, the hostname and the list of /etc/hosts must correspond .
2. can install from multiple distro package
My goal for the project is
1. make puppy cluster computer ---> half done, cluster are connected but having difficulty compiling program and running.... may need gcc and setting the path... since file mpicc are exists in usr/lib/mpich/bin but rox says not found
2. setting all cluster from server ----> half done, i have set scp but since i forgot to include /etc/mpd.conf then it doesnt work, if it was included then it will run.
3. automatic setting maybe scan port 22 then scan 1 by 1 each cluster and set their setting without asking password.
but now you have to edit each cluster for the data.
thank you.
Last edited by Master_wrong on Sat 01 Jan 2011, 04:28, edited 1 time in total.
Cluster-Pup v.2-Puppy Beowulf Cluster
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
-
- Posts: 79
- Joined: Fri 22 May 2009, 13:50
- Location: Largo, Florida USA
luci devx 245
Hi Master_worng
I find this very interesting but far over my head.
The devx is the same as luci 246 I think.
Good Luck with this!
Merry Christmas!
Sorry that was 244 :roll:too much eggnoog
I find this very interesting but far over my head.
The devx is the same as luci 246 I think.
Good Luck with this!
Merry Christmas!
Sorry that was 244 :roll:too much eggnoog
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
-
- Posts: 452
- Joined: Thu 20 Mar 2008, 01:48
Finally it success !!!!!
HAPPY NEW YEAR EVERYONE !!!!!
here is the recipes....
mpich2-1.0.8-i486-goa.tgz at
http://www.cebacad.net/files/mpich2/slackware/old/
python25, tcl, tk, db... at
http://www.murga-linux.com/puppy/viewto ... &start=317
also my script
and you also need password less sshd
http://www.murga-linux.com/puppy/viewto ... 532#482532
remember to extract my script to root/my-program....
edit data inside /root/myprogram/clusterdata/ etc and home according to your comp ip and hostname....
run auto --------> this set data into your server, should run at startup.
run superwoof ---------> this initiate passwordless-ssh (in my setting) and copy data from server to all node.
if nothing is wrong then the system is set to run mpd
thank you
HAPPY NEW YEAR EVERYONE !!!!!
here is the recipes....
mpich2-1.0.8-i486-goa.tgz at
http://www.cebacad.net/files/mpich2/slackware/old/
python25, tcl, tk, db... at
http://www.murga-linux.com/puppy/viewto ... &start=317
also my script
and you also need password less sshd
http://www.murga-linux.com/puppy/viewto ... 532#482532
remember to extract my script to root/my-program....
edit data inside /root/myprogram/clusterdata/ etc and home according to your comp ip and hostname....
run auto --------> this set data into your server, should run at startup.
run superwoof ---------> this initiate passwordless-ssh (in my setting) and copy data from server to all node.
if nothing is wrong then the system is set to run mpd
thank you
- Attachments
-
- pi.png
- (1.95 KiB) Downloaded 983 times
-
- demo.png
- (2.33 KiB) Downloaded 987 times
-
- clusterdata.tar.gz
- (1.59 KiB) Downloaded 349 times
Cluster-Pup v.2-Puppy Beowulf Cluster
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]
[url]http://www.murga-linux.com/puppy/viewtopic.php?p=499199#499199[/url]