Sign in with
Sign up | Sign in
Your question

Grid computing network. Feedback appreciated.

Last response: in Networking
Share
October 22, 2012 6:11:01 AM

I am looking for feedback on a project that I will be undertaking over the next few years. I am a university student and I have hopes of building a system of a network of computers able to share processing power to form one supercomputer with the education that I will be acquiring. I have put a lot of effort into this project so please look into it and tell me if you see any possible problems/limitations that I could run into. Below is the link to the word document that explains what the project is all about.



It might seem very ambitious, and that's because one I have only a limited knowledge in computer systems and two I have a lot of time in the future to work on this system. Thats why feedback is crucial. Thank you :) 
October 23, 2012 2:24:32 AM

If you could post that as a plain text document I will be happy to review it, but I will not open up a Word document that might contain malware.
October 23, 2012 4:11:20 AM

PhilFrisbie said:
If you could post that as a plain text document I will be happy to review it, but I will not open up a Word document that might contain malware.


I thought people might worry about that. Well it contains graphics, but for that part I can just link pngs instead.

I will just post the plain text helow.


MULTI-COMPUTER GRID PROCESSING THEORY

--> What is this project about?

This project was born with the goal to have inexpensive processing power;
more than what is available on regular commercial computer systems. The main
goal was to find a way to link different IBM-compatible computers to create
one powerful workstation. The second goal was to find a way to make it
user-friendly. Business and home users often need a lot of processing
power, don’t have a ton of money and don’t have the expertise to fiddle
with settings. Often they just wait it out or resort to cloud services
instead. This project would be a solution to these groups and would allow
them to easily set up a grid computing system to form one supercomputer.

--> How would it function?

It is understandable that the processes that would require such large
computing power need two things: a large amount of processing power and a
large amount of memory available. These systems would have to communicate
quickly and efficiently not to offset the purpose of having a lot of
computing power. To address this, the communication on these computers
should be done through PCI express (x16 and x1) port and/or simply a PCI
port and/or an AGP port. To do that, custom hardware and drivers must be
manufactured. Depending on the possible demand, this could be very possible.
This system would have two parts to it. The master system and the slave
systems.

--MASTER COMPUTER--
This should be the strongest computer. A large amount of memory, hard drive
space and processing power is required. The reason behind this is that it
would have two different parts to the system. On the bottom would be a
linux kernel. Above that would be a java OS (java was chosen for its
multi-device compatibility) engineered for grid computing and
virtualization (this would be handled by the computers own processor). This
system would have to create a virtual computer (using its resources and/or
the resources available through the slave computers) and would send
processing tasks to each computer at its disposal. On the top is an OS of
choice (it will be engineered for both Windows and Linux.) At the Java
level, the OS will take each individual process that the top OS requires,
and split them between the connected computers. It would then receive the
response and then apply it to the computer.

--SLAVE COMPUTERS--
Almost any computer can be a slave computer. This one does not require much
hard drive space (just enough for the operating system and to save its
settings.) It requires a bit of ram, but once again only enough to run the
operating system and to store the processing tasks. It can also send
processing tasks to other computers that are connected through the sub-
connection. If the computer has only one core, it will only do one or the
other. This requires another open (PCIe, PCI, AGP) slot on the computer for
another connector. This one also has the linux kernel and runs on java, but
does not have virtualization. Its sole purpose is to run and manage processes.

THE HARDWARE
The hardware would work through (PCIe, PCI or AGP) and would have two
versions. Master and Slave. The Master side would be the side that sends the
unprocessed tasks and would receive the processed task. The Slave side would
do the opposite. There would be a uniform connector cord between the two,
which would run at speeds fast enough to not hinder the system’s performance.
There will be three slots on the Master, but only one on the Slave.

--> Illustration of the system

(SEE PNGS LINKED ON FORUM)

--> Final notes:
This is designed for the average consumer/small business that wants more processing power inexpensively. Operating systems will have drivers for many different types of hardware. Almost any consumer available somewhat-modern computer should be supported.

Diagram one: http://dl.dropbox.com/u/75466097/Diagram%201.png
Diagram two: http://dl.dropbox.com/u/75466097/Diagram%202.png
!