If you liked this post, you may also be interested in...
- Pepe The Frog Creator, Infowars Both Claim Victory After $15k Copyright Settlement
- CBP Still Arresting Immigrants Trying To Stay In The Country By Furthering Their Education
- Techdirt Podcast Episode 199: From Apple To The ACLU, With Jon Callas
- DHS To Expand Foreign Laptop Ban If Overseas Airlines Won't Make Their Security More Theatrical
- US & EU Not Banning Laptops On Planes... Yet
Reader Comments
Subscribe: RSS
View by: Time | Thread
Distributed computing is not serious computing
Distributed computing, prone to unreliable communications and whimsical performance, is a tool for lower-priority projects that:
1. do not require security
2. is on a long timetable
3. is just a massively parallel, "dumb" task not requiring much coordination.
We would not think of distributing bank transactions or air traffic control systems to the screensavers of millions of home PC's.
[ link to this | view in chronology ]
Uh... No.
Whether or not something is a supercomputer depends upon three things:
Hardware
Software/OS
Task
Believe it or not, our brains are the fastest computers on the planet - for the tasks our brains were designed to handle (audio-visual analysis and storage, critical thinking, "fuzzy" logic).
But as for the question...
Interesting thought about superclusters making supercomputing obsolete...
Google, of course, runs on one of the largest and long-running (several years) super-cluster in the world.
But is it a supercomputer?
Well, that depends upon the task at hand.
Some tasks can be broken down into many smaller tasks which require little, if any, intercommunication. The SETI screensaver project was one of those. This type of task lends itself to distributed computing, and was (still is, I believe) the largest, most powerful, most widely distributed supercluster on the planet.
Was it a supercomputer? Yes, since the task was to analyze radio frequency data for patterns. Single task, distributed throughout millions of computers all over the planet. In this case, each chunk of data can be analyzed independant of the others.
Even the new weather supercomputer, if it were taked to do what the SETI project did, would be many, many times slower, as powerful as it is. Yet the distributed computer continued chunking away, day and night, using excess processor cycles!
To me, the technology is fairly simple, yet the concept is still amazing.
Other tasks require more frequent communication between the sub-tasks (Google), and so this approach would NOT work. However, a super-cluster like the one they're running works just fine. In this case, each sub-task has little (if anything) to do with other sub-tasks. John's search really has nothing to do with Sarah's search, other than the fact that both are accessing the same database.
Yet other tasks require a high level of communication between the sub-tasks (weather supercomputer and the DoD's nuclear simulation supercomputer). Thus, even a super-cluster connected with 100Base-T isn't fast enough, as the lag time between nodes becomes the bottleneck.
This is when a real supercomputer is called for, when the processors can communicate between themselves and the memory at the same speed your Pentium IV communicates with the L2 cache.
Now THAT's fast! And necessary in finite element analysis where every element affects not only those elements immediately surrounding them, but nearby elements, as well.
So, the correct answer is: A supercomputer is not defined merely by the hardware and software, but by the task it's performing, as well.
Consider, for example, trying to task the SETI project with the weather data... The internodal com jam would bottleneck the entire project, and the overall speed of the supercomputer would probably bog down to something like that of a Cray-1 (or less).
Also consider trying to task the weather supercomputer with the SETI project - it would be many times slower than were the millions of computers slogging away in the actual project.
Well, there you have it.
- Steve Janss
[ link to this | view in chronology ]