July 17, 2012
NOTHING COSTS MORE THAN IT USED TO:
Your Laptop Can Now Analyze Big Data : New software makes it possible to do in minutes on a small computer what used to be done by large clusters of computers. (JOHN PAVLUS, July 17, 2012, Technology Review)
Computer scientists from Carnegie Mellon University have devised a framework for running large-scale computations for tasks such as social network or Web search analysis efficiently on a single personal computer.The software could help developers working on many modern tasks: for example, designing a new recommendation engine using social network connections. In order to make effective recommendations--"your friends liked this movie, so here is another movie that you haven't seen yet, but you will probably like"--the software has to be able to analyze the connections between the members of a social network. This type of task is called graph computation, and it is increasingly common. But working with large-scale data sets (such as online social networks) usually requires the processing horsepower of many computers clustered together, such as those offered by Amazon's cloud-based EC2 service.The new software, called GraphChi, exploits the capacious hard drives that are becoming ever more common in personal computers.
Posted by Orrin Judd at July 17, 2012 6:09 AM
Tweet
« THE CHOICE BETWEEN JOBS AND WEALTH: |
Main
| AT THE INTERSECTION OF IDEOLOGY AND REALITY LIES DEFLATION: »
