Stephen Downes

Knowledge, Learning, Community

It is well known that one of Google's secrets was that it was designed to run on a large cluster of computers, and not one great big computer. In the last few years frameworks have been built to support massive parallel computing in clusters. One well-known framework is Apache's Hadoop, "designed to scale up from single servers to thousands of machines, each offering local computation and storage." It's how online services can start small and build to accommodate demand. Now the news is that Facebook has made its SQL database engine called Presto available as open source, which will provide significant speed advantages over previously available Hadoop database engines.

Today: 1060 Total: 1063 [Direct link] [Share]

Image from the website
View full size


Stephen Downes Stephen Downes, Casselman, Canada
stephen@downes.ca

Copyright 2024
Last Updated: Mar 29, 2024 01:51 a.m.

Canadian Flag Creative Commons License.

Force:yes