Content-type: text/html Downes.ca ~ Stephen's Web ~ Facebook open sources its SQL-on-Hadoop engine, and the web rejoices

Stephen Downes

Knowledge, Learning, Community

It is well known that one of Google's secrets was that it was designed to run on a large cluster of computers, and not one great big computer. In the last few years frameworks have been built to support massive parallel computing in clusters. One well-known framework is Apache's Hadoop, "designed to scale up from single servers to thousands of machines, each offering local computation and storage." It's how online services can start small and build to accommodate demand. Now the news is that Facebook has made its SQL database engine called Presto available as open source, which will provide significant speed advantages over previously available Hadoop database engines.

Today: 6 Total: 93 [Direct link] [Share]

Image from the website
View full size


Stephen Downes Stephen Downes, Casselman, Canada
stephen@downes.ca

Copyright 2024
Last Updated: Nov 22, 2024 06:56 a.m.

Canadian Flag Creative Commons License.

Force:yes