Data Informed

Data Informed


MIT Researcher Shows How Database Powers Real-Time Twitter Maps

April 26, 2013
CAMBRIDGE, Mass.—Todd Mostak had a turbulent experience with trying to process and plot tweets during the Arab Spring for his master's thesis for the Center for Middle Eastern Studies at Harvard. So while taking a course on databases at MIT, he created a massively parallel database using inexpensive graphical processing units (GPUs) that could attack data problems with brute force processing power.

You can read more about Mostak's development journey on Data Informed.

In this video Mostak explains his database, called MapD, and shows off his visualization tool TweetMap, an early use of the GPU-based system. TweetMap is in an alpha stage of development  and is hosted by Harvard's open source WorldMap GIS project. The visualization system can instantly visualize dynamic heat maps on geolocated tweets, and currently is available to the public to explore  125 million geolocated tweets sent in December 2012.

Mostak said the TweetMap was a bit of a "low hanging fruit" for MapD; because of it's GPU makeup, crunching and graphically rendering map data is a logical application. But Mostak said there are many possible use cases for the system, from processing and trend detection  on data stored in graph databases to machine learning.

Mostak recently created his own demo video, showing the reaction on Twitter on of the April 15 bombings at the 2013 Boston Marathon.

Email Staff Writer Ian B. Murphy at ian.murphy@wispubs.com. Follow him on Twitter @IBMurphyatDI.

Also on Data Informed:

Hack/Reduce Boston to foster big data talent.

 SAS CEO Jim Goodnight on modernizing analytics for massively parallel systems.

SAP pitches HANA platform to analytics startups.

The post MIT Researcher Shows How Database Powers Real-Time Twitter Maps appeared first on Data Informed.


DataInformed?d=yIl2AUoC8zA DataInformed?i=VxlX5nrXjxY:xqbzGL5PnCU:F7zBnMyn0Lo DataInformed?d=7Q72WNTAKBA DataInformed?i=VxlX5nrXjxY:xqbzGL5PnCU:V_sGLiPBpWU DataInformed?d=qj6IDK7rITs DataInformed?d=l6gmwiTKsz0 DataInformed?i=VxlX5nrXjxY:xqbzGL5PnCU:gIN9vFwOqvQ DataInformed?d=TzevzKxY174 DataInformed?i=VxlX5nrXjxY:xqbzGL5PnCU:KwTdNBX3Jqk
VxlX5nrXjxY