From “Overnight” to “Real-time”: A Two-Year NoSQL Case Study

This presentation was given Wednesday, August 24, 2011 at the NoSQL Now! 2011 Conference in San Jose, California

About the Presentation

Meteor Solutions integrates site and advertising analytics to provide major publishers and advertisers the ability to identify and reach their influential visitors with advertising, exclusive content and rewards. Eighteen months ago, Meteor was backed by a relational DB and struggling to keep up with volumes in a batch processing environment that was ill-suited to our graph oriented data model. Today, the service is backed by Cloudant, a distributed document store based on CouchDB, and provides deeper analytics in real-time. This transition enabled 10x growth and allowed us to open our technology to a much broader range of applications — though not without some bumps along the way. This talk will cover:

• Overview of our services and specific technical challenges
• Overview of Cloudant/CouchDB, how we leverage it, and its relation to other SQL, NoSQL, and web technologies in our stack
• Benefits we’ve seen and tradeoffs we have had to make
• Operational lessons learned
• Future plans: how NoSQL’s possibilities and limitations influence business, product and operational decisions

About the Speaker

Benjamin Anderson
Director of Engineering
Meteor Solutions

Ben has several years’ experience building web-focused applications with an emphasis on big data, distributed architectures and non-relational data stores. He graduated from the University of Washington in 2008 with a degree in business, but spends most of his time leading a growing engineering and operations team, hacking on various open-source projects, and remodeling his new home.

Connect with Ben on Twitter (@banjiewen).

For more videos and topics from the NoSQL Now! 2011 Conference, click HERE.

Tags: Benjamin Anderson, big data, Dataversity, NoSQL, video

This entry was posted on October 31, 2011 at 4:43 pm and is filed under Big Data, Conference and Webinar Communities, Data Topics, Education, Events, NoSQL, NoSQL Now!, Video. You can follow any responses to this entry through the RSS 2.0 feed.