That’s right. A modern big data solution requires more than Hadoop. Welcome to the data, it’s all big and fast.

Welcome to Big Data Central

Discuss on Hacker News

Discuss on Reddit

I’m excited to announce that Big Data Central is live!

It represents my big data story for Couchbase. It’s about the role of NoSQL databases in a world of big data.

There was a time when big data was Hadoop. It was offline analytics. That’s no longer the case. It’s a solution. It’s a solution that includes Hadoop but is not Hadoop. It’s a solution that meets both real-time analytical requirements and offline analytical requirements. It’s a solution that meets both analytical requirements and operational requirements.

The big data ecosystem now includes Storm for real-time processing, Couchbase Server for high performance data access, Hadoop for offline analytics, and more!

There are three big data challenges:

  1. The amount of data being generated, data volume.
  2. The rate at which data is being generated, data velocity.
  3. The rate at which information must be generated, information velocity.

Hadoop addresses data volume. It can store and process a lot of data, later. It scales out to store and process more data. Hadoop does not address data velocity. However, it meets offline analytical requirements.

Couchbase Server addresses data velocity. It is a high performance NoSQL database that can store a lot of data, now. It scales out to store a lot of data, faster. Couchbase Server does not address information velocity. It can store and process data at rest. However, it meets operational requirements.

Storm addresses information velocity. It can process a real-time stream of data. It scales out to process streams of data, faster. Storm does not address volume or data velocity. It does not store data. It processes data in motion. However, it meets real-time analytical requirements.

All three big data challenges can be met by integrating Storm, Couchbase Server, and Hadoop. By integrating Couchbase Server with storm, a real-time stream of data can be processed and stored. By integrating Couchbase Server with Hadoop, a lot of data can be processed offline.

Posted by Shane Johnson, Director, Product Marketing, Couchbase

Shane K Johnson was the Director of Product Marketing at Couchbase. Prior to Couchbase, he occupied various roles in developing and evangelism with a background in Java and distributed systems. He has consulted with organizations in the financial, retail, telecommunications, and media industries to draft and implement architectures that relied on distributed systems for data and analysis.

38 Comments

  1. Shane, very nice article on Big Data. With the explosion of big data, companies are faced with data challenges in three different areas. First, you know the type of results you want from your data but it’s computationally difficult to obtain. Second, you know the questions to ask but struggle with the answers and need to do data mining to help find those answers. And third is in the area of data exploration where you need to reveal the unknowns and look through the data for patterns and hidden relationships. The open source HPCC Systems big data processing platform can help companies with these challenges by deriving insights from massive data sets quick and simple. Designed by data scientists, it is a complete integrated solution from data ingestion and data processing to data delivery. Their built-in Machine Learning Library and Matrix processing algorithms can assist with business intelligence and predictive analytics. More at http://hpccsystems.com

  2. Great Information admin thanks For Your Information and Any body wants

    learn Testing Tools through Online for Details Please go through the Link


    Best Online Hadoop Training with real time scenarios/projects Worldwide

    This Will Helps you alot.

  3. Thanks for sharing your valuable Information for Online Learners.

    learn Hadoop through Online for Details Please go through the Link


    Best Online HADOOP Training by Experienced IT Professional Trainers

    This Will Helps you a alot.

  4. Well written…..This is the best article which is useful to all Online Learns…

    Learn HADOOP through Online for Details Please go through the Link

    Online HADOOP Training by IT Professionals in HYDERABAD | DELHI | BANGALORE | USA | UK | JAPAN | SWEDEN | AUSTRALIA

  5. attain prasathe July 15, 2014 at 9:26 am

    Great Information admin thanks For Your Information and Any body wants
    learn Hadoop through Online for Details Please go through the Link

    Online Hadoop Training with free Demo class in USA | UK | INDIA | SINGAPORE

    This Will Helps you allot.

  6. attain prasathe July 23, 2014 at 11:00 am

    Great Information admin thanks For Your Information and Any body wants
    learn Hadoop through Online for Details Please go through the Link

    Online Hadoop Training with free Demo class in USA | UK | INDIA | SINGAPORE

    This Will Helps you allot.

  7. attain prasathe July 25, 2014 at 5:49 am

    Great Information admin thanks For Your Information and Any body wants
    learn Hadoop through Online for Details Please go through the Link

    Online Hadoop Training with free Demo class in USA | UK | INDIA | SINGAPORE

    This Will Helps you allot.

  8. Yes, to understand modern Hadoop, everyone need to learn Apache Storm, Spark, MapReduce, hbase etc.

    Apache Storm is an open source engine which can process data in realtime using its distributed architecture. Storm is simple and flexible. It can be used with any programming language of your choice.

    Let’s look at the various components of a Storm Cluster:

    1 – Nimbus node. The master node (Similar to JobTracker)

    2 – Supervisor nodes. Starts/stops workers & communicates with Nimbus through Zookeeper

    3 – ZooKeeper nodes. Coordinates the Storm cluster

    Both Spark and Storm can operate in a Hadoop cluster and access Hadoop storage. Storm-YARN is Yahoo’s open source implementation of Storm and Hadoop convergence. Spark is providing native integration for Hadoop. Integration with Hadoop is achieved through YARN (NextGen MapReduce). Integrating real time analytics with Hadoop based systems allows for better utilization of cluster resources through computational elasticity and being in the same cluster means that network transfers can be minimal.

    I can\’t share complete information related to hadoop, spark anh storm so please visit below lnks for informative tutorials.

    For topics to learn or understand:- http://intellipaat.com/hadoop-

    For YouTube Tutorials :- https://www.youtube.com/user/i

  9. attain prasathe August 6, 2014 at 8:38 am

    We are announcing greatly that we are presenting Teksonit Online Institute all
    over the world for all courses.So Our teaching techniques are very unique when
    compare to the other.Great Information admin thanks For Your Information and Any body wants
    learn Hadoop through Online for Details Please go through the Link

    Online Hadoop Training with free Demo class in USA | UK | INDIA | SINGAPORE

    This Will Helps you allot.

  10. attain prasathe August 11, 2014 at 10:17 am

    We are announcing greatly that we are presenting Teksonit Online Institute all
    over the world for all courses.So Our teaching techniques are very unique when
    compare to the other.Great Information admin thanks For Your Information and Any body wants
    learn Hadoop through Online for Details Please go through the Link

    Online Hadoop Training with free Demo class in USA | UK | INDIA | SINGAPORE

    This Will Helps you allot.

  11. attain prasathe August 16, 2014 at 11:50 am

    We are announcing greatly that we are presenting Teksonit Online Institute all
    over the world for all courses.So Our teaching techniques are very unique when
    compare to the other.Great Information admin thanks For Your Information and Any body wants
    learn Hadoop through Online for Details Please go through the Link

    Online Hadoop Training with free Demo class in USA | UK | INDIA | SINGAPORE | Canada

    This Will Helps you allot.

  12. Well written…..This is the best article which is useful to all Online Learners…

    Learn HADOOP through Online for Details Please go through the Link

    HADOOP Online Training in INDIA | USA | UK | AUSTRALIA | SINGAPORE | CANADA | EUROPE

  13. attain prasathe August 21, 2014 at 11:16 am

    We are announcing greatly that we are presenting Teksonit Online Institute all
    over the world for all courses.So Our teaching techniques are very unique when
    compare to the other.Great Information admin thanks For Your Information and Any body wants
    learn Hadoop through Online for Details Please go through the Link

    Online Hadoop Training with free Demo class in USA | UK | INDIA | SINGAPORE | Canada

    This Will Helps you allot.

  14. Dorothy J. Hammond August 25, 2014 at 5:54 am

    Hadoop Online Training Hadoop can handle many kinds of data from programs that are disparate: structured, unstructured, record files, photos, files that are audio, text – just about anything you are able to think of, regardless of its ancient format. Furthermore, it can be fit by you all inside your Hadoop group without any preceding need for a schema. In words that are other, you don’t need to find out the method that before you shop it you intend to problem important computer data, ; Hadoop enables you to decide that after Hadoop Online Training.

    Hadoop Online Training

  15. We are announcing greatly that we are presenting Teksonit Online Institute all
    over the world for all courses.So Our teaching techniques are very unique when
    compare to the other.Great Information admin thanks For Your Information and Any body wants
    learn Hadoop through Online for Details Please go through the Link

    Hadoop Online Training with free Demo class in USA | UK | INDIA | SINGAPORE | Australia | Canada

    This Will Helps you allot.

  16. Thanks For Your Information and Any body want to

    Find top Hadoop online training and placement providers in INDIA


    Hadoop Online Training by highly qualified professionals in INDIA | NORWAY | USA | UK

    This Will Helps you aalot.

  17. We are announcing greatly that we are presenting Xbeen all over the world for all courses and also Jobs
    Assistance.If anybody wants Hadoop online training and also Jobs Assistance at a low of cost definitely you need to come to this website.
    please go through the Link
    Hadoop online training and placements providers USA | New York | Los Angeles | Chicago | Columbus.

  18. A great information regarding Hadoop it is interesting and people should understand easily who are looking to take certification course in Hadoop,Job Assistence and find out some more information in the site Hadoop online training and placements providers USA | New York | Los Angeles | Chicago | Columbus.

  19. Thanks For Your Information and Any body want to

    Find top Hadoop online training providers in INDIA


    HADOOP Online Training and Certification INDIA | GERMANY | USA | UK | SINGAPORE

    This Will Helps you aalot.

  20. Thanks for Sharing such a usefull Information….

    Learn HADOOP through Online for Details Please go through the Link…

    HADOOP Online Training and Certification in INDIA | USA | SIGNAPORE

  21. A useful information about Hadoop,
    it is interesting and people should understand easily who are looking to take
    certification course in Hadoop, Job Assistance and find out some more
    information in this site Hadoop
    online training in USA | Washington | New York | Indianapolis | New Jersey

  22. Thanks for providing such a usefull Information….

    Learn HADOOP through Online for Details Please go through the Link…


    HADOOP Online Training in USA | UK

  23. Dorothy J. Hammond October 31, 2014 at 10:26 am

    Hadoop online training Smart mind online training is
    the the perfect area where anybody optimistic to understand Apache Hadoop may
    beat. Our education gives the sophisticated insight in a manner that is such
    that everyone may understand issue and the gain and be a professional. The
    \”Apache Hadoop\” generates open source software for reliable,
    scalable, distributed processing Hadoop online training.


    Hadoop Online Training

  24. Thanks for providing such a usefull Information….

    Learn HADOOP through Online for Details Please go through the Link…


    HADOOP Online Training in USA | UK

  25. Great article! NoSQL provides a much more flexible, schemaless data model that better
    maps to an application’s data organization and simplifies the
    interaction between the application and the database, resulting in less
    code to write, debug, and maintain. Many security professionals who encounter big data environments for the
    first time don\’t understand why security is a big issue. They assume
    they are going to rely on the same tools and techniques that they use to
    protect their relational databases. For more info visit at https://intellipaat.com/nosql-

  26. BestQtp Training April 30, 2015 at 5:46 am

    how can we merge the data of two file written in diffrent data format like one is seprated by pipe and other one is by comma …located at diffrent location.

    http://www.bestandroidtraining

  27. Thanks for Sharing such a useful information….

    Learn HADOOPL through Online for Details Please go through the Link…

    Online HADOOP Training in INDIA | USA | UK | AUSTRALIA | CANADA | SINGAPORE | JAPAN

  28. Great article! NoSQL provides a much more flexible, schemaless data model that better
    maps to an application’s data organization and simplifies the
    interaction between the application and the database, resulting in less
    code to write, debug, and maintain. Many security professionals who encounter big data environments for the
    first time don\’t understand why security is a big issue. They assume
    they are going to rely on the same tools and techniques that they use to
    protect their relational databases. For more info visit at:http://smartmindonlinetraining

  29. Thanks for Sharing such a Wonderful Information….
    Learn Hadoop through Online for Details Please go through the Link
    http://www.leadonlinetraining….

  30. MindsMapped Consulting October 16, 2015 at 9:24 pm

    Good article. Love to read three challenges. http://www.mindsmapped.com/big

  31. Thank you for your
    very useful information. bigdata hadoop
    online training
    I appreciate that you looked it up to share with us
    all!

  32. Hi, you have given really informative post. Thanks for
    sharing this blog. Suppose If anyone interested to get real time Big
    Data Training in Chennai
    reach us besant technologies, rated as no.1
    IT training institute in Chennai.

  33. Thanks for
    nice topic. It’s a very wonderful excellent topic. We are providing online
    Training Classes. HADOOP
    ONLINE TRAINING

  34. Good work, I enjoyed a lot while reading this article. Thanks for useful information about Big data. I found one more good resource related to Big Data, which I am sharing a link with you where you can get more clear about Big Data Just have a look on this link: https://intellipaat.com/big-da

  35. We offer hadoop courses.

    Training is giving is by industry experts

    For course details refer:

    http://hadoopbigdatatutorial.c

    For free videos on hapoop refer:

    http://hadoopbigdatatutorial.c

  36. Techdata Solution April 26, 2016 at 10:19 am

    Hadoop Training in Mumbai and certification for professionals has opened up a world of opportunities as it will Hadoop Training in Mumbai enable professionals to help in proper structuring and management of enterprise data. At the core of Hadoop training is its central idea-the need for implementing data management at a granular level.

  37. Thanks for sharing.Nice post

    Big Data and Hadoop Online Classroom

    https://www.ezcertifications.c

Leave a reply