Apache Spark vs Hortonworks Data Platform vs IBM InfoSphere BigInsights [EOL] comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
2,430 views|1,869 comparisons
89% willing to recommend
Cloudera Logo
606 views|352 comparisons
89% willing to recommend
IBM Logo
views| comparisons
83% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache Spark, Hortonworks Data Platform, and IBM InfoSphere BigInsights [EOL] based on real PeerSpot user reviews.

Find out what your peers are saying about Apache, Cloudera, Amazon Web Services (AWS) and others in Hadoop.
To learn more, read our detailed Hadoop Report (Updated: April 2024).
769,236 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The scalability has been the most valuable aspect of the solution.""The most crucial feature for us is the streaming capability. It serves as a fundamental aspect that allows us to exert control over our operations.""DataFrame: Spark SQL gives the leverage to create applications more easily and with less coding effort.""I found the solution stable. We haven't had any problems with it.""With Hadoop-related technologies, we can distribute the workload with multiple commodity hardware.""It provides a scalable machine learning library.""The fault tolerant feature is provided.""We use Spark to process data from different data sources."

More Apache Spark Pros →

"Ambari Web UI: user-friendly.""It is a scalable platform.""We use it for data science activities.""Now, using this solution, it is much cheaper to have all of the data available for searching, not in real-time, but whenever there is a pending request.""Ranger for security; with Ranger we can manager user’s permissions/access controls very easily.""The scalability is the key reason why we are on this platform.""The Hortonworks solution is so stable. It is working as a production system, without any error, without any downtime. If I have downtime, it is mostly caused by the hardware of the computers.""The data platform is pretty neat. The workflow is also really good."

More Hortonworks Data Platform Pros →

"InfoSphere Streams was the one core product from the platform in which we were using. We were building a real-time response system and we built it on InfoSphere Streams."

More IBM InfoSphere BigInsights [EOL] Pros →

Cons
"When using Spark, users may need to write their own parallelization logic, which requires additional effort and expertise.""When you first start using this solution, it is common to run into memory errors when you are dealing with large amounts of data.""The solution’s integration with other platforms should be improved.""The management tools could use improvement. Some of the debugging tools need some work as well. They need to be more descriptive.""We've had problems using a Python process to try to access something in a large volume of data. It crashes if somebody gives me the wrong code because it cannot handle a large volume of data.""The solution must improve its performance.""The initial setup was not easy.""It's not easy to install."

More Apache Spark Cons →

"It would also be nice if there were less coding involved.""The version control of the software is also an issue.""Since Cloudera acquired HDP, it's been bundled with CBH and HDP. However, the biggest challenge is cloud storage integration with Azure, GCP, and AWS.""I would like to see more support for containers such as Docker and OpenShift.""Deleting any service requires a lot of clean up, unlike Cloudera.""Security and workload management need improvement.""The cost of the solution is high and there is room for improvement.""Hive performance. If Hive performance increased, Hadoop would replace (not everywhere) traditional databases."

More Hortonworks Data Platform Cons →

"The UI was not interactive: Responses used to be very slow and hang up at times."

More IBM InfoSphere BigInsights [EOL] Cons →

Pricing and Cost Advice
  • "Since we are using the Apache Spark version, not the data bricks version, it is an Apache license version, the support and resolution of the bug are actually late or delayed. The Apache license is free."
  • "Apache Spark is open-source. You have to pay only when you use any bundled product, such as Cloudera."
  • "We are using the free version of the solution."
  • "Apache Spark is not too cheap. You have to pay for hardware and Cloudera licenses. Of course, there is a solution with open source without Cloudera."
  • "Apache Spark is an expensive solution."
  • "Spark is an open-source solution, so there are no licensing costs."
  • "On the cloud model can be expensive as it requires substantial resources for implementation, covering on-premises hardware, memory, and licensing."
  • "It is an open-source solution, it is free of charge."
  • More Apache Spark Pricing and Cost Advice →

  • "It is priced well and it is affordable"
  • "Currently, we are using the product in a sandbox environment, and there is no licensing. We might choose a licensing option once we get the results."
  • More Hortonworks Data Platform Pricing and Cost Advice →

    Information Not Available
    report
    Use our free recommendation engine to learn which Hadoop solutions are best for your needs.
    769,236 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:We use Spark to process data from different data sources.
    Top Answer:In data analysis, you need to take real-time data from different data sources. You need to process this in a subsecond… more »
    Top Answer:Distributed computing, secure containerization, and governance capabilities are the most valuable features.
    Top Answer:I haven't done a price analysis specifically for HDP. However, when it was first introduced as Hadoop 2.0, there were a… more »
    Top Answer:Since Cloudera acquired HDP, it's been bundled with CBH and HDP. However, the biggest challenge is cloud storage… more »
    Ask a question

    Earn 20 points

    Ranking
    1st
    out of 22 in Hadoop
    Views
    2,430
    Comparisons
    1,869
    Reviews
    26
    Average Words per Review
    444
    Rating
    8.7
    6th
    out of 22 in Hadoop
    Views
    606
    Comparisons
    352
    Reviews
    5
    Average Words per Review
    354
    Rating
    8.0
    Unranked
    In Hadoop
    Comparisons
    Also Known As
    Hortonworks, HDP
    InfoSphere BigInsights
    Learn More
    Overview

    Spark provides programmers with an application programming interface centered on a data structure called the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. It was developed in response to limitations in the MapReduce cluster computing paradigm, which forces a particular linear dataflowstructure on distributed programs: MapReduce programs read input data from disk, map a function across the data, reduce the results of the map, and store reduction results on disk. Spark's RDDs function as a working set for distributed programs that offers a (deliberately) restricted form of distributed shared memory

    Hortonworks is a leading innovator in the industry, creating, distributing and supporting enterprise-ready open data platforms and modern data applications. Our mission is to manage the world's data. We have a single-minded focus on driving innovation in open source communities such as Apache Hadoop, NiFi, and Spark. We along with our 1600+ partners provide the expertise, training and services that allow our customers to unlock transformational value for their organizations across any line of business. Our connected data platforms powers modern data applications that deliver actionable intelligence from all data: data-in-motion and data-at-rest. We are Powering the Future of Data.
    IBM BigInsights delivers a rich set of advanced analytics capabilities that allows enterprises to analyze massive volumes of structured and unstructured data in its native format. The software combines open source Apache Hadoop with IBM innovations including sophisticated text analytics, IBM BigSheets for data exploration, IBM Big SQL for SQL access to data in Hadoop, and a range of performance, security and administrative features. The result is a cost-effective and user-friendly solution for complex, big data analytics.
    Sample Customers
    NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
    Mayo Clinic, Symantec, Progressive Insurance, Noble Energy, Cardinal Health, Rogers, Mercy, Neustar, TRUECar, T-Mobile
    Coherent Path Inc., Optibus, Delhaize America, Diyotta Inc., Ernst & Young, Teikoku Databank Ltd., NCSU, Vestas
    Top Industries
    REVIEWERS
    Computer Software Company30%
    Financial Services Firm15%
    University9%
    Marketing Services Firm6%
    VISITORS READING REVIEWS
    Financial Services Firm25%
    Computer Software Company13%
    Manufacturing Company7%
    Comms Service Provider6%
    REVIEWERS
    Comms Service Provider30%
    Government10%
    Financial Services Firm10%
    Wholesaler/Distributor10%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Financial Services Firm16%
    Government6%
    Outsourcing Company6%
    No Data Available
    Company Size
    REVIEWERS
    Small Business40%
    Midsize Enterprise18%
    Large Enterprise42%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise12%
    Large Enterprise71%
    REVIEWERS
    Small Business25%
    Midsize Enterprise18%
    Large Enterprise57%
    VISITORS READING REVIEWS
    Small Business26%
    Midsize Enterprise13%
    Large Enterprise60%
    REVIEWERS
    Small Business43%
    Large Enterprise57%
    Buyer's Guide
    Hadoop
    April 2024
    Find out what your peers are saying about Apache, Cloudera, Amazon Web Services (AWS) and others in Hadoop. Updated: April 2024.
    769,236 professionals have used our research since 2012.