Try our new research platform with insights from 80,000+ expert users

Apache Spark vs Cloudera Distribution for Hadoop vs Outerthought Lily comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Mindshare comparison

As of September 2025, in the Hadoop category, the mindshare of Apache Spark is 19.3%, up from 19.4% compared to the previous year. The mindshare of Cloudera Distribution for Hadoop is 22.1%, down from 25.8% compared to the previous year. The mindshare of Outerthought Lily is 2.1%, up from 0.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Hadoop Market Share Distribution
ProductMarket Share (%)
Apache Spark19.3%
Cloudera Distribution for Hadoop22.1%
Outerthought Lily2.1%
Other56.49999999999999%
Hadoop
 

Featured Reviews

Omar Khaled - PeerSpot reviewer
Empowering data consolidation and fast decision-making with efficient big data processing
I can improve the organization's functions by taking less time to make decisions. To make the right decision, you need the right data, and a solution can provide this by hiring talent and employees who can consolidate data from different sources and organize it. Not all solutions can make this data fast enough to be used, except for solutions such as Apache Spark Structured Streaming. To make the right decision, you should have both accurate and fast data. Apache Spark itself is similar to the Python programming language. Python is a language with many libraries for mathematics and machine learning. Apache Spark is the solution, and within it, you have PySpark, which is the API for Apache Spark to write and run Python code. Within it, there are many APIs, including SQL APIs, allowing you to write SQL code within a Python function in Apache Spark. You can also use Apache Spark Structured Streaming and machine learning APIs.
Rok Dolinsek - PeerSpot reviewer
Enables on-premise implementation with powerful data processing capabilities
This is the only solution that is possible to install on-premise. Cloudera provides a hybrid solution that combines compute on cloud or on-premises. It includes all machine learning algorithms in the Spark machine learning library. All functionalities needed for a big data platform and ETL are on the platform, eliminating the need for other tools. It is scalable, ready for vertical scaling, and very powerful, offering numerous functionalities and configurations for generative AI.
Use Outerthought Lily?
Share your opinion
report
Use our free recommendation engine to learn which Hadoop solutions are best for your needs.
867,445 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
26%
Computer Software Company
11%
Manufacturing Company
7%
Comms Service Provider
7%
Educational Organization
18%
Financial Services Firm
18%
Computer Software Company
11%
Energy/Utilities Company
6%
No data available
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business27
Midsize Enterprise15
Large Enterprise32
By reviewers
Company SizeCount
Small Business16
Midsize Enterprise9
Large Enterprise31
No data available
 

Questions from the Community

What do you like most about Apache Spark?
We use Spark to process data from different data sources.
What is your experience regarding pricing and costs for Apache Spark?
Apache Spark is open-source, so it doesn't incur any charges.
What needs improvement with Apache Spark?
Regarding Apache Spark, I have only used Apache Spark Structured Streaming, not the machine learning components. I am...
What do you like most about Cloudera Distribution for Hadoop?
The tool can be deployed using different container technologies, which makes it very scalable.
What is your experience regarding pricing and costs for Cloudera Distribution for Hadoop?
The price for Cloudera is average, yet it is very good compared to other solutions. It can be deployed on-premises, u...
What needs improvement with Cloudera Distribution for Hadoop?
If they could support modifying the data more easily than the current implementation, it would be beneficial.
Ask a question
Earn 20 points
 

Also Known As

No data available
No data available
Lily
 

Overview

 

Sample Customers

NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
37signals, Adconion,adgooroo, Aggregate Knowledge, AMD, Apollo Group, Blackberry, Box, BT, CSC
ING, Orange, France Telecom, Alpha Credit, Turkcell, Eni, Zain Group, AXA, Rogers, Toyota, Belfius
Find out what your peers are saying about Apache, Cloudera, Amazon Web Services (AWS) and others in Hadoop. Updated: August 2025.
867,445 professionals have used our research since 2012.