We performed a comparison between Apache Spark, Cloudera Distribution for Hadoop, and Hortonworks Data Platform based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, Cloudera, Amazon Web Services (AWS) and others in Hadoop.
"The good performance. The nice graphical management console. The long list of ML algorithms."
"The product’s most valuable features are lazy evaluation and workload distribution."
"The product is useful for analytics."
"Apache Spark provides a very high-quality implementation of distributed data processing."
"AI libraries are the most valuable. They provide extensibility and usability. Spark has a lot of connectors, which is a very important and useful feature for AI. You need to connect a lot of points for AI, and you have to get data from those systems. Connectors are very wide in Spark. With a Spark cluster, you can get fast results, especially for AI."
"Now, when we're tackling sentiment analysis using NLP technologies, we deal with unstructured data—customer chats, feedback on promotions or demos, and even media like images, audio, and video files. For processing such data, we rely on PySpark. Beneath the surface, Spark functions as a compute engine with in-memory processing capabilities, enhancing performance through features like broadcasting and caching. It's become a crucial tool, widely adopted by 90% of companies for a decade or more."
"The most valuable feature of Apache Spark is its memory processing because it processes data over RAM rather than disk, which is much more efficient and fast."
"Apache Spark can do large volume interactive data analysis."
"The features I find most valuable is that the solution is that it is easy to install and to work with. It starts with the installation and from there on the management is very simple and centralized."
"Customer service and support were able to fix whatever the issue was."
"CDH has a wide variety of proprietary tools that we use, like Impala. So from that perspective, it's quite useful as opposed to something open-source. We get a lot of value from Cloudera's proprietary tools."
"The most valuable feature is Impala, the querying engine, which is very fast."
"Cloudera is a very manageable solution with good support."
"I don't see any performance issues."
"We also really like the Cloudera community. You can have any question and will have your answer within a few hours."
"We're now able to store large volumes of data through Cloudera Distribution for Hadoop. We're able to push large volumes of data to the platform, and that used to be a challenge, especially when storing a terabyte of information. This is the area where Cloudera Distribution for Hadoop improved the organization."
"Distributed computing, secure containerization, and governance capabilities are the most valuable features."
"Hortonworks should not be expensive at all to those looking into using it."
"Now, using this solution, it is much cheaper to have all of the data available for searching, not in real-time, but whenever there is a pending request."
"The Hortonworks solution is so stable. It is working as a production system, without any error, without any downtime. If I have downtime, it is mostly caused by the hardware of the computers."
"The data platform is pretty neat. The workflow is also really good."
"The upgrades and patches must come from Hortonworks."
"The product offers a fairly easy setup process."
"We use it for data science activities."
"The graphical user interface (UI) could be a bit more clear. It's very hard to figure out the execution logs and understand how long it takes to send everything. If an execution is lost, it's not so easy to understand why or where it went. I have to manually drill down on the data processes which takes a lot of time. Maybe there could be like a metrics monitor, or maybe the whole log analysis could be improved to make it easier to understand and navigate."
"It should support more programming languages."
"The migration of data between different versions could be improved."
"The solution’s integration with other platforms should be improved."
"The initial setup was not easy."
"Stream processing needs to be developed more in Spark. I have used Flink previously. Flink is better than Spark at stream processing."
"Include more machine learning algorithms and the ability to handle streaming of data versus micro batch processing."
"The management tools could use improvement. Some of the debugging tools need some work as well. They need to be more descriptive."
"The areas of improvement depend on the scale of the project. For banking customers, security features and an essential budget for commercial licenses would be the top priority. Data regulation could be the most crucial for a project with extensive data or an extra use case."
"The procedure for operations could be simplified."
"Cloudera Distribution for Hadoop is not always completely stable in some cases, which can be a concern for big data solutions."
"The tool's ability to be deployed on a cloud model is an area of concern where improvements are required."
"Without the big data environment, we cannot store all of this data live. We have billions of records and terabytes of storage to be used. It's not an option actually for us to have a big data environment."
"Cloudera's support is extremely bad and cannot be relied on."
"Currently, we are using many other tools such as Spark and Blade Job to improve the performance."
"There is a maximum of a one-gigabyte block size, which is an area of storage that can be improved upon."
"Deleting any service requires a lot of clean up, unlike Cloudera."
"I work a lot with banking, IT and communications customers. Hortonworks must improve or must upgrade their services for these sectors."
"I would like to see more support for containers such as Docker and OpenShift."
"It's at end of life and no longer will there be improvements."
"Hive performance. If Hive performance increased, Hadoop would replace (not everywhere) traditional databases."
"Security and workload management need improvement."
"It would also be nice if there were less coding involved."
"More information could be there to simplify the process of running the product."
More Cloudera Distribution for Hadoop Pricing and Cost Advice →
