"The memory processing engine is the solution's most valuable aspect. It processes everything extremely fast, and it's in the cluster itself. It acts as a memory engine and is very effective in processing data correctly."
"One of the key features is that Apache Spark is a distributed computing framework. You can help multiple slaves and distribute the workload between them."
"Spark helps us reduce startup time for our customers and gives a very high ROI in the medium term."
"The solution has been very stable."
"Apache Spark can do large volume interactive data analysis."
"AI libraries are the most valuable. They provide extensibility and usability. Spark has a lot of connectors, which is a very important and useful feature for AI. You need to connect a lot of points for AI, and you have to get data from those systems. Connectors are very wide in Spark. With a Spark cluster, you can get fast results, especially for AI."
"Its scalability and speed are very valuable. You can scale it a lot. It is a great technology for big data. It is definitely better than a lot of earlier warehouse or pipeline solutions, such as Informatica. Spark SQL is very compliant with normal SQL that we have been using over the years. This makes it easy to code in Spark. It is just like using normal SQL. You can use the APIs of Spark or you can directly write SQL code and run it. This is something that I feel is useful in Spark."
"Spark can handle small to huge data and is suitable for any size of company."
"The main features of this solution are the ability to integrate multiple AWS applications or external applications very quickly and organize all of them. Additionally, it is easy to use and you can run various programming languages, such as Python, Go, and Java."
"Amazon takes care of the scalability. That's the right way. It's automatic and it's fully managed. That's one benefit of Lambda."
"I have found all of the features valuable. It's an easy and cheap solution."
"The installation and configuration of the solution is straightforward."
"It is my preferred product, as it provides me with source code within the solution."
"It's a fairly easy solution to learn."
"We have no issues with the technical support."
"Because AWS Lambda is serverless, server configuration is not required, and we can run it directly anywhere."
"Its UI can be better. Maintaining the history server is a little cumbersome, and it should be improved. I had issues while looking at the historical tags, which sometimes created problems. You have to separately create a history server and run it. Such things can be made easier. Instead of separately installing the history server, it can be made a part of the whole setup so that whenever you set it up, it becomes available."
"Spark could be improved by adding support for other open-source storage layers than Delta Lake."
"Apache Spark could improve the connectors that it supports. There are a lot of open-source databases in the market. For example, cloud databases, such as Redshift, Snowflake, and Synapse. Apache Spark should have connectors present to connect to these databases. There are a lot of workarounds required to connect to those databases, but it should have inbuilt connectors."
"The logging for the observability platform could be better."
"We are building our own queries on Spark, and it can be improved in terms of query handling."
"Stream processing needs to be developed more in Spark. I have used Flink previously. Flink is better than Spark at stream processing."
"The initial setup was not easy."
"The graphical user interface (UI) could be a bit more clear. It's very hard to figure out the execution logs and understand how long it takes to send everything. If an execution is lost, it's not so easy to understand why or where it went. I have to manually drill down on the data processes which takes a lot of time. Maybe there could be like a metrics monitor, or maybe the whole log analysis could be improved to make it easier to understand and navigate."
"Its price should be improved. Its pricing is on the higher side. I am not sure if it currently supports the Go language. If it doesn't support the Go language, they can introduce it."
"We'd love to see more integration potential in the future."
"The user-friendliness of the solution could be improved."
"I wish to see better execution time in the next release."
"We need to better understand Lambda for different scenarios. We need some joint effort between Amazon and the users to have the users identify how they can really leverage Lambda. It's not about Lambda itself; it's about the practice, the guidance. There needs to be very good documentation. From the user perspective, what exists now is not always enough."
"Amazon doesn't have enough local support based in our country."
"Its performance can be improved. There should also be more dynamic security permissions."
"AWS Lambda could improve by having no-code or low-code options because currently, you need to be able to write code well to use it."
Apache Spark is ranked 2nd in Compute Service with 11 reviews while AWS Lambda is ranked 1st in Compute Service with 25 reviews. Apache Spark is rated 8.0, while AWS Lambda is rated 8.4. The top reviewer of Apache Spark writes "Provides fast aggregations, AI libraries, and a lot of connectors". On the other hand, the top reviewer of AWS Lambda writes "Programming is getting much easier and does not need a lot of configuration ". Apache Spark is most compared with Spring Boot, Azure Stream Analytics, AWS Batch, SAP HANA and Apache NiFi, whereas AWS Lambda is most compared with AWS Batch, Apache NiFi, Amazon EC2 Auto Scaling, Azure Stream Analytics and Amazon EC2. See our AWS Lambda vs. Apache Spark report.
See our list of best Compute Service vendors.
We monitor all Compute Service reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
