Coming October 25: PeerSpot Awards will be announced! Learn more

Spark SQL Room for Improvement

Mahdi Sharifmousavi - PeerSpot reviewer
Lecturer at Amirkabir University of Technology

There are many inconsistencies in syntax for the different querying tasks like selecting columns and joining between two tables so I'd like to see a more consistent syntax. Notations should be unified for all tasks within Spark SQL. 

View full review »
AG
Engineering Manager/Solution architect at a computer software company with 201-500 employees

This solution could be improved by adding monitoring and integration for the EMR. 

View full review »
QG
Corporate Sales at a financial services firm with 10,001+ employees

Being a new user, I am not able to find out how to partition it correctly. I probably need more information or knowledge. In other database solutions, you can easily optimize all partitions. I haven't found a quicker way to do that in Spark SQL. It would be good if you don't need a partition here, and the system automatically partitions in the best way. They can also provide more educational resources for new users.

View full review »
Buyer's Guide
Hadoop
September 2022
Find out what your peers are saying about Apache, Informatica, VMware and others in Hadoop. Updated: September 2022.
632,539 professionals have used our research since 2012.
KG
Associate Manager at a consultancy with 501-1,000 employees

There should be better integration with other solutions.

View full review »
Buyer's Guide
Hadoop
September 2022
Find out what your peers are saying about Apache, Informatica, VMware and others in Hadoop. Updated: September 2022.
632,539 professionals have used our research since 2012.