Altiscale [EOL] vs Amazon EMR vs Apache Spark comparison

Liberate your data, by making it possible for any data analyst in your company to access and rapidly analyze data in the Hadoop data lake, without burdening your IT team. The Altiscale Insight Cloud handles both real-time and batch analytics, and connects easily to your favorite BI solutions.

Spark provides programmers with an application programming interface centered on a data structure called the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. It was developed in response to limitations in the MapReduce cluster computing paradigm, which forces a particular linear dataflowstructure on distributed programs: MapReduce programs read input data from disk, map a function across the data, reduce the results of the map, and store reduction results on disk. Spark's RDDs function as a working set for distributed programs that offers a (deliberately) restricted form of distributed shared memory