mirror of
https://github.com/jackyzha0/quartz.git
synced 2026-03-23 22:45:41 -05:00
656 B
656 B
Systems based on MapReduce
Early generation frameworks for big data processing.
Systems that replace MapReduce
newer, faster frameworks with different architectures and performance improvements.
Motivation: MapReduce and Apache Hive are too slow!
- Google Dremel
- Apache Spark
- Replaces MapReduce with its own engine that works much faster without compromising consistency
- Architecture not based on Map-reduce but rather on two concepts:
- RDD (Resilient Distributed Dataset)
- DAG (Directed Acyclic Graph)
- Pro’s:
- Works much faster than MapReduce;
- fast growing community.