mirror of
https://github.com/jackyzha0/quartz.git
synced 2025-12-23 21:04:07 -06:00
656 B
656 B
Systems based on MapReduce
Early generation frameworks for big data processing.
Systems that replace MapReduce
newer, faster frameworks with different architectures and performance improvements.
Motivation: MapReduce and Apache Hive are too slow!
- Google Dremel
- Apache Spark
- Replaces MapReduce with its own engine that works much faster without compromising consistency
- Architecture not based on Map-reduce but rather on two concepts:
- RDD (Resilient Distributed Dataset)
- DAG (Directed Acyclic Graph)
- Pro’s:
- Works much faster than MapReduce;
- fast growing community.