What are the main components of Hadoop?

2 years ago
Isabella Edwards
1 minute

The main components of Hadoop are:

  1. Hadoop Distributed File System (HDFS) is designed for storing large-scale datasets, providing high reliability, availability, and fault tolerance.
  2. Hadoop MapReduce is a distributed computing framework used to parallel process large datasets. It breaks tasks into multiple sub-tasks and leverages multiple computing nodes in the cluster to execute these tasks concurrently.
  3. YARN (Yet Another Resource Negotiator): Hadoop’s cluster resource manager responsible for scheduling resources and coordinating tasks within the cluster. YARN allocates cluster resources as containers and provides them to applications.
  4. Hadoop Common: The shared library and toolkit for Hadoop, which provides the essential functionality for processing Hadoop file systems and executing MapReduce tasks.

In addition to these core components, Hadoop also includes other related tools and components such as Hive, Pig, HBase, etc., which can integrate with Hadoop to enhance its functionality.

bannerAds