Title: Hadoop Author: Kriko Published: Jun 15, 2023 Last modified: Jul 7, 2026 --- 1. [Home](https://kriko.io/) / 2. [Glossary](https://kriko.io/glossary) / 3. H Letter # Hadoop Hadoop is an open-source framework and ecosystem of software tools developed for processing and storing large volumes of data. Maintained by the Apache Software Foundation, it is designed to help organisations manage large and complex datasets efficiently. Effective big data management plays an important role in both the operational performance and long-term development of a business. Hadoop-based technologies allow valuable data to be processed and used in different ways. They also enable data-intensive workloads that require significant computing power to be managed simultaneously across distributed environments. The Hadoop ecosystem consists of several components used in data storage, processing and analysis. Its core components include: **Hadoop Distributed File System (HDFS):** HDFS is a distributed file system designed to store large datasets. Data is divided into smaller blocks and distributed across multiple nodes, providing high availability, scalability and fault tolerance. **MapReduce:** MapReduce is a distributed programming model used to process large datasets in parallel. It divides processing tasks across multiple nodes and consists of stages such as data splitting, mapping, shuffling and reducing. **YARN, or Yet Another Resource Negotiator:** YARN is responsible for managing computing resources and scheduling workloads within a Hadoop cluster. It enables different applications to run on the same cluster while ensuring that available resources are allocated efficiently. This makes it easier to monitor and manage workloads across the Hadoop environment. **Hadoop Common:** Hadoop Common provides the shared libraries, utilities and services required by the other Hadoop modules. It contains the core resources and tools needed to support distributed data processing. The origins of the Hadoop ecosystem can be traced back to research papers published by Google on distributed file systems and large-scale data processing. Hadoop was later developed at Yahoo! as a practical framework for managing web-scale data. Today, Hadoop is widely used in areas such as big data analytics, data warehousing, machine learning and artificial intelligence. Its open-source structure, scalability and support from a large global community have contributed significantly to its widespread adoption. ## Discover it in the dictionary ### Domain Name A domain name is the readable internet address that users type into a browser to reach a website. Examples include kriko.blog, google.com and example.com.… ### Risk Management Risk management is the process of identifying, assessing and controlling potential events that may prevent an organisation or individual from achieving their objectives. Risk… ### Deep Learning Deep learning is a form of machine learning that uses artificial neural networks to analyse complex data structures. Inspired by certain aspects of how… ### Data Monetization Data monetization is a business strategy that involves converting data into measurable economic value. Customer, operational, product and market data can be analysed to… ### Backlink A backlink, also known as an inbound link, is a link from one website to another website. When a site links to another page,… ### No-code No-code development is a software development approach that enables users to create applications and digital solutions without requiring traditional coding or programming skills. It… ### Seed Keyword A seed keyword is the basic word or phrase that forms the starting point of keyword research in SEO and content strategy. It describes… ### Pagination Pagination is a web design and development method used to divide long content, product listings, comments or data sets into multiple pages. This structure… ### Client-side Errors: 4xx 4xx status codes are the group of HTTP status codes that represent client-side error responses. When a user tries to access a web page… ## Track the digital heartbeat with Kriko Subscribe to receive curated insights, news, and ideas shaping the digital landscape. By checking this box, you acknowledge and accept our [privacy policy](https://kriko.io/privacy-policy).