HDFS
Technology & Computing abbreviation · Data & Database
| Stands for | Hadoop Distributed File System |
|---|---|
| Categories | Technology & Computing |
HDFS stands for Hadoop Distributed File System, a data & database abbreviation.
The storage layer of Apache Hadoop, which splits large files into blocks, typically 128 MB, and replicates each block across several commodity servers for fault tolerance. It was the foundation of on-premises big-data clusters in the 2010s.
Example: Raw clickstream logs land in HDFS, and nightly Spark jobs aggregate them.
Usage notes
Modeled on Google's 2003 Google File System paper; Hadoop was created by Doug Cutting and Mike Cafarella and developed heavily at Yahoo. A NameNode tracks file metadata while DataNodes store the blocks, with three replicas by default. Cloud object storage such as Amazon S3 has largely replaced it for new projects.
Related abbreviations
More data & database abbreviations
- EDW – Enterprise data warehouse
- ELK – Elasticsearch, Logstash, Kibana
- ELT – Extract, load, transform
- ERD – Entity-relationship diagram
- ETL – Extract, transform, load
- FK – Foreign key
- JDBC – Java Database Connectivity
- KV – Key-value (store)
- MDM – Master data management
- MPP – Massively parallel processing
- MSSQL – Microsoft SQL Server
- MVCC – Multiversion concurrency control