mapreduce

SupMR: Circumventing Disk and Memory Bandwidth Bottlenecks for Scale-up MapReduce
Reading input from primary storage (i.e. the ingest phase) and aggregating results (i.e. the merge phase) are important pre- and …
PDF Cite
SIDR: Structure-Aware Intelligent Data Routing in Hadoop
The MapReduce framework is being extended for domains quite different from the web applications for which it was designed, including …
PDF Cite Project
Compressing Intermediate Keys between Mappers and Reducers in SciHadoop
In Hadoop mappers send data to reducers in the form of key/value pairs. The default design of Hadoop’s process for transmitting …
PDF Cite
SciHadoop Semantic Compression
PDF Cite
Structure-Aware Intelligent Data Routing in SciHadoop
PDF Cite
SciHadoop: Array-based Query Processing in Hadoop
Hadoop has become the de facto platform for large-scale data analysis in commercial applications, and increasingly so in scientific …
PDF Cite Project
Haceph: Scalable Metadata Management for Hadoop using Ceph
Cite
Ceph as a Scalable Alternative to the Hadoop Distributed File System
The Hadoop Distributed File System (HDFS) has a single metadata server that sets a hard limit on its maximum size. Ceph, a …
PDF Cite
Mixing Hadoop and HPC Workloads on Parallel Filesystems
MapReduce-tailored distributed filesystems—such as HDFS for Hadoop MapReduce—and parallel high-performance computing …
PDF Cite