array

Compressing Intermediate Keys between Mappers and Reducers in SciHadoop

In Hadoop mappers send data to reducers in the form of key/value pairs. The default design of Hadoop's process for transmitting this intermediate data can cause a very high overhead, especially for scientific data containing multiple variables in a …