Thumbnail - Request a copy

Improved deduplication through parallel binning

Zhang, Zhike; Bhagwat, Deepavali; Litwin, Witold; Long, Darrell; Schwarz, Thomas (2012), Improved deduplication through parallel binning, 2012 IEEE 31st International Performance Computing and Communications Conference (IPCCC), proceedings, IEEE, p. 130-141. 10.1109/PCCC.2012.6407746

Type
Communication / Conférence
Date
2012
Conference title
2012 IEEE 31st International Performance Computing and Communications Conference (IPCCC)
Conference date
2012-12
Conference city
Austin
Conference country
United States
Book title
2012 IEEE 31st International Performance Computing and Communications Conference (IPCCC), proceedings
Publisher
IEEE
ISBN
978-1-4673-4881-2
Pages
130-141
Publication identifier
Metadata
Show full item record
Author(s)
Zhang, Zhike

Bhagwat, Deepavali

Litwin, Witold
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Long, Darrell

Schwarz, Thomas
Abstract (EN)
Many modern storage systems use deduplication in order to compress data by avoiding storing the same data twice. Deduplication needs to use data stored in the past, but accessing information about all data stored can cause a severe bottleneck. Similarity based deduplication only accesses information on past data that is likely to be similar and thus more likely to yield good deduplication. We present an adaptive deduplication strategy that extends Extreme Binning and investigate theoretically and experimentally the effects of the additional bin accesses.
Subjects / Keywords
deduplication optimization