HAT: an efficient buffer management method for flash-based hybrid storage systems

Abstract

Flash solid-state drives (SSDs) provide much faster access to data compared with traditional hard disk drives (HDDs). The current price and performance of SSD suggest it can be adopted as a data buffer between main memory and HDD, and buffer management policy in such hybrid systems has attracted more and more interest from research community recently. In this paper, we propose a novel approach to manage the buffer in flash-based hybrid storage systems, named hotness aware hit (HAT). HAT exploits a page reference queue to record the access history as well as the status of accessed pages, i.e., hot, warm, and cold. Additionally, the page reference queue is further split into hot and warm regions which correspond to the memory and flash in general. The HAT approach updates the page status and deals with the page migration in the memory hierarchy according to the current page status and hit position in the page reference queue. Compared with the existing hybrid storage approaches, the proposed HAT can manage the memory and flash cache layers more effectively. Our empirical evaluation on benchmark traces demonstrates the superiority of the proposed strategy against the state-of-the-art competitors.

Keywords

flash memory / SSD / hybrid storage / buffer management / hotness aware

References

[1] LaPedus M. SSDs: still not a “Solid State” Business. Electronic Engineering Times. 2010

[2] Momentus XT Solid State Hybrid Drives.

[3]

[4] Oracle. Deploying hybrid storage pools with Oracle flash technology and the Oracle Solaris ZFS file system. OracleWhite Paper, 2011, 1−17

[5] Ou Y, Härder T. Trading memory for performance and energy. In: Proceedings of the 2011 Database Systems for Advanced Applications Workshops. 2011, 241−253

[6] Wu X, Reddy A L N. Managing storage space in a flash and disk hybrid storage system. In: Proceedings of the 17th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. 2009, 1−4

[7] Canim M, Mihaila G A, Bhattacharjee B, Ross K A, Lang C A. SSD bufferpool extensions for database systems. The Proceedings of the Very Large Database Endowment, 2010, 3(2): 1435−1446

[8] Do J, Zhang D, Patel J M, DeWitt D J, Naughton J F, Halverson A. Turbocharging DBMS buffer pool using SSDs. In: Proceedings of the 2011 Special Interest Group on Management of Data Conference. 2011, 1113−1124

[9] Kang W H, Lee S W, Moon B. Flash-based extended cache for higher throughput and faster recovery. The Proceedings of the Very Large Database Endowment, 2012, 5(11): 1615−1626

[10] Lv Y, Cui B, Chen X, Li J. Hotness-aware buffer management for flashbased hybrid storage systems. In: Proceedings of the 22nd ACM International Conference on Conference on Information and Knowledge Management. 2013, 1631−1636

[11] Bouganim L, Jónsson B T, Bonnet P. uFLIP: Understanding flash IO patterns. In: Proceedings of the 4th Biennial Conference on Innovative Data Systems Research. 2009, 1−12

[12] Chen F, Koufaty D A, Zhang X. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In: Proceedings of the 11th International Joint Conference Of SIGMETRICS and Performance on Measurement and Modeling of Computer Systems. 2009, 181−192

[13] Agrawal N, Prabhakaran V, Wobber T, Davis J D, Manasse M S, Panigrahy R. Design tradeoffs for SSD performance. In: Proceedings of the 2008 USENIX Annual Technical Conference. 2008, 57−70

[14] Cho j H, Shin D, Eom Y I. Kast: K-associative sector translation for NAND flash memory in real-time systems. In: Proceedings of the 2009 Conference on Design, Automation and Test in Europe. 2009, 507−512

[15] Gupta A, Kim Y, Urgaonkar B. DFTL: a flash translation layer employing demand-based selective caching of page-level address mappings. In: Proceedings of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems. 2009, 229−240

[16] Bisson T, Brandt S A, Long D D E. A hybrid disk-aware spin-down algorithm with I/O subsystem support. In: Proceedings of the 26th IEEE International Performance Computing and Communications Conference. 2007, 236−245

[17] Koltsidas I, Viglas S. Flashing up the storage layer. The Proceedings of the Very Large Database Endowment, 2008, 1(1): 514−525

[18] Wu X, Reddy A L N. Exploiting concurrency to improve latency and throughput in a hybrid storage system. In: Proceedings of the 18th IEEE/ACMInternational Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. 2010, 14−23

[19] Canim M, Bhattacharjee B, Mihaila G A, Lang C A, Ross K A. An object placement advisor for DB2 using solid state storage. The Proceed-ings of the Very Large Database Endowment, 2009, 2(2): 1318−1329

[20] Chen S. Flashlogging: exploiting flash devices for synchronous logging performance. In: Proceedings of the 2009 Special Interest Group on Management of Data Conference. 2009, 73−86

[21] Debnath B K, Sengupta S, Li J. Flashstore: high throughput persistent key-value store. The Proceedings of the Very Large Database Endowment, 2010, 3(2): 1414−1425

[22] Debnath B K, Sengupta S, Li J. Skimpystash: Ram space skimpy keyvalue store on flash-based storage. In: Proceedings of the 2011 Special Interest Group on Management of Data Conference. 2011, 25−36

[23] Zhou Y, Chen Z, Li K. Second-level buffer cache management. IEEE Transactions on Parallel and Distributed System, 2004, 15(6): 505−519

[24] Luo T, Lee R, Mesnier M P, Chen F, Zhang X. HStorage-DB: heterogeneity-aware data management to exploit the full capability of hybrid storage systems. The Proceedings of the Very Large Database Endowment, 2012, 5(10): 1076−1087

[25] Jin P, Ou Y, Häoder T, Li Z. AD-LRU: an efflcient buffer replacement algorithm for flash-based databases. Data & Knowledge Engineering, 2012, 83−102

[26] Li Z, Jin P, Su X, Cui K, Yue L. CCF-LRU: a new buffer replacement algorithm for flashmemory. IEEE Transactions on Consumer Electronics, 2009, 55(3): 1351−1359

[27] Johnson T, Shasha D. 2Q: a low overhead high performance buffer management replacement algorithm. In: Proceedings of the 20th International Conference on Very Large Data Bases. 1994, 439−450

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag Berlin Heidelberg