Chisel: Reshaping Queries to Trim Latency in Key-Value Stores

Robert Birke, Juan F. Perez, Sonia Ben Mokhtar, Navaneeth Rameshan, Lydia Y. Chen

    Research output: Contribution to conferencePaper

    Abstract

    It is challenging for key-value data stores to trim user (tail) latency of requests as the workloads are observed to have skewed number of key-value pairs and commonly retrieved via multiget operation, i.e., all keys at the same time. In this paper we present Chisel, a novel client side solution to efficiently reshape the query size at the data store by adaptively splitting big requests into chunks to reap the benefits of parallelism and merge small requests into a single query to amortize latency overheads per request. We derive a novel layered queueing model that can quickly and approximately steer the decisions of Chisel. We extensively evaluate Chisel on memcached clusters hosted on a testbed, across a large number of scenarios with different workloads and system configurations. Our evaluation results show that Chisel can overturn the inherent high variability of requests into a judicious operational region, showcasing significant gains for the mean and 95th percentile of user perceived latency, compared to the state-of-art query processing policy.
    Original languageEnglish (US)
    Number of pages10
    DOIs
    StatePublished - Sep 13 2019
    Event2019 IEEE International Conference on Autonomic Computing (ICAC) - Umea, Switzerland
    Duration: Jun 16 2019Jun 20 2019
    https://ieeexplore.ieee.org/document/8831208

    Conference

    Conference2019 IEEE International Conference on Autonomic Computing (ICAC)
    Abbreviated title2019 IEEE
    CountrySwitzerland
    CityUmea
    Period6/16/196/20/19
    Internet address

    Cite this

    Birke, R., Perez, J. F., Mokhtar, S. B., Rameshan, N., & Chen, L. Y. (2019). Chisel: Reshaping Queries to Trim Latency in Key-Value Stores. Paper presented at 2019 IEEE International Conference on Autonomic Computing (ICAC), Umea, Switzerland. https://doi.org/10.1109/icac.2019.00016