A cost model for random access queries in document stores

Document stores have become one of the key NoSQL storage solutions. They have been widely adopted in different domains due to their ability to store semi-structured data and expressive query capabilities. However, implementations differ in terms of concrete data storage and retrieval. Unfortunately,...

ver descrição completa

Detalhes bibliográficos
Autores: Hewasinghage, Moditha Lakshan Dharmasir, Abelló Gamazo, Alberto|||0000-0002-3223-2186, Varga, Jovan|||0000-0003-3773-3382, Zimányi, Esteban
Formato: artículo
Fecha de publicación:2021
País:España
Recursos:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/346433
Acesso em linha:https://hdl.handle.net/2117/346433
https://dx.doi.org/10.1007/s00778-021-00660-x
Access Level:acceso abierto
Palavra-chave:Memory management (Computer science)
Metadata
Information storage and retrieval systems
Document stores
Cost model
Query
NoSQL
Gestió de memòria (Informàtica)
Metadades
Informació -- Sistemes d'emmagatzematge i recuperació
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
id ES_cd971deda47f82f15381317fec3a04ec
oai_identifier_str oai:upcommons.upc.edu:2117/346433
network_acronym_str ES
network_name_str España
repository_id_str
spelling A cost model for random access queries in document storesHewasinghage, Moditha Lakshan DharmasirAbelló Gamazo, Alberto|||0000-0002-3223-2186Varga, Jovan|||0000-0003-3773-3382Zimányi, EstebanMemory management (Computer science)MetadataInformation storage and retrieval systemsDocument storesCost modelQueryNoSQLGestió de memòria (Informàtica)MetadadesInformació -- Sistemes d'emmagatzematge i recuperacióÀrees temàtiques de la UPC::Informàtica::Sistemes d'informacióDocument stores have become one of the key NoSQL storage solutions. They have been widely adopted in different domains due to their ability to store semi-structured data and expressive query capabilities. However, implementations differ in terms of concrete data storage and retrieval. Unfortunately, a standard framework for data and query optimization for document stores is nonexistent, and only implementation-specific design and query guidelines are used. Hence, the goal of this work is to aid automating the data design for document stores based on query costs instead of generic design rules. For this, we define a generic storage and query cost model based on disk access and memory allocation that allows estimating the impact of design decisions. Since all document stores carry out data operations in memory, we first estimate the memory usage by considering characteristics of the stored documents, their access patterns, and memory management algorithms. Then, using this estimation and metadata storage size, we introduce a cost model for random access queries. We validate our work on two well-known document store implementations: MongoDB and Couchbase. The results show that the memory usage estimates have the average precision of 91% and predicted costs are highly correlated to the actual execution times. During this work, we have managed to suggest several improvements to document storage systems. Thus, this cost model also contributes to identifying discordance between document store implementations and their theoretical expectations.This research has been funded by the European Commission through the Erasmus Mundus Joint Doctorate Information Technologies for Business Intelligence- Doctoral College (IT4BI-DC)Peer Reviewed20212021-07-0120212021-05-31journal articlehttp://purl.org/coar/resource_type/c_6501AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/2117/346433https://dx.doi.org/10.1007/s00778-021-00660-xreponame:UPCommons. Portal del coneixement obert de la UPCinstname:Universitat Politècnica de Catalunya (UPC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:upcommons.upc.edu:2117/3464332026-05-27T15:37:01Z
dc.title.none.fl_str_mv A cost model for random access queries in document stores
title A cost model for random access queries in document stores
spellingShingle A cost model for random access queries in document stores
Hewasinghage, Moditha Lakshan Dharmasir
Memory management (Computer science)
Metadata
Information storage and retrieval systems
Document stores
Cost model
Query
NoSQL
Gestió de memòria (Informàtica)
Metadades
Informació -- Sistemes d'emmagatzematge i recuperació
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
title_short A cost model for random access queries in document stores
title_full A cost model for random access queries in document stores
title_fullStr A cost model for random access queries in document stores
title_full_unstemmed A cost model for random access queries in document stores
title_sort A cost model for random access queries in document stores
dc.creator.none.fl_str_mv Hewasinghage, Moditha Lakshan Dharmasir
Abelló Gamazo, Alberto|||0000-0002-3223-2186
Varga, Jovan|||0000-0003-3773-3382
Zimányi, Esteban
author Hewasinghage, Moditha Lakshan Dharmasir
author_facet Hewasinghage, Moditha Lakshan Dharmasir
Abelló Gamazo, Alberto|||0000-0002-3223-2186
Varga, Jovan|||0000-0003-3773-3382
Zimányi, Esteban
author_role author
author2 Abelló Gamazo, Alberto|||0000-0002-3223-2186
Varga, Jovan|||0000-0003-3773-3382
Zimányi, Esteban
author2_role author
author
author
dc.subject.none.fl_str_mv Memory management (Computer science)
Metadata
Information storage and retrieval systems
Document stores
Cost model
Query
NoSQL
Gestió de memòria (Informàtica)
Metadades
Informació -- Sistemes d'emmagatzematge i recuperació
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
topic Memory management (Computer science)
Metadata
Information storage and retrieval systems
Document stores
Cost model
Query
NoSQL
Gestió de memòria (Informàtica)
Metadades
Informació -- Sistemes d'emmagatzematge i recuperació
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
description Document stores have become one of the key NoSQL storage solutions. They have been widely adopted in different domains due to their ability to store semi-structured data and expressive query capabilities. However, implementations differ in terms of concrete data storage and retrieval. Unfortunately, a standard framework for data and query optimization for document stores is nonexistent, and only implementation-specific design and query guidelines are used. Hence, the goal of this work is to aid automating the data design for document stores based on query costs instead of generic design rules. For this, we define a generic storage and query cost model based on disk access and memory allocation that allows estimating the impact of design decisions. Since all document stores carry out data operations in memory, we first estimate the memory usage by considering characteristics of the stored documents, their access patterns, and memory management algorithms. Then, using this estimation and metadata storage size, we introduce a cost model for random access queries. We validate our work on two well-known document store implementations: MongoDB and Couchbase. The results show that the memory usage estimates have the average precision of 91% and predicted costs are highly correlated to the actual execution times. During this work, we have managed to suggest several improvements to document storage systems. Thus, this cost model also contributes to identifying discordance between document store implementations and their theoretical expectations.
publishDate 2021
dc.date.none.fl_str_mv 2021
2021-07-01
2021
2021-05-31
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
AM
http://purl.org/coar/version/c_ab4af688f83e57aa
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/2117/346433
https://dx.doi.org/10.1007/s00778-021-00660-x
url https://hdl.handle.net/2117/346433
https://dx.doi.org/10.1007/s00778-021-00660-x
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:UPCommons. Portal del coneixement obert de la UPC
instname:Universitat Politècnica de Catalunya (UPC)
instname_str Universitat Politècnica de Catalunya (UPC)
reponame_str UPCommons. Portal del coneixement obert de la UPC
collection UPCommons. Portal del coneixement obert de la UPC
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869419868558721024
score 15,301629

Registos relacionados