Managing polyglot systems metadata with hypergraphs

A single type of data store can hardly fulfill every end-user requirements in the NoSQL world. Therefore, polyglot systems use different types of NoSQL datastores in combination. However, the heterogeneity of the data storage models makes managing the metadata a complex task in such systems, with on...

Descripción completa

Detalles Bibliográficos
Autores: Hewasinghage, Moditha Lakshan Dharmasir, Abelló Gamazo, Alberto|||0000-0002-3223-2186, Varga, Jovan|||0000-0003-3773-3382, Zimányi, Esteban
Tipo de recurso: artículo
Fecha de publicación:2021
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/346432
Acceso en línea:https://hdl.handle.net/2117/346432
https://dx.doi.org/10.1016/j.datak.2021.101896
Access Level:acceso abierto
Palabra clave:Metadata
Graph theory
Metadata management
NoSQL
Polystore
Metadades
Grafs, Teoria de
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
id ES_3f816a62b79216be430b0ac6df90c260
oai_identifier_str oai:upcommons.upc.edu:2117/346432
network_acronym_str ES
network_name_str España
repository_id_str
spelling Managing polyglot systems metadata with hypergraphsHewasinghage, Moditha Lakshan DharmasirAbelló Gamazo, Alberto|||0000-0002-3223-2186Varga, Jovan|||0000-0003-3773-3382Zimányi, EstebanMetadataGraph theoryMetadata managementNoSQLPolystoreMetadadesGrafs, Teoria deÀrees temàtiques de la UPC::Informàtica::Sistemes d'informacióA single type of data store can hardly fulfill every end-user requirements in the NoSQL world. Therefore, polyglot systems use different types of NoSQL datastores in combination. However, the heterogeneity of the data storage models makes managing the metadata a complex task in such systems, with only a handful of research carried out to address this. In this paper, we propose a hypergraph-based approach for representing the catalog of metadata in a polyglot system. Taking an existing common programming interface to NoSQL systems, we extend and formalize it as hypergraphs. Then, we define design constraints and query transformation rules for three representative data store types. Next, we propose a simple query rewriting algorithm from the metadata of the catalog to underlying data store specific ones and provide a prototype implementation. Furthermore, we introduce a storage statistics estimator on the underlying data stores. Finally, we show the feasibility of our approach on a use case of an existing polyglot system, and its usefulness in metadata and physical query path calculations.This research has been funded by the European Commission, Spain through the Erasmus Mundus Joint Doctorate ‘‘Information Technologies for Business Intelligence - Doctoral College" (IT4BI-DC).Peer ReviewedElsevier20212021-07-0120212021-05-31journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/2117/346432https://dx.doi.org/10.1016/j.datak.2021.101896reponame:UPCommons. Portal del coneixement obert de la UPCinstname:Universitat Politècnica de Catalunya (UPC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2Attribution-NonCommercial-NoDerivatives 4.0 Internationalhttps://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessoai:upcommons.upc.edu:2117/3464322026-05-27T15:37:01Z
dc.title.none.fl_str_mv Managing polyglot systems metadata with hypergraphs
title Managing polyglot systems metadata with hypergraphs
spellingShingle Managing polyglot systems metadata with hypergraphs
Hewasinghage, Moditha Lakshan Dharmasir
Metadata
Graph theory
Metadata management
NoSQL
Polystore
Metadades
Grafs, Teoria de
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
title_short Managing polyglot systems metadata with hypergraphs
title_full Managing polyglot systems metadata with hypergraphs
title_fullStr Managing polyglot systems metadata with hypergraphs
title_full_unstemmed Managing polyglot systems metadata with hypergraphs
title_sort Managing polyglot systems metadata with hypergraphs
dc.creator.none.fl_str_mv Hewasinghage, Moditha Lakshan Dharmasir
Abelló Gamazo, Alberto|||0000-0002-3223-2186
Varga, Jovan|||0000-0003-3773-3382
Zimányi, Esteban
author Hewasinghage, Moditha Lakshan Dharmasir
author_facet Hewasinghage, Moditha Lakshan Dharmasir
Abelló Gamazo, Alberto|||0000-0002-3223-2186
Varga, Jovan|||0000-0003-3773-3382
Zimányi, Esteban
author_role author
author2 Abelló Gamazo, Alberto|||0000-0002-3223-2186
Varga, Jovan|||0000-0003-3773-3382
Zimányi, Esteban
author2_role author
author
author
dc.subject.none.fl_str_mv Metadata
Graph theory
Metadata management
NoSQL
Polystore
Metadades
Grafs, Teoria de
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
topic Metadata
Graph theory
Metadata management
NoSQL
Polystore
Metadades
Grafs, Teoria de
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
description A single type of data store can hardly fulfill every end-user requirements in the NoSQL world. Therefore, polyglot systems use different types of NoSQL datastores in combination. However, the heterogeneity of the data storage models makes managing the metadata a complex task in such systems, with only a handful of research carried out to address this. In this paper, we propose a hypergraph-based approach for representing the catalog of metadata in a polyglot system. Taking an existing common programming interface to NoSQL systems, we extend and formalize it as hypergraphs. Then, we define design constraints and query transformation rules for three representative data store types. Next, we propose a simple query rewriting algorithm from the metadata of the catalog to underlying data store specific ones and provide a prototype implementation. Furthermore, we introduce a storage statistics estimator on the underlying data stores. Finally, we show the feasibility of our approach on a use case of an existing polyglot system, and its usefulness in metadata and physical query path calculations.
publishDate 2021
dc.date.none.fl_str_mv 2021
2021-07-01
2021
2021-05-31
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/2117/346432
https://dx.doi.org/10.1016/j.datak.2021.101896
url https://hdl.handle.net/2117/346432
https://dx.doi.org/10.1016/j.datak.2021.101896
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution-NonCommercial-NoDerivatives 4.0 International
https://creativecommons.org/licenses/by-nc-nd/4.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution-NonCommercial-NoDerivatives 4.0 International
https://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:UPCommons. Portal del coneixement obert de la UPC
instname:Universitat Politècnica de Catalunya (UPC)
instname_str Universitat Politècnica de Catalunya (UPC)
reponame_str UPCommons. Portal del coneixement obert de la UPC
collection UPCommons. Portal del coneixement obert de la UPC
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869406645044379648
score 15.301629

Similares en LA Referencia