• français
    • English
  • English 
    • français
    • English
  • Login
JavaScript is disabled for your browser. Some features of this site may not work without it.
BIRD Home

Browse

This CollectionBy Issue DateAuthorsTitlesSubjectsJournals BIRDResearch centres & CollectionsBy Issue DateAuthorsTitlesSubjectsJournals

My Account

Login

Statistics

View Usage Statistics

AS-Index: A Structure For String Search Using n-grams and Algebraic Signatures

Thumbnail
Date
2016
Link to item file
https://hal.archives-ouvertes.fr/hal-01126550
Dewey
Organisation des données
Sujet
Full text indexing; Large scale indexing; Algebraic signatures; Signatures algébriques; Indexation de grande échelle; L'indexation de texte intégral
Journal issue
Journal of Computer Science and Technology
Volume
31
Number
1
Publication date
01-2016
Article pages
147–166
DOI
http://dx.doi.org/10.1007/s11390-016-1618-6
URI
https://basepub.dauphine.fr/handle/123456789/20784
Collections
  • LAMSADE : Publications
Metadata
Show full item record
Author
Constantin, Camelia
du Mouza, Cedric
Litwin, Witold
989 Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Rigaux, Philippe
Schwarz, Thomas
Type
Article accepté pour publication ou publié
Abstract (EN)
We present the AS-Index, a new index structure for exact string search in disk resident databases. AS-Index relies on a classical inverted file structure, whose main innovation is a probabilistic search based on the properties of algebraic signatures used for both n-grams hashing and pattern search. Specifically, the properties of our signatures allow to carry out a search by inspecting only two of the posting lists. The algorithm thus enjoys the unique feature of requiring a constant number of disk accesses, independently from both the pattern size and the database size. We conduct extensive experiments on large datasets to evaluate our index behavior. They confirm that it steadily provides a search performance proportional to the two disk accesses necessary to obtain the posting lists. This makes our structure a choice of interest for the class of applications that require very fast lookups in large textual databases. We describe the index structure, our use of algebraic signatures, and the search algorithm. We discuss the operational trade-offs based on the parameters that affect the behavior of our structure, and present the theoretical and experimental performance analysis. We next compare the AS-Index with the state-of-the-art alternatives and show that 1) its construction time matches that of its competitors, due to the similarity of structures, 2) as for search time, it constantly outperforms the standard approach, thanks to the economical access to data complemented by signature calculations, which is at the core of our search method.

  • Accueil Bibliothèque
  • Site de l'Université Paris-Dauphine
  • Contact
SCD Paris Dauphine - Place du Maréchal de Lattre de Tassigny 75775 Paris Cedex 16

 Content on this site is licensed under a Creative Commons 2.0 France (CC BY-NC-ND 2.0) license.