LRD: latent relation discovery for vector space expansion and information retrieval.
Goncalves, Alexandre L.
MetadataShow full item record
In this paper, we propose a text mining method called LRD (latent relation discovery), which extends the traditional vector space model of docu-ment representation in order to improve information retrieval (IR) on docu-ments and document clustering. Our LRD method extracts terms and entities, such as person, organization, or project names, and discovers relationships be-tween them by taking into account their co-occurrence in textual corpora. Given a target entity, LRD discovers other entities closely related to the target effectively and efficiently. With respect to such relatedness, a measure of rela-tion strength between entities is defined. LRD uses relation strength to enhance the vector space model, and uses the enhanced vector space model for query based IR on documents and clustering documents in order to discover complex relationships among terms and entities. Our experiments on a standard dataset for query based IR shows that our LRD method performed significantly better than traditional vector space model and other five standard statistical methods for vector expansion.