Search:
Computing and Library Services - delivering an inspiring information environment

An Efficient Framework of Utilizing the Latent Semantic Analysis in Text Extraction

Ababneh, Ahmad, Joan, Lu and Qiang, Xu (2019) An Efficient Framework of Utilizing the Latent Semantic Analysis in Text Extraction. An Efficient Framework of Utilizing the Latent Semantic Analysis in Text Extraction, 22 (3). pp. 785-815. ISSN 1381-2416

Metadata only available from this repository.

Abstract

The use of the latent semantic analysis (LSA) in text mining demands large space and time requirements. This paper proposes a new text extraction method that sets a framework on how to employ the statistical semantic analysis in the text extraction in an efficient way. The method uses the centrality feature and omits the segments of the text that have a high verbatim, statistical, or semantic similarity with previously processed segments. The identification of similarity is based on a new multi-layer similarity method that computes the similarity in three statistical layers, it uses the Jaccard similarity and the vector space model in the first and second layers respectively, and uses the LSA in the third layer. The multi-layer similarity restricts the use of the third layer for the segments that the first and second layers failed to estimate their similarities. Rouge tool is used in the evaluation, but because Rouge does not consider the extract’s size, we supplemented it with a new evaluation strategy based on the compression rate and the ratio of the sentences intersections between the automatic and the reference extracts. Our comparisons with classical LSA and traditional statistical extractions showed that we reduced the use of the LSA procedure by 52%, and we obtained 65% reduction on the original matrix dimensions, also, we obtained remarkable accuracy results. It is concluded that the employment of the centrality feature with the proposed multi-layer framework yields a significant solution in terms of efficiency and accuracy in the field of text extraction.

Item Type: Article
Subjects: Q Science > QA Mathematics > QA76 Computer software
Schools: School of Computing and Engineering
Depositing User: Ahmad Ababneh
Date Deposited: 19 Sep 2019 12:11
Last Modified: 19 Sep 2019 12:11
URI: http://eprints.hud.ac.uk/id/eprint/35013

Downloads

Downloads per month over past year

Repository Staff Only: item control page

View Item View Item

University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©