Decomposition of term-document matrix representation for clustering analysis

Jianxiong Yang*, Junzo Watada

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    4 Citations (Scopus)


    Latent Semantic Indexing (LSI) is an information retrieval technique using a low-rank singular value decomposition (SVD) of term-document matrix. The aim of this method is to reduce the matrix dimension by finding a pattern in document collection with concurrently referring terms. The methods are implemented to calculate the weight of term-document in vector space model (VSM) for document clustering using fuzzy clustering algorithm. LSI is an attempt to exploit the underlying semantic structure of word usage in documents. During the query-matching phase of LSI, a user's query is first projected into the term-document space, and then compared to all terms and documents represented in the vector space. Using some similarity measure, the nearest (most relevant) terms and documents are identified and returned to the user. The current LSI query-matching method requires computing the similarity measure about the query of every term and document in the vector space. In this paper, the Maximal Tree Algorithm is used within a recent LSI implementation to mitigate the computational time and computational complexity of query matching. The Maximal Tree data structure stores the term and document vectors in such a way that only those terms and documents are most likely qualified as the nearest neighbor to the query will be examined and retrieved. In a word, this novel algorithm is suitable for improving the accuracy of data miners.

    Original languageEnglish
    Title of host publicationIEEE International Conference on Fuzzy Systems
    Number of pages8
    Publication statusPublished - 2011
    Event2011 IEEE International Conference on Fuzzy Systems, FUZZ 2011 - Taipei
    Duration: 2011 Jun 272011 Jun 30


    Other2011 IEEE International Conference on Fuzzy Systems, FUZZ 2011


    • data mining
    • Fuzzy clustering
    • LSI
    • SVD

    ASJC Scopus subject areas

    • Software
    • Artificial Intelligence
    • Applied Mathematics
    • Theoretical Computer Science


    Dive into the research topics of 'Decomposition of term-document matrix representation for clustering analysis'. Together they form a unique fingerprint.

    Cite this