Published Articles >> Table of Contents >> Abstract

Third IEEE International Conference on Data Mining (ICDM'03)   p. 489
Mining Relevant Text from Unlabelled Documents
Daniel Barbara, George Mason University, Fairfax, VA
Carlotta Domeniconi, George Mason University, Fairfax, VA
Ning Kang, George Mason University, Fairfax, VA

Full Article Text:

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ICDM.2003.1250959
Send link to a friend

Abstract
Automatic classification of documents is an important area of research with many applications in the fields of document searching, forensics and others. Methods to perform classification of text rely on the existence of a sample of documents whose class labels are known. However, in many situations, obtaining this sample may not be an easy (or even possible) task. In this paper we focus on the classification of unlabelled documents into two classes: relevant and irrelevant, given a topic of interest. By dividing the set of documents into buckets (for instance, answers returned by different search engines), and using association rule mining to find common sets of words among the buckets, we can efficiently obtain a sample of documents that has a large percentage of relevant ones. This sample can be used to train models to classify the entire set of documents. We prove, via experimentation, that our method is capable of filtering relevant documents even in adverse conditions where the percentage of irrelevant documents in the buckets is relatively high.
Back to Top Additional Information
Citation:  Daniel Barbara, Carlotta Domeniconi, Ning Kang, "Mining Relevant Text from Unlabelled Documents," icdm, p. 489,  Third IEEE International Conference on Data Mining (ICDM'03),  2003