Outlier detection by network flow
by Liu, Ying, Ph.D., THE UNIVERSITY OF ALABAMA AT BIRMINGHAM, 2007, 142 pages; 3301391

Abstract:

Outliers are those points which are different from or inconsistent with the rest of the data. Novel, new, abnormal, unusual or noisy information can all be called outliers. Sometimes the outliers are more interesting than the majority of the data, such as the applications of intrusion detection and unusual usage of credit cards. With the increase of the complexity and variety of datasets, the challenges of outlier detection are how to catch similar outliers as a group, and how to evaluate the outliers. The research described in this dissertation has investigated the above challenges and has addressed the solutions.

A novel method for outlier and outlier group identification which is based on network flow has been proposed in this dissertation. It uses the Maximum Flow Minimum Cut theorem from graph theory to find the outliers and strong outlier groups, and evaluate the outliers by outlier degrees. This algorithm uses k-nearest neighbors to find density connected points of the dataset. Data relationships are magnified to expose loosely connected outliers by the network settings. It can repair poor quality clusters generated by any clustering algorithm, in particular, to solve the problem that points supposed to be separated are in one cluster.

As part of the experimental evaluation, our algorithm has been compared with density-based, distribution-based, and conventional statistic outlier detection algorithms, and it is more effective at finding outlier groups. For high dimensional data, this algorithm is also effective at detecting outliers and outlier groups. The effectiveness of this algorithm is demonstrated by improving the query accuracy of content-based image retrieval.

 
AdviserAlan P. Sprague
SchoolTHE UNIVERSITY OF ALABAMA AT BIRMINGHAM
SourceDAI/B 69-02, p. , Jun 2008
Source TypeDissertation
SubjectsComputer science
Publication Number3301391
Adobe PDF Access the complete dissertation:
 

» Find an electronic copy at your library.
  Use the link below to access a full citation record of this graduate work:
  http://gateway.proquest.com/openurl%3furl_ver=Z39.88-2004%26res_dat=xri:pqdiss%26rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation%26rft_dat=xri:pqdiss:3301391
  If your library subscribes to the ProQuest Dissertations & Theses (PQDT) database, you may be entitled to a free electronic version of this graduate work. If not, you will have the option to purchase one, and access a 24 page preview for free (if available).

About ProQuest Dissertations & Theses
With over 2.3 million records, the ProQuest Dissertations & Theses (PQDT) database is the most comprehensive collection of dissertations and theses in the world. It is the database of record for graduate research.

The database includes citations of graduate works ranging from the first U.S. dissertation, accepted in 1861, to those accepted as recently as last semester. Of the 2.3 million graduate works included in the database, ProQuest offers more than 1.9 million in full text formats. Of those, over 860,000 are available in PDF format. More than 60,000 dissertations and theses are added to the database each year.

If you have questions, please feel free to visit the ProQuest Web site - http://www.proquest.com - or call ProQuest Hotline Customer Support at 1-800-521-3042.