《计算机应用研究》|Application Research of Computers

一种基于邻域系统密度差异度量的离群点检测算法

Outlier detection algorithm based on neighborhood system density difference measurement

免费全文下载 (已被下载 次)  
获取PDF全文
作者 杜旭升,于炯,陈嘉颖,王跃飞,蒲勇霖,叶乐乐
机构 1.新疆大学 a.软件学院;b.信息科学与工程学院,乌鲁木齐 830008;2.西安交通大学 软件学院,西安 710049
统计 摘要被查看 次,已被下载
文章编号 1001-3695(2020)07-010-1969-05
DOI 10.19734/j.issn.1001-3695.2018.12.0932
摘要 针对离群点检测算法LOF在高维离散分布数据集中检测精度较低及参数敏感性较高的问题,提出了基于邻域系统密度差异度量的离群点检测NSD(neighborhood system density difference)算法。相较于传统基于密度的离群点检测方法,NSD算法引入了截取距离的概念。首先计算数据集中对象在截取距离内的邻居点个数;其次计算对象的邻域系统密度;然后将对象的密度与它邻居的密度进行比较,判定目标对象与其邻居趋向于同一簇的程度;最后输出最可能是离群点的对象。将NSD算法与LOF、LDOF、CBOF算法在真实数据集与合成数据集中对比实验发现,NSD算法具有较高的检测准确率和执行效率以及较低的参数敏感性,证明了NSD算法是有效可行的。
关键词 数据挖掘; 离群点检测; 基于密度; LOF; LDOF; CBOF
基金项目 国家自然科学基金资助项目(61862060,61462079,61562086,61562078)
本文URL http://www.arocmag.com/article/01-2020-07-010.html
英文标题 Outlier detection algorithm based on neighborhood system density difference measurement
作者英文名 Du Xusheng, Yu Jiong, Chen Jiaying, Wang Yuefei, Pu Yonglin, Ye Lele
机构英文名 1.a.School of Software,b.School of Information Science & Engineering,Xinjiang University,Urumqi 830008,China;2.School of Software,Xi'an Jiaotong University,Xi'an 710049,China
英文摘要 LOF is a famous algorithm for outlier detection, and it has lower detection accuracy and higher parameter sensitivity on high-dimensional discrete distribution datasets. Aiming at these problems, this paper proposed a neighborhood system density difference(NSD) algorithm based on density difference measurement of neighborhood systems. Compared with the traditional density-based methods, NSD algorithm proposed and introduced the concept of intercept distance. Firstly, it calculated the number of neighbors of an object within the intercept distance on dataset. Then, it computed the density of neighborhood system. After that, it estimated the degree of tending to the same cluster by comparing the density between the object and its neighbors. Finally, it output the objects which closed to outlier with maximum likelihood. Experiments with NSD, LOF, LDOF, CBOF algorithms carried out on the real-world dataset and synthetic dataset, show that the NSD algorithm performs with higher detection accuracy and execution efficiency, while with lower parameter sensitivity.
英文关键词 data mining; outlier detection; density-based; LOF(local outlier factor); LDOF(local distance-based outlier factor); CBOF(cohesiveness-based outlier factor)
参考文献 查看稿件参考文献
 
收稿日期 2018/12/20
修回日期 2019/3/11
页码 1969-1973
中图分类号 TP301.6
文献标志码 A