Full-Text Search:
Home|Journal Papers|About CNKI|User Service|FAQ|Contact Us|中文
《Journal of Software》 2007-04
Add to Favorite Get Latest Update

An Efficient Algorithm for Mining Approximate Frequent Item over Data Streams

WANG Wei-Ping1+, LI Jian-Zhong1,2, ZHANG Dong-Dong1, GUO Long-Jiang1,2 1(School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China) 2(School of Computer Science and Technology, Heilongjiang University, Harbin 150080, China)  
A frequent item of a data stream is a data point whose occurrence frequency is above a given threshold. Finding frequent item of data stream has wide applications in various fields, such as network traffic monitor, data stream OLAP and data stream mining, etc. In data stream model, the algorithm can only scan the data in one pass and the available memory space is very limited relative to the volume of a data stream, therefore it is usually unable to find all the accurate frequent items of a data stream. This paper proposes a novel algorithm to find ε-approximate frequent items of a data stream, its space complexity is O(ε~(-1)) and the processing time for each item is O(1) in average. Moreover, the frequency error bound of the results returned by the proposed algorithm is ε(1-s+ε)N. Among all the existed approaches, this method is the best.
【Fund】: SupportedbytheKeyProgramoftheNationalNaturalScienceFoundationofChinaunderGrantNo.60533110(国家自然科学基金重点项目);; theNationalNaturalScienceFoundationofChinaunderGrantNo.60473075(国家自然科学基金);; theKeyProgramofNaturalScienceFoundationofHeilongjiangProvinceofChinaunderGrantNo.zjg03-05(黑龙江省自然科学基金);; theProgramforNewCenturyExcellentTalentsinUniversityofChinaunderGrantNo.NCET-05-0333(新世纪优秀人才支持计划)
【CateGory Index】: TP311.13
Download(CAJ format) Download(PDF format)
CAJViewer7.0 supports all the CNKI file formats; AdobeReader only supports the PDF format.
【References】
Chinese Journal Full-text Database 8 Hits
1 Li Jianzhong and Gao Hong (School of Computer Science and Technology,Harbin Institute of Technology,Harbin 150001);Survey on Sensor Network Research[J];Journal of Computer Research and Development;2008-01
2 ZU Yue1,DANG De-yu2 (1.Personnel Division,Jilin Institute of Chemical Technology,Jilin City 132022,China;2.College of Information Engineering,Northeast Dianli University,Jilin City 132012,China);On the data updating algorithm based on distributed data flow under grid environment[J];Journal of Jilin Institute of Chemical Technology;2009-01
3 WANG Xiu-kun,WANG Tie-cun,ZHOU Guo-neng,FENG Wei Department of Computer,Dalian University of Technology,Dalian,Liaoning 116023,China;Improved algorithm for mining approximate frequent item over data streams[J];Computer Engineering and Applications;2008-13
4 ZHANG Xiao-jian,SHAO Chao,ZHANG Ya-dong(College of Information,Henan University of Finance & Economics,Zhengzhou 450002);Mining of Frequent Traversal Sequences in Dynamic Web Clickstreams[J];Computer Engineering;2009-14
5 GAO Hong-bin,ZHANG Xiao-bin,YANG Hai-zhen(School of Information,Wuyi University,Jiangmen Guangdong 529020,China);Real-time algorithm for mining approximate frequent items over data streams[J];Journal of Computer Applications;2008-S2
6 KUANG Zhu-fang1,YANG Guo-gui2,XIN Dong-jun1(1.College of Computer,Central South University of Forestry & Technology,Changsha 410004,China;2.College of Computer,National University of Defense Technology,Changsha 410073,China);SWFPM:efficient algorithm for mining frequent item over data streams[J];Application Research of Computers;2009-02
7 KUANG Zhu-fang, TAN Jun-shan, YANG Wei-min, XIN Dong-jun(College of Computer, Central South University of Forestry and Technology, Changsha 410004, China);Gradual Minimum Support Threshold Function Based Mining Frequent Item over Data Streams[J];Microelectronics & Computer;2008-10
8 WU Feng1,ZHONG Yan1,JIN Xin2,WU Quan-yuan1,JIA Yan1,YANG Shu-qiang11(School of Computer,National University of Defense Technology,Changsha 410073,China)2(Changsha Social work College,Changsha 410004,China);Arbitrary Shape Clustering Algorithm for Evolving Data Stream over Sliding Windows[J];Journal of Chinese Computer Systems;2009-05
【Co-references】
Chinese Journal Full-text Database 10 Hits
1 FENG Wen-feng,GUO Qiao,WU Su-yan(Network Information Center,Beijing Institute of Technology,Beijing 100081,China);Finding Frequent Items of Data Streams Based on Hierarchical Sketch[J];Transactions of Beijing Institute of Technology;2006-06
2 WANG Jun-feng1,JIA Jian-hua2,SHEN Zhi-wei3(1.College of Information Engineering,Zhengzhou University,Zhengzhou,Henan 450052,China;2.Electrical Engineering College,Zhengzhou University,Zhengzhou,Henan 450052,China;3.Zhengzhou Zhongxing Project Supervision Co.Ltd,Zhengzhou,Henan 450052,China);An improved random sampling algorithm[J];Computer and Information Technology;2006-02
3 Gu Guanqun;The Development Expectation of Computer Network[J];Industrial Contral Computer;1999-01
4 YU Yan,HUANG Hao(Department of Computer Science and Technology,Nanjing University,State Key Laboratory for Novel Software Technology,Nanjing University.Nanjing,Jiangsu 210093,China);A Streaming Ensemble Intrusion Detection Model Based on Small Labeled Data[J];Acta Electronica Sinica;2007-02
5 NI Zhi-wei,HUANG Ling,LI Feng-gang,XIN Ling(School of Management,Hefei University of Technology,Hefei 230009,China);Study on management and mining of data stream[J];Journal of Hefei University of Technology(Natural Science);2005-09
6 GUO Long Jiang 1,2 , LI Jian Zhong 1,2 , WANG Wei Ping 1 , and ZHANG Dong Dong 1 1 (Institute of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001) 2 (Institute of Computer Science and Technology, Heilongjiang University, Harbin 150080);Predictive Continuous Aggregate Queries over Data Streams[J];Journal of Computer Research and Development;2004-10
7 SONG Guo Jie, TANG Shi Wei, YANG Dong Qing, and WANG Teng Jiao (School of Electronics Engineering and Computer Science, Peking University, Beijing 100871);Extraction and Trend Detection of Unusual Patterns over Data Streams[J];Journal of Computer Research and Development;2004-10
8 Liu Xuejun~(1,2), Xu Hongbing~1, Dong Yisheng~1, Wang Yongli~1, and Qian Jiangbo~1()~1(Department of Computer Science and Technology, Southeast University, Nanjing 210096)()~2(College of Information Science and Engineering,Nanjing University of Technology, Nanjing 210009);Mining Frequent Patterns in Data Streams[J];Journal of Computer Research and Development;2005-12
9 Liu Bing,Wang Wei,and Shi Baile (Department of Computing and Information Technology,Fudan University,Shanghai 200433);The Tight Estimation Distance Using Wavelet[J];Journal of Computer Research and Development;2006-10
10 Liu Xuejun 1,2 ,Xu Hongbing1,Dong Yisheng1,Qian Jiangbo1,and Wang Yongli1 1 (Department of Computer Science and Technology,Southeast University,Nanjing 210096) 2 (College of Information Science and Engineering,Nanjing University of Technology,Nanjing 210009);Mining Frequent Closed Patterns from a Sliding Window over Data Streams[J];Journal of Computer Research and Development;2006-10
【Secondary References】
Chinese Journal Full-text Database 10 Hits
1 ZHU Ding-ding, JIN Xin-yu, ZHANG Yu (Department of Information Science and Electronic Engineering,Zhejiang University,Hangzhou 310027,China);Layered Routing Protocol Based on the Energy Priority Clustering Algorithm for WSN[J];Chinese Journal of Sensors and Actuators;2009-04
2 LIU Chang-xin,TAN Yun-lan,TANG Wei-dong(Department of Computer Science,Jinggangshan University,Ji'an 343009,China);Researach on middleware for wireless sensor networks[J];Transducer and Microsystem Technologies;2008-11
3 Zhu Xiangjun1, Ying Yaping1, Ying Shaodong2, Feng Zhilin1 (1. Zhejiang University of Technology, Hangzhou 310024, China; 2. Hangzhou Ziglet Technology Co., Ltd., Hangzhou 310012, China);Design of Smart Home Surveillance System Based on ZigBee and WLAN[J];Telecommunications Science;2009-06
4 SHEN Lin1,2,SHI Xiang-quan11.College of Electro-Optics,Nanjing University of Science and Technology,Nanjing 210094,China;2.Jiangsu Teachers University of Technology,Changzhou 213001,China;Relevant Data-Fusion to the Influence of Clustering Lifetime in Wireless Sensor Networks[J];Chinese Journal of Electron Devices;2009-02
5 Wu Meiwen Zhao Jianping (College of Physics & Engineering,Qufu Normal University);Oil-Field Indicator Parameter Monitoring System Based On ZigBee Technology[J];Electronic Technology;2009-09
6 YE Hui-kun(Fujian Pinghe Forestry Bureau,Pinghe 363700,Fujian,China);Wireless Sensor Networks and Its Application in Forestry[J];Journal of Fujian Forestry Science and Technology;2009-03
7 DONG Wu-shi(College of Computer Science,Hubei Normal University,Huangshi 435002,China);Overview of QoS routing protocols in wireless sensor networks[J];Journal of Hubei Normal University(Natural Science);2008-03
8 ZHOU Quan1,2,XIAO De-qin2,LI Jiu-hao21.College of Mathematic and Information Sciences,Guangzhou University,Guangzhou 510006,China 2.Key Lab.of Key Tech.on Agricultural Machine and Equipment,South China Agricultural University,Guangzhou 510642,China;Transmission-limited routing algorithm in large-scale wireless sensor networks[J];Computer Engineering and Applications;2009-18
9 XU Xiao-longa,LIN Ya-pinga,b,ZHOU Si-wangb,ZHU Tie-juna(a.School of Computer & Communication,b.School of Software,Hunan University,Changsha 410082,China);Trust model based on beta distribution for sparse wireless sensor networks[J];Application Research of Computers;2009-06
10 ZHANG Jing,XU Dao-wei 1(Department of Computer and Information Science,Fujian University of Technology,Fuzhou 350014,P.R.China; College of Forestry,Agriculture and Foresty University 1,Fujian 350002,P.R.China);Cluster-based Intrusion Detection System for Sensor Network[J];Science Technology and Engineering;2009-17
©2006 Tsinghua Tongfang Knowledge Network Technology Co., Ltd.(Beijing)(TTKN) All rights reserved