Full-Text Search:
Home|Journal Papers|About CNKI|User Service|FAQ|Contact Us|中文
《Journal of Guangxi Normal University(Natural Science Edition)》 2016-01
Add to Favorite Get Latest Update

A General Method of Chinese Word Segmentation Based on the Resolution of Word Frequency Ambiguity

PENG Qi;ZHU Xinhua;CHEN Yishan;Network Center,Guangxi Normal University;College of Computer Science and Information Technology,Guangxi Normal University;College of Lijiang,Guangxi Normal University;  
Ambiguity is a common problem in dictionary based word segmentation methods.In the past,the word segmentation method based on dictionary often uses the bidirectional maximum matching method to get the result of word segmentation,and then carries out ambiguity resolution by using the context imformation,which cannot be used in the environment without context information.A general disambiguation method based on word frequency is presented in this paper,which is context-free and expands the application range of ambiguity resolution.Experimental results show that compared with the traditional methods of dictionary-based Chinese word segmentation,this method has a stronger applicability and higher availability.
【Fund】: 国家自然科学基金资助项目(61363036 61462010)
【CateGory Index】: TP391.1
Download(CAJ format) Download(PDF format)
CAJViewer7.0 supports all the CNKI file formats; AdobeReader only supports the PDF format.
©2006 Tsinghua Tongfang Knowledge Network Technology Co., Ltd.(Beijing)(TTKN) All rights reserved