TITLE:
Design and Implementation of a New Chinese Word Segmentation Dictionary for the Personalized Mobile Search
AUTHORS:
Zhongmin Wang, Jingna Qi, Yan He
KEYWORDS:
Chinese Word Segmentation; Dictionary Mechanism; Natural Language Processing; Personalized Search; Word Classification Information
JOURNAL NAME:
Communications and Network,
Vol.5 No.1B,
November
7,
2013
ABSTRACT: Chinese word segmentation is the basis of natural language processing. The dictionary mechanism significantly influences the efficiency of word segmentation and the understanding of the user’s intention which is implied in the user’s query. As the traditional dictionary mechanisms can't meet the present situation of personalized mobile search, this paper presents a new dictionary mechanism which contains the word classification information. This paper, furthermore, puts forward an approach for improving the traditional word bank structure, and proposes an improved FMM segmentation algorithm. The results show that the new dictionary mechanism has made a significant increase on the query efficiency and met the user’s individual requirements better.