How to parse Chinese and parse Tokens from Chinese sentences without spaces

[jacky6024]

Hello, everyone, I need to parse out the corresponding keywords in the text, Chinese is not need to be separated by Spaces, so I define the grammar can not parse out the corresponding token from a Chinese sentence, the following is a syntax file example I wrote:

grammar test;

start : Words Chinese;

Chinese : '中国人' ;

Words : Character+ ;

fragment Character : [\u4E00-\u9FFF] ;

WS : [ \t\r\n]+ -> skip ;

Parse the following sentences using the above syntax:

我是中国人

The Parse Tree is shown in the following figure

The Parse Tree is incorrect because it is not delimited by Spaces。

However, since Chinese grammar does not need to use Spaces to separate characters, the above sentence is legal, but Antlr seems to be unable to deal with it, please see if there is any other way to define Antlr syntax, so that it can parse the above sentence 。

[jacky6024]

I already know how to do it