Tokenization with 2 words verbs in English #13372
Unanswered
RichardPortelli
asked this question in
Help: Other Questions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello,
Is there a way to Tokenize the sentence : "I want to find out what it means. " so that "want to", "find out" are considered as one token?
I could specify a pattern Verb + Preposition but I'm not sure that would work out well for all cases?
Thanks
Beta Was this translation helpful? Give feedback.
All reactions