Skip to content

ivankunyankin/intent_suggestions

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Intent suggestions

Python package for early user intent detection using n-gram language models

The idea behind intent suggestions is similar to autofill when we use words that were typed to make predictions. But instead of predicting the next word, we try to detect the user's intent.

The proposed approach uses n recursively initialised models. Each next model uses a smaller n. I.e. a model initialised with n=3 will include three models (with n=3, n=2 and n=1) This recursive approach allows to also take into account frequency counts from smaller n-grams in case there is no match for the parent model.

Installation

pip install intent_suggestions

Quickstart

Fit takes a list of items (training phrases) and a list of labels (intents) as input.

from intent_suggestions import IntentSuggester

model = IntentSuggester()

items = ["one two three four", "five six seven eight"]
labels = ["intent_1", "intent_2"]

model.fit(items, labels)

print(model.predict("zero two three four"))

Output:

{'intent_1': 0.9902, 'intent_2': 0.0098}

During training the model splits phrases by words. Thus, it works better when given input phrases with complete last words. For example, instead of making a prediction when a user typed "five six se", wait until they type "five six seven" and put a space. Now make the prediction.

Notation

According to the common notation, an n-gram language model uses n-1 words to predict the next word. Given that we are trying to predict a user's intent rather the next word, we'll use a slightly different notation. n in our case will represent the number of words used to predict intent probabilities. So a 3-gram (or trigram) model will use three words to make predictions.

References

The approach was inspired by this work