'x' is tagged PUNCT

[bittlingmayer]

Displacy tags x in What are some Spanish words that start with x? as PUNCT.

https://explosion.ai/demos/displacy?text=What%20are%20some%20Spanish%20words%20that%20start%20with%20x%3F&model=en_core_web_sm&cpu=0&cph=0

[bittlingmayer]

Interestingly, although often the errors are correlated, this time Google gets it right, which leads me to think it is not just from the training data but an actual bug.

[ines]

Well, I assume Google's model is likely trained on a different corpus, using a different process and a different model architecture. While the comparison is always interesting, I'm not sure this really indicates anything deeper about spaCy's pre-trained models.

I'm merging this with #3052. We've now added a master thread for incorrect predictions and related reports – see the issue for more details.

[bittlingmayer]

I assume Google's model is likely trained on a different corpus

From my observation (caveat: a sort of rolling average over the past few years and biased towards English), often relatively peculiar errors on parsing specific sentences are so suspiciously similar between spaCy, Google and to some degree Stanford that my perhaps naïve conclusion is that there must be significant overlap in the training data.

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.