Skip to content

Does it make sense not to normalize input vectors #1

@chledowski

Description

@chledowski

Hi! Thanks for your nice work.

I was wondering if I could use your embeddings on the SNLI dataset. Unfortunately, the results are a bit worse than i've expected.

I think this is due to normalization (there is some information in the norm of i.e. glove embeddings, that is useful for Natural Language Inference), as you use normalization when loading the word vectors.

Do you think that it could make sense to use unnormalized wv?

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions