Skip to content
This repository has been archived by the owner on Apr 23, 2024. It is now read-only.

Issues: VKCOM/YouTokenToMe

32 Open 28 Closed
32 Open 28 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

ImportError: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.20' not found
#113 opened Dec 5, 2023 by timotheecour
Visual studio c++ 14.0 error while installing.
#112 opened Oct 12, 2023 by manjunath7472
Special tokens accessibility
#111 opened Sep 11, 2023 by xdevfaheem
Youtokentome cannot be installed on Windows if VisualStudio not installed
#96 opened Jul 26, 2022 by yilmazay74
5
Can't pip install on a new env (without Cython)
#94 opened May 19, 2022 by zachmoshe
4
compatibility of youtokentome.BPE outputs with the official implementation
#93 opened Jan 11, 2022 by l-k-11235
Installing error C1083
#91 opened Sep 20, 2021 by YFrite
2
error: Microsoft Visual C++ 14.0 or greater is required.
#89 opened Jul 23, 2021 by fourat-bs
1
Decode() got an unexpected keyword argument 'ignore_ids'
#88 opened Jul 8, 2021 by raphkhan
No word tokenizer under the hood?
#87 opened May 17, 2021 by slowwavesleep
Error during installation
#86 opened May 17, 2021 by ruruu127
How does YouTokenToMe's speed compare to subword-nmt?
#85 opened Apr 16, 2021 by gowtham1997
Using YouTokenToMe with pre-defined vocab and embeddings
#84 opened Feb 16, 2021 by alexbalandi
2
Tokenizing large corpus
#80 opened Nov 1, 2020 by quetz
2
Is it possible to unset random seed for BPE-dropout? enhancement New feature or request
#75 opened Sep 17, 2020 by skurzhanskyi
2
Controlling word tokenization
#73 opened Aug 20, 2020 by MexicanMan
How to train with multiple corpus files?
#72 opened Aug 15, 2020 by hccho2
Process killed?
#71 opened Jul 31, 2020 by miguelvictor
4
how to get vocab
#69 opened Apr 30, 2020 by wqfengnlpr
2
Vocabulary contains underscore multiple times?
#68 opened Apr 20, 2020 by RuABraun
"▁" character can be separated when using BPE-dropout
#67 opened Apr 4, 2020 by TIXFeniks
11
How to generate vocab.json and merges.txt for YTTM tokenizer?
#66 opened Mar 8, 2020 by nikhilno1
1
Special Tokens
#65 opened Mar 6, 2020 by martingajek
1
1
Adding new terms into pre-trained model vocab | Issue in tokenizing OOV keywords
#63 opened Feb 24, 2020 by spate141
Doesn't consider combining characters.
#59 opened Jan 21, 2020 by IDDT
ProTip! Updated in the last three days: updated:>2024-12-19.