Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Kagomeのトークン単位で置き換えする辞書 #4

Open
notoiro opened this issue Jan 10, 2024 · 3 comments
Open

Kagomeのトークン単位で置き換えする辞書 #4

notoiro opened this issue Jan 10, 2024 · 3 comments
Labels
documentation Improvements or additions to documentation

Comments

@notoiro
Copy link
Owner

notoiro commented Jan 10, 2024

Neologd特有のカスの英語読みがあるのでこれの対策をする。
特に2文字は魔境。

形態素解析による分かち書き自体は優秀なので、読みが怪しい物だけ辞書置換することで高品質な読みのみを利用することができるはず。
@notoiro
Copy link
Owner Author

notoiro commented Jan 10, 2024 •
edited
Loading

現在判明しているカスの読み

  • AF
  • CM
  • AMD

@notoiro
Copy link
Owner Author

notoiro commented Jan 16, 2024

TODO: 速度計測

@notoiro notoiro added the Feature New feature or request label Feb 6, 2024
@notoiro notoiro changed the title Kagomeのトークン単位で置き換えする辞書の作成 Kagomeのトークン単位で置き換えする辞書 Feb 7, 2024
@notoiro notoiro added documentation Improvements or additions to documentation and removed Feature New feature or request labels Feb 7, 2024
@notoiro
Copy link
Owner Author

notoiro commented Jun 9, 2024

OBS
Amiga

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@notoiro