Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"l1" identified as language #24

Open
voitsehovska opened this issue Jan 4, 2018 · 2 comments
Open

"l1" identified as language #24

voitsehovska opened this issue Jan 4, 2018 · 2 comments

Comments

@voitsehovska
Copy link

I have not found any information about language identificator "l1" in the basic documentation of transliterate package. The problem is that German text was recognized as l1. However, it should be "de" according to my code and output (as you can see in further examples on the attached screen, in the fourth column "DIE EINHEIT" was identified correctly as "de", but "DEUTSCHE WAHRHEIT..." was identified as l1).

l1_detected

I also found this submodule http://pythonhosted.org/transliterate/transliterate.contrib.languages.l1.html
If it is Latin 1, then why does it emerge like that?

@barseghyanartur
Copy link
Owner

@voitsehovska:

Well, German uses Latin script (with some additions).

I guess you have created a new language pack for transliterating from/to German. In that case, you should explicitly provider the language pack code to/from which you plan to transliterate.

I suggest you to use another library for language detection Google and transliterate for transliteration.

@davidam
Copy link

davidam commented Mar 4, 2022

I am seeing the same thing ...

print(get_available_language_codes())
['hy', 'bg', 'sr', 'uk', 'l1', 'ru', 'mk', 'mn', 'ka', 'el']

From my point of view, must appear a subset of http://www.loc.gov/standards/iso639-2/php/code_list.php. So, l1 is not an iso language code ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants