UTF 8 file parsing failed

[anupshaw50]

Hi,

on file _parsing.py the function read_file(path: str) fails to read file exported from pubmed.
Replace this line with line 20
with open(path, mode='r', encoding='utf-8') as f:

sample file attached that fails parsing, please remove the txt at the end

test.nbib.txt

[holub008]

Hi @anupshaw50 - when encoding is not specified to open, it uses your platform default. Could you share your operating system and what the below reports, for my edification?

import sys
sys.getdefaultencoding()

I hesitate to hardcode the encoding as you're suggesting, although given that I've written this lib to focus on exports from PubMed itself, it may make sense to do so.

[holub008]

FYI, as a temporary workaround, you may use nbib.read, instead of nbib.read_file, which is a thin wrapper.

[anupshaw50]

Hi, its utf-8 , i am using windows

[holub008]

If sys.getdefaultencoding() is UTF-8, then I wouldn't expect you to encounter an issue with parsing a PubMed-generated nbib file (which would in fact be UTF-8 encoded). Right?

[holub008]

Could you share the code & error on your system when running the nbib file attached to this issue? Thanks