xhs小红书爬虫时遇到报错导致中断 #448
luyixiao31
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
python main.py --platform xhs --lt qrcode --type search
爬取23篇笔记后,部分报错内容如下:
Traceback (most recent call last):
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\httpcore_exceptions.py", line 10, in map_exceptions
yield
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\httpcore_async\http11.py", line 197, in _receive_event
event = self._h11_state.next_event()
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\h11_connection.py", line 469, in next_event
event = self._extract_next_receive_event()
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\h11_connection.py", line 419, in _extract_next_receive_event
event = self._reader.read_eof() # type: ignore[attr-defined]
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\h11_readers.py", line 137, in read_eof
raise RemoteProtocolError(
h11._util.RemoteProtocolError: peer closed connection without sending complete message body (received 2097152 bytes, expected 71692919)
是不是爬虫被发现了
Beta Was this translation helpful? Give feedback.
All reactions