现在有什么办法手动更新IP池吗？

[cresstoo]

用了kuaidaili的私密代理，保守设置了2个IP池爬了xhs的90条笔记就开始MediaCrawler ERROR (core.py:309) - [XiaoHongShuCrawler.get_note_detail_async_task] Get note detail error
有什么手动替换过期IP的办法吗？

[NanmiCoder]

可以尝试在请求发起前的入口函数进行IP过期时间判断

MediaCrawler/media_platform/xhs/client.py

Lines 85 to 118 in dc9116e

	async def request(self, method, url, **kwargs) -> Union[str, Any]:
	"""
	封装httpx的公共请求方法，对请求响应做一些处理
	Args:
	method: 请求方法
	url: 请求的URL
	**kwargs: 其他请求参数，例如请求头、请求体等
	Returns:
	"""
	# return response.text
	return_response = kwargs.pop("return_response", False)
	async with httpx.AsyncClient(proxies=self.proxies) as client:
	response = await client.request(method, url, timeout=self.timeout, **kwargs)
	if response.status_code == 471 or response.status_code == 461:
	# someday someone maybe will bypass captcha
	verify_type = response.headers["Verifytype"]
	verify_uuid = response.headers["Verifyuuid"]
	raise Exception(
	f"出现验证码，请求失败，Verifytype: {verify_type}，Verifyuuid: {verify_uuid}, Response: {response}"
	)
	if return_response:
	return response.text
	data: Dict = response.json()
	if data["success"]:
	return data.get("data", data.get("success", {}))
	elif data["code"] == self.IP_ERROR_CODE:
	raise IPBlockError(self.IP_ERROR_STR)
	else:
	raise DataFetchError(data.get("msg", None))