Skip to content
This repository was archived by the owner on Apr 16, 2025. It is now read-only.

Commit 391355f

Browse files
authored
Merge pull request #473 from duckduckgo/junderhill/update-duckassistbot-useragent
Update duckassistbot.md
2 parents 412635b + 505af3a commit 391355f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

_docs/results/duckassistbot.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ order: 1450
1010

1111
DuckAssistBot is a specialized web crawler for [DuckDuckGo Search](https://duckduckgo.com) that crawls pages in real-time for answers generated by [DuckAssist]({{ site.baseurl }}/results/duckassist/), which prominently cites its sources. This data is not used in any way to train AI models.
1212

13-
If you’re a publisher, you may opt out of being a potential source for DuckAssist answers by modifying the [robots.txt](https://metacpan.org/module/WWW::RobotRules){:target="\_blank"}{:rel="noopener noreferrer"} file for your domain(s). Once you’ve updated the file to disallow the DuckAssistBot user agent, the change will take effect after 72 hours and DuckAssistBot will stop crawling your site. The crawler’s user agent will appear as `DuckAssistBot/1.1; (+http://duckduckgo.com/duckassistbot.html)` and originates from the following IP addresses:
13+
If you’re a publisher, you may opt out of being a potential source for DuckAssist answers by modifying the [robots.txt](https://metacpan.org/module/WWW::RobotRules){:target="\_blank"}{:rel="noopener noreferrer"} file for your domain(s). Once you’ve updated the file to disallow the DuckAssistBot user agent, the change will take effect after 72 hours and DuckAssistBot will stop crawling your site. The crawler’s user agent will appear as `DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html)` and originates from the following IP addresses:
1414

1515
- 57.152.72.128
1616
- 51.8.253.152

0 commit comments

Comments
 (0)