Does PubPub Have Protections Against LLM and Other Web Crawlers

[cguess07]

Hello, I haven't been able to find anything about PubPub's protections against Web Crawlers and other automated scrapers. Should I start using robots.txt for my website or install a plugin/CloudFlare, or does PubPub have pre-installed protections since it's home to a lot of academic publishing?

[tefkah]

Hi, welcome!

Forgive me for being a bit suspicious, but why are you asking? You cannot modify robots.txt, nor install plugins on PubPub, so you shouldn't need to worry about this, unless you are looking for ways to get around these measures.

Which community are you trying to protect?

If you are worried about scrapers or LLMs reading your content, then the only thing you can do to mitigate this is to not make your content publicly available.

[tefkah]

Marking this as closed.