Skip to content

Conversation

alex-bezek
Copy link
Collaborator

@alex-bezek alex-bezek commented Oct 9, 2025

  • create robots.txt file to not allow indexing. our ngrok traffic policy will add one that is served for the ngrok.com domain
  • create js file that will run

Validation: Added a console log to the file and ran it locally
image

And robots.txt file is served
image
https://ngrok-alex-hide-mintlify-origin-url.mintlify.app/robots.txt

Note: I tried this originally https://www.mintlify.com/docs/optimize/seo#disabling-indexing which added meta tags. I don't think this will work since our api gateway can't override those values

image image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant