Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test humanity #8

Open
lmrodriguezr opened this issue Feb 22, 2017 · 1 comment
Open

Test humanity #8

lmrodriguezr opened this issue Feb 22, 2017 · 1 comment
Assignees
@lmrodriguezr
Labels
enhancement

Comments

@lmrodriguezr
Copy link
Member

Not all robots respect robots.txt and a crawler could possibly take significant resources (e.g., crawling all reference data sets in a large project). It could also tunnel-request analyses to RDP, which is highly undesirable!

All /projects/* URLs should be protected.

This looks like a great option: https://gemfury.com/crushlovely/ruby:rack-iamnotarobot.
@lmrodriguezr lmrodriguezr self-assigned this Feb 22, 2017
@lmrodriguezr
Copy link
Member Author

Perhaps to be considered for sign-up (and login?) too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lmrodriguezr lmrodriguezr

Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@lmrodriguezr