██████╗ ██████╗ ██████╗ ██████╗ ██╗ ██╗██╗ ██╗███╗ ██╗████████╗
██╔══██╗██╔═══██╗██╔══██╗██╔═══██╗██║ ██║██║ ██║████╗ ██║╚══██╔══╝
██████╔╝██║ ██║██████╔╝██║ ██║███████║██║ ██║██╔██╗ ██║ ██║
██╔══██╗██║ ██║██╔══██╗██║ ██║██╔══██║██║ ██║██║╚██╗██║ ██║
██║ ██║╚██████╔╝██████╔╝╚██████╔╝██║ ██║╚██████╔╝██║ ╚████║ ██║
╚═╝ ╚═╝ ╚═════╝ ╚═════╝ ╚═════╝ ╚═╝ ╚═╝ ╚═════╝ ╚═╝ ╚═══╝ ╚═╝
Robots.txt Directory Scanner
v1.0.0
Created by: Psikoz-coder
RoboHunt
is a high-performance, concurrent robots.txt
scanner designed for security professionals and bug bounty hunters. It efficiently scans a list of subdomains to find accessible directories and paths listed in their robots.txt
files, helping you uncover potential vulnerabilities and expand your attack surface.
- Concurrent Scanning: Utilizes goroutines to scan multiple subdomains at once for maximum speed.
- Verbose Mode: Get detailed information about redirects and scan status.
- Customizable Threads: Adjust the number of concurrent threads to match your needs.
- Flexible Output: Save the results to a file for further analysis.
- Clear & Organized: Color-coded output for easy readability.
- Go 1.16 or higher
- A list of subdomains to scan
go install -v github.com/Psikoz-coder/RoboHunt@latest
-
Clone the repository:
git clone https://github.com/Psikoz-coder/RoboHunt.git cd RoboHunt
-
Build the executable:
go build -o robohunt robohunt.go
-
(Optional) Move to your bin directory:
sudo mv robohunt /usr/local/bin/
To start scanning, you need a text file containing a list of subdomains (one per line).
robohunt -l subdomains.txt
Save the scan results to a file for later review.
robohunt -l subdomains.txt -o results.txt
For more detailed output, including redirect information, use the -v
flag.
robohunt -l subdomains.txt -v
Control the performance by setting the number of concurrent threads.
robohunt -l subdomains.txt -t 20
Flag | Description | Default |
---|---|---|
-l |
(Required) Path to the subdomain list file. | |
-o |
Path to the output file. | (none) |
-v |
Enable verbose mode to show redirect info. | false |
-t |
Number of concurrent threads. | 10 |
-h |
Show the help message. |
Contributions, issues, and feature requests are welcome! Feel free to check the issues page.
- Fork the Project
- Create your Feature Branch (
git checkout -b feature/AmazingFeature
) - Commit your Changes (
git commit -m 'Add some AmazingFeature'
) - Push to the Branch (
git push origin feature/AmazingFeature
) - Open a Pull Request
This tool is intended for ethical and legal security testing purposes only. Usage of RoboHunt
for any unauthorized or malicious activities is strictly prohibited. The author is not responsible for any misuse or damage caused by this program.
⭐ If you find this tool useful, please give it a star!