Skip to content

Commit 81cf44a

Browse files
Adds detection for CloudServerMarketSpider and Pandalytics (#7873)
* Adds detection for Pandalytics * Adds detection for CloudServerMarketSpider ref #7872
1 parent e6e2c6c commit 81cf44a

File tree

2 files changed

+28
-0
lines changed

2 files changed

+28
-0
lines changed

Tests/fixtures/bots.yml

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8367,3 +8367,18 @@
83678367
producer:
83688368
name: Peer39 Tech, LLC
83698369
url: https://www.peer39.com/
8370+
-
8371+
user_agent: Pandalytics/2.0 (https://domainsbot.com/pandalytics/)
8372+
bot:
8373+
name: Pandalytics
8374+
category: Crawler
8375+
url: https://www.domainsbot.com/business-intelligence/
8376+
producer:
8377+
name: DomainsBot, Inc.
8378+
url: https://www.domainsbot.com/
8379+
-
8380+
user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 ( compatible; CloudServerMarketSpider/1.0; +http://cloudservermarket.com/spider.html )
8381+
bot:
8382+
name: CloudServerMarketSpider
8383+
category: Crawler
8384+
url: https://web.archive.org/web/20151228225429/https://cloudservermarket.com/spider.html

regexes/bots.yml

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4854,6 +4854,19 @@
48544854
name: 'Peer39 Tech, LLC'
48554855
url: 'https://www.peer39.com/'
48564856

4857+
- regex: 'Pandalytics'
4858+
name: 'Pandalytics'
4859+
category: 'Crawler'
4860+
url: 'https://www.domainsbot.com/business-intelligence/'
4861+
producer:
4862+
name: 'DomainsBot, Inc.'
4863+
url: 'https://www.domainsbot.com/'
4864+
4865+
- regex: 'CloudServerMarketSpider'
4866+
name: 'CloudServerMarketSpider'
4867+
category: 'Crawler'
4868+
url: 'https://web.archive.org/web/20151228225429/https://cloudservermarket.com/spider.html'
4869+
48574870
# Generic bots
48584871
- regex: 'nuhk|grub-client|Download Demon|SearchExpress|Microsoft URL Control|borg|altavista|dataminr\.com|teoma|oegp|http%20client|htdig|mogimogi|larbin|scrubby|searchsight|semanticdiscovery|snappy|vortex(?!(?: Build|Plus| CM62| HD65))|zeal(?!ot)|dataparksearch|findlinks|BrowserMob|URL2PNG|ZooShot|GomezA|Google SketchUp|Read%20Later|7Siters|centuryb\.o\.t9|InterNaetBoten|EasyBib AutoCite|Bidtellect|tomnomnom/meg|cortex|Re-re Studio|adreview|AHC/|NameOfAgent|Request-Promise|ALittle Client|Hello,? world|wp_is_mobile|0xAbyssalDoesntExist|Anarchy99|^revolt|nvd0rz|xfa1|Hakai|gbrmss|fuck-your-hp|IDBTE4M CODE87|Antoine|Insomania|Hells-Net|b3astmode|Linux Gnu \(cow\)|Test Certificate Info|iplabel|Magellan|TheSafex?Internetx?Search|Searcherx?web|kirkland-signature|LinkChain|survey-security-dot-txt|infrawatch|Time/|r00ts3c-owned-you|nvdorz|Root Slut|NiggaBalls|BotPoke|GlobalWebSearch|xx032_bo9vs83_2a|sslshed|geckotrail|Wordup|Keydrop|^xenu|^(?:chrome|firefox|Abcd|Dark|KvshClient|Node.js|Report Runner|url|Zeus|ZmEu)$'
48594872
name: 'Generic Bot'

0 commit comments

Comments
 (0)