TestomatoBot

TestomatoBot is name of a toolset we use to send web forms, download web pages, and download resources that will be checked according to the project configurations of Testomato's users. It accesses websites according to project settings (i.e. every 5 minutes or more).

How to identify request from TestomatoBot?

TestomatoBot using follow User-Agent string:

Testomatobot/1.0 (Linux x86_64; +https://www.testomato.com/testomatobot) minicrawler/5.2.6

Testomato servers

All our request are going from following server addresses:

Location IPV4 IPV6
USA (San Francisco, California): 107.170.228.203 2604:a880:1:20::bfe:5001
USA (Dallas, Texas): 45.32.199.43 2001:19f0:6401:3f:5400:ff:fe67:1bc7
USA (Chicago, Illinois): 166.78.244.172 2001:4801:7818:6:be76:4eff:fe10:3573
USA (New York City, New York): 45.55.245.157 2604:a880:800:10::14a2:2001
Europe (London, United Kingdom): 46.101.5.124 2a03:b0c0:1:d0::5e9:b001
Europe (Nuremberg, Germany): 159.69.13.52 2a01:4f8:1c1c:2f5e::1
Europe (Prague, Czech Republic): 217.31.53.128/27
217.31.54.192/27
217.31.55.64/27
2001:1ab0:f001:face:2::/80
Asia (Singapore): 128.199.231.88 2400:6180:0:d0::b43:1
Asia (Hong Kong): 119.9.119.95 2401:1800:7800:101:be76:4eff:fe1c:3488

If you don't want Testomatobot to access your server (i.e. due to overloading), please contact us at info@testomato.com.

What is Minicrawler

TestomatoBot uses Minicrawler to perform an HTTP requests for a given URL to get an HTTP response, including headers. It was developed to have the smallest possible memory footprint, processor time consumption, and fit the needs of Testomato, as well as other internal projects. Minicrawler is open-sourced under the AGPL License.

We encourage you to check Minicrawler out and try it out for yourself. We welcome any suggestions or feedback you might have for ways we can improve it!

Dependencies

  • asynchronous hostname resolving – c-ares
  • URL parsing and resolving – uriparser
  • TLS/SSL support – OpenSSL
  • gzipped content decoding – zlib