About Testomatobot

Testomatobot is a toolset we use to send web forms, download web pages, and download resources that will be checked according to the project configurations of Testomato's users. It accesses websites according to project settings (i.e. every 5 minutes or more).

User agent format: Testomatobot/1.0 (%os%; +https://www.testomato.com/testomatobot) minicrawler/%version%
IP addresses USA (San Francisco, California): 107.170.228.2032604:a880:1:20::bfe:5001
USA (Dallas, Texas): 45.32.199.432001:19f0:6401:3f:5400:ff:fe67:1bc7
USA (Chicago, Illinois): 166.78.244.1722001:4801:7818:6:be76:4eff:fe10:3573
USA (New York City, New York): 45.55.245.1572604:a880:800:10::14a2:2001
Europe (London, United Kingdom): 46.101.5.1242a03:b0c0:1:d0::5e9:b001
Europe (Nuremberg, Germany): 159.69.13.522a01:4f8:1c1c:2f5e::1
Europe (Prague, Czech Republic): 217.31.53.128/27, 217.31.54.192/27, 217.31.55.64/27 2001:1ab0:f001:face:2::/80
Asia (Singapore): 128.199.231.882400:6180:0:d0::b43:1
Asia (Hong Kong): 119.9.119.952401:1800:7800:101:be76:4eff:fe1c:3488

If you don't want Testomatobot to access your server (i.e. due to overloading), please contact us at info@testomato.com.

Minicrawler

Testomatobot uses Minicrawler to perform an HTTP requests for a given URL to get an HTTP response, including headers. It was developed to have the smallest possible memory footprint, processor time consumption, and fit the needs of Testomato, as well as other internal projects. Minicrawler is open-sourced under the AGPL License.

We encourage you to check Minicrawler out and try it out for yourself. We welcome any suggestions or feedback you might have for ways we can improve it!

Dependencies

  • asynchronous hostname resolving – c-ares
  • URL parsing and resolving – uriparser
  • TLS/SSL support – OpenSSL
  • gzipped content decoding – zlib