This website is a tool designed to help users check whether their websites effectively block unwanted bots and crawlers. By entering a URL into the search box, our app tests the URL with various user agent strings and referrers to determine if the site effectively blocks these visits.
Our application sends HTTP requests to the provided URL using different user agent strings and referrers commonly associated with bots and crawlers. It then analyzes the HTTP response codes to determine if the site blocks these visits. Results are displayed in a table format on a new page.
The results indicate whether the URL successfully blocks visits from bots and crawlers. A "Blocked" status means that the site effectively blocked the visit, while an "Allowed" status means that the visit was not blocked.
Yes, to prevent abuse and ensure fair usage, we have implemented the following limitations: Each IP address is limited to 25 checks per day. Each URL can be checked up to 10 times per day.
Timeouts and technical issues are considered as errors. If our application encounters a timeout or technical issue while testing a URL, it will be marked as an error in the results.
Yes, we log all requests, including the datetime, visitor IP, URL to check, and the results of the test. However, we prioritize user privacy and adhere to strict security measures to protect this data.
We follow a defined data retention policy and regularly review and purge old data to maintain a manageable dataset and ensure compliance with relevant privacy regulations.
While we strive to provide accurate and reliable results, it's important to note that the effectiveness of website blocking measures may vary depending on various factors. Our tool aims to provide insights, but it's always recommended to complement this with other security measures and regular monitoring of website traffic.
If you encounter any issues or have questions about using our tool, please feel free to contact our support team at support@example.com. We're here to help!