Official crawler for the 360 Search project.
360SearchBot is an automated web crawler that discovers and indexes publicly accessible web pages for use in the 360 Search search engine.
The crawler downloads HTML pages, extracts searchable text and metadata, and stores information used to provide search results. It is designed to crawl responsibly and avoid unnecessary repeat requests.
360SearchBot
| Purpose | Web Search Indexing |
|---|---|
| Supports | HTML Pages |
| Follows | Public hyperlinks |
| Indexes | Titles, descriptions, visible page text, and links |
360SearchBot respects robots.txt. To block crawling entirely,
add the following to your site's robots.txt file:
User-agent: 360SearchBot Disallow: /
To block all crawlers:
User-agent: * Disallow: /
Questions Or Concerns About Crawling?
Email: [email protected] Or report bugs at 360-search.com/report
360Digital's search engine is an independent search engine project focused on discovering, indexing, and organizing publicly available information to make it easier to find useful content across the web.