Majestic-12 logo MJ12search v0.6.7 (ALPHA)
 
Home | Options | Docs | About | Login

Submit URLs

Here you can submit URLs that will be crawled, indexed and merged into searchable index pretty much straight away. You will be able to monitor progress of your submission via a URL provided after you click the Submit button.


Copy/paste URLs into the box, one URL per line. Make sure you copy exact URLs because those that will fail to be retrieved won't be indexed.

Notes:

1. The only protocol supported is HTTP (no FTP, GOPHER, HTTPS etc)
2. URLs that are not prefixed with protocol will have HTTP:// added automatically.
3. URLs with IP addresses and domains like "localhost" will be rejected
4. Crawler will respect robots.txt standard, which means URLs disallowed for crawling won't be indexed
5. The only supported content types are 'text/html' and 'text/plain'. Do not bother submitting links to PDFs, EXEs etc since they won't be indexed.

Copyright © Majestic-12