Removing content

If you are the web site’s owner, you can remove your site from Small Little Robot by using your Robots.txt file.

For newbies to robots.txt, here’s how to remove your entire web site from our search engine index:

Use notepad to create a text file called robots.txt
Add the following text to this file: User-agent: smalllittlerobot Disallow: /
Upload your robots.txt file to the top level of your web site … e.g. www.YourSite.com/robots.txt

The next time our search engine updates its index, we will check for your associated robots.txt file on your web site, and if we find the smalllittlerobot Disallow command written inside the file, we will remove all your crawled pages from our search engine.

Be aware, the way our A.I.’s deep learning systems work, if you purge your site from our index and then later change your mind and decide you do want to be indexed, you’re unlikely to be well-ranked. You’ve basically trained the A.I. not to see your site and web pages.