Flickr Photos

Remove URL’s From GoogleBot’s Crawl List Using Google Webmaster Tools

Blogging, SEO Blog, Web Development Add comments

I recently had to remove some development pages from Google’s search results pages and I used Google Webmaster Tools to do so. Google Webmaster Tools doesn’t automatically stop GoogleBot from crawling your site, it does however provide options for alerting Google that you no longer want to have a page indexed for whatever reason.

1: Choose your website.
Once you logged into Google Webmaster Tools using your Google account info you’ll be asked to choose a website you have associated with your Google account.

2: Website Dashboard
Here you get a quick rundown of crawl errors Google ran into. From this page select the tools tab on the left hand bottom side.

3: URL removal tool (Requests Google Stops Crawling Pages You Assign)
Here’s where you’ll choose which page or pages you want GoogleBot to pass by on it’s next crawl.

4: Removal Tool Options
Choose an individual URL, a directory, a cached page or your entire site here.

5: Removal Request Page
Here’s where you leave the specifics. Is this a dead page or a dead image link?

6: Not What You Needed? Try Altering Your Robot.txt
Are your results still showing up? You may need to alter your robot.txt file. You can review your robot.txt from Google Webmaster Tools, but you can not alter it here. This way you can tell which pages/ directories are being left out. Get more information about Robots.txt files here.

Rate this:
2.8
Add to Social Networks:
These icons link to social bookmarking sites where readers can share and discover new web pages.
  • bodytext
  • StumbleUpon
  • del.icio.us
  • Technorati
  • Google
  • TwitThis
  • Facebook
  • Reddit
  • Simpy
  • Blue Dot
  • Bumpzee
  • Ma.gnolia
  • Furl
  • Live
  • YahooMyWeb
  • SphereIt
  • Mixx
  • Sphinn
  • BlinkList
  • Netvouz
  • NewsVine
  • E-mail this story to a friend!

If you enjoyed this post, make sure you subscribe to my RSS feed!

Leave a Reply



Artist Blogs - Blog Catalog Blog Directory 2k Bloggers Blogger's Choice Awards Blogs Record Creative Commons License page counter Check Out My Lens Save the Net Directory of Web Design Blogs
Join My Community at MyBloglog! Bumpzee BlogBurst.com StumbleUpon BRDTracker My Zimbio  Technology Blogs - Blogged Blog Directory