Wordpress, duplicate content and robots.txt

futurepro · 11-25-2008, 03:33 AM

The following is what mine looks like:

# PREVENT SE INDEXING OF THE FOLLOWING
User-agent: *
Disallow: /contact-us/
Disallow: /about/
Disallow: /2008/
Disallow: /2009/
Disallow: /2010/
Disallow: /category/
Disallow: /page/
Disallow: /feed/
Disallow: /trackback/
Disallow: /comments/
Disallow: /wp-admin/
Disallow: /wp-content/
Disallow: /wp-includes/
Disallow: /wpau-backup/

I think the other example wasn't quite correct.

11-25-2008, 03:33 AM	#5 (permalink)
futurepro building a porn empire Join Date: Aug 2008 Location: Oakville, Ontario, Canada Posts: 104 Points: 520	The following is what mine looks like: # PREVENT SE INDEXING OF THE FOLLOWING User-agent: * Disallow: /contact-us/ Disallow: /about/ Disallow: /2008/ Disallow: /2009/ Disallow: /2010/ Disallow: /category/ Disallow: /page/ Disallow: /feed/ Disallow: /trackback/ Disallow: /comments/ Disallow: /wp-admin/ Disallow: /wp-content/ Disallow: /wp-includes/ Disallow: /wpau-backup/ I think the other example wasn't quite correct. __________________ netpond the best