Help me to correct this robots.txt

Status
Not open for further replies.
O

ooen

I have the following robots.txt, but apparently, this is not working, since Google still has post-*.html pages in its index. What's the problem here?
Code:
User-agent: *

Disallow: post-*.html$
Disallow: updates-topic.html*$
Disallow: stop-updates-topic.html*$
Disallow: ptopic*.html$
Disallow: ntopic*.html$
 
O

ooen

myshtern said:
Why would you want to take that out?
post-*.html pages are essentially duplicate. update-topic.html* pages are meaningless. So are stop-updates-topic.html*, ptopic*.html and ntopic*.html. These pages only spread out PR too thin.
 
Status
Not open for further replies.
Top