Robots.txt question: Can this work?

Status
Not open for further replies.
O

ooen

Can this work?
Code:
Disallow: post- ([1000-9999]+).html$
What I want to do is to not let SE crawl pages that have url string
Code:
post- *.html$
where * is bigger than 1000.
 
Status
Not open for further replies.
Top