4images Forum & Community

4images Issues / Ausgaben => Discussion & Troubleshooting => Topic started by: flashback on August 24, 2006, 04:21:02 AM

Title: NOINDEX, FOLLOW in details.html
Post by: flashback on August 24, 2006, 04:21:02 AM

I have the dynamic page title/mod_rewrite modification installed..so when my site is like this on an image details page, http://example.com/img342.htm

if I were to add a noindex,nofollow meta tag in the details.html, will search engine bots ignore those pages and won't crawl them?

i don't want the details pages crawled because it adds thousands of useless urls

thanks

Title: Re: NOINDEX, FOLLOW in details.html
Post by: V@no on August 24, 2006, 07:08:27 AM

search google for "robots.txt" with that you should be able restrict bots from crawling pages you dont want them to.