Author Topic: NOINDEX, FOLLOW in details.html  (Read 2447 times)

0 Members and 1 Guest are viewing this topic.

Offline flashback

  • Pre-Newbie
  • Posts: 3
    • View Profile
NOINDEX, FOLLOW in details.html
« on: August 24, 2006, 04:21:02 AM »
I have the dynamic page title/mod_rewrite modification installed..so when my site is like this on an image details page, http://example.com/img342.htm

if I were to add a noindex,nofollow meta tag in the details.html, will search engine bots ignore those pages and won't crawl them?

i don't want the details pages crawled because it adds thousands of useless urls

thanks

Offline V@no

  • If you don't tell me what to do, I won't tell you where you should go :)
  • Global Moderator
  • 4images Guru
  • *****
  • Posts: 17.849
  • mmm PHP...
    • View Profile
    • 4images MODs Demo
Re: NOINDEX, FOLLOW in details.html
« Reply #1 on: August 24, 2006, 07:08:27 AM »
search google for "robots.txt" with that you should be able restrict bots from crawling pages you dont want them to.
Your first three "must do" before you ask a question:
Please do not PM me asking for help unless you've been specifically asked to do so. Such PMs will be deleted without answer. (forum rule #6)
Extension for Firefox/Thunderbird: Master Password+    Back/Forward History Tweaks (restartless)    Cookies Manager+    Fit Images (restartless for Thunderbird)