4images Forum & Community

4images Issues / Ausgaben => Discussion & Troubleshooting => Topic started by: I_Want_Mods_2 on March 15, 2009, 09:56:16 AM

Title: Duplicate content (duplicate pages)
Post by: I_Want_Mods_2 on March 15, 2009, 09:56:16 AM

site.com/details.php?image_id=22 and site.com/details.php?image_id=22&mode=search has duplicate content. Don't you think this may cause troubles with the search engines?

Title: Re: Duplicate content (duplicate pages)
Post by: KurtW on March 15, 2009, 10:04:20 AM

and i hope, you don't use multilanguage... a lot of duplicate content  8O  :wink:

site.com/details.php?image_id=22&l=deutsch
site.com/details.php?image_id=22&l=english
site.com/details.php?image_id=22&l=french
....
site.com/index.php?image_id=22&l=deutsch
site.com/index.php?image_id=22&l=english
site.com/index.php?image_id=22&l=french
...

Kurt

Title: Re: Duplicate content (duplicate pages)
Post by: I_Want_Mods_2 on March 15, 2009, 11:11:50 AM

Quote from: KurtW on March 15, 2009, 10:04:20 AM

and i hope, you don't use multilanguage... a lot of duplicate content  8O  :wink:

site.com/details.php?image_id=22&l=deutsch
site.com/details.php?image_id=22&l=english
site.com/details.php?image_id=22&l=french
....
site.com/index.php?image_id=22&l=deutsch
site.com/index.php?image_id=22&l=english
site.com/index.php?image_id=22&l=french
...

Kurt

wtf?!?!?!?!?!?!?!?!?  8O :? :( :x :cry: :evil:
How can I put noindex in site.com/details.php?image_id=22&mode=search  :?:

Title: Re: Duplicate content (duplicate pages)
Post by: I_Want_Mods_2 on March 18, 2009, 05:26:12 PM

I want to disallow site.com/details.php?image_id=22&mode=search to be indexed. Can I do this by writing

Code: [Select]

User-agent: *
Disallow: /search.php
Disallow: /*&mode=search$in robots.txt?

Title: Re: Duplicate content (duplicate pages)
Post by: Nicky on March 18, 2009, 07:39:06 PM

yes,
disallow command belongs to robots.txt

more on http://www.google.com/support/webmasters/bin/answer.py?answer=40360&hl=en

Title: Re: Duplicate content (duplicate pages)
Post by: V@nо on March 18, 2009, 07:43:15 PM

a little correction:
no $ sign in this line

Code: [Select]

Disallow: /*&mode=search$

Title: Re: Duplicate content (duplicate pages)
Post by: I_Want_Mods_2 on March 19, 2009, 10:47:00 AM

Quote from: V@nо on March 18, 2009, 07:43:15 PM

no $ sign in this line

Code: [Select]

Disallow: /*&mode=search$

Why?

Title: Re: Duplicate content (duplicate pages)
Post by: V@no on March 19, 2009, 02:04:31 PM

because there is no guerantee that mode=search will the last item in the url
if anything this should be better:

Code: [Select]

Disallow: /*&mode=search(&|$)

Title: Re: Duplicate content (duplicate pages)
Post by: AntiNSA2 on May 17, 2009, 08:56:06 PM

CAn you tell me V@no if there are bad things to disallowing google bots to use search.php ?

Will this lower the content indexed or have other negative effects?

Title: Re: Duplicate content (duplicate pages)
Post by: whosthis.ee on June 12, 2009, 05:57:54 PM

the correct way to avoid search pages indexing in google is

add
Disallow: /*search.htm$

to robots.txt