Author Topic: En Uygun Robots.txt ?  (Read 8398 times)

0 Members and 1 Guest are viewing this topic.

Offline dantey

  • Newbie
  • *
  • Posts: 11
    • View Profile
En Uygun Robots.txt ?
« on: March 02, 2012, 10:52:50 PM »
Arkadaşlar 4images için en uygun robots.txt nasıl olmalıdır?

Kullandıklarınızı paylaşabilir misiniz?

Offline boss24

  • Newbie
  • *
  • Posts: 49
    • View Profile
Re: En Uygun Robots.txt ?
« Reply #1 on: September 30, 2012, 06:59:23 PM »
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Allow: /
Disallow: /temp/       
Disallow: /logfiles/   
Disallow: /cgi-bin/   
Disallow: /member.php
Disallow: /admin/
Disallow: /captcha/
Disallow: /cache/
Disallow: /data/
Disallow: /data/media/
Disallow: /docs/
Disallow: /logs/
Disallow: /templates/
Disallow: /usage/
Disallow: /includes/
Disallow: /lang/
Disallow: /e-kart/
Disallow: /postcards/
Disallow: /*ref= *
Disallow: /*?ref=
Disallow: /*ref=*
Disallow: /ref=
Disallow: /sq.php/
Disallow: /*?sessionid=
Disallow: /*?l=english
Disallow: /*?l=deutsch
Disallow: /*?l=spanish
Disallow: /search.php
Disallow: /*&mode=search(&|$)
Disallow: /download.php
Disallow: /details.php?image_id=
Disallow: /categories.php?cat_id=
Disallow: /*&sessionid=
Disallow: /*&show_result=
Disallow: /*?show_result=
Allow: /sitemap.xml
Sitemap: http://www.siten.com/sitemap.xml