ARAMA MOTORUNA KAYIT

cilginsolist' Alıntı:

Robot.txt dosyasi botlar icin hazirlanan bir dosyadir bu dosyanin icerisinde botlarin sitende nereleri indexlemesi gerektigini nereleri indexlememesi gerektigini filan ayarlarsin.Simdi asagidaki örnek bir vbulletin sistem icin ftp bulunan bir robots.txt dosyasidir.
User-agent: *
allow: /
Disallow: /?ref=
Disallow: /admincp/
Disallow: /ajax.php
Disallow: /clientscript/
Disallow: /cpstyles/
Disallow: /images/
Disallow: /includes/
Disallow: /install/
Disallow: /subscriptions/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /announcement.php
Disallow: /attachment.php
Disallow: /calendar.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /faq.php
Disallow: /image.php
Disallow: /inlinemod.php
Disallow: /joinrequests.php
Disallow: /login.php
Disallow: /memberlist.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattachment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /payment_gateway.php
Disallow: /payments.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /showpost.php
Disallow: /subscription.php
Disallow: /usercp.php
Disallow: /threadrate.php
Disallow: /usernote.php
Disallow: /member_inlinemod.php
Disallow: /threadtag.php
Disallow: /archieve/
Disallow: /helpcenter/
Disallow: /ajax.php
Disallow: /converse.php
Disallow: /global.php
Disallow: /helpcenter.php
Disallow: /archive/
Disallow: /calendar.php
Disallow: /member.php?
Disallow: /announcement.php

robots.txt dosyasai ftp olmak mecburiyetinde degildir..

Genişletmek için tıkla ...