All SEO Plugin v1.5 has new file readme.txt included I’ll tell you more about this file and what problems it fixes.
First I offer you to read this post about Duplicate content and README.TXT was made to fix this problem. This file tells GOOGLE and other search engines what they should index and what thay should not take into consideration.
Why this is good thing:
- Search engines index your website faster if they index only pages that is importand without all Duplicate garbige.
- You will not get any penalties for the Duplicate stuff from Big G!
- this is just right thing to have website without duplicate content.
ROBOT.XTX – solve Duplicate problem for:
- Index page
- Profile page
- Pages on other languages (if website has 2 or more languages)
- Pages like Terms Of Use, Privacy policy, FAQ, etc – there are many website based on Dolphin in the Internet and all of them has the same page content for this pages. Search engines does not need to see these page only users need them.
here is the robot.txt file content
================
User-agent: *
Disallow: *lang=*
Disallow: *sh_photoMode=*
Disallow: *sh_videoMode=*
Disallow: *sh_musicMode=*
Disallow: *events_mode=*
Disallow: *Mode_p=*
Disallow: *members_mode=*
Disallow: *groups_mode=*
Disallow: *classifieds_mode=*
Disallow: *blogs_mode=*
Disallow: *tags_mode=*
Disallow: *ppoll_mode=*
Disallow: *lang=*
Disallow: */search/tag/*
Disallow: /about_us.php
Disallow: /privacy.php
Disallow: /terms_of_use.php
Disallow: /faq.php
==========================
You are free to use it and get more from SEO!
You are so right! I hope with a time the people think about and say damn the earth is not flat neverteless. Boonex has a duplicate content problem! But here is the solution!
Thats great for dolphin! It works good. But there are still some areas with duplicate content like galerys with huge number of IDs and search sites:
search.php?LookingFor[0]=male&Sex[0]=male&DateOfBirth[0]=20&DateOfBirth[1]=25&res_per_page=10&page=2
/search.php?LookingFor[0]=male&Sex[0]=male&DateOfBirth[0]=19&DateOfBirth[1]=33&res_per_page=10&page=2
/photos_gallery.php?ID=2163&photoID=1128
/photos_gallery.php?ID=2105&photoID=1114
They are all generated automaticly with the same header and description. Do you think we should also block this via robots.txt?
Best wishes,
Michael