FRIHOST FORUMS SEARCH FAQ TOS BLOGS COMPETITIONS
You are invited to Log in or Register a free Frihost Account!


Google Bots





[FuN]goku
Can someone tell me how i would go about getting google bots to crawl my forums?? ive heard about robots.txt but i dont really get it.. so....
Scorpio
Robots.txt does not impact the crawling

It is used only to prevent the bot from crawling but cannot be forced to make it crawl

What you do is submit your site to google and wait for it to crawl thats all.

Use some sensible meta tags to help in the crawling
Jamatu
The more backlinks you create the more likely you are to get Googlebot or any other search engine bot to crawl your website. In addition to the increased likelyhood of a bot comming to your site you will also get a higher amount pages in total indexed. Take some of the large forums, for example www.phpbb.com and www.area51.phpbb.com/phpBB/ the major search engine crawlers basically live on these forums.

Check the screenshot that I just took


Making and submitting a sitemap to Google and Yahoo will also help in getting your site indexed.
Google - www.google.com/webmasters/sitemaps/login
Yahoo - http://search.yahoo.com/info/submit.html

Finally as scorpio said you can submit your site to google and other major search engines.
Related topics
To all of the Admin staff here at FriHosting...
Flash SEO
Blog or Forum? Opinions Please
PHP call to GetImageSize sometimes throws warnings
Google Tips
Miracles
does we really need to submit xml sitemap to google?
Rate my new design.
How to prepare a "robots.txt" to get crawled by Se
how to set: Mydomain+freends.afraid.org+gmail apps?
How to prepare a true "GOOGLE XML" file - SITEMAP.
How to get displayed in first ranks on Google?
Google's Video Sharing
Google gets license to operate China office
Reply to topic    Frihost Forum Index -> Webmaster and Internet -> SEO and Search Engines

FRIHOST HOME | FAQ | TOS | ABOUT US | CONTACT US | SITE MAP
© 2005-2011 Frihost, forums powered by phpBB.