Bots

LiamMcilveen · Post by **LiamMcilveen** » Sun Sep 10, 2006 11:00 pm

I cant seem to find any info on bots, can someone either point me to a post or give me a quick rundown of the purpose of the bots, and how to run one.

harmlessgoat22 · Post by **harmlessgoat22** » Sun Sep 10, 2006 11:53 pm

Bots are things that go on your site and look through it. Search engines use Bots to index pages, but that is not the only kind of Bot.

LiamMcilveen · Post by **LiamMcilveen** » Sun Sep 10, 2006 11:58 pm

Ok thankyou, and how do make it operate, or does it do it automatically.

harmlessgoat22 · Post by **harmlessgoat22** » Mon Sep 11, 2006 12:00 am

You have to submit your website to google, yahoo, etc. search engines and then after about a month or less they will send a Bot to your site to review it. After that, they will periodically come back to check for new content and such.

LiamMcilveen · Post by **LiamMcilveen** » Mon Sep 11, 2006 12:05 am

Ok thankyou, and how do make it operate, or does it do it automatically.

Lastof · Post by **Lastof** » Mon Sep 11, 2006 12:12 am

The Bots system in phpBB 3.0 "Olympus" recognises a bot in it's list and presents them with only the data they need to see, such as the posts, but not that which they don't, such as the posting/reply page.

It is possible to add new bots, however upon the release of phpBB 3.0 we have been told that all major search engine bots will have already been preconfigured into the database, so it shouldn't really be necessary.

LiamMcilveen · Post by **LiamMcilveen** » Mon Sep 11, 2006 12:51 am

ok chears guys

LiamMcilveen

Eelke · Post by **Eelke** » Mon Sep 11, 2006 8:05 am

Lastof wrote: The Bots system in phpBB 3.0 "Olympus" recognises a bot in it's list and presents them with only the data they need to see, such as the posts, but not that which they don't, such as the posting/reply page.

Not to mention that:
- bots tend to open up a whole bunch of sessions, which without bot support looks like you have a whole bunch of guest users (as is the case with phpBB 2).
- with bot detection, it's possible to not give a bot a session ID in its URL (would happen if they were a regular user), which would result in the search engine thinking there are a seemingly limitless number of URLs to the same page (which wil get the page penalized).

Highway of Life · Post by **Highway of Life** » Mon Sep 11, 2006 9:07 pm

Re: Bots tend to open a lot of sessions.
Yes, very much so.

MSNbot and Googlebot were the worst, followed closely by the ever present Gigabot.
The problem I found was that phpBB3 did not come installed with a correct list of (5) bots, 3 of which are outdated.
So thanks to Meik, I was able to add some 100+ bots to my forum, and it brought the sessions down quite a bit.

HebRew · Post by **HebRew** » Sun Sep 17, 2006 12:14 pm

I suppose to create bots? create MSNBot and etc.

Development Discussion Board