Session IDs

Wondering why that MOD you have won't install correctly? Let's take a look
Forum rules
DO NOT give out any FTP passwords to anyone! There is no reason to do so! If you need help badly enough, create a temporary FTP account that is restricted to only the files that you need help with and give the information for that. Giving out FTP information can be very dangerous!
Locked
RebelOne
Posts: 125
Joined: Sun Aug 06, 2006 5:49 am
Contact:

Session IDs

Post by RebelOne »

Im trying to make my forum friendly to indexed by google. Is the mod that able2know.com offering a good mod to use? Im using phpbb 2.0.21 with a few mods.

you can view my meta tags at http://www.texas-rebel.com/forum" target="_blank

How can I make my forum index friendly?

Nightrider
Registered User
Posts: 7219
Joined: Tue Nov 16, 2004 8:54 pm
Location: Florida, US
Contact:

Re: Session IDs

Post by Nightrider »

I really don't know that much about marketing the sites and improving your site's position with Google and I really have no idea what able2know.com has to offer. I know you can control where the Search engines go using a robots.txt file and Meta tags are supposed to help as well. I really can't tell you how much though. I have seen 100's of search bots scowering my site from time to time. I really don't know how to make them work better to promote my site though...

Here's an example of my robots.txt file:

Code: Select all

User-agent: *
Disallow: /cgi-bin/

User-agent: Mediapartners-Google* 
Disallow: 

User-agent: BotRightHere 
Disallow: / 

User-agent: WebZip 
Disallow: / 

User-agent: larbin 
Disallow: / 

User-agent: b2w/0.1 
Disallow: / 

User-agent: Copernic 
Disallow: / 

User-agent: psbot 
Disallow: / 

User-agent: Python-urllib 
Disallow: / 

User-agent: NetMechanic 
Disallow: / 

User-agent: URL_Spider_Pro 
Disallow: / 

User-agent: CherryPicker 
Disallow: / 

User-agent: EmailCollector 
Disallow: / 

User-agent: EmailSiphon 
Disallow: / 

User-agent: WebBandit 
Disallow: / 

User-agent: EmailWolf 
Disallow: / 

User-agent: ExtractorPro 
Disallow: / 

User-agent: CopyRightCheck 
Disallow: / 

User-agent: Crescent 
Disallow: / 

User-agent: SiteSnagger 
Disallow: / 

User-agent: ProWebWalker 
Disallow: / 

User-agent: CheeseBot 
Disallow: / 

User-agent: LNSpiderguy 
Disallow: / 

User-agent: Alexibot 
Disallow: / 

User-agent: Teleport 
Disallow: / 

User-agent: TeleportPro 
Disallow: / 

User-agent: MIIxpc 
Disallow: / 

User-agent: Telesoft 
Disallow: / 

User-agent: Website Quester 
Disallow: / 

User-agent: WebZip 
Disallow: / 

User-agent: moget/2.1 
Disallow: / 

User-agent: WebZip/4.0 
Disallow: / 

User-agent: WebStripper 
Disallow: / 

User-agent: WebSauger 
Disallow: / 

User-agent: WebCopier 
Disallow: / 

User-agent: NetAnts 
Disallow: / 

User-agent: Mister PiX 
Disallow: / 

User-agent: WebAuto 
Disallow: / 

User-agent: TheNomad 
Disallow: / 

User-agent: WWW-Collector-E 
Disallow: / 

User-agent: RMA 
Disallow: / 

User-agent: libWeb/clsHTTP 
Disallow: / 

User-agent: asterias 
Disallow: / 

User-agent: httplib 
Disallow: / 

User-agent: turingos 
Disallow: / 

User-agent: spanner 
Disallow: / 

User-agent: InfoNaviRobot 
Disallow: / 

User-agent: Harvest/1.5 
Disallow: / 

User-agent: Bullseye/1.0 
Disallow: / 

User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95) 
Disallow: / 

User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 
Disallow: / 

User-agent: CherryPickerSE/1.0 
Disallow: / 

User-agent: CherryPickerElite/1.0 
Disallow: / 

User-agent: WebBandit/3.50 
Disallow: / 

User-agent: NICErsPRO 
Disallow: / 

User-agent: Microsoft URL Control - 5.01.4511 
Disallow: / 

User-agent: DittoSpyder 
Disallow: / 

User-agent: Foobot 
Disallow: / 

User-agent: SpankBot 
Disallow: / 

User-agent: BotALot 
Disallow: / 

User-agent: lwp-trivial/1.34 
Disallow: / 

User-agent: lwp-trivial 
Disallow: / 

User-agent: BunnySlippers 
Disallow: / 

User-agent: Microsoft URL Control - 6.00.8169 
Disallow: / 

User-agent: URLy Warning 
Disallow: / 

User-agent: Wget/1.6 
Disallow: / 

User-agent: Wget/1.5.3 
Disallow: / 

User-agent: Wget 
Disallow: / 

User-agent: LinkWalker 
Disallow: / 

User-agent: cosmos 
Disallow: / 

User-agent: moget 
Disallow: / 

User-agent: hloader 
Disallow: / 

User-agent: humanlinks 
Disallow: / 

User-agent: LinkextractorPro 
Disallow: / 

User-agent: Offline Explorer 
Disallow: / 

User-agent: Mata Hari 
Disallow: / 

User-agent: LexiBot 
Disallow: / 

User-agent: Web Image Collector 
Disallow: / 

User-agent: The Intraformant 
Disallow: / 

User-agent: True_Robot/1.0 
Disallow: / 

User-agent: True_Robot 
Disallow: / 

User-agent: BlowFish/1.0 
Disallow: / 

User-agent: JennyBot 
Disallow: / 

User-agent: MIIxpc/4.2 
Disallow: / 

User-agent: BuiltBotTough 
Disallow: / 

User-agent: ProPowerBot/2.14 
Disallow: / 

User-agent: BackDoorBot/1.0 
Disallow: / 

User-agent: toCrawl/UrlDispatcher 
Disallow: / 

User-agent: suzuran 
Disallow: / 

User-agent: TightTwatBot 
Disallow: / 

User-agent: VCI WebViewer VCI WebViewer Win32 
Disallow: / 

User-agent: VCI 
Disallow: / 

User-agent: Szukacz/1.4 
Disallow: / 

User-agent: Openfind data gatherer 
Disallow: / 

User-agent: Openfind 
Disallow: / 

User-agent: Xenu's Link Sleuth 1.1c 
Disallow: / 

User-agent: Xenu's 
Disallow: / 

User-agent: Zeus 
Disallow: / 

User-agent: RepoMonkey Bait & Tackle/v1.01 
Disallow: / 

User-agent: RepoMonkey 
Disallow: / 

User-agent: Microsoft URL Control 
Disallow: / 

User-agent: Openbot 
Disallow: / 

User-agent: URL Control 
Disallow: / 

User-agent: Zeus Link Scout 
Disallow: / 

User-agent: Zeus 32297 Webster Pro V2.9 Win32 
Disallow: / 

User-agent: Webster Pro 
Disallow: / 

User-agent: EroCrawler 
Disallow: / 

User-agent: LinkScan/8.1a Unix 
Disallow: / 

User-agent: Keyword Density/0.9 
Disallow: / 

User-agent: Kenjin Spider 
Disallow: / 

User-agent: Iron33/1.0.2 
Disallow: / 

User-agent: Bookmark search tool 
Disallow: / 

User-agent: GetRight/4.2 
Disallow: / 

User-agent: FairAd Client 
Disallow: / 

User-agent: Gaisbot 
Disallow: / 

User-agent: Aqua_Products 
Disallow: / 

User-agent: Radiation Retriever 1.1 
Disallow: / 

User-agent: Flaming AttackBot 
Disallow: / 

Image

RebelOne
Posts: 125
Joined: Sun Aug 06, 2006 5:49 am
Contact:

Re: Session IDs

Post by RebelOne »

where is the robots.txt?

Nightrider
Registered User
Posts: 7219
Joined: Tue Nov 16, 2004 8:54 pm
Location: Florida, US
Contact:

Re: Session IDs

Post by Nightrider »

You have to create the robots.txt file. I placed mine in the domain root...

Image

RebelOne
Posts: 125
Joined: Sun Aug 06, 2006 5:49 am
Contact:

Re: Session IDs

Post by RebelOne »

why do you disallow all those user agents in your text file?

Nightrider
Registered User
Posts: 7219
Joined: Tue Nov 16, 2004 8:54 pm
Location: Florida, US
Contact:

Re: Session IDs

Post by Nightrider »

A lot of these search bots are rogue and I wouldn't want to be listed in their search engines. I found this from another security site that discussed what to disallow...

Image

RebelOne
Posts: 125
Joined: Sun Aug 06, 2006 5:49 am
Contact:

Re: Session IDs

Post by RebelOne »

what does rogue mean? i found these mods that remove session ids for google bot. would you recommend the install? please visit this page

to see the mods

http://www.phpbb.com/kb/article.php?article_id=29" target="_blank

Nightrider
Registered User
Posts: 7219
Joined: Tue Nov 16, 2004 8:54 pm
Location: Florida, US
Contact:

Re: Session IDs

Post by Nightrider »

By rogue, I mean bots that are phishing for data from your messages so that they can use against you and your members...

I really don't know enough about marketing through the search engines to tell you the best things to try and do. You can try installing those two MODs and see what happens. I can't imagine that it could hurt unless the MODs are flawed...

Image

RebelOne
Posts: 125
Joined: Sun Aug 06, 2006 5:49 am
Contact:

Re: Session IDs

Post by RebelOne »

i installed the first one, but i guess theres no way to know if it actually works in helping google index sites.

RebelOne
Posts: 125
Joined: Sun Aug 06, 2006 5:49 am
Contact:

Re: Session IDs

Post by RebelOne »

so is this okay for google and yahoo and excite...
is my syntax correct on those folders?
and what is that mediapartners-google thing?

Code: Select all

User-agent: *
Disallow: /cgi-bin/
Disallow: /mystuff/
Disallow: /private/

User-agent: Mediapartners-Google* 
Disallow: 

User-agent: BotRightHere 
Disallow: / 

User-agent: WebZip 
Disallow: / 

User-agent: larbin 
Disallow: / 

User-agent: b2w/0.1 
Disallow: / 

User-agent: Copernic 
Disallow: / 

User-agent: psbot 
Disallow: / 

User-agent: Python-urllib 
Disallow: / 

User-agent: NetMechanic 
Disallow: / 

User-agent: URL_Spider_Pro 
Disallow: / 

User-agent: CherryPicker 
Disallow: / 

User-agent: EmailCollector 
Disallow: / 

User-agent: EmailSiphon 
Disallow: / 

User-agent: WebBandit 
Disallow: / 

User-agent: EmailWolf 
Disallow: / 

User-agent: ExtractorPro 
Disallow: / 

User-agent: CopyRightCheck 
Disallow: / 

User-agent: Crescent 
Disallow: / 

User-agent: SiteSnagger 
Disallow: / 

User-agent: ProWebWalker 
Disallow: / 

User-agent: CheeseBot 
Disallow: / 

User-agent: LNSpiderguy 
Disallow: / 

User-agent: Alexibot 
Disallow: / 

User-agent: Teleport 
Disallow: / 

User-agent: TeleportPro 
Disallow: / 

User-agent: MIIxpc 
Disallow: / 

User-agent: Telesoft 
Disallow: / 

User-agent: Website Quester 
Disallow: / 

User-agent: WebZip 
Disallow: / 

User-agent: moget/2.1 
Disallow: / 

User-agent: WebZip/4.0 
Disallow: / 

User-agent: WebStripper 
Disallow: / 

User-agent: WebSauger 
Disallow: / 

User-agent: WebCopier 
Disallow: / 

User-agent: NetAnts 
Disallow: / 

User-agent: Mister PiX 
Disallow: / 

User-agent: WebAuto 
Disallow: / 

User-agent: TheNomad 
Disallow: / 

User-agent: WWW-Collector-E 
Disallow: / 

User-agent: RMA 
Disallow: / 

User-agent: libWeb/clsHTTP 
Disallow: / 

User-agent: asterias 
Disallow: / 

User-agent: httplib 
Disallow: / 

User-agent: turingos 
Disallow: / 

User-agent: spanner 
Disallow: / 

User-agent: InfoNaviRobot 
Disallow: / 

User-agent: Harvest/1.5 
Disallow: / 

User-agent: Bullseye/1.0 
Disallow: / 

User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95) 
Disallow: / 

User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 
Disallow: / 

User-agent: CherryPickerSE/1.0 
Disallow: / 

User-agent: CherryPickerElite/1.0 
Disallow: / 

User-agent: WebBandit/3.50 
Disallow: / 

User-agent: NICErsPRO 
Disallow: / 

User-agent: Microsoft URL Control - 5.01.4511 
Disallow: / 

User-agent: DittoSpyder 
Disallow: / 

User-agent: Foobot 
Disallow: / 

User-agent: SpankBot 
Disallow: / 

User-agent: BotALot 
Disallow: / 

User-agent: lwp-trivial/1.34 
Disallow: / 

User-agent: lwp-trivial 
Disallow: / 

User-agent: BunnySlippers 
Disallow: / 

User-agent: Microsoft URL Control - 6.00.8169 
Disallow: / 

User-agent: URLy Warning 
Disallow: / 

User-agent: Wget/1.6 
Disallow: / 

User-agent: Wget/1.5.3 
Disallow: / 

User-agent: Wget 
Disallow: / 

User-agent: LinkWalker 
Disallow: / 

User-agent: cosmos 
Disallow: / 

User-agent: moget 
Disallow: / 

User-agent: hloader 
Disallow: / 

User-agent: humanlinks 
Disallow: / 

User-agent: LinkextractorPro 
Disallow: / 

User-agent: Offline Explorer 
Disallow: / 

User-agent: Mata Hari 
Disallow: / 

User-agent: LexiBot 
Disallow: / 

User-agent: Web Image Collector 
Disallow: / 

User-agent: The Intraformant 
Disallow: / 

User-agent: True_Robot/1.0 
Disallow: / 

User-agent: True_Robot 
Disallow: / 

User-agent: BlowFish/1.0 
Disallow: / 

User-agent: JennyBot 
Disallow: / 

User-agent: MIIxpc/4.2 
Disallow: / 

User-agent: BuiltBotTough 
Disallow: / 

User-agent: ProPowerBot/2.14 
Disallow: / 

User-agent: BackDoorBot/1.0 
Disallow: / 

User-agent: toCrawl/UrlDispatcher 
Disallow: / 

User-agent: suzuran 
Disallow: / 

User-agent: TightTwatBot 
Disallow: / 

User-agent: VCI WebViewer VCI WebViewer Win32 
Disallow: / 

User-agent: VCI 
Disallow: / 

User-agent: Szukacz/1.4 
Disallow: / 

User-agent: Openfind data gatherer 
Disallow: / 

User-agent: Openfind 
Disallow: / 

User-agent: Xenu's Link Sleuth 1.1c 
Disallow: / 

User-agent: Xenu's 
Disallow: / 

User-agent: Zeus 
Disallow: / 

User-agent: RepoMonkey Bait & Tackle/v1.01 
Disallow: / 

User-agent: RepoMonkey 
Disallow: / 

User-agent: Microsoft URL Control 
Disallow: / 

User-agent: Openbot 
Disallow: / 

User-agent: URL Control 
Disallow: / 

User-agent: Zeus Link Scout 
Disallow: / 

User-agent: Zeus 32297 Webster Pro V2.9 Win32 
Disallow: / 

User-agent: Webster Pro 
Disallow: / 

User-agent: EroCrawler 
Disallow: / 

User-agent: LinkScan/8.1a Unix 
Disallow: / 

User-agent: Keyword Density/0.9 
Disallow: / 

User-agent: Kenjin Spider 
Disallow: / 

User-agent: Iron33/1.0.2 
Disallow: / 

User-agent: Bookmark search tool 
Disallow: / 

User-agent: GetRight/4.2 
Disallow: / 

User-agent: FairAd Client 
Disallow: / 

User-agent: Gaisbot 
Disallow: / 

User-agent: Aqua_Products 
Disallow: / 

User-agent: Radiation Retriever 1.1 
Disallow: / 

User-agent: Flaming AttackBot 
Disallow: / 

Locked