GOOGLE wrote: It will in certain instances. What criteria is used to determine if a dynamic page is indexable is debatable. Most have found that clean, high ranking (High page rank) sites can get dynamic content indexed.
Problems:
Sites that use session tracking urls to give each visitor a dynamic url. These sites can generate an infinite amount of pages for a spider to visit. These types of pages, are usually blocked from being indexed by Google.
If a sites dynamic urls change between spidering. If possible, treat your dynamic urls as though they were static and never changing.
Code: Select all
##############################################################
## MOD Title: enhance-google-indexing
## MOD Author: Showscout & R. U. Serious
## MOD Description: If the User_agent includes the string 'Googlebot', then no session_ids are appended to links, which will (hopefully) allow google to index more than just your index-site.
## MOD Version: 0.9.1
##
## Installation Level: easy
## Installation Time: 2 Minutes
## Files To Edit: includes/sessions.php
## Included Files: n/a
##############################################################
## For Security Purposes, Please Check: http://www.phpbb.com/mods/downloads/ for the
## latest version of this MOD. Downloading this MOD from other sites could cause malicious code
## to enter into your phpBB Forum. As such, phpBB will not offer support for MOD's not offered
## in our MOD-Database, located at: http://www.phpbb.com/mods/downloads/
##############################################################
## Author Notes: There may be issues with register globals on newer
## PHP version. If you know for sure and also how to fix it post in
## this thread: http://www.phpbb.com/phpBB/viewtopic.php?t=32328
##
## Obviously, if someone thinks it's funny to surf around with a
## user_agent containing Googlebot and at the same time does not
## allow cookies, he will loose his session/login on every pageview.
## Should he complain to you, tell him to eat your shorts.
##
## If you want to add further crawlers look at the appropiate line and
## feel free to add part of the user_agent which should be _unique_
## unique to that, so a user is never confused with a bot.
##
##############################################################
## Version History: 0.9.0 initial release, only googlebot
## 0.9.1 added inktomi (MSN-search/crawler-bot)
##############################################################
## Before Adding This MOD To Your Forum, You Should Back Up All Files Related To This MOD
##############################################################
#-----[ OPEN ]------------------------------------------
includes/sessions.php
#-----[ FIND ]------------------------------------------
global $SID;
if ( !empty($SID) && !eregi('sid=', $url) )
#-----[ REPLACE WITH ]------------------------------------------
global $SID, $HTTP_SERVER_VARS;
if ( !empty($SID) && !eregi('sid=', $url) && !strstr($HTTP_SERVER_VARS['HTTP_USER_AGENT'] ,'Googlebot') && !strstr($HTTP_SERVER_VARS['HTTP_USER_AGENT'] ,'[email protected];'))
#
#-----[ SAVE/CLOSE ALL FILES ]------------------------------------------
#
# EoM
...setting up pages/links with the sole purpose of fooling search engines may result in permanent removal from our index.
cdk wrote: I'd been looking for a solution like that on this thread: http://www.phpbb.com/phpBB/viewtopic.php?t=31269
Thanks.