Forums / Setup & design / Site not being indexed by google?: Solution

Site not being indexed by google?: Solution

Author Message

Bruce Morrison

Thursday 27 November 2003 1:59:43 pm

Hi all

I have worked on a number of sites over the last 12 months and was becoming increasinging frustrated because theyy were not being spidered beyond the home page by google. I found the reason this week!

Have you noticed that on some ezPublsih sites, the first page visited will have links will have appended something like "?PHPSESSID=b0da36931dc38bd1f04e9a7af8c5b165" ?

Well this is the issue!

From another CMS mailing list I'm on:

"We were having a problem getting our action app content indexed (by google search, not news), so i asked my brother who had just started working at Google. He said:

1. yes, they do index the query string (stuff after the ?).
2. in order to do so, they pay attention to the problem of session variables in the query string by assuming that anything that looks like a session variable is one.
3. the long item ids are thus assumed to be session variables, and aren't getting spidered (i don't know the exact rule, but probably any string longer than 16 chars is going to be assumed to be a session variable).
4. they were trying to improve their algorithm for figuring out what's a session variable and what isn't."

This issue is not a specific ezPublish one but relates to the fact that it uses sessions and a PHP default configuration.

The php configuration item is "session.use_trans_sid"

This needs to be turned off and the session information will dissappear from the link, the site will work fine and google will get beyond your home page.

See http://martin.f2o.org/php/session for details.

Cheers
Bruce
http://www.designit.com.au/

My Blog: http://www.stuffandcontent.com/
Follow me on twitter: http://twitter.com/brucemorrison
Consolidated eZ Publish Feed : http://friendfeed.com/rooms/ez-publish

Tristan Koen

Friday 28 November 2003 12:30:55 am

Brilliant Bruce!

We used to have exactly that problem too.... Google only indexed the landing page.
Our host recently upgraded to PHP4.2.2 and suddenly Google indexed over 150 pages.

Never managed to figure out why until now.

bisk

Friday 28 November 2003 2:38:16 am

I'm having the same problems with sessid's on the first page and google as well.

I guess not anymore, thanks Bruce.

The .htaccess fix works nicely.

-------------------------------
http://www.kookfijn.nl & http://www.magento.be

Simion Ward

Wednesday 17 December 2003 3:43:12 pm

Add the following meta tags to your site.ini.append file:

[SiteSettings]
MetaDataArray[robots]=all
MetaDataArray[robots]=index,follow
MetaDataArray[revisit after]=5 days

Should help with indexing.

Simon
http://www.webrak.co.uk

Simion Ward

Thursday 18 December 2003 2:11:49 am

just a quick note: google indexed 25 megs of my site last night after I made this change.

eZ debug

Timing: Jan 18 2025 14:55:41
Script start
Timing: Jan 18 2025 14:55:41
Module start 'content'
Timing: Jan 18 2025 14:55:41
Module end 'content'
Timing: Jan 18 2025 14:55:41
Script end

Main resources:

Total runtime0.2000 sec
Peak memory usage2,048.0000 KB
Database Queries141

Timing points:

CheckpointStart (sec)Duration (sec)Memory at start (KB)Memory used (KB)
Script start 0.00000.0144 587.8438180.8125
Module start 'content' 0.01440.0159 768.656397.9297
Module end 'content' 0.03040.1695 866.5859528.3750
Script end 0.1999  1,394.9609 

Time accumulators:

 Accumulator Duration (sec) Duration (%) Count Average (sec)
Ini load
Load cache0.01276.3622200.0006
Check MTime0.00130.6434200.0001
Mysql Total
Database connection0.00050.263110.0005
Mysqli_queries0.129264.62041410.0009
Looping result0.00100.50731390.0000
Template Total0.169284.610.1692
Template load0.00070.371410.0007
Template processing0.168584.235410.1685
Override
Cache load0.00050.257510.0005
Sytem overhead
Fetch class attribute can translate value0.00231.128410.0023
XML
Image XML parsing0.00020.111510.0002
General
dbfile0.021810.9244200.0011
String conversion0.00000.002530.0000
Note: percentages do not add up to 100% because some accumulators overlap

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
CSS0extension/community/design/community/stylesheets/ext/jquery.autocomplete.css
extension/community_design/design/suncana/stylesheets/scrollbars.css
extension/community_design/design/suncana/stylesheets/tabs.css
extension/community_design/design/suncana/stylesheets/roadmap.css
extension/community_design/design/suncana/stylesheets/content.css
extension/community_design/design/suncana/stylesheets/star-rating.css
extension/community_design/design/suncana/stylesheets/syntax_and_custom_tags.css
extension/community_design/design/suncana/stylesheets/buttons.css
extension/community_design/design/suncana/stylesheets/tweetbox.css
extension/community_design/design/suncana/stylesheets/jquery.fancybox-1.3.4.css
extension/bcsmoothgallery/design/standard/stylesheets/magnific-popup.css
extension/sevenx/design/simple/stylesheets/star_rating.css
extension/sevenx/design/simple/stylesheets/libs/fontawesome/css/all.min.css
extension/sevenx/design/simple/stylesheets/main.v02.css
extension/sevenx/design/simple/stylesheets/main.v02.res.css
JS0extension/ezjscore/design/standard/lib/yui/3.17.2/build/yui/yui-min.js
extension/ezjscore/design/standard/javascript/jquery-3.7.0.min.js
extension/community_design/design/suncana/javascript/jquery.ui.core.min.js
extension/community_design/design/suncana/javascript/jquery.ui.widget.min.js
extension/community_design/design/suncana/javascript/jquery.easing.1.3.js
extension/community_design/design/suncana/javascript/jquery.ui.tabs.js
extension/community_design/design/suncana/javascript/jquery.hoverIntent.min.js
extension/community_design/design/suncana/javascript/jquery.popmenu.js
extension/community_design/design/suncana/javascript/jScrollPane.js
extension/community_design/design/suncana/javascript/jquery.mousewheel.js
extension/community_design/design/suncana/javascript/jquery.cycle.all.js
extension/sevenx/design/simple/javascript/jquery.scrollTo.js
extension/community_design/design/suncana/javascript/jquery.cookie.js
extension/community_design/design/suncana/javascript/ezstarrating_jquery.js
extension/community_design/design/suncana/javascript/jquery.initboxes.js
extension/community_design/design/suncana/javascript/app.js
extension/community_design/design/suncana/javascript/twitterwidget.js
extension/community_design/design/suncana/javascript/community.js
extension/community_design/design/suncana/javascript/roadmap.js
extension/community_design/design/suncana/javascript/ez.js
extension/community_design/design/suncana/javascript/ezshareevents.js
extension/sevenx/design/simple/javascript/main.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1pagelayout.tpl<No override>extension/sevenx/design/simple/templates/pagelayout.tplEdit templateOverride template
 Number of times templates used: 1
 Number of unique templates used: 1

Time used to render debug report: 0.0002 secs