Loading...
 
Features / Usability

Features / Usability


traffic caused by google search robots

posts: 3 Germany

Hi folks,

in the last few months I had unbelievable traffic caused by search machines.
In February the google robots were responsible for 4 Gigabyte traffic! This is far more
than all of my users generated! sad

Do you have an idea how to reduce this traffic?? question

On my normal homepage I use a metatag like this:
META NAME="REVISIT-AFTER" CONTENT="31 DAYS"

Can I do the same with my tikiwiki-system?

(My version: Tiki-Wiki-1-8-6 // PHP 4.4.2 // Linux // Apache)

Many thanks,

Wavecrest

posts: 1092

You can do it by changing the smarty template header.tpl and adding your line. The file is in the directory templates/styles/your_style where you_style is moreneat... or if not in the default location templates

You can also adjust the robots.txt file
sylvie


posts: 3 Germany

Thank you!

I changed the header.tpl - I hope it will work! mrgreen

What kind of text do I add to the robot.txt file?

Bye, Wavecrest.

posts: 1092


> What kind of text do I add to the robot.txt file?
It wouldn' do the same effect. But you can avoid browser to go in useless pages and retruce traffic

You have already in robots.txt in your tikwiki root. But in 1.8., it is not updated. Pick the one from 1.9 http://cvs.sourceforge.net/viewcvs.py/tikiwiki/tiki/robots.txt?rev=1.8&view=log a little better but still nor perfect. Follow the instruction at the top if you are in a subdirectory . Add other links

sylvie


posts: 3 Germany

Thank You!! biggrin I think your recommendation is very useful - Google caused the traffic especially with the file "tiki-pagehistory.php".

My installation is in the subdirectory "methoden" so I modified
the robots.txt in this way:

I hope everything works now!! biggrin

Bye, Wavecrest.

content of "MY" robtots.txt now:

User-agent: *
Disallow: /methoden/CVS/
Disallow: /methoden/lib/
Disallow: /methoden/doc/
Disallow: /methoden/dump/
Disallow: /methoden/img/
Disallow: /methoden/templates/
Disallow: /methoden/templates_c/
Disallow: /methoden/var/
Disallow: /methoden/lang/
Disallow: /methoden/backups/
Disallow: /methoden/bin/
Disallow: /methoden/db/
Disallow: /methoden/games/
Disallow: /methoden/images/
Disallow: /methoden/maps/
Disallow: /methoden/modules/
Disallow: /methoden/popups/
Disallow: /methoden/temp/
Disallow: /methoden/tests/
Disallow: /methoden/tikimovies/
Disallow: /methoden/tiki-install.php
Disallow: /methoden/tiki-admin.php
Disallow: /methoden/tiki-editpage.php
Disallow: /methoden/tiki-print.php
Disallow: /methoden/tiki-print_article.php
Disallow: /methoden/tiki-print_blog_post.php
Disallow: /methoden/tiki-print_multi_pages.php
Disallow: /methoden/tiki-print_pages.php
Disallow: /methoden/tiki-pagehistory.php
Disallow: /methoden/tiki-backlinks.php
Disallow: /methoden/tiki-likepages.php
Disallow: /methoden/tiki-listpages.php
Disallow: /methoden/tiki-lastchanges.php
Disallow: /methoden/tiki-orphan_pages.php
Disallow: /methoden/tiki-register.php
Disallow: /methoden/tiki-login_scr.php
Disallow: /methoden/tiki-view_cache.php
Disallow: /methoden/tiki-user_information.php
Disallow: /methoden/get_strings.php
Disallow: /methoden/tiki-index.php?page=SandBox
Disallow: /methoden/CVS/
Disallow: /methoden/lib/
Disallow: /methoden/doc/
Disallow: /methoden/dump/
Disallow: /methoden/img/
Disallow: /methoden/templates/
Disallow: /methoden/templates_c/
Disallow: /methoden/var/
Disallow: /methoden/lang/
Disallow: /methoden/backups/
Disallow: /methoden/bin/
Disallow: /methoden/db/
Disallow: /methoden/games/
Disallow: /methoden/images/
Disallow: /methoden/maps/
Disallow: /methoden/modules/
Disallow: /methoden/popups/
Disallow: /methoden/temp/
Disallow: /methoden/tests/
Disallow: /methoden/tikimovies/
Disallow: /methoden/tiki-install.php
Disallow: /methoden/tiki-admin.php
Disallow: /methoden/tiki-editpage.php
Disallow: /methoden/tiki-print.php
Disallow: /methoden/tiki-print_article.php
Disallow: /methoden/tiki-print_blog_post.php
Disallow: /methoden/tiki-print_multi_pages.php
Disallow: /methoden/tiki-print_pages.php
Disallow: /methoden/tiki-pagehistory.php
Disallow: /methoden/tiki-backlinks.php
Disallow: /methoden/tiki-likepages.php
Disallow: /methoden/tiki-listpages.php
Disallow: /methoden/tiki-lastchanges.php
Disallow: /methoden/tiki-orphan_pages.php
Disallow: /methoden/tiki-register.php
Disallow: /methoden/tiki-login_scr.php
Disallow: /methoden/tiki-view_cache.php
Disallow: /methoden/tiki-user_information.php
Disallow: /methoden/get_strings.php
Disallow: /methoden/tiki-index.php?page=SandBox
Disallow: /methoden/tiki-register.php
Disallow: /methoden/tiki-login_scr.php


Upcoming Events

1)  18 Apr 2024 14:00 GMT-0000
Tiki Roundtable Meeting
2)  16 May 2024 14:00 GMT-0000
Tiki Roundtable Meeting
3)  20 Jun 2024 14:00 GMT-0000
Tiki Roundtable Meeting
4)  18 Jul 2024 14:00 GMT-0000
Tiki Roundtable Meeting
5)  15 Aug 2024 14:00 GMT-0000
Tiki Roundtable Meeting
6)  19 Sep 2024 14:00 GMT-0000
Tiki Roundtable Meeting
7) 
Tiki birthday
8)  17 Oct 2024 14:00 GMT-0000
Tiki Roundtable Meeting
9)  21 Nov 2024 14:00 GMT-0000
Tiki Roundtable Meeting
10)  19 Dec 2024 14:00 GMT-0000
Tiki Roundtable Meeting