Thema: Auswirkung von .htaccess auf Suchmaschinen?

Hallo,

inwiefern wirkt sich der Verzeichnisschutz des Adminordners auf Suchmaschinen aus? Ich war längere Zeit auf Platz 1 unterschiedlicher Suchbegriffe. Mit aktiviertem .htaccess des Adminordners jedoch nach einer gewissen Zeit unauffindbar.

Zum damaligen Zeitpunkt war jedoch kein Open-SEF aktiviert. Nun ist Open-SEF aktiviert und der Verzeichnisschutz über einen gewissen Zeitraum deaktiviert worden. Dank Open-SEF ist die Seite binnen kürzester Zeit wieder auf den oberen Rängen gelandet.

Ist damit zu rechnen, dass die HP mit aktiviertem Verzeichnisschutz .htaccess des Adminordners von den Suchmaschinen ignoriert wird?

Bin für jede Hilfe dankbar.

PS: Die Suche im Forum brachte leider nicht den gewünschten Erfolg.

Gruß
Christian

Hallo Zorro,

vielen Dank für die schnelle und vor allem kompetente Antwort. Habe soeben den Verzeichnisschutz aktiviert und hoffe, dass diesmal keine Nebenwirkungen auftreten.

Hier der Inhalt der administrator-htaccess (chmod 444):

AuthUserFile /www/htdocs/xxx//joomla/administrator//.htpasswd
AuthGroupFile /dev/null
AuthName ByPassword
AuthType Basic
<Limit GET POST>
require user xxx
</Limit>

Hier der Inhalt meiner Joomla-htaccess (chmod 444):

php_value register_globals off
php_flag register_globals off
php_flag magic_quotes_gpc on


# ---------------------------------------
RewriteEngine on

# Nice trick.. => 301-Redirect to themself...
RewriteCond %{ENV:banned} ^1$
RewriteCond %{HTTP_REFERER} ^(.*)$
RewriteRule ^(.*)$ %1 [R=301,L]

# In any case => 403-Forbidden
Order Deny,Allow
Deny from env=banned




##
# @version $Id: htaccess.txt 4756 2006-08-25 16:07:11Z stingrey $
# @package Joomla
# @copyright Copyright (C) 2005 Open Source Matters. All rights reserved.
# @license http://www.gnu.org/copyleft/gpl.html GNU/GPL
# Joomla! is Free Software
##


################################################## ###
# READ THIS COMPLETELY IF YOU CHOOSE TO USE THIS FILE
#
# The line just below this section: 'Options FollowSymLinks' may cause problems
# with some server configurations. It is required for use of mod_rewrite, but may already
# be set by your server administrator in a way that dissallows changing it in
# your .htaccess file. If using it causes your server to error out, comment it out (add # to
# beginning of line), reload your site in your browser and test your sef url's. If they work,
# it has been set by your server administrator and you do not need it set here.
#
# Only use one of the two SEF sections that follow. Lines that can be uncommented
# (and thus used) have only one #. Lines with two #'s should not be uncommented
# In the section that you don't use, all lines should start with #
#
# For Standard SEF, use the standard SEF section. You can comment out
# all of the RewriteCond lines and reduce your server's load if you
# don't have directories in your root named 'component' or 'content'
#
# If you are using a 3rd Party SEF or the Core SEF solution
# uncomment all of the lines in the '3rd Party or Core SEF' section
#
################################################## ###

##### SOLVING PROBLEMS WITH COMPONENT URL's that don't work #####
# SPECIAL NOTE FOR SMF USERS WHEN SMF IS INTEGRATED AND BRIDGED
# OR ANY SITUATION WHERE A COMPONENT's URL's AREN't WORKING
#
# In both the 'Standard SEF', and '3rd Party or Core SEF' sections the line:
# RewriteCond %{REQUEST_URI} ^(/component/option,com) [NC,OR] ##optional - see notes##
# May need to be uncommented. If you are running your Joomla/Mambo from
# a subdirectory the name of the subdirectory will need to be inserted into this
# line. For example, if your Joomla/Mambo is in a subdirectory called '/test/',
# change this:
# RewriteCond %{REQUEST_URI} ^(/component/option,com) [NC,OR] ##optional - see notes##
# to this:
# RewriteCond %{REQUEST_URI} ^(/test/component/option,com) [NC,OR] ##optional - see notes##
#
################################################## ###


## Can be commented out if causes errors, see notes above.
#Options FollowSymLinks

#
# mod_rewrite in use

RewriteEngine On


# Uncomment following line if your webserver's URL
# is not directly related to physical file paths.
# Update Your Joomla/MamboDirectory (just / for root)

RewriteBase /


########## Begin - Joomla! core SEF Section
############# Use this section if using ONLY Joomla! core SEF
## ALL (RewriteCond) lines in this section are only required if you actually
## have directories named 'content' or 'component' on your server
## If you do not have directories with these names, comment them out.
#
#RewriteCond %{REQUEST_FILENAME} !-f
#RewriteCond %{REQUEST_FILENAME} !-d
#RewriteCond %{REQUEST_URI} ^(/component/option,com) [NC,OR] ##optional - see notes##
#RewriteCond %{REQUEST_URI} (/|\.htm|\.php|\.html|/[^.]*)$ [NC]
#RewriteRule ^(content/|component/) index.php
#
########## End - Joomla! core SEF Section



########## Begin - 3rd Party SEF Section
############# Use this section if you are using a 3rd party (Non Joomla! core) SEF extension - e.g. OpenSEF, 404_SEF, 404SEFx, SEF Advance, etc
#
RewriteCond %{REQUEST_URI} ^(/component/option,com) [NC,OR] ##optional - see notes##
RewriteCond %{REQUEST_URI} (/|\.htm|\.php|\.html|/[^.]*)$ [NC]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule (.*) index.php
#
########## End - 3rd Party SEF Section



########## Begin - Rewrite rules to block out some common exploits
## If you experience problems on your site block out the operations listed below
## This attempts to block the most common type of exploit `attempts` to Joomla!
#
# Block out any script trying to set a mosConfig value through the URL
RewriteCond %{QUERY_STRING} mosConfig_[a-zA-Z_]{1,21}(=|\%3D) [OR]
# Block out any script trying to base64_encode crap to send via URL
RewriteCond %{QUERY_STRING} base64_encode.*\(.*\) [OR]
# Block out any script that includes a ********** tag in URL
RewriteCond %{QUERY_STRING} (\<|%3C).*script.*(\>|%3E) [NC,OR]
# Block out any script trying to set a PHP GLOBALS variable via URL
RewriteCond %{QUERY_STRING} GLOBALS(=|\[|\%[0-9A-Z]{0,2}) [OR]
# Block out any script trying to modify a _REQUEST variable via URL
RewriteCond %{QUERY_STRING} _REQUEST(=|\[|\%[0-9A-Z]{0,2})
# Send all blocked request to homepage with 403 Forbidden error!
RewriteRule ^(.*)$ index.php [F,L]
#
########## End - Rewrite rules to block out some common exploits

Aufgrund der begrenzten Zeichenanzahl für Posts hier noch die enthaltene User-Agent-Liste (enthalten in joomla-htaccess):

# ------------------------------------------
# Block (ban) referer spam in different ways
# ------------------------------------------

# Deny access to certain IPs
# --------------------------
#Deny from 148.244.150.
#Deny from 213.23.



# User-Agents with no privileges (mostly spambots/spybots/offline downloaders that ignore robots.txt)
# ---------------------------------------------------------------------------------------------------
#SetEnvIfNoCase User-Agent "^Mozilla/??$" banned
SetEnvIfNoCase User-Agent "^(google|i?explorer?\.exe|(MS)?IE( [0-9.]+)?[ ]?(Compatible( Browser)?)?)$" banned
SetEnvIfNoCase User-Agent "^(Mozilla( [0-9.]+)?[ ]?\((Windows|Linux|(IE )?Compatible)\))$" banned
SetEnvIfNoCase User-Agent "^[A-Z]+$" banned
SetEnvIfNoCase User-Agent "^DA d.d+" banned
SetEnvIfNoCase User-Agent "^Download" banned
SetEnvIfNoCase User-Agent "^IE d.d Compatible.*Browser$" banned
SetEnvIfNoCase User-Agent "^Internet Explore" banned
SetEnvIfNoCase User-Agent "^Mozilla/.+[. ]+$" banned
SetEnvIfNoCase User-Agent "^Mozilla/[0-9.]+ \(compatible; MSIE [0-9.]+; Windows( NT)?( [0-9.]*)?;[0-9./ ]*\)?$" banned
SetEnvIfNoCase User-Agent "^Mozilla/4.0$" banned
SetEnvIfNoCase User-Agent "^Mozilla/5\.0 \(X11; U; Linux i686; en-US; rv\:0\.9\.6\+\) Gecko/2001112$" banned
SetEnvIfNoCase User-Agent "^MSIE\ 6\.0 \(compatible;" banned
SetEnvIfNoCase User-Agent "^NG" banned
SetEnvIfNoCase User-Agent "4\.0 Robot\) Microsoft.*$" banned
SetEnvIfNoCase User-Agent "adressendeutschland.*$" banned
SetEnvIfNoCase User-Agent "AmigaOs/MC680x0.*$" banned
SetEnvIfNoCase User-Agent "anarchie" banned
SetEnvIfNoCase User-Agent "Atomz" banned
SetEnvIfNoCase User-Agent "biz-Spider_for.*$" banned
SetEnvIfNoCase User-Agent "BlackWidow" banned
SetEnvIfNoCase User-Agent "Bot\ mailto:craftbot@yahoo.com" banned
SetEnvIfNoCase User-Agent "Check\&Get.*$" banned
SetEnvIfNoCase User-Agent "cherry.?picker" banned
SetEnvIfNoCase User-Agent "ChinaClaw" banned
SetEnvIfNoCase User-Agent "Cobra Development.*$" banned
SetEnvIfNoCase User-Agent "compatible ; MSIE 6.0?" banned
SetEnvIfNoCase User-Agent "compatible; MSIE 4\.5; Windows.*$" banned
SetEnvIfNoCase User-Agent "Crazy Browser" banned
SetEnvIfNoCase User-Agent "crescent" banned
SetEnvIfNoCase User-Agent "Custo" banned
SetEnvIfNoCase User-Agent "DISCo" banned
SetEnvIfNoCase User-Agent "Download\ Demon" banned
SetEnvIfNoCase User-Agent "DTS Agent" banned
SetEnvIfNoCase User-Agent "e?mail.?(collector|magnet|reaper|siphon|sweeper|h arvest|collect|wolf)" banned
SetEnvIfNoCase User-Agent "EasyDL/d.d+" banned
SetEnvIfNoCase User-Agent "eCatch" banned
SetEnvIfNoCase User-Agent "efp@gmx.net" banned
SetEnvIfNoCase User-Agent "EirGrabber" banned
SetEnvIfNoCase User-Agent "email" banned
SetEnvIfNoCase User-Agent "EmailSiphon" banned
SetEnvIfNoCase User-Agent "EmailWolf" banned
SetEnvIfNoCase User-Agent "Enterprise_Search" banned
SetEnvIfNoCase User-Agent "express" banned
SetEnvIfNoCase User-Agent "Express\ WebPictures" banned
SetEnvIfNoCase User-Agent "extractor" banned
SetEnvIfNoCase User-Agent "ExtractorPro" banned
SetEnvIfNoCase User-Agent "EyeNetIE" banned
SetEnvIfNoCase User-Agent "fake\-agent" banned
SetEnvIfNoCase User-Agent "Fetch API Request" banned
SetEnvIfNoCase User-Agent "flashget" banned
SetEnvIfNoCase User-Agent "FlickBot" banned
SetEnvIfNoCase User-Agent "FrontPage" banned
SetEnvIfNoCase User-Agent "getright" banned
SetEnvIfNoCase User-Agent "GetWeb!" banned
SetEnvIfNoCase User-Agent "Go-Ahead-Got-It" banned
SetEnvIfNoCase User-Agent "Go!Zilla" banned
SetEnvIfNoCase User-Agent "go.?zilla" banned
SetEnvIfNoCase User-Agent "grabber" banned
SetEnvIfNoCase User-Agent "GrabNet" banned
SetEnvIfNoCase User-Agent "Grafula" banned
SetEnvIfNoCase User-Agent "harvest" banned
SetEnvIfNoCase User-Agent "HMView" banned
SetEnvIfNoCase User-Agent "httrack" banned
SetEnvIfNoCase User-Agent "Image\ Stripper" banned
SetEnvIfNoCase User-Agent "Image\ Sucker" banned
SetEnvIfNoCase User-Agent "imagefetch" banned
SetEnvIfNoCase User-Agent "Indy\ Library" banned
SetEnvIfNoCase User-Agent "InterGET" banned
SetEnvIfNoCase User-Agent "Internet Explorer" banned
SetEnvIfNoCase User-Agent "Internet\ Ninja" banned
SetEnvIfNoCase User-Agent "JetCar" banned
SetEnvIfNoCase User-Agent "JOC\ Web\ Spider" banned
SetEnvIfNoCase User-Agent "larbin" banned
SetEnvIfNoCase User-Agent "libwww-perl" banned
SetEnvIfNoCase User-Agent "LeechFTP" banned
SetEnvIfNoCase User-Agent "LinkExplore" banned
SetEnvIfNoCase User-Agent "LINKS ARoMATIZED" banned
SetEnvIfNoCase User-Agent "Mass\ Downloader" banned
SetEnvIfNoCase User-Agent "Maxthon.*$" banned
SetEnvIfNoCase User-Agent "Microsoft Data Access.*$" banned
SetEnvIfNoCase User-Agent "Microsoft URL Control" banned
SetEnvIfNoCase User-Agent "MIDown\ tool" banned
SetEnvIfNoCase User-Agent "mister pix" banned
SetEnvIfNoCase User-Agent "Mister\ PiX" banned
SetEnvIfNoCase User-Agent "MSIECrawler" banned
SetEnvIfNoCase User-Agent "Navroad" banned
SetEnvIfNoCase User-Agent "NearSite" banned
SetEnvIfNoCase User-Agent "net.?(ants|mechanic|spider|vampire|zip)" banned
SetEnvIfNoCase User-Agent "Net\ Vampire" banned
SetEnvIfNoCase User-Agent "NetAnts" banned
SetEnvIfNoCase User-Agent "NetSpider" banned
SetEnvIfNoCase User-Agent "NetZIP" banned
SetEnvIfNoCase User-Agent "nicerspro" banned
SetEnvIfNoCase User-Agent "ninja" banned
SetEnvIfNoCase User-Agent "NPBot" banned
SetEnvIfNoCase User-Agent "Octopus" banned
SetEnvIfNoCase User-Agent "offline" banned
SetEnvIfNoCase User-Agent "Offline\ Explorer" banned
SetEnvIfNoCase User-Agent "Offline\ Navigator" banned
SetEnvIfNoCase User-Agent "PageGrabber" banned
SetEnvIfNoCase User-Agent "Papa\ Foto" banned
SetEnvIfNoCase User-Agent "pavuk" banned
SetEnvIfNoCase User-Agent "pavuk/[0-9.]+" banned
SetEnvIfNoCase User-Agent "pcBrowser" banned
SetEnvIfNoCase User-Agent "pd02_[09.]+.*$" banned
SetEnvIfNoCase User-Agent "PersonaPilot" banned
SetEnvIfNoCase User-Agent "port-agent" banned
SetEnvIfNoCase User-Agent "pranks4fun" banned
SetEnvIfNoCase User-Agent "Program Shareware.*$" banned
SetEnvIfNoCase User-Agent "Proxtrans" banned
SetEnvIfNoCase User-Agent "RealDownload" banned
SetEnvIfNoCase User-Agent "ReGet" banned
SetEnvIfNoCase User-Agent "SAFEXPLORER TL.*$" banned
SetEnvIfNoCase User-Agent "SiteSnagger" banned
SetEnvIfNoCase User-Agent "SmartDownload" banned
SetEnvIfNoCase User-Agent "snagger" banned
SetEnvIfNoCase User-Agent "Snoopy_v" banned
SetEnvIfNoCase User-Agent "Sqworm" banned
SetEnvIfNoCase User-Agent "SuperBot" banned
SetEnvIfNoCase User-Agent "SuperHTTP" banned
SetEnvIfNoCase User-Agent "Surfbot" banned
SetEnvIfNoCase User-Agent "SurveyBot" banned
SetEnvIfNoCase User-Agent "tAkeOut" banned
SetEnvIfNoCase User-Agent "tele(port|soft)" banned
SetEnvIfNoCase User-Agent "Teleport\ Pro" banned
SetEnvIfNoCase User-Agent "TurnitinBot" banned
SetEnvIfNoCase User-Agent "vayala" banned
SetEnvIfNoCase User-Agent "VoidEYE" banned
SetEnvIfNoCase User-Agent "web.?(auto|bandit|collector|copier|devil|download er|fetch|hook|mole|miner|mirror|reaper|sauger|suck er|site|snake|stripper|weasel|zip)" banned
SetEnvIfNoCase User-Agent "Web\ Image\ Collector" banned
SetEnvIfNoCase User-Agent "Web\ Sucker" banned
SetEnvIfNoCase User-Agent "WebAuto" banned
SetEnvIfNoCase User-Agent "WebCopier" banned
SetEnvIfNoCase User-Agent "WebDAV" banned
SetEnvIfNoCase User-Agent "WebFetch" banned
SetEnvIfNoCase User-Agent "WebGo\ IS" banned
SetEnvIfNoCase User-Agent "WebLeacher" banned
SetEnvIfNoCase User-Agent "WebReaper" banned
SetEnvIfNoCase User-Agent "WebSauger" banned
SetEnvIfNoCase User-Agent "Website\ eXtractor" banned
SetEnvIfNoCase User-Agent "Website\ Quester" banned
SetEnvIfNoCase User-Agent "WebStripper" banned
SetEnvIfNoCase User-Agent "WebWhacker" banned
SetEnvIfNoCase User-Agent "WebZIP" banned
SetEnvIfNoCase User-Agent "Wget" banned
SetEnvIfNoCase User-Agent "Widow" banned
SetEnvIfNoCase User-Agent "WinHttp\.WinHttpRequest.*$" banned
SetEnvIfNoCase User-Agent "WWWOFFLE" banned
SetEnvIfNoCase User-Agent "Xaldon\ WebSpider" banned
SetEnvIfNoCase User-Agent "YANDEX.*$" banned
SetEnvIfNoCase User-Agent "zeus" banned


# Deny access to all with status "banned"

@ seven
Die Kommentare stören evtl., helfen jedoch gerade auch in deinem Fall:

# Update Your Joomla/MamboDirectory (just / for root)
RewriteBase /

Wie du siehst ist RewriteBase als Root definiert.

.htpasswd hat wohl keine Auswirkung auf das Problem - auch wenn dich der Inhalt brennend interessiert!

Hallo Zorro und alle weiteren Helfer,

danke für Eure Unterstützung. Der Verzeichnisschutz ist aktiviert -falls sich bei den Suchmaschinen etwas verändert werde ich mich einfach nochmal melden.

Einen schönen Tag noch.

Christian