mnoGoSearch 3.2.31 reference manual: Full-featured search engine software
Prev |  | Next

# Robots
mnoGoSearch - Full Featured Web site Open Source Search Engine Software over the Internet and Intranet Web Sites Based on SQL Database. It is a Free search software covered by GNU license.
Keywords: shareware, freeware, download, internet, unix, utilities, search engine, text retrieval, knowledge retrieval, text search, information retrieval, database search, mining, intranet, webserver, index, spider, filesearch, meta, free, open source, full-text, udmsearch, website, find, opensource, search, searching, software, udmsearch, engine, indexing, system, web, ftp, http, cgi, php, SQL, MySQL, database, php3, FreeBSD, Linux, Unix, mnoGoSearch, MacOS X, Mac OS X, Windows, 2000, NT, 95, 98, GNU, GPL, url, grabbing

## Name

Robots -- allows using robots.txt

indexer.conf

## Synopsis

Robots {yes | no}

## Description

Allows/disallows using robots.txt and <META NAME="robots"> exclusions. Use "no", for example for link validation of your server(s). Command may be used several times before "Server" command and takes effect till the end of config file or till next Robots command.

Default value is "yes".

## Examples

    Robots yes

Prev | Home | Next
ReverseAlias | Up | Section