RoboGen Product Overview
RoboGen is a visual editor
for Robot Exclusion Files. It allows the user to quickly and easily
create the ROBOTS.TXT files required to instruct web search engines which
parts of a web site are not to be indexed and made searchable by the general
web public. RoboGen does this by providing the user a way to log
onto his FTP server and then select the documents and directories which
are not to be made searchable.
For more information on RoboGen
and robot exclusion files, see Introduction
to Web Robots, ROBOTS.TXT, and RoboGen.
Feature Overview
-
Create Robot Exclusion Files
by selecting documents and directories.
-
Log into FTP servers and even
upload robots.txt from RoboGen.
-
Manage information for multiple
servers.
-
Database of over 180 know user-agents
and 10 major search engines.
-
Ability to edit the robot database
and add additional user-agents.
-
RoboGen recognizes common document
roots when logging into FTP servers and suggests that they be set as the
document root.
For a detailed overview of RoboGen's
features, see the RoboGen Feature Comparison
Chart.
Pricing
Base Cost:
- $24.95 for a single-license.
Shipping and Handling:
- Additional $5.75 for CD-ROM delivery.
- $0.00 for Download Only delivery.
|
