RoboGen
Add Dialog Overview Contents > Dialog Reference >Add Dialog
The Add Path dialog is used to enter paths and files that you wish to disallow without logging onto your FTP server to select the file.  You simply type in the path to the file or directory you want to disallow relative to your root.  For example, if you had a directory for files that are constantly changing, such as www.mydomain.com/news/today then you would type /news/today1in the edit field and click OK or press Enter to add that directory to the disallow list.

Add Dialog Screen Shot

If you want to add more than one path to the current agent's disallow list at one time, choose the Advanced button.  It will open the Advanced Add Dialog which will let you add any number of paths at one time.


1Note:  It does not make sense for search engine robots to index constantly changing content since it will quickly become obsolete and only add to the huge amount of bad information returned by web searches. 

Copyright ©1999 Rietta.  All Rights Reserved.

This HTML file is part of the documentation for Rietta Solutions's RoboGen application.  Click here for more information about RoboGen.