Some people reported problems using RoboGen with certain FTP servers.  These FTP servers would return additional information with each file and effectively break RoboGen.  When one would try to disallow a file on these servers, RoboGen would not recognize the file and would attempt to disallow the entire directory tree.  This problem has been fixed in the new version of RoboGen SE.