.Google.com restricts robots.txt support to four industries, clarifying its own viewpoint on in need of support instructions.Google just assists four specific robots.txt industries.In need of support ordinances in robots.txt will definitely be disregarded.Look at bookkeeping your robots.txt reports because of this improve.