.Google.com restricts robots.txt assistance to 4 fields, clarifying its stance on unsupported instructions.Google only supports four specific robots.txt fields.Unsupported ordinances in robots.txt will definitely be actually disregarded.Look at bookkeeping your robots.txt documents in light of this improve.