.Google.com restricts robots.txt assistance to four fields, clarifying its own viewpoint on in need of support regulations.Google simply sustains four details robots.txt industries.In need of support directives in robots.txt will certainly be actually neglected.Consider auditing your robots.txt reports in light of this update.