.Google.com restricts robots.txt assistance to four areas, clarifying its standpoint on in need of support ordinances.Google simply supports 4 specific robots.txt industries.In need of support ordinances in robots.txt will definitely be actually ignored.Take into consideration auditing your robots.txt data because of this improve.