Ensure your website’s crawling rules are set up correctly. Instantly check and view your robots.txt file.