SharePoint 2019 Search: Crawl failed Posted by By Thomas Heinz 19. November 2019No Comments When experiencing the error: Make sure to add a robots.txt to each WebApp's Virtual Directory. E.g. the default path to one one the WebApps: robots.txt content: