Override /robots.txt to disallow all web crawlers, regardless settings stored in the database.

So you are assured that no search engine like Google, Bing, Yahoo, Baidu or Yandex will index your Liferay platform, even when there has been a configuration mistake .

Compatible with Liferay 7.0, 7.1, 7.2, 7.3 and 7.4.