Note: Malicious actors and specialized hacker bots ignore robots.txt rules, meaning this step only prevents legitimate engines like Google from caching the data. Conclusion
Do you regularly generate or reports?