[Evergreen-general] Dealing with significant traffic increase caused by AI bots

[Linda Jansová]

Dear all,

Have any of you encountered an extensive crawling by Bytespider and 
Bytedance (see e.g., 
https://wordpress.org/support/topic/psa-bytedance-and-bytespider-bots-recommend-blocking/), 
Claudebot or other AI bots?

If so, do you have any secret recipe how to disable the crawler from 
accessing the site?

Thank you very much for sharing your experience!

Linda