We have our web presence in AWS: at the end of the day we pay every bit, from traffic to CPU...
Bots are a real costs: it is mainly by night where proper traffic is almost zero, and (day and night) mostly on the same (cached) content, while Bots are the real cost!
In the last 24hr load is coming from ... Amazon itself (!) https://developer.amazon.com/support/amazonbot
What the hell