All, The flood of bots inundating the message board is starting to affect performance. CPU load continues to increase, all directly due to the number of BOTs that crawl the site. I attribute this to the latest AI bots that are sucking up content everywhere. And part of the problem is they are not identifying as BOTs. A little bit ago I logged in to find just shy of 1000 guests logged in 5 minutes. Those guests are obviously Bots, especially when you look and see multiple IPs looking at the same thread from 10 years ago at the same time.
The first indication something was going on was a week ago when the board froze due to maxing out the Who's Online memory table in the database. I got around that by switching that database entry from memory to disk. But the guests still came. I then reduced the Who's Online window from 10 minutes to 5 minutes. And they still come at a higher and higher rate.
We can't sustain this.
So unfortunately, I'm having to take the drastic step to remove the permission of guests (non-logged in people) to read threads. They can still view the forums and see the thread topics. But they will not be able to read content. Immediately after implementing this, the number of guests has dropped significantly. Unfortunately this will affect search results. I'm hoping it will cause more people to register and log-in on the board. We will see.
Right now I'm not sure if this will be a permanent change or not.
Your thoughts welcome.
PaulC
|