Hi, Shrewd!        Login  
Shrewd'm.com 
A merry & shrewd investing community
Best Of ShrewdsmithBest OfAll BoardsThe Shrewd’m WeeklyLearn to InvestHow to Become Shrewd
Search
Shrewd'm.com Merry shrewd investors
Search
Best Of ShrewdsmithBest OfAll BoardsThe Shrewd’m WeeklyLearn to InvestHow to Become Shrewd


The week's question
In December 2024, in the thread "Re: BRK: Why Not XOM?", BreckHutHigh asked the members: "What about the long road trips with kids?" This week it is put to everyone again. The button below opens the small thread re-asking it - read what others have said so far, then give your own answer as an ordinary reply.
Answer this questionContinue to Shrewd'mThis note won't appear again
Halls of Shrewd'm / Shrewdsmith
Unthreaded | Threaded | Whole Thread (19) |
Author: Manlobbi 🐝🐝  😊 😞
Number: of 321 
Subject: Re: Too Many Requests
Date: 07/24/26 5:51 AM
Post New | Post Reply | Report Post | Recommend It!
No. of Recommendations: 26
The problem isn't the normal use by all of us, but robot scraping massively increased last year (from Google, Bing are there, but also thousands of unrelated residential/global IPS).

To get an idea what happened, daily requests suddenly rose from 77,349 on July 10 to 320,784 on July 22, which you can calculate as 3 requests per second if it was even.. but as it isn't even, some single seconds have hundreds of simultaneous requests.

A lot of this I expect is the increase in AI infrastructure around the world. They suddenly decided our content is 'on their radar'.

I cannot simply increase the threshhold, as that would overload the server CPU/memory.

The message usually only appears for few seconds, so if you see the busy message, just wait a few seconds and click refresh.

If the busy error happens whilst you are posting and clicking 'Send', even if you don't make a copy-paste backup of the text, remember that unlike TMF, at Shrewd'm the go-back button is safe to get back to your post and click 'Send' again.

Don't worry, I'm on it. It requires work both at the application layer (deeper caching, etc), plus changing configuration of the server protection software (blocking far more, though not all, traditional and AI robots).

- Manlobbi
Post New | Post Reply | Report Post | Recommend It!
Print the post
Members reply directly to Manlobbi here — and replies get answered. Reading is free; so is joining the conversation. Join Shrewd'm »
This community has written 293 posts about Shrewdsmith. The article-length ones it recommended most:
3 Minute Page Loads · 10 recs · 2024
Searching across boards, plus Shrewdness-stars · 8 recs · 2022
Unthreaded | Threaded | Whole Thread (19) |


Announcements
Shrewdsmith FAQ
Contact Shrewd'm
Contact the developer of these message boards.

Best Of Shrewdsmith | Best Of | Favourites & Replies | All Boards | Followed Shrewds | Open Questions | Moving a community