- Location
- Next door to Mr Benn at No 54
I am very pleased Admin, that you have been able to iron out some of the problems.
Site Running Slow
- Thread starter Shaun
- Start date
- Location
- Next door to Mr Benn at No 54
Or should I say, I am very impressed with your success with this board this evening. 
Seams it was nothing to get steamed up about! A hem!
Seams it was nothing to get steamed up about! A hem!
MacB
Lover of things that come in 3's
- Location
- Farnborough, Hampshire
Or should I say, I am very impressed with your success with this board this evening.
Seams it was nothing to get steamed up about! A hem!
that'll be enough of that sort of stuff, I'm pretty sure excessive punning can have an even worse effect than spiderbots
potsy
Rambler
- Location
- My Armchair
Why break the habit of a lifetime though?
- Location
- Next door to Mr Benn at No 54
An iron ic post, Potsy, which just in creases the chances of it happening even more
summerdays
Cycling in the sun
- Location
- Bristol
we're being overrun by a very aggressive spider-bot from a Chinese search engine called Baidu that has been flooding the CC server with requests and using up all available resources.
OK ... in simple terms ... someone what to tell me what a spider-bot was doing ... I've a vague impression of Aragog fiddling with the insides of a computer... (I don't think it helps that he has a name)
Is Baidu (your friendly Chinese spider), trying to use your computer resources to do something else with it? What does he gain?
Has she not broken up from school yet?
OP
OP
OK ... in simple terms ... someone what to tell me what a spider-bot was doing ... I've a vague impression of Aragog fiddling with the insides of a computer... (I don't think it helps that he has a name)
Spiders are little software robots that Google and other search engines use. They come along to your web site and download the page content to add to their search results.
Some are very good and will respect your site and not harvest too much information all at once. Some are less considerate and will send lots and lots of these little bots to grab your site data all at once - so much so that the server can't cope with volume and grinds to a halt.
I presume it uses the data in the same way as Google, but I have yet to see any traffic generated from it and after reading other web site owner resources it seems many people are more than happy to block it completely to save on bandwidth/resources.
Nope - not until Wednesday!!
summerdays
Cycling in the sun
- Location
- Bristol
Thank you ... I understood that ... (I think )
)
OP
OP
Scilly Suffolk
Über Member
Noticeable improvement! 
OP
OP
Sorted.
For the techies: The Shorewall firewall has been installed on the server and the Baidu IP ranges have been blacklisted for the TCP protocol (on port 80).
For the non-technical CC'ers: The do-dahs have now been added to the thing-a-me-jig and the baddies can't hog the server so much now!
Cheers,
Shaun
For the techies: The Shorewall firewall has been installed on the server and the Baidu IP ranges have been blacklisted for the TCP protocol (on port 80).
For the non-technical CC'ers: The do-dahs have now been added to the thing-a-me-jig and the baddies can't hog the server so much now!
Cheers,
Shaun
accountantpete
OAP
Thanks Shaun - much faster now.