BT getting hammered by the Chinese

[Dennis Vogel]

The site and this forum are slow because the Chinese bots are crawling everything.


City Wuchuan
Region Guangdong
Coordinates 21.4571,110.7659
Timezone Asia/Urumqi
Local Time January 14, 2020 | 11:05 PM
Country China

[Nelson Boils]

Hi,

What do the bots do though?How do they affect the site?

I know the world of bots is big in the YouTube world,mainly music, people getting bots to play their videos and audio files so that it can seem like they are getting alot of attention and high reviews and listens,only to find that the numbers are fake and not from actual people.
All in the name of marketing.

[Dennis Vogel]

They are computer robots that crawl/catalog every word on the forum and site. When you get 6000+ of them working at the same time things slow down.

I could get more bandwidth from our host but it's not worth the money for something that happens once every few months.

China banned us years ago so I wonder why they bother to crawl us in the first place?

[indianabob]

Hi Dennis,

The Chinese are intelligent and clever and want to understand how people think so that they can control them.
Your site is filled with a wealth of human knowledge and understanding which is a necessary commodity for every dictator.

Every successful General teaches "first, know your enemy" and that may be why they take an interest in a web site that teaches the truth.

Indiana Bob

[Wanda]

Dennis, I don't know if this could be of any help.

Blocking aggressive Chinese crawlers/scrapers/bots
There is additional information in the comments below the article.

https://www.johnlarge.co.uk/blocking-aggressive-chinese-crawlers-scrapers-bots/

[Dennis Vogel]

Dennis, I don't know if this could be of any help.

Blocking aggressive Chinese crawlers/scrapers/bots
There is additional information in the comments below the article.

https://www.johnlarge.co.uk/blocking-aggressive-chinese-crawlers-scrapers-bots/

Thanks Wanda