175.24.9.202 - - [17/Jul/2020:22:06:29 +0800] "POST /index.php?r=/index HTTP/1.0" 499 0 "https://servicewechat.com/wxb9710e6cf52cbe4d/143/page-frame.html" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/604.1.38 (KHTML, like Gecko) Version/11.0 Mobile/15A372 Safari/604.1 MicroMessenger/6.5 mpcrawler"
微信官方你好,这个是微信的爬虫吗?把我们服务器搞趴了
微信还有很多非官方的,不带mpcrawler 的,看记录完全是安卓手机用户的访问,防不胜防呀~~~
mpcrawler 确认是官方爬虫。。。建议你配置sitemap过滤
https://mp.weixin.qq.com/wxopen/readtemplate?t=config/collection_agreement_tmpl
文档说明:https://developers.weixin.qq.com/miniprogram/dev/framework/sitemap.html