crawler_detect:Ruby gem通过用户代理检测机器人和爬虫
需积分: 20 92 浏览量
2021-04-30
19:31:22
上传
评论
收藏 2.51MB ZIP 举报
crawler_detect-master.zip （40个子文件） 
crawler_detect-master 
.gitignore 113B .rspec 46B bin update_raw_files 778B .rubocop.yml 349B CHANGELOG.md 614B
LICENSE.txt 1KB .github workflows build.yml 1016B crawler_detect.gemspec 2KB spec crawler_detect_spec.rb 2KB crawler_detect detector_spec.rb 597B detector_devices white_list_1_spec.rb 125B white_list_4_spec.rb 125B white_list_3_spec.rb 125B white_list_2_spec.rb 125B support devices.rb 406B spec_helper.rb 807B rack_spec.rb 792B fixtures raw Headers.json 20B Exclusions.json 3B Crawlers.json 25B crawlers.txt 232KB parallel_runtime_rspec.log 450B devices.txt 23.34MB README.md 3KB lib crawler_detect library raw Headers.json 230B Exclusions.json 792B Crawlers.json 19KB headers.rb 258B loader.rb 364B exclusions.rb 264B crawlers.rb 260B library.rb 567B config.rb 993B detector.rb 1KB version.rb 91B rack crawler_detect.rb 1009B crawler_detect.rb 1KB Gemfile 141B Rakefile 145B Gemfile.lock 3KB
评论0
最新资源