abot：为提高速度和灵活性而构建的跨平台C＃Web爬网程序框架。 请为该项目加注星标！ +1
需积分: 10 175 浏览量
2021-02-04
04:42:40
上传
评论
收藏 1.29MB ZIP 举报
abot：为提高速度和灵活性而构建的跨平台C＃Web爬网程序框架。 请为该项目加注星标！ +1 （103个子文件） 
NuGet.Config 164B WebCrawlerTest.cs 59KB WebCrawler.cs 40KB CrawlDecisionMakerTest.cs 32KB HyperlineParserTest.cs 23KB PoliteWebCrawlerTest.cs 22KB CrawlTest.cs 17KB RobotsDotTextTest.cs 13KB PageRequesterTest.cs 11KB CrawlConfiguration.cs 11KB BloomFilter.cs 10KB DomainRateLimiterTest.cs 9KB PageRequester.cs 9KB SchedulerTest.cs 9KB CrawlDecisionMaker.cs 8KB LimitedConcurrencyTaskScheduler.cs 8KB PoliteWebCrawler.cs 8KB RateLimiter.cs 8KB CrawledPageTest.cs 7KB CrawlTestBase.cs 7KB WebContentExtractorTest.cs 6KB HyperLinkParser.cs 6KB RobotsDotTextFinderTest.cs 5KB ThreadManagerTest.cs 5KB DomainRateLimiter.cs 5KB ThreadManager.cs 4KB CrawledPage.cs 4KB WebContentExtractor.cs 4KB Scheduler.cs 3KB TaskThreadManagerTest.cs 3KB CrawlConfigurationTest.cs 3KB AngleSharpHyperLinkParser.cs 3KB CrawlContext.cs 3KB PagesToCrawlRepositoryTest.cs 3KB PageToCrawl.cs 3KB CrawledUrlRepositoryTest.cs 3KB PageToCrawlTest.cs 3KB RateLimiterTest.cs 2KB TaskThreadManager.cs 2KB MemoryManagerTest.cs 2KB MemoryManager.cs 2KB CachedMemoryMonitorTest.cs 2KB RobotsDotText.cs 2KB RobotsDotTextFinder.cs 2KB Program.cs 2KB HyperLinkTest.cs 2KB CrawlContextTest.cs 1KB CachedMemoryMonitor.cs 1KB CrawlResultTest.cs 1KB PageLinksCrawlDisallowedArgsTest.cs 1KB PageCrawlDisallowedArgsTest.cs 1KB ManualThreadManagerTest.cs 1KB AngleSharpHyperLinkParserTest.cs 1KB GcMemoryMonitorTest.cs 1KB BloomFilterCrawledUrlRepository.cs 1KB CrawlArgsTest.cs 1017B FifoPagesToCrawlRepository.cs 1013B CrawlResult.cs 1012B CrawlDecision.cs 911B CompactCrawledUrlRepository.cs 904B HyperLink.cs 818B FakeHttpContent.cs 767B PageCrawlCompletedArgsTest.cs 755B PageCrawlStartingArgsTest.cs 753B GcMemoryMonitor.cs 749B InMemoryCrawledUrlRepository.cs 736B PageContent.cs 735B RobotsDotTextParseCompletedArgs.cs 670B FifoPagesToCrawlRepositoryTest.cs 642B AssemblySetup.cs 619B PageCrawlDisallowedArgs.cs 570B PageLinksCrawlDisallowedArgs.cs 569B CrawlDecisionTest.cs 560B AssemblySetup.cs 528B PageContentTest.cs 523B ManualThreadManager.cs 510B PageCrawlCompletedArgs.cs 428B PageCrawlStartingArgs.cs 426B BloomFilterCrawledUrlRepositoryTest.cs 357B InMemoryCrawledUrlRepositoryTest.cs 350B CompactCrawledUrlRepositoryTest.cs 349B CrawlArgs.cs 341B Constants.cs 285B AssemblyDirectives.cs 176B BloomFilterTest.cs 158B Enums.cs 136B Abot2.csproj 2KB Abot2.Tests.Unit.csproj 1KB Abot2.Tests.Integration.csproj 751B Abot2.Demo.csproj 457B
NuGet.exe 1.59MB .gitattributes 92B .gitignore 2KB
HtmlAgilityPackStackOverflow1.html 894KB HtmlAgilityPackStackOverflow2.html 410KB Abot2.nuspec.ignore 1KB README.md 18KB msbuild.rsp 14B TestResponses.saz 626KB Abot.sln 5KB共 103 条
- 1
- 2
资源评论
