微软官方推荐.NET平台的爬虫软件下载，DotnetSpider.Core下载

[20180626 09:26:21][2a386af18ccb48338c1b4e3797783e34][Info] Build internal component... [20180626 09:26:21][2a386af18ccb48338c1b4e3797783e34][Info] Add start urls to scheduler, count 10000. [20180626 09:26:21][2a386af18ccb48338c1b4e3797783e34][Trace] Left 10000 Success 0 Error 0 Total 10000 Dowload 0 Extract 0 Pipeline 0 [20180626 09:26:26][2a386af18ccb48338c1b4e3797783e34][Warn] Skip http://taimansf.com//goods.php?id=0 because extract 0 result. [20180626 09:26:26][2a386af18ccb48338c1b4e3797783e34][Warn] Skip http://taimansf.com//goods.php?id=2 because extract 0 result. [20180626 09:28:46][22a3e4b46f0447d4b7576fac3555fedc][Info] Build internal component... [20180626 09:28:46][22a3e4b46f0447d4b7576fac3555fedc][Info] Add start urls to scheduler, count 1. [20180626 09:28:46][22a3e4b46f0447d4b7576fac3555fedc][Trace] Left 1 Success 0 Error 0 Total 1 Dowload 0 Extract 0 Pipeline 0 [20180626 09:28:52][22a3e4b46f0447d4b7576fac3555fedc][Info] Crawl: http://xiaohuij.cn/goods.php?id=1377 success, results: , effectedRow: . [20180626 09:28:52][22a3e4b46f0447d4b7576fac3555fedc][Trace] Left 0 Success 1 Error 0 Total 1 Dowload 1636 Extract 827 Pipeline 3 [20180626 09:29:04][22a3e4b46f0447d4b7576fac3555fedc][Trace] Left 0 Success 1 Error 0 Total 1 Dowload 1636 Extract 827 Pipeline 3 [20180626 09:29:04][22a3e4b46f0447d4b7576fac3555fedc][Info] Crawl complete, cost: 17.1016689 seconds. [20180626 09:31:15][d5de3f303cfb4b1ca46a717776cab127][Info] Build internal component... [20180626 09:31:16][d5de3f303cfb4b1ca46a717776cab127][Info] Add start urls to scheduler, count 1. [20180626 09:31:16][d5de3f303cfb4b1ca46a717776cab127][Trace] Left 1 Success 0 Error 0 Total 1 Dowload 0 Extract 0 Pipeline 0 [20180626 09:31:19][d5de3f303cfb4b1ca46a717776cab127][Info] Crawl: http://xiaohuij.cn/goods.php?id=1377 success, results: , effectedRow: . [20180626 09:31:20][d5de3f303cfb4b1ca46a717776cab127][Trace] Left 0 Success 1 Error 0 Total 1 Dowload 1033 Extract 825 Pipeline 3 [20180626 09:31:33][d5de3f303cfb4b1ca46a717776cab127][Trace] Left 0 Success 1 Error 0 Total 1 Dowload 1033 Extract 825 Pipeline 3 [20180626 09:31:33][d5de3f303cfb4b1ca46a717776cab127][Info] Crawl complete, cost: 17.1452595 seconds. [20180626 10:01:48][77537b98cd884b0aab4bb2630ca73002][Info] Build internal component... [20180626 10:01:48][77537b98cd884b0aab4bb2630ca73002][Info] Add start urls to scheduler, count 1. [20180626 10:01:49][77537b98cd884b0aab4bb2630ca73002][Trace] Left 1 Success 0 Error 0 Total 1 Dowload 0 Extract 0 Pipeline 0 [20180626 10:01:54][77537b98cd884b0aab4bb2630ca73002][Info] Crawl: http://xiaohuij.cn/goods.php?id=1377 success, results: , effectedRow: . [20180626 10:01:54][77537b98cd884b0aab4bb2630ca73002][Trace] Left 0 Success 1 Error 0 Total 1 Dowload 1634 Extract 823 Pipeline 3 [20180626 10:02:06][77537b98cd884b0aab4bb2630ca73002][Trace] Left 0 Success 1 Error 0 Total 1 Dowload 1634 Extract 823 Pipeline 3 [20180626 10:02:06][77537b98cd884b0aab4bb2630ca73002][Info] Crawl complete, cost: 17.1354775 seconds. [20180626 11:23:51][9429b108b3fd4906a82de88c4de3315a][Info] Build internal component... [20180626 11:23:51][9429b108b3fd4906a82de88c4de3315a][Info] Add start urls to scheduler, count 1. [20180626 11:23:51][9429b108b3fd4906a82de88c4de3315a][Trace] Left 1 Success 0 Error 0 Total 1 Dowload 0 Extract 0 Pipeline 0 [20180626 11:23:56][9429b108b3fd4906a82de88c4de3315a][Info] Crawl: http://xiaohuij.cn/goods.php?id=1377 success, results: , effectedRow: . [20180626 11:23:56][9429b108b3fd4906a82de88c4de3315a][Trace] Left 0 Success 1 Error 0 Total 1 Dowload 1622 Extract 843 Pipeline 3 [20180626 11:24:09][9429b108b3fd4906a82de88c4de3315a][Trace] Left 0 Success 1 Error 0 Total 1 Dowload 1622 Extract 843 Pipeline 3 [20180626 11:24:09][9429b108b3fd4906a82de88c4de3315a][Info] Crawl complete, cost: 17.6700891 seconds.