python实现简单爬虫.zip

共15个文件

py：6个

pyc：6个

pydevproject：1个

需积分: 0 0 下载量 116 浏览量 2023-12-23 17:54:45 上传评论收藏 7KB ZIP 举报

温馨提示

Python爬虫源码大放送：抓取数据，轻松搞定！想轻松抓取网站数据，却苦于技术门槛太高？别担心，这些源码将助你轻松搞定数据抓取，让你成为网络世界的“数据侠盗”。它们还具有超强的实用价值。无论你是想要分析竞品数据、收集行业情报，还是想要偷窥某个女神的社交媒体动态，这些源码都能满足你的需求。是时候打破技术壁垒，开启数据抓取的新篇章了

资源推荐

资源详情

资源评论

收起资源包目录

python实现简单爬虫.zip （15个子文件）

ergsdfgsdgsdgsdfgdsfdfghfhfdgh42354353esdfsdfgsdfgdfg

.settings

org.eclipse.core.resources.prefs 215B

.project 384B

.pydevproject 439B

com

__init__.py 0B

learn

beautifusoup.py 1KB

__init__.py 0B

urllib2_2.pyc 459B

beautifusoup.pyc 1KB

bs4_test.pyc 168B

urllib2_1.py 268B

__init__.pyc 136B

urllib2_2.py 374B

bs4_test.py 39B

urllib2_1.pyc 336B

__init__.pyc 130B

共 15 条

# coding:utf8 from bs4 import BeautifulSoup import re html_doc = """ <html><head><title>The Dormouse's story</title></head> <body> The Dormouse's story Once upon a time there were three little sisters; and their names were <a href="http://example.com/elsie" class="sister" id="link1">Elsie</a>, <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>; and they lived at the bottom of a well. ... """ soup = BeautifulSoup(html_doc,'html.parser',from_encoding='utf8') print '获取所有的链接' links = soup.find_all('a') for link in links: print link.name,link['href'],link.get_text() print '单独获取elsie的连接' link_node = soup.find('a',href='http://example.com/elsie') print link_node.name,link_node['href'],link_node.get_text() print '正则表达式' link_node = soup.find('a',href=re.compile(r"cie")) print link_node.name,link_node['href'],link_node.get_text() print '获取段落文字' p_node = soup.find('p',class_='title') print p_node.name,p_node.get_text()

评论收藏

内容反馈