使用scrapy 爬取豆瓣top250 scrapy for douban top250
1,使用scrapy 爬取豆瓣电影top250
2,连接mongodb 保存数据
3,配置了随机请求头
4,配置了代理IP,(有用户密码和没有用户密码的需要不同的处理)
-
Couldn't load subscription status.
- Fork 0
Wjun0/douban
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
scrapy for douban top250
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published