All workflows
102 results
102 results
解决bug: redis有序集合变化后导致顺序重排,以至于重复test (#78)
* pip使用镜像
* 获取代理时设置timeout
因为在获取某些网站公布的代理ip时,由于该网站被墙或者其他原因,导致需要几分钟才能反馈。
* 第5页之后的代理ip都是两三天之后的信息,质量很差
* 解决bug: redis有序集合变化后导致顺序重排,以至于重复test
解...
build
#42:
Commit 737998f
pushed
by
Germey
解决bug:ZhandayeCrawler没有headers属性 (#76)
* 解决bug:ZhandayeCrawler没有headers属性
解决bug: AttributeError: 'ZhandayeCrawler' object has no attribute 'headers'
* Add: 在getter中进行重试时,增加时间间隔
build
#39:
Commit b42c77f
pushed
by
Germey
增加校验功能:采集到的代理IP是否为匿名代理 (#74)
* anonymous proxy ip
Add verification of whether proxy IP is anonymous
* catch AssertionError
fix: AssertionError will now be caught
build
#38:
Commit 50a8f7e
pushed
by
Germey
修复is_valid_proxy函数的bug,add: 站大爷crawler (#68)
* fix: 修复is_valid_proxy函数的bug,add: 站大爷crawler
* fix: 修改__init__中 站大爷 detailcrawler的判断逻辑,使其更为通用
build
#37:
Commit 2cd11fa
pushed
by
Germey
Merge pull request #67 from linupychiang/master
add xiladaili proxy source and add lxml in requirements.txt
build
#36:
Commit c31c080
pushed
by
Germey