Factual package intelligence from PyPI

distribute-crawler 1.0.1 package intelligence

使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现。

pip install distribute-crawler

Current version
1.0.1
Python requirement
Not declared
License
MIT License
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
10.2 KiB
Release history
1 releases with files
Median release cadence
Not enough dated releases

distribute-crawler dependencies

PyPI declares 27 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. requests
  2. faker
  3. execjs
  4. loguru
  5. base64
  6. hashlib
  7. Crypto
  8. pandas
  9. fuzzywuzzy
  10. httpx
  11. Pillow
  12. playwright
  13. PyExecJS
  14. redis
  15. fastapi
  16. uvicorn
  17. APScheduler
  18. beautifulsoup4

The compact report shows 18 of 27 declarations. The interactive dependency graph loads the complete metadata.

Compatibility and release files

distribute-crawler publishes 1 wheel and 1 source archive for version 1.0.1. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Metadata completeness

PyPI does not currently declare: Python requirement. PyDeps marks these fields as unknown instead of guessing values.

Release activity and sources

PyPI lists 1 release with files. The first dated release is ; 1 release falls within the 365 days preceding the latest dated release. The current release files were uploaded on .