Bruce Tang

awesome-crawler. A collection of awesome web crawler,spider in different languages

clock. 可视化任务调度系统，精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)

scrapy_demo. all kinds of scrapy demo

tensorflow-demos. all kinds of demos of tensorflow code

Tiktok. Python web visualize build on the awesome web framework sanic

darknet_demo. darknet yolov3 tiny train model demo

cnbeta. 一键抓取cnbeta 首页的所有消息

dagobah. Simple DAG-based job scheduler in Python

tensorflow-gpu-docker. tensorflow gpu docker file to build docker image

webapi. demo of using dotnet core and Nancy

clock-admin. Vue

portia. Visual scraping for Scrapy

docker_library. all kinds of docker library ,such as opencv 3 , pytorch ,deep learning library

web_message_queue_app. using vibora and all kinds of message queue

scrapyd. A service daemon to run Scrapy spiders

frp. A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

pholcus. Pholcus is a distributed high-concurrency crawler software written in pure golang

ecapture. capture SSL/TLS text content without CA cert by eBPF.

redis_exporter. Prometheus Exporter for Redis Metrics. Supports Redis 2.x, 3.x, 4.x, and 5.x

scrapy-headless. Python

chatGPT-web. chatGPT私有化部署

TinyWebServer. :fire: Linux下C++轻量级Web服务器

bruce-blog-comments. for brucedone.com blog comments here, feel free to comment on it :)

Spider. The code of the spider

DouBanAlbumHelper. 豆瓣相册助手，选择相册，下载图片，一键帮助

py12306. 🚂 12306 购票助手，支持分布式，多账号，多任务购票以及 Web 页面管理

flask-autoindex. Generates index page like mod_autoindex.

scrapy-cluster. This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

python-scrapyd-api. A Python wrapper for working with Scrapyd's API.

captcha. A captcha library that generates audio and image CAPTCHAs.

ScrapydArt. 在scrapyd基础上新增权限验证、爬虫运行信息统计、界面重构、，并增加排序、筛选过滤等多个API

python-v4l2capture. Python extension to capture video with video4linux2 (fork of https://launchpad.net/python-v4l2-capture)

airflow-docker. Docker Apache Airflow

flask-profiler. a flask profiler which watches endpoint calls and tries to make some analysis.

khronos. A flexible python library for building your own cron-like system, with REST APIs and a Web UI.

scrapy. Scrapy, a fast high-level web crawling & scraping framework for Python.

p2pspider. DHT Spider + BitTorrent Client = P2P Spider