Build software better, together

python爬虫项目合集，从基础到js逆向，包含基础篇、自动化篇、进阶篇以及验证码篇。案例涵盖各大网站(xhs douyin weibo ins boss job，jd...)，你将会学到有关爬虫以及反爬虫、自动化和验证码的各方面知识

python3网络爬虫笔记与实战源码。记录python爬虫学习全程笔记、参考资料和常见错误，约40个爬取实例与思路解析，涵盖urllib、requests、bs4、jsonpath、re、 pytesseract、PIL等常用库的使用。

A simple distributed crawler for zhihu && data analysis

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

XML sitemap parser designed to extract and process millions of URLs while bypassing most modern anti-bot protections. Supports plain and compressed XML, unlimited nested sitemaps, multi-threading, multiple inputs, CloudScraper integration, fingerprint randomization, proxy/user agent rotation, auto stealth mode, and detailed monitoring.

Python Crawler

基于 Playwright 的自主 AI 搜索智能体。支持迭代式任务规划、深度网页爬取，以及带引用来源的多源知识整合。

It's designed to be a simple, tiny, pratical python crawler using json and sqlite instead of mysql or mongdb. The destination website is Zhihu.com.

🐍A collection of simple Python crawlers.

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

豆瓣电影爬虫: 电影信息 + 影评 + 短评

这是也一个爬虫教学的项目

This repo is mainly for dynamic web (Ajax Tech) crawling using Python, taking China's NSTL websites as an example.

just for python learning.

🐍🗺️ This Python script empowers you to scrape data from Google Maps, enabling extraction of valuable information like addresses, reviews, and ratings. 📋🏢⭐

支持多种爬取方式，下载用户相册，爬取用户帖子，爬取实时搜索帖子等，欢迎下载使用和补充功能

大三课设。本项目是一个基于Django框架的股票分红数据爬虫和展示系统。它可以从东方财富网站爬取股票分红数据，并将数据存储到Django数据库中，同时提供数据查询、导出和图表展示功能。

keep watching new bug bounty (vulnerability) postings.

Python airline/flights data crawler

Python asynchronous library for web scrapping