Build software better, together

🤖 Scrape data from HTML websites automatically by just providing examples

稳定工作4年的微信公众号爬虫 Based on python and vuejs 微信公众号采集 Python爬虫 公众号采集 公众号爬虫 公众号备份

Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.

Powerful Telegram bot for web scraping and crawling. Fast, easy, and loved by thousands!

Spiderbuf 是一个专注于 Python 爬虫练习的网站。提供丰富的爬虫教程、爬虫案例解析和爬虫练习题。Python爬虫开发强化练习，在矛与盾的攻防中不断提高技术水平，通过大量的爬虫实战掌握常见的爬虫与反爬套路。 引导式爬虫案例 + 免费爬虫视频教程，以闯关的形式挑战各个爬虫任务，培养爬虫开发的直觉及经验，验证自身爬虫开发与反爬虫实力的时候到了。

A universal solution for web crawling lists. 抓取网页列表的通用解决方案

Google Maps crawler using Selenium. All extracted data is forwarded to a SQS queue.

👾 CLI MetaSpy (Facebook, Instagram) scraper and crawler - instagram account, facebook accounts, pages and search

🍠小红书 rednote 简易爬虫 获取文章title、文章id、文章内容、话题标签 👌🏻 三步实现

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

Tutorial de raspagem de dados realizado em parceria com a JusBrasil

• Updated Jul 1, 2024
• Python

newbing api by PlayWright

email scraper/crawls using python (Google/Bing)

A collection of Bangla newspaper and blog crawlers. Can be used to mine bangla text data for Natural Language Processing tasks.

Reddit Media Downloader is a Python application designed to simplify the process of downloading images and GIFs from Reddit. It allows users to specify a subreddit and number of posts to fetch, then automatically retrieves and downloads all available media files. The app features built-in cache logic, which remembers previously downloaded posts to

爬取京东商品评论数据

基于双向双层、引入注意力机制的LSTM对英雄联盟比赛胜率进行预测。

End-to-end ELT pipeline for 160K+ Skytrax airline reviews: Airflow orchestration, BeautifulSoup scraping, S3 staging, Snowflake warehouse, dbt star schema transformation, Terraform IaC, GitHub Actions CI/CD, and Next.js dashboard with LangChain RAG chatbot.

crawling google full size image