← LeaderboardThe Skill Leaderboard

scraping-skills

6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks.

Published by brycewang-stanford ↗brycewang-stanford/Auto-Empirical-Research-Skills

Try your first task

scraping-skills

Start a fresh conversation. Replace the highlighted placeholders.

Use scraping-skills to select the most suitable ethical data-collection workflow for [research question and target data] and provide a rate-limited, data-quality-conscious collection plan.

Required inputs

  • [research question and target data]

User-approved starter prompt based on a pinned source version; check current skill requirements before running. Task evidence ↗

SKILL.md

name: scraping-skillsdescription: "6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks."

Web Scraping & Data Collection — 6 Skills

Select the skill matching the user's need, then read its SKILL.md.

SkillDescription
academic-web-scrapingEthical web scraping and API-based data collection for research
dataset-finder-guideSearch and download research datasets from Kaggle, HuggingFace, and repos
easy-spider-guideGuide to EasySpider for visual no-code web data collection
google-scholar-scraperEthical Google Scholar data collection techniques and best practices
repository-harvesting-guideHarvest metadata from open repositories using OAI-PMH protocol
web-scraping-ethics-guideScrape web data ethically and legally for research purposes