GitHub - thewebscraping/llm-scraper: High-performance article scraper leveraging tls-requests and BeautifulSoup for building clean training datasets and RAG pipelines.

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
.vscode		.vscode
src/llm_scraper		src/llm_scraper
tests		tests
.env.example		.env.example
.gitignore		.gitignore
.pre-commit-config.yaml		.pre-commit-config.yaml
.python-version		.python-version
LICENSE		LICENSE
Procfile		Procfile
README.md		README.md
api.py		api.py
celery_app.py		celery_app.py
example.py		example.py
example_multi_json.py		example_multi_json.py
pyproject.toml		pyproject.toml
uv.lock		uv.lock
worker.py		worker.py