aioscraper
Async Python framework for large-scale API data collection: JSON/REST fan-out with adaptive rate limiting, retries, priority queues and pipelines
What XERJ indexed
Snapshot
The whole repository at commit a77246573f (2026-10-18). main is 8 commits ahead.
Selected work
“remove deprecated request aliases and narrow the public API”. 9 files, 241 lines in aioscraper, tests.
Licence
The repository
LICENSE file checked at the pinned commit; the author agreed to inclusion.
The XERJ corpus
The author agreed by email on 2026-10-27. Same terms as the repository. Answers name the repo, the commit and the file:line.
selected for the XERJ Corpus Hublicence clearedsuggested use: adapt with attribution
asynciopythonscraperdata-collectionaiojobsrate-limitingrequest-manageraiohttp
Example questions
- How does aioscraper implement asyncio?
- Where does aioscraper handle “remove deprecated request aliases and narrow the public API”?
- What does aioscraper do in aioscraper?
Inside the indexed corpus
- On GitHub since 2025-04-24, last push 2026-10-26, 251 commits on main.
- The pin is 8 commits behind main; the corpus answers from the pinned code, not the newest.
Licence on GitHub and in the corpus
GitHub reported MIT for DarkStussy/aioscraper on 2026-10-29, and the LICENSE file at commit a77246573f was reviewed as MIT. They match, so answers from this corpus carry the same terms as the live repository.
Contributors
Stanislav (@DarkStussy) has 1 selected repository on the hub.
Using XERJ with aioscraper
- Search an OpenAPI spec so an agent can find endpoints The hub files it under API design and specification.
- ripgrep vs a code index for coding agents: 30 tasks
- Best MCP servers for local code search in 2026, compared
- Best grep alternative for AI coding agents (2026)
The prompt
Paste it into your AI agent. It clones DarkStussy/aioscraper at the pinned commit and indexes it on your machine.
Search the GitHub repository DarkStussy/aioscraper with XERJ (https://hub.xerj.org/corpus/darkstussy--aioscraper). Run these in a shell, in order, and check each result before the next: 1. xerj --help (success: it prints usage). If xerj is missing: curl -fsSL https://xerj.org/get | sh 2. git clone https://github.com/DarkStussy/aioscraper aioscraper && git -C aioscraper checkout a77246573f86f61c1505126dd377ab3c36804e00 3. Start a local node and leave it running: xerj --insecure --data-dir ./xerj-data 4. xerj autoindex ./aioscraper --url http://127.0.0.1:9200 --prefix aioscraper --progress plain 5. xerj autoindex map --url http://127.0.0.1:9200 Then answer my question from the indexed files and cite the ax_path of every hit. Query syntax: https://xerj.org/llms.txt Licence: MIT. Keep the copyright notice and credit the authors.
Related
StanislavAPI design and specification corporaaiohttpautogenadalflowdymmond/ravynfireflyframework/fireflyframework-pyflytrassert/Luminto
Stats: GitHub API, fetched 2026-10-29. Selected work and consent: the XERJ registry.