Skip to content

flyakite/100-million-requests-aiohttp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Making 100 million requests with aiohttp

Inspired by Andy Balaam's blog

Creating huge amount of asynchronous tasks all at once would encounter memory error. This repo provides a way to make 100 million plus requests using asyncio and aiohttp. We limits the concurrent requests with a simple semaphore to prevent CPU or memory exhausting.

Runtime

Python 3.6

Usage

Server

python server.py

Client, e.g., make 100,000,000 total requests, 1,000 concurrent requests

python client.py -n 100000000 -c 1000

About

Creating enormous tasks using aiohttp(asyncio) without memory error.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages