As an operator of a web application written with GenHTTP, I would like my application to provide high throughput, low latency and low memory allocations so I do not need to care about scaling that much.

Example

The current implementation of the ClientHandler wraps the socket obtained for the client into a NetworkStream that is then passed to a PipeReader for parsing purposes.

As all work is currently scheduled on the ThreadPool and the various streams inbetween the socket and the application framework cause a lot of allocations, the performance of the server cannot be improved without fundamentally changing this architecture.

Looking at Kestrel, we should:

• Use IO threads to read and write from the socket
• Use ThreadPool to actually handle requests in the application
• Read the incoming data without streams into a pipe that can directly re-use the memory allocated by the socket
• Allow to write outgoing data allocation free directly to the socket

See this reference for a potential starting point: https://github.com/aykutalparslan/high-perfomance-tcp-server/

Main question would be how to handle SSL connections without the functionality provided by SslStream.

Acceptance criteria

• There is an implementation that uses IO threads to write and write to the underlying socket
• There is an implementation that avoids the use of additional streams to avoid allocations
• The implementation can be used with SSL while not implementing SSL handling itself
• If the implementation has side effects when embedding GenHTTP into an UI based application, the new implementation must be activated via opt-in
• The application tests still pass
• It has been shown that the application no longer suffers from thread starvation (CPU in waiting state) within benchmarks (e.g. via dotTrace)
• The application has been tested for allocations in a text-based hello world scenario and it can be shown that there are no massive allocations per request (e.g. via dotMemory)