Move uvicorn start into ClusterServlet to increase process locality.

[rohinb2]

Running 15s test @ http://127.0.0.1:32300/get_pid_basic/call
  8 threads and 64 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    36.35ms   10.23ms 203.99ms   92.54%
    Req/Sec   222.72     34.87   290.00     76.86%
  Latency Distribution
     50%   33.85ms
     75%   36.67ms
     90%   41.39ms
     99%   74.09ms
  26654 requests in 15.06s, 5.03MB read
Requests/sec:   1770.19
Transfer/sec:    342.28KB

[rohinb2]

• Move uvicorn start into ClusterServlet to increase process locality. #669 👈
• Move main script of http_server into async main. #664 : 4 other dependent PRs (#657 , #660 , #671 and 1 other)
• Change daemon-side components to be fully async for performance improvements. #656
• Cache get_obj_from_pointers call for function. #662
• Cache computation of Module's signature. #665
• Cache dir(Module). #661
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @rohinb2 and the rest of your teammates on Graphite