You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi! Sorry, maybe it is not the correct place to ask. I went through awesome #tiangolo repos and dockerswarm.rocks as well. But I got confused about what technologies I need to use on top of Flask/FastAPI if I want to serve a ML model.
If I understand correctly I need to use at least: I. Flask + uWSGI
or II. FastAPI + Uvicorn with Gunicorn
On top of that I can put Nginx as a reverse proxy (load balancing, caching, security, etc.): I. Flask + uWSGI + Nginx II. FastAPI + Uvicorn/Gunicorn + Nginx
My questions:
Do I need to use Traefik on top of that? Or do I need to change Nginx to Traefik if I want to use Traefik?
If I have an application which only accepts POST requests is is recommended to use Nginx and/or Traefik on top of FastAPI + Uvicorn/Gunicorn?
If I will use Tensorflow Serving or other ML serving solutions (Kubeflow, MLflow, Seldon, etc) is it still recommended to wrap up Tensorflow Serving into FastAPI + Uvicorn/Gunicorn + Nginx or/and Traefik?
The text was updated successfully, but these errors were encountered:
I would use traefik or nginx-proxy on top if you want https. It handles that well
Irrelevent AFAIK
I would seperate if you have the time to write it up. But that would have overhead, and if you want to go quick and dirty its worth just putting it all in a bundle.
Hi! Sorry, maybe it is not the correct place to ask. I went through awesome #tiangolo repos and dockerswarm.rocks as well. But I got confused about what technologies I need to use on top of Flask/FastAPI if I want to serve a ML model.
If I understand correctly I need to use at least:
I. Flask + uWSGI
or
II. FastAPI + Uvicorn with Gunicorn
On top of that I can put Nginx as a reverse proxy (load balancing, caching, security, etc.):
I. Flask + uWSGI + Nginx
II. FastAPI + Uvicorn/Gunicorn + Nginx
My questions:
Do I need to use Traefik on top of that? Or do I need to change Nginx to Traefik if I want to use Traefik?
If I have an application which only accepts POST requests is is recommended to use Nginx and/or Traefik on top of FastAPI + Uvicorn/Gunicorn?
If I will use Tensorflow Serving or other ML serving solutions (Kubeflow, MLflow, Seldon, etc) is it still recommended to wrap up Tensorflow Serving into FastAPI + Uvicorn/Gunicorn + Nginx or/and Traefik?
The text was updated successfully, but these errors were encountered: