Tox command added for readiness

[snwagh]

Description

• Adding a new tox command called dev.k8s.ready that will check a k8s deployment for readiness of various services.
  • Run the command as tox -e dev.k8s.ready -- frontend backend proxy to check if frontend, backend, proxy are ready. The full set of posargs is {frontend backend proxy mongo seaweedfs registry} (order is immaterial).
  • Also checks curl http://localhost:${CLUSTER_HTTP_PORT}/api/v2/metadata
• Updating the existing end-to-end testing tox environment -- syft.test.helm
  • to use dev.k8s.ready
  • additionally check the health of seaweedfs and registry services (missing previously)
  • add an override posarg that will allow syft to be deployed in resource constrained environments (more notes below)

Affected Dependencies

NA

How has this been tested?

• Run tox -e syft.test.helm
• Or manually deploy using this notebook and run CLUSTER_NAME=<CLUSTER_NAME> tox -e dev.k8s.ready -- frontend seaweedfs registry to check health of frontend, seaweedfs, and registry

Resource constraint testing

Testing succeeded all the way down till a single CPU and 2GB of RAM (Hypothesis is that things should work till about 1.5GB give or take; 1CPU, 1GB unfortunately gets all but the backend pod running)! Follow these instructions to witness this incredible feat of achievement by the Syft team!

• Go to Docker Desktop --> Settings --> Resources and set the CPU to 1, RAM to 2GB.
• Run tox -e syft.test.helm -- override (this will run all the notebook tests). Except notebooks/api/0.8/11-container-images-k8s.ipynb all other tests should pass (if you set about 4GB of RAM, this test should pass as well).

Set resource constraints

Check for successful deployment using k9s

Notebook tests

Docker resource usage

11th Test (notebooks/api/0.8/11-container-images-k8s.ipynb) with 4GB RAM.

Checklist

• I have followed the Contribution Guidelines and Code of Conduct
• I have commented my code following the OpenMined Styleguide
• I have labeled this PR with the relevant Type labels
• My changes are covered by tests

[itstauq]

Great job @snwagh 🚀. Left some minor comments.