PyTorch CI Metrics Dashboards: the HUD

PyTorch CI Metrics/Dashboards Compilation: the HUD

All our relevant dashboards and metrics have been consolidated on our HUD: https://hud.pytorch.org/ Code for the HUD can be found in https://github.com/pytorch/test-infra/tree/main/torchci

OUTDATED - The below was as of Sept 2021.

This page is a compilation of dashboards we have for tracking PyTorch CI, including test time, test status, and when the docs were last updated.

OSS:

• Grafana: https://metrics.pytorch.org/?orgId=1
• The HUD
  • https://hud.pytorch.org/build2/pytorch-master cleaner
  • https://hud.pytorch.org/build1/pytorch-master has more data, like estimated cost per commit
• PyTorch download stats

Internal Dashboards

• Some of the following should be combined into one folder structure.
• Michael’s trunk health Unidash
• Rong’s [potentially outdated] Collation of Unidash, containing
  • Binary build TTS
  • Test TTS
  • Test Status
• PyTorch Dev Infra Perf collation (a few of these are broken)
  • OSS CI Test Time Details
  • OSS CI Build Time Details
  • Landhugger
  • Internal Statuses
• Ed’s [potentially outdated] PyTorch OSS Unidash
  • Has stats based on branch: master, nightly, postnightly, pull request
• viable/strict promo logs
• Links to nightly cron jobs per domain
  • nightlies trigger
  • torchaudio
  • torchvision
  • torchtext
• TorchBench stats
• Internal stats from other teams
  • Fortify Reliability (https://fburl.com/unidash/kicivh9f) (from internal DevX)
  • Remote worker status (https://fburl.com/unidash/iu7kdxza) (from internal DevX, mostly for GPU and mobile RE)