Blog posts

[bouthilx]

First setup main website for the blog posts (June 30)

Potential topics:

• Hydra (July 8)
• W&B
• Pytorch-lightning
• Pytorch-Lightning + W&B + Hydra
• Fine-tuning language models with 🤗
• Multi-fidelity optimisation of large language model using dataset size as the fidelity
• Brax
• Other RL tasks
• Graph neural network tasks, ex: TorchDrug
• GAN example
• Speech: Speechbrain
• Mutransfert: https://github.com/microsoft/mup
• Parallelism
  • Parallelism with multi-processing and dask backends
  • Nested parallelism
  • Cluster scaling with Dask
• Resilience
• Optimization of image transformation of computer vision tasks
• Algorithms description (like PBT and Hyperband which many struggles to understand well)
• Algo implementation
• Algo Benchmarking

[bouthilx]

There is some confusion around the definition of blog posts and tutorials. I would suggest we instead try to define the type of communications we would like to make, and see afterwards how we could group them under a single stream (announcements, blog posts, tutorial, examples, ...). Maybe they could also all be in the same stream but differentiated used tags.

• Announcements / News
  • New Releases
  • Collaborations
  • Presentations or participations in conferences
• Technical explanations
  • Of a feature in Oríon
  • Of an algorithm
  • Of family of algorithms and how to select among them
  • How to use benchmarking
  • Developping an algorithm using Oríon
• Examples of applications using Oríon
  • ex: Fine-tuning of a LM in 🤗
  • Personal experiences

Any other ideas?