Skip to content
View xwinxu's full-sized avatar
💭
alignment and llms.
💭
alignment and llms.
249 followers · 125 following

Achievements

Achievement: YOLOAchievement: QuickdrawAchievement: Starstruckx2Achievement: Arctic Code Vault ContributorAchievement: Pull Sharkx2
BetaSend feedback

Achievements

Achievement: YOLOAchievement: QuickdrawAchievement: Starstruckx2Achievement: Arctic Code Vault ContributorAchievement: Pull Sharkx2
BetaSend feedback

Highlights

  • Pro

Organizations

@for-ai @VectorInstitute @UTMIST
Block or Report

Block or report xwinxu

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
xwinxu/README.md

I research scalable and principled methods for aligning large generative models. In the past, I worked at FAIR Labs at Meta, Google DeepMind and Stanford AI. I'm a graduate of CS, Math, and Stats at the University of Toronto where I began learning about latent variable models and probabilistic inference at the Vector Institute. I'm open to full-time ML research and engineering roles.

Like my models, I'm still learning (:

Pinned

  1. ContextualAI/HALOs ContextualAI/HALOs Public

    A library with extensible implementations of DPO, KTO, PPO, and other human-aware loss functions (HALOs).

    Python 525 26

  2. bayeSDE bayeSDE Public

    Code for "Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equations"

    Python 154 25

  3. google-research/cascades google-research/cascades Public

    Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference, and more.

    Python 181 13

  4. ermongroup/self-similarity-prior ermongroup/self-similarity-prior Public

    Self-Similarity Priors: Neural Collages as Differentiable Fractal Representations

    Jupyter Notebook 23 3

  5. variational-mnist variational-mnist Public

    Fitting a recognition model (VAE) to do approximate inference on intractable posteriors of probabilistic models using an ELBO estimator.

    Python 9 1

  6. pruning-neural-nets pruning-neural-nets Public

    Generating structured sparsity in neural networks using weight and unit pruning techniques.

    Python 1