A curated collection of engineering blogs on the use of Large Language Models (LLMs) in production.
If you've been searching for information on LLMs online, you've probably come across numerous articles explaining what LLMs are, how they work, steps for integrating them into your applications, and their potential applications in various industries. Two of the best ones I've read are from Chip Huyen (Building LLM applications for production) and Eugene Yan (Patterns for Building LLM-based Systems & Products).
It's easy to make something cool with LLMs, but very hard to make something production-ready with them.
I wholeheartedly agree with Chip's statement in the linked blog post. On top of top that, I'd add that making something production-ready with LLMs that actually benefits a business (improves a business metric in a cost-efficient way) is damn hard! I have found it pretty hard to find blogs describing the use of LLMs in real products to tackle actual business issues.
I'll list the engineering blogs from different companies that I've explored and read here. These blogs detail real-world applications of LLMs in solving specific business problems. I hope they will provide valuable insights and ideas on how you might employ LLMs to address challenges in your business problems.
I'll keep the list updated as and when I find new blogs. If you find a blog that fits here, send a PR or share it with me!
| Title | Company | Date |
|---|---|---|
| Building DoorDash’s Product Knowledge Graph with Large Language Models | DoorDash | Apr, 2024 |
| Leveraging LLMs in Production: Looking Back, Going Forward | Mercari | Dec, 2023 |
| CoEdIT: State-of-the-Art Text Editing With Fewer Parameters | Grammarly | Dec, 2023 |
| LLM-powered data classification for data entities at scale | Grab | Oct, 2023 |
| Let AI Entertain You: Increasing User Engagement with Generative AI and Rejection Sampling | Nextdoor | Oct, 2023 |
| Dont you (forget NLP): Prompt injection with control characters in ChatGPT | Dropbox | Jul, 2023 |
| From reviews to insights: Building analytic applications with Large Language Models in e-commerce | Microsoft | Jul, 2023 |
| Automating data analytics with ChatGPT | Microsoft | Jul, 2023 |
| The Right Tools For The Job | BuzzFeed | May, 2023 |
| How AI Text Generation Models Are Reshaping Customer Support at Airbnb | Airbnb | Nov, 2022 |