3 Comments
User's avatar
Rohit Akiwatkar's avatar

What an informative piece! It's great to have a clear overview of language model options and their evolution. Kudos to David for breaking down the choices so effectively!

Expand full comment
Bob Miles's avatar

If you're serving inference at scale, your best option is salad.com :)

Expand full comment
Jules S. Damji's avatar

You missed an important framework for option 4 & 5. Ray. Checkout my post on LinkedIn about the emerging stack for fine tuning OSS LLMS.

Expand full comment