Article URL: https://fume.substack.com/p/inference-is-free-and-instant
Comments URL: https://news.ycombinator.com/item?id=41367749
Points: 18
# Comments: 8
Creato
6mo
|
27 ago 2024, 15:10:09
Accedi per aggiungere un commento
Altri post in questo gruppo

Article URL: https://www.construction-physics.com/p/why-its-so-hard-to-build-a-jet-engine
Comments

Article URL: https://github.com/cmackenzie1/torii-rs
Comments URL: https://news


Some background: I work on Langfuse and we've been collaborating with LiteLLM.
(LiteLLM is a Python library and proxy/gateway that handles cost management, virtual keys, caching, and rate-limiti