Hey HN, we wanted to share our repo where we fine-tuned Llama 3.1 on Google TPUs. We’re building AI infra to fine-tune and serve LLMs on non-NVIDIA GPUs (TPUs, Trainium, AMD GPUs).
The problem: Right now, 90% of LLM workloads run on NVIDIA GPUs, but there are equally powerful and more cost-effective alternatives out there. For example, training and serving Llama 3.1 on Google TPUs is about 30% cheaper than NVIDIA GPUs.
But developer tooling for non-NVIDIA chipsets is lacking. We felt thi
Article URL: https://columbialawreview.org/content/on-algorithmic-wage-discrimination/
Comments URL: https://news.ycombinator.com/item?id=41513417
Points: 62
# Comments: 22
https://columbialawreview.org/content/on-algorithmic-wage-discrimination/
Article URL: https://www.darrenhorrocks.co.uk/why-copilot-making-programmers-worse-at-programming/
Comments URL: https://news.ycombinator.com/item?id=41513767
Points: 22
# Comments: 3
https://www.darrenhorrocks.co.uk/why-copilot-making-programmers-worse-at-programming/
Article URL: https://netflixtechblog.com/noisy-neighbor-detection-with-ebpf-64b1f4b3bbdd
Comments URL: https://news.ycombinator.com/item?id=41513860
Points: 43
# Comments: 13
https://netflixtechblog.com/noisy-neighbor-detection-with-ebpf-64b1f4b3bbdd
I have been building the open source project https://github.com/claceio/clace. Clace is an application server that builds and deploys containers, allowing it to manage webapps in any language/framework.
Compared to application servers like Nginx Unit, Clace has the advantage of being able to work with any application, without requiring any dependency or packaging changes. Clace provides a blue-green staged deployment model for apps. Not just c
Article URL: https://www.krayorn.com/posts/http-server-go/
Comments URL: https://news.ycombinator.com/item?id=41511899
Points: 5
# Comments: 0