Show HN: Selfhostllm.org – Plan GPU capacity for self-hosting LLMs
selfhostllm.orgA simple calculator that estimates how many concurrent requests your GPU can handle for a given LLM, with shareable results.
A simple calculator that estimates how many concurrent requests your GPU can handle for a given LLM, with shareable results.
I also added a Mac version: https://selfhostllm.org/mac/ so you can know which models you can run on your Mac and get an estimated tokens/sec.
Very useful, thanks. I'm missing a reset button though.