Right-sizes LLM models to your system's RAM, CPU, and GPU

[bilsbie]

Article URL: GitHub - AlexsJones/llmfit: Hundreds of models & providers. One command to find what runs on your hardware.

Comments URL: Right-sizes LLM models to your system's RAM, CPU, and GPU | Hacker News

Points: 212

# Comments: 49

Continue reading...