

21·
2 months ago865GB? I can’t run that locally. I want like 30 specialized 100GB models I can run locally. I can’t load/unload them as needed. Would take longer to do the inference but things have gotten good enough to set it and forget it.


865GB? I can’t run that locally. I want like 30 specialized 100GB models I can run locally. I can’t load/unload them as needed. Would take longer to do the inference but things have gotten good enough to set it and forget it.
Interesting 🤔