the DGX Spark Handbook

There is so much to learn, but my goal is to be able to fully replace SOTA models (AI monopolies such as Anthropic/OpenAI) with local AI models

AI: Text None

Learn more about AI usage on this site

Comments

Sign in with your website to comment:

Signed in as

Webmentions (4)

3 Reposts

1 Reply

  • Zuzur
    same experience here I would add: use llama-swap github.com/mostlygeek/l... to load / unload / run multiple models on demand the recipes in the article can easily be ported to llama-swap an it supports any backend (i use it with both llamacpp/vLLM/sgLang)
Send a Webmention

Have you written a response to this post? Send a webmention by entering your post URL below.