This video shows you how to load models in Unsloth Studio – and how to share them locally and across the network. Using Unsloth Studio, you can download and use models directly (much like ollama – but it appears to be much faster since it seems to use llama.cpp under the hood. You can also host these models either locally on the same machine, or set up an external port and connect Claude Code or other cli from another machine.

Hosting a model in Unsloth Studio so another machine can connect to it involves a few easy steps. First, install Unsloth Studio on your host machine (with the big GPU and lots of memory). Then download and start the desired model in Unsloth Studio. After that, go to Settings -> API. Create a new API key. On your client system set up a batch file or environment variables then run claude from the command line:

> set ANTHROPIC_BASE_URL=http://<ip address of your server>:<port number>
> set ANTHROPIC_AUTH_TOKEN=<your unsloth api key - usually: sk-unsloth-d5134......>
> set ANTHROPIC_MODEL=Qwen3.8

> claude --model Qwen3.8 %*