Unsloth desktop vs LM Studio: first impressions

Explore Unsloth's folder sync, model loading and deep research, with a Linux install report and beta limitations from testing on 8 GB of VRAM.

Player not loading? Watch on YouTube

Noah reviews the Unsloth desktop beta after roughly one to two hours of use. He reports installing its Debian package successfully on Linux and describes the app as open source. His preference over LM Studio and Open WebUI reflects his own workflow and early testing.

The walkthrough starts with document retrieval. He links a folder of PDFs to a project, lets the app embed them, then removes files and clicks Sync Changes. The project's file count drops from 17 to six. He also reports errors when trying to change the default embedding model.

For local LLM use, the model hub supports discovery through Hugging Face and a choice of quantization. Noah raises the default 4096-token context setting and uses automatic fitting when loading a model on his system with 8 GB of VRAM. That hardware detail describes his test machine, not a minimum requirement.

Deep research creates an editable plan before starting its searches. A tool call fails during the demonstration; Noah retries it and says retries usually resolved similar failures in his limited testing. He estimates about 20 minutes for a full research run on his PC but does not show it finishing.

The app also has an API and connections to remote models. His Chat LM connection returns a response, though he cannot access tools for those connected models. He leaves the cause unresolved and shows permission settings that can require approval before high-risk tool calls.