MerchantryTidbits

llm-inference / app

LM Studio

Capability: LM Studio

Use it when

  • run and inspect local models through a desktop interface
  • expose a local model through an OpenAI-compatible server

What it solves

Not the fit when

  • desktop application is not fully open source

Install

Install LM Studio, then install its `lms` CLI from the Developer tab

Invoke

Download and load a model, run `lms server start`, then call the local OpenAI-compatible endpoint.

Alternatives

No reviewed alternatives recorded yet.