MerchantryTidbits

ml-operations / app

Transformer Lab

Capability: Transformer Lab

Use it when

  • You want to fine-tune open models (LoRA/QLoRA, DPO, ORPO) on your own Apple Silicon, NVIDIA, or AMD hardware but do not want to assemble separate training scripts, chat UIs, and eval harnesses by hand
  • Your research team needs one interface to submit training jobs to Slurm or SkyPilot clusters with shared experiment tracking instead of everyone running ad hoc scripts

What it solves

Not the fit when

  • Individual edition assumes one machine; Slurm and SkyPilot orchestration belongs to the separate Teams edition and existing cluster or cloud infrastructure
  • Requires Apple Silicon on macOS, an NVIDIA or AMD GPU on Linux, or NVIDIA through WSL2 on Windows
  • AGPL-3.0 obligations apply when modifying, distributing, or operating the software as a network service; review those obligations for proprietary deployments
  • The local-privacy claim applies to the individual local workflow; remote providers, plugins, SkyPilot clouds, and Teams infrastructure have their own data boundaries
  • Not a hosted inference API; compute, storage, and any cloud-cluster charges remain yours
  • cost-per-call-too-high
  • vector-db-server-dependency
  • multi-model-routing
  • llm-app-boilerplate-sprawl

Install

Download https://lab.cloud/install.sh to a local file, inspect it, then run it with bash; the upstream quickstart is curl https://lab.cloud/install.sh | bash

Invoke

cd ~/.transformerlab/src && ./run.sh, then open http://localhost:8338 in a browser to download models, fine-tune (LoRA/QLoRA, DPO), chat, and run evals from one UI

Alternatives

No reviewed alternatives recorded yet.