torchtune (PyTorch) alternatives

Pure-PyTorch library for fine-tuning LLMs — Llama/Mistral/Phi/Gemma recipes; native FSDP2 + memory-efficient training. From Meta PyTorch team. Per its README, torchtune is no longer actively maintained; active development ended in 2025. Full torchtune (PyTorch) record →

  1. 1 FSDP (PyTorch) Training infrastructure

    also in Training infrastructure · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 105k released 2026-09-30 BSD-3-Clause (PyTorch) Compare with torchtune (PyTorch) →

  2. 2 Unsloth Training infrastructure

    also in Training infrastructure · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 79k released 2026-10-26 Apache-2.0 (free tier) Compare with torchtune (PyTorch) →

  3. 3 Label Studio (HumanSignal) Training infrastructure

    also in Training infrastructure · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 29k released 2026-09-29 Apache-2.0 (Community); proprietary Enterprise Compare with torchtune (PyTorch) →

  4. 4 Prefect Training infrastructure

    also in Training infrastructure · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 24k released 2026-10-21 Apache-2.0 Compare with torchtune (PyTorch) →

  5. 5 Hugging Face Datasets Training infrastructure

    also in Training infrastructure · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 22k released 2026-10-05 Apache-2.0 Compare with torchtune (PyTorch) →

  6. 6 DVC Training infrastructure

    also in Training infrastructure · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 16k released 2026-03-31 Apache-2.0 Compare with torchtune (PyTorch) →

  7. 7 MLflow Training infrastructure

    also in Training infrastructure · also open source · also self-hostable

    OSS ✓ Self-host ✓ Managed ? MCP ✓ ★ 29k released 2026-10-21 Apache-2.0 Compare with torchtune (PyTorch) →

  8. 8 Flyte Training infrastructure

    also in Training infrastructure · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 7.8k released 2026-10-27 Apache-2.0 Compare with torchtune (PyTorch) →

Ranked by shared memory design (storage, retrieval, conflict handling, memory unit), same section and shared must-haves (open source, self-hosting, MCP), with adoption as a tie-breaker. ✓ confirmed · — no · ? not in the catalog yet. Want picks for your own requirements? Use the chooser. Checking a whole project? Check your stack.