torchtune (PyTorch)
https://github.com/meta-pytorch/torchtune
Pure-PyTorch library for fine-tuning LLMs — Llama/Mistral/Phi/Gemma recipes; native FSDP2 + memory-efficient training. From Meta PyTorch team. Per its README, torchtune is no longer actively maintained; active development ended in 2025.
Archived · Verified 2026-10-29 · fresh as of 2026-10-29 · 16 cited facts, 1 with a third-party source · 3 recorded changes · Suggest a correction
At a glance
- Type
- Native PyTorch LLM fine-tuning repo fix
- Tier
- T2
- Section
- Training infrastructure
- Latest release
- v0.6.1 (2025-04-07) — torchtune registry fix
- License
- BSD-3-Clause repo fix
- GitHub
- meta-pytorch/torchtune (linked from pytorch/torchtune) — ~5.8k stars, last commit 2026-04 repo fix
- Pricing
- searched not found fix
- Funding
- searched not found fix
- Freshness
- 2026-10-29 fix
- Layer
- model-infra repo fix
- Licensing
- open-source repo fix
- Developer activity
- OpenRank 0.56 (12-mo avg 18.5) · 6 participants — 2026-09 third-party fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
PyTorch-native LLM fine-tuning library; LoRA/QLoRA/full FT for Llama/Mistral/Phi; Meta PyTorch team maintained.
Technical surface
- API surface
- searched not found
- Backend storage
- searched not found
- Deployment
- Self-hosted only — library
- Embedding model
- not applicable — not a memory product
- Multi-tenancy
- searched not found
- MCP
- searched not found
- A2A
- searched not found
- OpenTelemetry
- searched not found
Similar systems
Other training infrastructure in the catalog, ranked by inbound references.
- MLflow T1
Databricks-incubated open platform for ML lifecycle — tracking, projects, models, model registry. Standard ML-ops baseline. MLflow 3.0 (2024) added LLM-eval features.
- AWS SageMaker T1
AWS's managed ML platform — Studio, Training, HyperPod (large-scale clusters), Endpoints. Industry-standard for enterprise AWS-hosted training.
- Weights & Biases T1
Experiment-tracking and ML-ops platform (metrics, artifacts, sweeps, Weave tracing/evals). Acquired by CoreWeave (completed 2025-05-05, ~$1.7B); now part of CoreWeave Forge.
- Comet ML T2
ML experiment tracking + LLM evaluation platform (Opik for LLM eval). Comet competes head-to-head with Weights & Biases.
- Azure Machine Learning T1
Microsoft Azure's managed ML platform — pipelines, AutoML, Designer, prompt flow (LLM). Heavy integration with Azure OpenAI and Azure AI Studio.
- LoRA T3
Microsoft Research's Low-Rank Adapters method — trains rank-r matrices added to attention weights; 10000x parameter reduction. Foundation of all adapter-style fine-tuning.
Sources (15 cited facts, 1 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Native PyTorch LLM fine-tuning repo
- What it does & what's distinct Pure-PyTorch library for fine-tuning LLMs — Llama/Mistral/Phi/Gemma recipes; native FSDP… repo
- Claims / benefits PyTorch-native LLM fine-tuning library; LoRA/QLoRA/full FT for Llama/Mistral/Phi; Meta P… repo
- Created 2024 repo
- Latest release v0.6.1 (2025-04-07) — torchtune registry
- License BSD-3-Clause repo
- GitHub meta-pytorch/torchtune (linked from pytorch/torchtune) — ~5.8k stars, last commit 2026-04 repo
- Deployment Self-hosted only — library repo
- Code/weights release Active — last commit 2026-05 · 5,751★ repo
- commit-trajectory [{"ym":"2024-04","cum":497},{"ym":"2024-05","cum":536},{"ym":"2024-06","cum":573},{"ym":… repo
- architecture-deployment-locus local repo
- licensing-bucket open-source repo
- positioning-platform-vs-product platform repo
- taxonomy-three-layer-rollup model-infra repo
- developer-activity-opendigger {"activity":13.38,"as_of":"2026-09","openrank_12mo":18.5,"openrank_current":0.56,"partic… third-party
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
- 2026-10-29
- Lifecycle first recorded as “archived”
- 2026-10-28
- Homepage “https://github.com/pytorch/torchtune” → “https://github.com/meta-pytorch/torchtune”
- 2026-10-27
- Latest release first recorded as “v0.6.1 (2025-04-07) — torchtune” source
- Deployment first recorded as “Self-hosted only — library” source