LoRA
https://arxiv.org/abs/2106.09685
Microsoft Research's Low-Rank Adapters method — trains rank-r matrices added to attention weights; 10000x parameter reduction. Foundation of all adapter-style fine-tuning.
Stale · Verified 2026-10-27 · fresh as of 2026-10-27 · 14 cited facts, 1 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Type
- Low-rank adapter fine-tuning vendor fix
- Tier
- T3
- Section
- Training infrastructure
- Latest release
- v0.1.2 (2023-08-27) — loralib registry fix
- License
- MIT (microsoft/LoRA, loralib) repo fix
- Pricing
- not applicable — research paper fix
- Funding
- not applicable — research paper fix
- Freshness
- 2026-10-27 fix
- Layer
- model-infra repo fix
- Licensing
- open-source repo fix
- Developer activity
- OpenRank 0.48 (12-mo avg 1.44) · 1 participants — 2026-09 third-party fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
ICLR 2022; one of the most-cited fine-tuning papers.
Technical surface
- API surface
- not applicable — research paper
- Backend storage
- not applicable — research paper
- Deployment
- not applicable — research paper
- Embedding model
- not applicable — research paper
- Multi-tenancy
- not applicable — research paper
- MCP
- not applicable — research paper
- A2A
- not applicable — research paper
- OpenTelemetry
- not applicable — research paper
Similar systems
Other training infrastructure in the catalog, ranked by inbound references.
- MLflow T1
Databricks-incubated open platform for ML lifecycle — tracking, projects, models, model registry. Standard ML-ops baseline. MLflow 3.0 (2024) added LLM-eval features.
- AWS SageMaker T1
AWS's managed ML platform — Studio, Training, HyperPod (large-scale clusters), Endpoints. Industry-standard for enterprise AWS-hosted training.
- Weights & Biases T1
Experiment-tracking and ML-ops platform (metrics, artifacts, sweeps, Weave tracing/evals). Acquired by CoreWeave (completed 2025-05-05, ~$1.7B); now part of CoreWeave Forge.
- Comet ML T2
ML experiment tracking + LLM evaluation platform (Opik for LLM eval). Comet competes head-to-head with Weights & Biases.
- Azure Machine Learning T1
Microsoft Azure's managed ML platform — pipelines, AutoML, Designer, prompt flow (LLM). Heavy integration with Azure OpenAI and Azure AI Studio.
- Argilla T2
Open-source data-quality platform for LLM training data — human-in-the-loop labelling, RLHF data collection, dataset curation. Acquired by Hugging Face 2024.
Sources (13 cited facts, 1 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Low-rank adapter fine-tuning vendor
- What it does & what's distinct Microsoft Research's Low-Rank Adapters method — trains rank-r matrices added to attentio… vendor
- Claims / benefits ICLR 2022; one of the most-cited fine-tuning papers. vendor
- Created 2021-06 vendor
- Latest release v0.1.2 (2023-08-27) — loralib registry
- License MIT (microsoft/LoRA, loralib) repo
- GitHub microsoft/LoRA — ~13.9k stars, last commit 2024-12 repo
- citation-trajectory [{"year":2023,"cum":6,"infl":2},{"year":2024,"cum":9,"infl":4},{"year":2025,"cum":14,"in… paper
- architecture-deployment-locus local repo
- licensing-bucket open-source repo
- positioning-platform-vs-product platform repo
- taxonomy-three-layer-rollup model-infra repo
- developer-activity-opendigger {"activity":2.14,"as_of":"2026-09","openrank_12mo":1.44,"openrank_current":0.48,"partici… third-party
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
Related systems
Referenced by (6)
- CL of LLMs Survey cites — S2 isInfluential citation
- FOREVER cites — S2 isInfluential citation
- LongLoRA cites — S2 isInfluential citation
- MemoryBench (Tsinghua THUIR) cites — S2 isInfluential citation
- QLoRA cites — S2 isInfluential citation
- TransformerFAM cites — S2 isInfluential citation