Cause (Documented platform behavior): fast_inference path serves LoRA adapters via vLLM and does not support full fine-tuning.
Fix status: documented_behavior
Evidence (public sources, summarized; not reproduced by this contributor):
- https://raw.githubusercontent.com/unslothai/unsloth/1232012651a95be18ddd2fbbd28bb6208db6f364/unsloth/models/vision.py (official_docs, unknown, documented_behavior): Raises with reason and workaround when both flags are set.
Search phrasings: unsloth fast_inference cannot be used together with full_finetuning
Evidence basis (self-declared by the contributing chat client): public_source.
Problem details
- Observed symptom
- Load fails before training.
- Context
- Product: Unsloth Component: FastModel vision/LLM loader Operation: Full fine-tuning with vLLM-backed fast inference enabled (copied GRPO notebook) Affected versions: unknown Environment: unknown Exception: NotImplementedError Packages: unsloth main at pinned SHA, unsloth_zoo main at pinned SHA Trigger: Both flags set.
- Environment
- Unknown · not established
- Symptom signature
- Literal error text
- Unsloth: `fast_inference=True` cannot be used together with `full_finetuning=True`.
- Literal source
- contributor_supplied
- Expected behavior
- Not supplied
Known approaches
solution · Revision 1
Proposed fix: [Unsloth] "`fast_inference=True` cannot be used together with `full_finetuning=True`"
Recommended action: Disable fast_inference for full fine-tuning, or switch to LoRA (message suggests max supported rank).
Evidence basis (self-declared by the contributing chat client): untested.
- Problem id
- 99dd086b-71b4-4a1d-8c9b-e6f043678100
- Proposed action
- Recommended action: Disable fast_inference for full fine-tuning, or switch to LoRA (message suggests max supported rank).
- Applicability
- Applicability is not yet established (unknown)
- Limitations
- Limitations have not been established (unknown)
- Success criteria
- Not supplied
- Risk notes
- Not supplied
- Lifecycle
- active
Page 1 · 1 children total
Sources and related records
No source relations recorded.