NEWS · MODELS · #3893
Amazon SageMaker adds Full Fine-Tuning (FFT) to AI Serverless Model Customization
Amazon SageMaker AI Serverless Model Customization now supports Full Fine-Tuning (FFT), enabling full-parameter fine-tuning (used with SFT on models like Qwen3-4B) without GPU provisioning or cluster setup. SageMaker’s post reports that FFT outperforms PEFT methods such as LoRA as dataset scale grows — citing ~90.0% LLM-as-Judge semantic correctness on code tasks at 100k+ examples — and provides experimental results and tuning guidance.
KEY POINTS
- Amazon SageMaker AI Serverless Model Customization now supports Full Fine-Tuning (FFT), enabling full-parameter fine-tuning (used with SFT on models like Qwen3-4B) without GPU provisioning or cluster setup.
- SageMaker’s post reports that FFT outperforms PEFT methods such as LoRA as dataset scale grows — citing ~90.0% LLM-as-Judge semantic correctness on code tasks at 100k+ examples — and provides experimental results and tuning guidance.
- Serverless FFT removes infrastructure overhead for full-parameter fine-tuning and can materially improve model quality on large datasets compared with PEFT methods like LoRA.
WHY IT MATTERS
Serverless FFT removes infrastructure overhead for full-parameter fine-tuning and can materially improve model quality on large datasets compared with PEFT methods like LoRA.