Hugging Face Model Trainer
An official Hugging Face skill that lets Claude Code or Codex fine-tune open-source models using HF Jobs.
Before & after
Same prompt, same agent — the only difference is the skill.
Fine-tuning a small model on your support tickets could work well. Here's the general process: 1. **Prepare your data** — format your tickets into input/output pairs 2. **Choose a base model** — a small open model like Qwen or Llama works for this 3. **Set up training** — configure hyperparameters (learning rate, epochs, batch size) 4. **Train** — run the fine-tuning job, ideally on a GPU 5. **Evaluate** — test on held-out examples 6. **Deploy** — serve the fine-tuned model You'll need GPU access for training. Services like Hugging Face, Modal, or a cloud provider can provide that. Consider whether fine-tuning is actually necessary — sometimes good prompting or RAG gets you there without the training cost. What does your ticket data look like?
Official HF skill — orchestrates the fine-tune on Hugging Face Jobs from inside this coding session, so you don't leave the agent to run training. BEFORE ANYTHING: IS FINE-TUNING EVEN RIGHT? Worth 30 seconds. If you want the model to answer FROM your tickets, that's RAG, not fine-tuning. If you want it to answer LIKE your team (tone, format, escalation style), that's fine-tuning. Support tickets usually want both — RAG for the facts, a fine-tune for the voice. Assuming you want the voice: DATA — the step that decides everything Format: instruction → response pairs. Ticket question → your team's actual reply. Strip PII first; a fine-tune memorizes. Quality over quantity: 500 clean, on-voice pairs beat 5,000 noisy ones. Drop the tickets where the reply was "see attached" or a one-word close — they teach the model nothing but shape. MODEL A small open model (e.g. Qwen) is the right default here — support replies don't need a frontier model, and small means cheap to train and cheap to serve. TRAINING — launched on HF Jobs The skill configures and submits the job: LoRA (not full fine-tune — cheaper, and you can swap adapters later), sane LR, a couple epochs. It runs on HF's GPUs; you watch from the session. EVALUATE — hold out before you train, not after Reserve 10% of tickets the model never sees. After training, judge on those: does it match your team's tone and escalate correctly? Eyeball 20 side by side. A loss number won't tell you if it sounds like you. THE FAILURE TO WATCH FOR Overfitting to phrasing — the model parrots exact past replies instead of generalizing. If eval answers feel copy-pasted, you have too many epochs or too little data variety. Fix the data, not the LR. Share a few sanitized ticket→reply pairs and I'll spec the dataset format the job expects.
About this skill
name: hf-model-trainer description: Use when An official Hugging Face skill that lets Claude Code or Codex fine-tune open-source models using HF Jobs.
Hugging Face Model Trainer
The Hugging Face Model Trainer skill orchestrates fine-tuning of small open-source models (e.g. Qwen) on Hugging Face Jobs directly from an agentic coding session. github.com/huggingface/skills/tree/main/skills/hugging-face-model-trainer
What you get
- A skill that fine-tunes open-source models via Hugging Face Jobs.
Customize your output
- Swap the base model and dataset per project.
Example output
A small open-source model fine-tuned into a custom task-specific model.
Best for
Developers who want to fine-tune open models without leaving their coding agent.
SKILL.md preview
---
name: hf-model-trainer
description: Use this skill when fine-tuning a small open-source model such as Qwen on Hugging Face Jobs directly from an agentic coding session.
version: 1.0.0
category: Development / Machine Learning
author: AgentVolt
license: proprietary
tags:
- development
- machine-learning
- standard
---
# Hugging Face Model Trainer
Orchestrates fine-tuning of small open-source models on Hugging Face Jobs without leaving the coding session, from dataset prep through checkpoint retrieval.
## When to use
… (sign up to view the full skill)More development skills
View all Development skills →Business Automation Stack
A connected set of agents that handle the repetitive ops work — follow-ups, summaries, and handoffs.
Generate
Scaffold code, tests, and boilerplate from a short spec.
Performance Profiler
Systematic performance profiling for Node.js, Python, and Go applications.
Chaos Engineer
Designs controlled failure experiments — from a single fault injection to a full game day — and produces the runbook, rollback plan.