-
-
Notifications
You must be signed in to change notification settings - Fork 3.9k
Open
Labels
Description
- Did you update?
I am on the latest version of the docker container ColaborKaggleor local / cloudlocal- Number GPUs used, use
nvidia-smi1x RTX 3070 - Which notebook? Please link!
N/A - Which Unsloth version, TRL version, transformers version, PyTorch version?
The latest - Which trainer?
SFTTrainer,GRPOTraineretcSFTTrainer
model, tokenizer = FastLanguageModel.from_pretrained(
model_name = "ibm-granite/granite-4.0-h-350m-base",
max_seq_length = max_seq_length,
dtype = dtype,
load_in_4bit = False,
full_finetuning = True,
)When that is run, this is the output:
RuntimeError: only Tensors of floating point dtype can require gradients
🦥 You can also ask via our Reddit page: https://www.reddit.com/r/unsloth/