Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 15, 2025

• ⛔ Add EOS token to processed input in SFT (#3091)

  Show description for 5cb390c
  qgallouedec

  authored
  5cb390c

  Copy full SHA for 5cb390c

Commits on Mar 13, 2025

• Fixing JSD loss computation as per definition (#3043)

  Show description for b55d9f0
  

  abhigoyal1997

  and

  kashif

  authored
  b55d9f0

  Copy full SHA for b55d9f0

Commits on Mar 12, 2025

• 🏊 [SFT] Compatibility with padding free and iterable dataset (#3053)

  Show description for 4871c82
  qgallouedec

  authored
  4871c82

  Copy full SHA for 4871c82

Commits on Mar 5, 2025

• 🎲 Add support for additional generation kwargs in GRPO Trainer (#2989)

  Show description for 6a02c69
  

  3 peopleauthored
  6a02c69

  Copy full SHA for 6a02c69

Commits on Feb 28, 2025

• ⚰️ Deprecate liger-kernel (#2949)

  Show description for b882f57
  

  qgallouedec

  and

  kashif

  authored
  b882f57

  Copy full SHA for b882f57

Commits on Feb 27, 2025

• 🌌 Fix logits computation in trainer prediction step (#2969)

  Show description for c0854c3
  

  4 peopleauthored
  c0854c3

  Copy full SHA for c0854c3

Commits on Feb 23, 2025

• 🧼 Upgrade ruff (#2938)

  qgallouedec

  authored
  8453017

  Copy full SHA for 8453017

Commits on Feb 20, 2025

• 🐦‍🔥 6x faster GRPO with multi-step optimization (#2899)

  Show description for e5ae703
  qgallouedec

  authored
  e5ae703

  Copy full SHA for e5ae703

Commits on Feb 18, 2025

• 📍 [GRPO] add gradient_checkpointing (#2848)

  Show description for 9b3c5bf
  

  kashif

  and

  qgallouedec

  authored
  9b3c5bf

  Copy full SHA for 9b3c5bf

• 🍃 GRPO - Do not load reference model when beta == 0 (#2806)

  Show description for 15fec31
  

  ingambe

  and

  qgallouedec

  authored
  15fec31

  Copy full SHA for 15fec31

• 🩳 max_seq_length to max_length (#2895)

  Show description for be1e340
  qgallouedec

  authored
  be1e340

  Copy full SHA for be1e340

• ✨ Add vLLM guided decoding support to GRPO Trainer (#2811)

  Show description for 49adf74
  

  kldzj

  and

  qgallouedec

  authored
  49adf74

  Copy full SHA for 49adf74

• 🪂 Don't gather logits in SFT to avoid hanging (#2890)

  Show description for 6c54f02
  qgallouedec

  authored
  6c54f02

  Copy full SHA for 6c54f02

• 🍟 [SFT] Handles the dataset if it has been preprocessed (#2863)

  Show description for aafd8cb
  

  3 peopleauthored
  aafd8cb

  Copy full SHA for aafd8cb

Commits on Feb 17, 2025

• 💬 Add maybe_convert_to_chatml map for conversational datasets in SFT (#2862)

  Show description for ba03657
  

  kashif

  and

  qgallouedec

  authored
  ba03657

  Copy full SHA for ba03657

Commits on Feb 13, 2025

• 👨‍👩‍👧 GRPO + PEFT + vLLM (#2818)

  Show description for 5c9cf20
  

  winglian

  and

  qgallouedec

  authored
  5c9cf20

  Copy full SHA for 5c9cf20

Commits on Feb 12, 2025

• ⚡ Fix GRPO PEFT (#2725)

  qgallouedec

  authored
  8122166

  Copy full SHA for 8122166

Commits on Feb 11, 2025

• 👴 Update tokenizer parameter to processing_class in tests (#2828)

  qgallouedec

  authored
  2106b31

  Copy full SHA for 2106b31

• ⚖️ Add reward weight in multi-reward settings for GRPO (#2676)

  Show description for e752fc6
  

  hesamsheikh

  and

  qgallouedec

  authored
  e752fc6

  Copy full SHA for e752fc6

Commits on Feb 7, 2025

• ⛰️ Reduce peak vram consumption with efficient selective log_softmax (#2799)

  Show description for 09eefa7
  

  tyler-romero

  and

  qgallouedec

  authored
  09eefa7

  Copy full SHA for 09eefa7

• 🔬 SFT simplification (#2405)

  Show description for 5b9236d
  

  qgallouedec

  and

  kashif

  authored
  5b9236d

  Copy full SHA for 5b9236d

• 🎯 [SFT] add token accuracy metric (#2597)

  Show description for 84d73fd
  

  kashif

  and

  qgallouedec

  authored
  84d73fd

  Copy full SHA for 84d73fd

Commits on Feb 6, 2025

• 📉 Optimize GRPO memory usage by redefining per_device_batch_size as generations per device (#2776)

  Show description for cf97133
  qgallouedec

  authored
  cf97133

  Copy full SHA for cf97133

Commits on Feb 4, 2025

• 🔁 🦈 Support iterative GRPO (#2700)

  Show description for b2ae999
  

  shirinyamani

  and

  qgallouedec

  authored
  b2ae999

  Copy full SHA for b2ae999

• 🤖 Properly unwrap torch.compile-ed models in GRPO (#2750)

  Show description for bd946f9
  

  winglian

  and

  qgallouedec

  authored
  bd946f9

  Copy full SHA for bd946f9

Commits on Jan 31, 2025

• 🏰 num_logits_to_keep to logits_to_keep (#2721)

  qgallouedec

  authored
  1c35a48

  Copy full SHA for 1c35a48

Commits on Jan 30, 2025

• 📋 Add eval loss logging during prediction in GRPO (#2694)

  Show description for fecaa99
  

  kashif

  and

  qgallouedec

  authored
  fecaa99

  Copy full SHA for fecaa99

• ☠️ Remove deprecated (#2692)

  Show description for 6dc278a
  qgallouedec

  authored
  6dc278a

  Copy full SHA for 6dc278a

Commits on Jan 29, 2025

• ⚡ vLLM for fast generation in GRPO (#2600)

  Show description for ed14ed9
  

  3 peopleauthored
  ed14ed9

  Copy full SHA for ed14ed9

Commits on Jan 28, 2025

• 🖊 Fix typos (#2673)

  Show description for 4659ad9
  omahs

  authored
  4659ad9

  Copy full SHA for 4659ad9

Commits on Jan 24, 2025

• 🚛 Provide all columns of the dataset to the reward function (#2650)

  Show description for 2578e95
  qgallouedec

  authored
  2578e95

  Copy full SHA for 2578e95

Commits on Jan 23, 2025

• 🍭 Custom reward function for RLOO (#2612)

  Show description for 0e216f7
  August-murr

  authored
  0e216f7

  Copy full SHA for 0e216f7

• 🏆 Custom reward function for GRPO and shiny doc (#2606)

  Show description for a1d2955
  

  qgallouedec

  and

  lewtun

  authored
  a1d2955

  Copy full SHA for a1d2955

Commits on Jan 21, 2025

• 🧰 Tool fine-tuning support DPO (#2479)

  Show description for d9f0568
  

  August-murr

  and

  qgallouedec

  authored
  d9f0568

  Copy full SHA for d9f0568

Commits on Jan 20, 2025

• Fix merge error (#2595)

  qgallouedec

  authored
  3d2c1e4

  Copy full SHA for 3d2c1e4

Pagination

Previous

Next