Skip to content

Commit a9121f7

Browse files
authored
Reduced k50 temperature to 0.9 (LAION-AI#2568)
1 parent ada91f1 commit a9121f7

File tree

1 file changed

+1
-1
lines changed
  • inference/server/oasst_inference_server/routes

1 file changed

+1
-1
lines changed

inference/server/oasst_inference_server/routes/configs.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ class ModelConfigInfo(pydantic.BaseModel):
2929
sampling_parameters=inference.SamplingParameters(
3030
top_k=50,
3131
top_p=0.95,
32-
temperature=1.0,
32+
temperature=0.9,
3333
repetition_penalty=1.2,
3434
),
3535
),

0 commit comments

Comments
 (0)