You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
fix: Semantic parse should only set higher temperature for google models (#277)
Setting temperature to 1.0 was to fix google specific
Addresses comment
https://github.com/typedef-ai/fenic/pull/253/files#r2437422061
Note that we are still setting temperature to 1.0 for openrouter google
models, even if the Profile is configured to use the OpenRouter's parse
engine, which is not ideal
temperature=1.0# Use a higher temperature so gemini flash models can handle complex table formatting. For more info see the conversation here: https://discuss.ai.google.dev/t/gemini-2-0-flash-has-a-weird-bug/65119/26
67
+
63
68
super().__init__(
64
69
input=input,
65
70
request_sender=CompletionOnlyRequestSender(
66
71
model=model,
67
72
operator_name="semantic.parse_pdf",
68
73
inference_config=InferenceConfiguration(
69
74
max_output_tokens=max_output_tokens,
70
-
temperature=1.0, # Use a higher temperature so gemini flash models can handle complex table formatting. For more info see the conversation here: https://discuss.ai.google.dev/t/gemini-2-0-flash-has-a-weird-bug/65119/26
0 commit comments