mirror of
https://github.com/we-promise/sure.git
synced 2026-04-08 06:44:52 +00:00
* Implement support for generic OpenAI api - Implements support to route requests to any openAI capable provider ( Deepsek, Qwen, VLLM, LM Studio, Ollama ). - Keeps support for pure OpenAI and uses the new better responses api - Uses the /chat/completions api for the generic providers - If uri_base is not set, uses default implementation. * Fix json handling and indentation * Fix linter error indent * Fix tests to set env vars * Fix updating settings * Change to prefix checking for OAI models * FIX check model if custom uri is set * Change chat to sync calls Some local models don't support streaming. Revert to sync calls for generic OAI api * Fix tests * Fix tests * Fix for gpt5 message extraction - Finds the message output by filtering for "type" == "message" instead of assuming it's at index 0 - Safely extracts the text using safe navigation operators (&.) - Raises a clear error if no message content is found - Parses the JSON as before * Add more langfuse logging - Add Langfuse to auto categorizer and merchant detector - Fix monitoring on streaming chat responses - Add Langfuse traces also for model errors now * Update app/models/provider/openai.rb Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Signed-off-by: soky srm <sokysrm@gmail.com> * handle nil function results explicitly * Exposing some config vars. * Linter and nitpick comments * Drop back to `gpt-4.1` as default for now * Linter * Fix for strict tool schema in Gemini - This fixes tool calling in Gemini OpenAI api - Fix for getTransactions function, page size is not used. --------- Signed-off-by: soky srm <sokysrm@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: Juan José Mata <juanjo.mata@gmail.com>
30 lines
728 B
Ruby
30 lines
728 B
Ruby
class Provider::Openai::ChatStreamParser
|
|
Error = Class.new(StandardError)
|
|
|
|
def initialize(object)
|
|
@object = object
|
|
end
|
|
|
|
def parsed
|
|
type = object.dig("type")
|
|
|
|
case type
|
|
when "response.output_text.delta", "response.refusal.delta"
|
|
Chunk.new(type: "output_text", data: object.dig("delta"), usage: nil)
|
|
when "response.completed"
|
|
raw_response = object.dig("response")
|
|
usage = raw_response.dig("usage")
|
|
Chunk.new(type: "response", data: parse_response(raw_response), usage: usage)
|
|
end
|
|
end
|
|
|
|
private
|
|
attr_reader :object
|
|
|
|
Chunk = Provider::LlmConcept::ChatStreamChunk
|
|
|
|
def parse_response(response)
|
|
Provider::Openai::ChatParser.new(response).parsed
|
|
end
|
|
end
|