fix: enable useLegacyCompletionsEndpoint to use openai package streaming#10026
fix: enable useLegacyCompletionsEndpoint to use openai package streaming#10026uinstinct wants to merge 6 commits intocontinuedev:mainfrom
useLegacyCompletionsEndpoint to use openai package streaming#10026Conversation
RomneyDa
left a comment
There was a problem hiding this comment.
@uinstinct since stream is already in completion options, how does this impact functionality? I think we should avoid adding a duplicate configuration option.
- already completionoptions.stream is present
91a97d2 to
ac5b8dc
Compare
useLegacyCompletionsEndpoint to use openai package streaming
My bad - I thought since completionOptions.stream was removed from config.yaml reference doc, support was dropped. Added that back to the config.yaml reference in docs |
RomneyDa
left a comment
There was a problem hiding this comment.
@uinstinct could you clarify how useLegacyCompletionsEndpoint and stream are related? As far as I understand useLegacyCompletionsEndpoint is for using a different URL endpoint /completions which was used prior to chat/completions coming out. stream is the issue here (you can use chat/completions with stream = false)
|
openai models (which require org verifications) cannot use the responses endpoint - so when |
|
@uinstinct the legacy completions endpoint is the ancient But I don't think we need to fallback to that either, I think they can use responses, they just can't stream it. Kilo code fixed this by adding a stream toggle, I don't think they routed to a different endpoint. I think the issue is that I think a stream toggle (which only shows when error detected) is a decent solution, as long as the |
Description
Add supports for
useLegacyCompletionsEndpointto use openai adapter streaming.closes CON-5285
AI Code Review
@continue-reviewChecklist
Screen recording or screenshot
[ When applicable, please include a short screen recording or screenshot - this makes it much easier for us as contributors to review and understand your changes. See this PR as a good example. ]
Tests
[ What tests were added or updated to ensure the changes work as expected? ]
Continue Tasks:▶️ 1 queued · ✅ 1 no changes — View all
Summary by cubic
Disables streaming for OpenAI o-series/GPT-5 when the legacy completions endpoint is used, aligning behavior with model constraints. Addresses CON-5285.
Written for commit be39317. Summary will update on new commits.