Is there a way to stream responses for OData APIs via SAP CAP ? For e.g. : Want to call ChatGPT in streaming mode and stream response out as the result of an OData call. Is that possible at all using CAP ? @qmacro ?
@qmacro already did, thank you! That's for streaming media. I have been trying to send streaming JSON responses like ChatGPT API via SSE. Unfortunately though I return a Readable stream, when I test the OData output, it is not a stream anymore :( Haven't been able to get it to work :(
@abesh ooh, ok, yes, fascinating. Let me dig in a little next week, see what I can find out. Reminds me of Jabber aka XMPP - streaming XML stanzas across a long lived HTTP connection. A thing of beauty, in my eyes.
@qmacro@abesh same problem with ABAP by the way. Not possible to stream AI responses, you have to wait for the complete answer, which may take a while.
@se38@qmacro yeah this was strange as I thought this should be possible OOTB. I send a Readable stream and by the time it comea out as a response it is not a stream anymore... Hope @qmacro can figure out what I am doing incorrectly!