Abesh BhattacharjeeOct 9, 2024
Is there a way to stream responses for OData APIs via SAP CAP ? For e.g. : Want to call ChatGPT in streaming mode and stream response out as the result of an OData call. Is that possible at all using CAP ? @qmacro ?
Show threadDJ AdamsOct 10, 2024
@abesh Might be worth having a look at custom streaming (which is beta right now)? https://cap.cloud.sap/docs/node.js/best-practices#custom-streaming-beta
Best Practices | capire

Documentation for SAP Cloud Application Programming Model

Show threadAbesh Bhattacharjee
@qmacro already did, thank you! That's for streaming media. I have been trying to send streaming JSON responses like ChatGPT API via SSE. Unfortunately though I return a Readable stream, when I test the OData output, it is not a stream anymore :( Haven't been able to get it to work :(
Oct 10, 2024 at 2:33pmWeb
Show threadDJ AdamsOct 11, 2024
@abesh ooh, ok, yes, fascinating. Let me dig in a little next week, see what I can find out. Reminds me of Jabber aka XMPP - streaming XML stanzas across a long lived HTTP connection. A thing of beauty, in my eyes.
Show threadUwe FetzerOct 11, 2024
@qmacro @abesh same problem with ABAP by the way. Not possible to stream AI responses, you have to wait for the complete answer, which may take a while.
Show threadAbesh BhattacharjeeOct 11, 2024
@se38 @qmacro yeah this was strange as I thought this should be possible OOTB. I send a Readable stream and by the time it comea out as a response it is not a stream anymore... Hope @qmacro can figure out what I am doing incorrectly!
Show threadAbesh BhattacharjeeOct 11, 2024
@qmacro XMPP and Jabber! Now you are bringing back memories. I remember the time when Google Messenger ran on XMPP.
Show threadAbesh BhattacharjeeOct 15, 2024
@qmacro Find anything ? @se38
Show threadDJ AdamsOct 15, 2024
@abesh not had chance to look yet, I'm afraid.
Show threadAbesh BhattacharjeeOct 15, 2024
@qmacro No worries, thank you ! I know you are very busy :)