Replies: 1 comment 4 replies
-
Great to hear that you're finding value in the node. Your use case sounds interesting, and I understand your need for preserving non-payload message properties in chat response streams. Stay tuned for an update on this feature! |
Beta Was this translation helpful? Give feedback.
4 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Loving the library so far, thanks so much for building it. My question is this. I have a bunch of users that will be using this thing at the same time via websockets. I store a session Id in the message that I pass around so I know which socket to respond to.
Question: The node-red-openai-api library, while streaming, creates a new message for each chunk that comes back. I can't think of a way to recover the session Id or the other breadcrumbs I stored in the msg along the way. I was hoping that the library would preserve non-payload properties of the msg. I can update the library but I thought surely someone else must be doing multi-user with a way to solve this issue.
Thanks in advance! -Michael
Beta Was this translation helpful? Give feedback.
All reactions