Thread

DP
debabrata pattnayak8:44 PMOpen in Slack
hey @user what are you thoughts on implementing semantic cashing in archestra ?

3 replies
IK
Innokentii Konstantinov (archestra team)9:16 AMOpen in Slack
Hi! Could you please add more details to your proposal?
DP
debabrata pattnayak5:57 PMOpen in Slack
(semantic cashing) It helps reduce latency and reduce cost by serving cached responce. We can implement vector similarity search to cache AI responce by serving cached results for semantically similar requests even when the exact wording differs
DP
debabrata pattnayak5:58 PMOpen in Slack
i will write detail proposal with implementation plan shortley.