AI커뮤니티
로그인 회원가입 EN

#prompt-caching

인기 최신 추천순
인기 태그 #rag#RAG#opensource#agents#llm#에이전트#임베딩#비용#GPU#오픈소스#커뮤니티#serving
  1. 4
    추천
    S Anthropic prompt caching — worth the setup for a chatbot?
    We're paying a lot for repeated system prompts across a long agent conversation. Their caching docs promise 90% savings on reads. Anyone measured real-world savings? Does it break with streaming?
    질문답변 @Sofia Alvarez · 9일 전 · 댓글 0 #prompt-caching#anthropic#costs