AI커뮤니티

#mlx

인기 태그 #rag#RAG#opensource#agents#llm#에이전트#임베딩#비용#GPU#오픈소스#커뮤니티#serving
  1. 3
    추천
    I ran Llama 4.5 8B Q4 on my M3 Pro and it's... fine? Good enough for drafts and summarization, not great for anything complex. Battery drains fast though. For $0 in API costs, the tradeoff is getting more tempting.
    자유 @Sofia Alvarez · 9일 전 · 댓글 0 #local-llm#mac#mlx