Tag: rag
All the articles with the tag "rag".
-
FEMS Project #1 — Comparing Low-Spec Local Setup (Ollama + bge-m3 + Chroma) vs Claude API RAG
Building a RAG prototype while studying the FEMS (Factory Energy Management System) domain. Comparing local LLM inference (Ollama) on a low-spec environment (GTX1660 Super, 6GB VRAM) against calling the Claude / OpenAI APIs. Using bge-m3 for embeddings (strong Korean support) and Chroma as the vector DB. Ollama's cold start of 95 seconds dropped to 10 seconds after warm-up, with accuracy matching the cloud.
-
Building a RAG Q&A System with Chroma + My Blog — From Parts to System
Yesterday I played with the parts of RAG (embedding / cosine similarity / chunks). Today, I put them together into a system. I introduced the Chroma vector DB, indexed 270 chunks from my blog, and built a Q&A system with OpenAI + Claude. The most memorable moment was when it answered 'I don't know' to a question about information not covered on my blog.
-
Building RAG from Scratch — Embedding, Cosine Similarity, Chunk Search (with Korean vs English Comparison)
Carving out the inside of RAG (Retrieval-Augmented Generation) with actual code, from what embedding even is to debugging suspicious results. I pulled 1536-dimension vectors with OpenAI's text-embedding-3-small, compared them with cosine similarity, compared Korean vs English performance, and worked through chunk splitting. Surprisingly, Korean embedding similarity turned out to be lower.