All posts
RAGBasics

What is a RAG chatbot? RAG explained (and why your support bot needs it)

What is RAG, a RAG chatbot, and a RAG assistant? Retrieval-augmented generation is the difference between a bot that guesses and one that answers from your actual content — with sources. Here's how it works.

TMThe MySiteGPT TeamMay 28, 20265 min read

A plain language model knows a lot about the world and nothing about *your* business. Ask it your refund window and it will confidently invent one. That's the problem RAG — retrieval-augmented generation — solves.

The two-step trick

RAG splits answering into retrieve, then generate:

  1. Retrieve. Your content is split into chunks and turned into vectors (embeddings). When a visitor asks a question, the question is embedded too, and the most similar chunks are pulled from the database.
  2. Generate. Those chunks are handed to the model as context, with an instruction: *answer using only this.*

The result is an answer grounded in your material — with the sources to prove it.

Why it beats fine-tuning

You could fine-tune a model on your docs, but it's slow, expensive, and goes stale the moment you change a price. RAG just reads your latest content at question time. Update a page, retrain in seconds, done.

What good RAG needs

  • Clean content. Garbage in, garbage out. Well-structured pages retrieve better.
  • Smart chunking. Chunks that respect headings keep ideas intact.
  • A refusal path. When nothing relevant is found, the bot should say so — not hallucinate.
The best support bots aren't the most creative. They're the most honest.

That honesty is the whole point: a RAG assistant only speaks when your content backs it up, and points the visitor to the source. Everything else is just a chatbot.

RAG assistant vs a plain chatbot

A plain chatbot answers from whatever the base model already "knows" — which means it will happily invent your refund window, your pricing, or a feature you don't ship. A RAG assistant (also called a RAG bot or RAG chatbot) answers only from *your* retrieved content and cites where each answer came from. Same friendly chat box; completely different trust model. For any business that cares about being right, the RAG version is the only one worth deploying.

Build a RAG assistant on your own content

You don't need to wire up a vector database yourself. Start free and paste your site URL — MySiteGPT crawls, chunks, embeds, and stores it, then answers with citations out of the box. If you want the step-by-step, how to train an AI chatbot on your own website content walks through the whole pipeline.

Frequently asked questions

What is a RAG assistant?

A RAG (retrieval-augmented generation) assistant is a chatbot that answers by first retrieving relevant chunks of your own content and then generating an answer from only that context, with citations. Unlike a plain chatbot, it won't invent facts about your business — it either answers from your material or says it doesn't know.

What's the difference between a RAG bot and a normal chatbot?

A normal chatbot answers from the base model's general knowledge and can hallucinate details about your business. A RAG bot answers only from your retrieved content and shows the source page for each answer, so replies stay grounded and verifiable.

Do I need a vector database to build a RAG chatbot?

Conceptually yes — RAG stores your content as vector embeddings for similarity search — but you don't have to build one yourself. MySiteGPT runs the crawl, chunking, embedding, and vector storage for you; you just paste a URL and start asking questions.

Build your own assistant
Train it on your content and embed it in minutes — free.
Get started free