The AI chatbot is only as good as the instructions you give it. Most businesses set up their AI assistant with a vague system prompt like "Help customers with their questions" — and then wonder why the bot gives irrelevant or generic answers. A well-written prompt is the difference between an AI that feels like a knowledgeable team member and one that feels like a broken FAQ page.
Why the system prompt matters so much
Large language models do not know anything about your business unless you tell them. The system prompt is the instruction manual the AI reads before every conversation. If it is vague, the AI will guess. If it is specific, the AI will behave like a genuine expert on your products, policies, and tone of voice.
Think of it as onboarding a new employee. You would not hand someone a phone and say "answer customer questions." You would explain who you are, what you sell, what your policies are, and how you want customers to feel after interacting with your team. The system prompt is that onboarding document.
Start with identity
The first line of your system prompt should tell the AI who it is and who it works for. Be specific and concrete: "You are the customer support assistant for BikeWorld.nl, a Dutch online bicycle and accessories store. You help customers before and after their purchase." This single line already prevents the AI from going off-topic or pretending to be something it is not.
Define the scope — and the limits
List exactly what the AI should help with, and be equally explicit about what it should not do. For example: "Help customers with: product selection and compatibility, order status, delivery timeframes, our 30-day return policy, and warranty questions. Do not discuss competitor pricing. Do not make promises about delivery dates outside our stated policy. If you cannot answer a question confidently, say that a human agent will follow up shortly."
The limits are as important as the capabilities. Without them, the AI will attempt to answer everything — sometimes confidently and incorrectly.
Paste in your key policies
Do not assume the AI knows your return policy, your delivery partners, or your warranty terms. Paste them directly into the system prompt. Keep them concise but complete. A good format is: "Return policy: customers can return any item within 30 days of delivery for a full refund, no questions asked. Items must be unused and in original packaging."
The more specific information you give the AI, the more accurate its answers will be. It cannot invent details that are not there, but it can accurately explain details that are.
Set the tone
A sentence or two on tone goes a surprisingly long way: "Be friendly and professional. Use simple, clear language — avoid jargon. Keep responses concise. Respond in the same language the customer uses." This prevents the AI from producing overly formal corporate-speak or, conversely, being inappropriately casual.
Test, observe, and iterate
After writing your first prompt, test it with the ten questions your customers ask most often. See where the AI stumbles and add those cases to the prompt. Check the first week of real conversations and look for patterns in where the AI gave incomplete or incorrect answers — then fix the prompt accordingly.
A good system prompt is a living document. Update it when your policies change, when you launch new products, or when you notice a recurring gap in the AI's knowledge. Thirty minutes of prompt refinement can save your agents hundreds of unnecessary chat interruptions per month.