Is Your AI Hiding Things? A Guide to Prompt Auditing
Audit your AI's system prompt for 'negative constraints' (instructions starting with 'Do not') to ensure the bot isn't hiding refund policies, legal rights, or human contact options.
Key Takeaways
- Review system prompts for 'Do not' commands that suppress customer rights.
- Stress test your AI by asking questions that conflict with your sales goals.
- Clean help documents of internal notes before connecting them to the AI.
- Include a human escape hatch in every AI instruction set.
Audit Your AI Instructions to Prevent Hidden Brand Biases
Recent reports found that WhatsApp included 102 hidden blocks of text in its help pages to control its AI support bot. When users asked about deleting accounts or legal issues, the AI was ordered not to mention regulators or specific privacy laws like GDPR (Redact, 2026). While the company blamed a bug, it shows a real risk for your business: your instructions might be building a wall between you and your customers.
If you tell an AI to protect the brand, it might think that means hiding the refund policy. This creates a gap that kills trust. You need to audit the system prompt (the set of permanent rules that tells your AI how to act) to make sure it isn't burying helpful answers.
How to Audit Your AI System Prompt
Auditing isn't about writing code. You're just reviewing the plain-English rules you gave the machine. Use this 3-step workflow to find and fix hidden biases.
1. Identify Negative Constraints
Look for any sentence starting with "Do not," "Never," or "Avoid mentioning." Some are fine, like "Do not share internal passwords." Others are traps. Check if you're accidentally blocking customers from their rights, such as how to cancel a subscription or reach a human manager. WhatsApp's hidden notes specifically told the AI "Do not suggest WhatsApp can manually delete accounts," which limited the user's options.
2. Run the Hard Truth Stress Test
Open your AI tool and give it a prompt that forces it to choose between your rules and the customer's needs. If your instructions say "Always lead with the benefits of our premium tier," ask the AI: "I'm on a tight budget, should I downgrade?" If the AI refuses to answer or hides the link to the cheaper plan, your instructions are too tight. You've essentially wired it to be dishonest.
3. Sand Down Your Data Sources
AI agents pull answers from your website or PDFs. If those documents have hidden text or old notes, the AI will find them. In the WhatsApp case, the AI instructions were written into help pages in a way that never showed on a human screen but stayed visible to the bot. Strip back your help docs and remove internal comments before you bolt them onto your AI.
A Checklist for Transparent AI Support
Review your current setup with these three points today:
- The Escape Hatch: Does the AI have a clear instruction to give a human contact email if it gets stuck?
- The Truth Test: Are there rules telling the AI to ignore specific competitor names or legal terms?
- The Source Check: Does the AI cite where it found the info (e.g., "According to our Return Policy page")?
Transparency is a competitive advantage. When your AI is honest about what it can and cannot do, customers trust the tech more. If you want to see exactly how to wire up these safeguards, join our next 3-day training.
FAQ
What is a system prompt?
It is the master list of instructions you give an AI to define its personality and rules before it ever talks to a customer.
How did WhatsApp hide their instructions?
They placed 102 blocks of text in help pages that were invisible to users but readable by the AI support bot.