School/Custom AI Agents/Understanding AI Agents
4/4
Wave 610 minintermediate

Agent Memory & Knowledge

How to give agents persistent memory and domain expertise.

Agent Memory & Knowledge

A chatbot forgets everything when you close the window. A well-built agent remembers your preferences, learns from past interactions, and has deep knowledge of your domain.

Types of Agent Memory

1. Context Memory (Short-Term)

This is the conversation itself — what's been said in the current session. All AI has this by default, limited by the context window.

Limitation: Goes away when the session ends.

2. Knowledge Base (Long-Term Knowledge)

Documents, guides, and reference material you upload for the agent to draw from.

Examples:

  • Your company's employee handbook
  • Product documentation
  • Standard operating procedures (SOPs)
  • Pricing sheets
  • FAQ documents
  • Brand voice guidelines

This is like giving a new employee a training manual.

3. Conversation Memory (Long-Term Recall)

The ability to remember things from previous conversations.

Examples:

  • "Last time you asked me about the Q3 report, you wanted it in bullet format"
  • "Your preferred email sign-off is 'Best regards, Sarah'"
  • "You mentioned your team has 12 people"

Some platforms (Claude Projects, Custom GPTs with memory) support this natively.

4. Retrieval-Augmented Generation (RAG)

A system that searches a large knowledge base to find relevant information for each query. Instead of cramming everything into the context window, RAG retrieves only what's needed.

How it works:

  1. 1.You ask a question
  2. 2.The system searches your documents for relevant sections
  3. 3.Those sections are passed to the AI along with your question
  4. 4.AI generates a response grounded in your specific documents

This is how enterprise AI assistants work — they can access thousands of documents without exceeding context limits.

Building a Knowledge Base

What to Include

Priority 1 (Essential):

- Company policies and procedures

- Product/service information

- FAQ and common customer questions

- Pricing and terms

Priority 2 (Valuable):

- Past reports and analysis

- Meeting notes and decisions

- Email templates and communication standards

- Industry-specific terminology

Priority 3 (Nice to Have):

- Competitor information

- Market research

- Training materials

- Historical data

How to Organize

Structure matters more than volume. A well-organized 10-page document beats a messy 100-page dump.

  • Use clear headings so AI can find relevant sections
  • Be explicit about rules — "Always do X" and "Never do Y"
  • Include examples — show the agent what good output looks like
  • Update regularly — stale knowledge bases produce stale answers

Platform-Specific Memory

Claude Projects

  • Upload documents to the project
  • AI can reference them in every conversation
  • Set project-level instructions that persist
  • Great for team knowledge bases

Custom GPTs (OpenAI)

  • Upload files in the configuration
  • Set persistent instructions
  • Users get consistent experience
  • Limited by file size and number

Zapier Central / AI Assistants

  • Connect to live data sources (CRM, docs, etc.)
  • Memory updates in real-time as data changes
  • Best for agents that need current information

The Knowledge Maintenance Problem

Agents are only as good as their knowledge. If your procedures change and the knowledge base doesn't, the agent gives wrong answers.

Best practice: Schedule monthly reviews of your agent's knowledge base. Update documents, remove outdated information, and add new procedures. Treat it like updating your employee training manual — because that's exactly what it is.

Exercises

0/3
Reflection+15 XP

Draft a knowledge base outline for an AI agent at your workplace. List 10 documents or information sources you would include, organized by priority (essential, valuable, nice to have). Explain why each one matters.

Hint: Start with the questions your team answers most often. Those FAQs are your highest-priority knowledge base entries.

Quiz+5 XP

What is Retrieval-Augmented Generation (RAG)?

Quiz+5 XP

How often should you review and update an agent's knowledge base?