To onboard agentic colleagues into existing teams we need them to continually improve themselves, by learning from the real world, reflecting on those memories and adapting its behaviour according to insights from reflecting.

Self-improvement requires

  • agent being involved in actual collaboration and/or agent has access to human knowledge bases to generate raw material
  • its own persistent memory
  • a mechanism to reason and reflect on memories regularly and distill knowledge or surface insights

Approaches

There are several approaches to this.

  1. Karpathy’s AI Librarian has been the most influential. It uses a knowledge-base-in-context approach where the system maintains a working memory of relevant information and retrieves it as needed. Karpathy later expanded on the idea with LLM Wiki. A very early version can be seen in The “append-and-review note”.
  2. classic architecture with LLM, RAG and MCP