Skip to main content

Notebooks

This page contains a collection of notebooks that demonstrate how to use AutoGen. The notebooks are tagged with the topics they cover. For example, a notebook that demonstrates how to use function calling will be tagged with tool/function.

Filter by tags
Mitigating Prompt hacking with JSON Mode in Autogen
Open In ColabStatic Badge
Use JSON mode and Agent Descriptions to mitigate prompt manipulation and control speaker transition.
JSONdescriptionprompt hackinggroup chatorchestration
Using RetrieveChat for Retrieve Augmented Code Generation and Question Answering
Open In ColabStatic Badge
Explore the use of AutoGen's RetrieveChat for tasks like code generation from docstrings, answering complex questions with human feedback, and exploiting features like Update Context, custom prompts, and few-shot learning.
RAG
Using RetrieveChat Powered by MongoDB Atlas for Retrieve Augmented Code Generation and Question Answering
Open In ColabStatic Badge
Explore the use of AutoGen's RetrieveChat for tasks like code generation from docstrings, answering complex questions with human feedback, and exploiting features like Update Context, custom prompts, and few-shot learning.
MongoDBintegrationRAG
Using RetrieveChat Powered by PGVector for Retrieve Augmented Code Generation and Question Answering
Open In ColabStatic Badge
Explore the use of AutoGen's RetrieveChat for tasks like code generation from docstrings, answering complex questions with human feedback, and exploiting features like Update Context, custom prompts, and few-shot learning.
PGVectorintegrationRAG
Using RetrieveChat with Qdrant for Retrieve Augmented Code Generation and Question Answering
Open In ColabStatic Badge
This notebook demonstrates the usage of QdrantRetrieveUserProxyAgent for RAG.
QdrantintegrationRAG
Agent Tracking with AgentOps
Open In ColabStatic Badge
Use AgentOps to simplify the development process and monitor your agents in production.
integrationmonitoringdebugging
AgentOptimizer: An Agentic Way to Train Your LLM Agent
Open In ColabStatic Badge
AgentOptimizer is able to prompt LLMs to iteratively optimize function/skills of AutoGen agents according to the historical conversation and performance.
optimizationtool/function
Task Solving with Code Generation, Execution and Debugging
Open In ColabStatic Badge
Use conversable language learning model agents to solve tasks and provide automatic feedback through a comprehensive example of writing, executing, and debugging Python code to compare stock price changes.
code generation
Assistants with Azure Cognitive Search and Azure Identity
Open In ColabStatic Badge
This notebook demonstrates the use of Assistant Agents in conjunction with Azure Cognitive Search and Azure Identity
integrationRAGAzure IdentityAzure AI Search
Usage tracking with AutoGen
Open In ColabStatic Badge
cost calculation
cost
Agent Chat with custom model loading
Open In ColabStatic Badge
Define and laod a custom model
integrationcustom model
Agent Chat with Multimodal Models: DALLE and GPT-4V
Open In ColabStatic Badge
Multimodal agent chat with DALL-E and GPT-4v.
multimodalgpt-4v
Use AutoGen in Databricks with DBRX
Open In ColabStatic Badge
Use Databricks DBRX and Foundation Model APIs to build AutoGen applications backed by open-source LLMs.
integrationcode generationdbrxdatabricksopen sourcelakehousecustom modeldata intelligence
Auto Generated Agent Chat: Task Solving with Provided Tools as Functions
Open In ColabStatic Badge
Register function calls using AssistantAgent and UserProxyAgent to execute python or shell code in customized ways. Demonstrating two ways of registering functions.
code generationtool/function
Task Solving with Provided Tools as Functions (Asynchronous Function Calls)
Open In ColabStatic Badge
Learn how to implement both synchronous and asynchronous function calls using AssistantAgent and UserProxyAgent in AutoGen, with examples of their application in individual and group chat settings for task execution with language models.
tool/functionasync
Writing a software application using function calls
Open In ColabStatic Badge
Equip your agent with functions that can efficiently implement features into your software application.
code generationtool/functionfastapisoftware engineering
Currency Calculator: Task Solving with Provided Tools as Functions
Open In ColabStatic Badge
Learn how to register function calls using AssistantAgent and UserProxyAgent.
tool/function
Groupchat with Llamaindex agents
Open In ColabStatic Badge
Integrate llamaindex agents with Autogen.
reactllamaindexintegrationgroup chatsoftware engineering
Group Chat
Open In ColabStatic Badge
Explore the utilization of large language models in automated group chat scenarios, where agents perform tasks collectively, demonstrating how they can be configured, interact with each other, and retrieve specific information from external resources.
orchestrationgroup chatcode generation
Group Chat with Retrieval Augmented Generation
Open In ColabStatic Badge
Implement and manage a multi-agent chat system using AutoGen, where AI assistants retrieve information, generate code, and interact collaboratively to solve complex tasks, especially in areas not covered by their training data.
group chatorchestrationRAG
Group Chat with Customized Speaker Selection Method
Open In ColabStatic Badge
Introduce group chat with customized speaker selection method.
orchestrationgroup chat
FSM - User can input speaker transition constraints
Open In ColabStatic Badge
Explore the demonstration of the Finite State Machine implementation, which allows the user to input speaker transition constraints.
group chatfsmorchestration
Perform Research with Multi-Agent Group Chat
Open In ColabStatic Badge
Perform research using a group chat with a number of specialized agents.
group chatplanningcode generation
StateFlow: Build Workflows through State-Oriented Actions
Open In ColabStatic Badge
StateFlow: Build workflows through state-oriented actions.
orchestrationgroup chatstateflowresearch
Group Chat with Coder and Visualization Critic
Open In ColabStatic Badge
Explore a group chat example using agents such as a coder and visualization agent.
group chatcode generation
Using Guidance with AutoGen
Open In ColabStatic Badge
Constrained responses via guidance.
guidanceintegrationJSON
Auto Generated Agent Chat: Task Solving with Code Generation, Execution, Debugging & Human Feedback
Open In ColabStatic Badge
Code generation, execution, debugging and human feedback.
humancode generation
Generate Dalle Images With Conversable Agents
Open In ColabStatic Badge
Generate images with conversable agents.
capabilitymultimodal
Auto Generated Agent Chat: Function Inception
Open In ColabStatic Badge
Function Inception: Enable AutoGen agents to update/remove functions during conversations.
function inceptiontool/function
Auto Generated Agent Chat: Task Solving with Langchain Provided Tools as Functions
Open In ColabStatic Badge
Use Langchain tools.
langchainintegrationtool/function
Engaging with Multimodal Models: GPT-4V in AutoGen
Open In ColabStatic Badge
Leveraging multimodal models through two different methodologies: MultimodalConversableAgent and VisionCapability.
multimodalgpt-4v
Agent Chat with Multimodal Models: LLaVA
Open In ColabStatic Badge
Leveraging multimodal models like llava.
multimodalllava
Runtime Logging with AutoGen
Open In ColabStatic Badge
Provide capabilities of runtime logging for debugging and performance analysis.
loggingdebugging
Agent with memory using Mem0
Open In ColabStatic Badge
Use Mem0 to create agents with memory.
memory
Solving Multiple Tasks in a Sequence of Async Chats
Open In ColabStatic Badge
Use conversational agents to solve a set of tasks with a sequence of async chats.
orchestrationasyncsequential chats
Solving Multiple Tasks in a Sequence of Chats
Open In ColabStatic Badge
Use conversational agents to solve a set of tasks with a sequence of chats.
orchestrationsequential chats
Nested Chats for Tool Use in Conversational Chess
Open In ColabStatic Badge
LLM-backed agents playing chess with each other using nested chats.
nested chattool/functionorchestration
Conversational Chess using non-OpenAI clients
Open In ColabStatic Badge
LLM-backed agents playing chess with each other using nested chats.
nested chattool/functionorchestration
Solving Complex Tasks with A Sequence of Nested Chats
Open In ColabStatic Badge
Solve complex tasks with one or more sequence chats nested as inner monologue.
nested chatsequential chatsorchestration
Solving Complex Tasks with Nested Chats
Open In ColabStatic Badge
Solve complex tasks with a chat nested as inner monologue.
nested chatreflectionreasoningorchestration
OptiGuide with Nested Chats in AutoGen
Open In ColabStatic Badge
This is a nested chat re-implementation of OptiGuide which is an LLM-based supply chain optimization framework.
nested chathierarchical chatcode generationorchestration
Chat with OpenAI Assistant using function call in AutoGen: OSS Insights for Advanced GitHub Data Analysis
Open In ColabStatic Badge
This Jupyter Notebook demonstrates how to leverage OSS Insight (Open Source Software Insight) for advanced GitHub data analysis by defining `Function calls` in AutoGen for the OpenAI Assistant.
OpenAI Assistanttool/function
Auto Generated Agent Chat: Group Chat with GPTAssistantAgent
Open In ColabStatic Badge
Use GPTAssistantAgent in group chat.
OpenAI Assistantgroup chat
RAG OpenAI Assistants in AutoGen
Open In ColabStatic Badge
OpenAI Assistant with retrieval augmentation.
RAGOpenAI Assistant
OpenAI Assistants in AutoGen
Open In ColabStatic Badge
Two-agent chat with OpenAI assistants.
OpenAI Assistant
Auto Generated Agent Chat: GPTAssistant with Code Interpreter
Open In ColabStatic Badge
This Jupyter Notebook showcases the integration of the Code Interpreter tool which executes Python code dynamically within applications.
OpenAI Assistantcode interpreter
Auto Generated Agent Chat: Collaborative Task Solving with Coding and Planning Agent
Open In ColabStatic Badge
Use planning agent in a function call.
planningorchestrationnested chattool/function
SocietyOfMindAgent
Open In ColabStatic Badge
Explore the demonstration of the SocietyOfMindAgent in the AutoGen library, which runs a group chat as an internal monologue, but appears to the external world as a single agent, offering a structured way to manage complex interactions among multiple agents and handle issues such as extracting responses from complex dialogues and dealing with context window constraints.
orchestrationnested chatgroup chat
SQL Agent for Spider text-to-SQL benchmark
Open In ColabStatic Badge
Natural language text to SQL query using the Spider text-to-SQL benchmark.
SQLtool/function
Interactive LLM Agent Dealing with Data Stream
Open In ColabStatic Badge
Automated continual learning from new data.
streamingasynclearning
WebSurferAgent
Open In ColabStatic Badge
Browse the web with agents.
webnested chattool/function
Chatting with a teachable agent
Open In ColabStatic Badge
Learn how to persist memories across chat sessions using the Teachability capability
teachabilitylearningRAGcapability
Making OpenAI Assistants Teachable
Open In ColabStatic Badge
Teach OpenAI assistants.
teachabilitycapabilitylearningRAGOpenAI Assistant
Auto Generated Agent Chat: Teaching AI New Skills via Natural Language Interaction
Open In ColabStatic Badge
Teach the agent news skills using natural language.
learningteaching
Preprocessing Chat History with `TransformMessages`
Open In ColabStatic Badge
Preprocessing chat history with `TransformMessages`
long context handlingcapability
Auto Generated Agent Chat: Collaborative Task Solving with Multiple Agents and Human Users
Open In ColabStatic Badge
Involve multiple human users via function calls and nested chat.
humantool/function
Translating Video audio using Whisper and GPT-3.5-turbo
Open In ColabStatic Badge
Use tools to extract and translate the transcript of a video file.
whispermultimodaltool/function
Auto Generated Agent Chat: Solving Tasks Requiring Web Info
Open In ColabStatic Badge
Solve tasks requiring web info.
webcode generation
Web Scraping using Apify Tools
Open In ColabStatic Badge
Scrapping web pages and summarizing the content using agents with tools.
webapifyintegrationtool/function
Websockets: Streaming input and output using websockets
Open In ColabStatic Badge
Websockets facilitate real-time, bidirectional communication between web clients and servers, enhancing the responsiveness and interactivity of AutoGen-powered applications.
websocketsstreaming
Agent with memory using Mem0
Open In ColabStatic Badge
Use Mem0 to create agents with memory.
mem0integrationmemory
Solving Multiple Tasks in a Sequence of Chats with Different Conversable Agent Pairs
Open In ColabStatic Badge
Use AutoGen to solve a set of tasks with a sequence of chats.
orchestrationsequential chats
Demonstrating the `AgentEval` framework using the task of solving math problems as an example
Open In ColabStatic Badge
AgentEval: a multi-agent system for assessing utility of LLM-powered applications
eval
Agent Chat with Async Human Inputs
Open In ColabStatic Badge
Async human inputs.
asynchuman
Automatically Build Multi-agent System from Agent Library
Open In ColabStatic Badge
Automatically build multi-agent system from agent library
autobuild
AutoBuild
Open In ColabStatic Badge
Automatically build multi-agent system with AgentBuilder
autobuild
A Uniform interface to call different LLMs
Open In ColabStatic Badge
Uniform interface to call different LLM.
integrationcustom model
From Dad Jokes To Sad Jokes: Function Calling with GPTAssistantAgent
Open In ColabStatic Badge
Use tools in a GPTAssistantAgent Multi-Agent System by utilizing functions such as calling an API and writing to a file.
OpenAI Assistanttool/function
Language Agent Tree Search
Open In ColabStatic Badge
Language Agent Tree Search.
LATSsearchreasoningreflection