A Comprehensive Guide to Large Language Models Agents

Brain John Aboze

July 08, 2024

This blog post was written by Brain John Aboze as part of the Deepchecks Community Blog. If you would like to contribute your own blog post, feel free to reach out to us via blog@deepchecks.com. We typically pay a symbolic fee for content that's accepted by our reviewers.

A Comprehensive Guide to Large Language Models Agents

Humans have an amazing capacity for learning, making decisions, and acting. We think, replan, and adjust to produce the outcomes we desire. Just imagine how we might create computers with this same dynamic problem-solving capability. LLMs are getting closer and closer to having human-like capacity for integrative, independent assessment, decision-making, and action.

Think back to the science fiction trope of the central AI assistant-like J.A.R.V.I.S. (Just A Rather Very Intelligent System) from Iron Man-that guides Iron Man with its vast knowledge and problem-solving skills. What gives J.A.R.V.I.S. its power isn’t just access to information but an ability to synthesize it, make autonomous decisions, and take action to help Iron Man. This is the essence of the LLM agents we see emerging today.

Iron Man and JARVIS communication, Source: Marvel

OpenAI’s ChatGPT is a stride towards this goal. When you engage with the Plus subscription, you witness a dynamic process: the system analyzes your request and deliberates on the optimal approach-be it leveraging a Python REPL for analytical tasks, initiating a web search for the latest information, or tapping into DALL-E for creative imagery-before delivering a response.

LLM agents represent a profound change in the realm of AI and convert language into action. They sit on top of LLMs; they go beyond just conversations. They can understand textual instructions, reason with possible solutions, and take action to carry out a task, no matter how challenging it may be. Think of them as an AI assistant that can convert your text into tasks. In this guide, we’ll dig deep into LLM agents, learn about the value they bring, and discover the potential for transformation that resides in them.

Understanding LLM Agents

The very term ‘agent’ is borrowed from philosophy and refers to an entity posited as being independent for the purpose of carrying out actions within an environment. An artificial agent in AI is an independent entity that makes use of percepts it receives from the environment-visual, textual, or through its ears-by way of mathematical models. Hence, an agent is uniquely characterized by its action of interacting with and responding to the environment-the very character of having agency, acting in independence.

Traditional AI follows rule-based procedures that are very rigid. But, LLM agents break this mold, enabling fluid movements as humans navigate through a problem. The LLM agents are sophisticated systems that use the power of LLMs to analyze complex issues, devise strategies, and apply solutions with the help of a suite of tools. They excel at making well-reasoned decisions and honing their approach until an acceptable resolution has been reached. Unlike rule-based systems, LLM agents will change their approach to a problem dynamically, even if the input is presented to them in a similar way many times. They learn and adjust on the fly.

LLM agent interactions, Xi et al., 2023

Agents work by interpreting user input, understanding needs, and deciding the best way forward in dynamic, often nondeterministic manners. What makes LLM agents unique is their adaptability; they are able to respond in a personalized way and conduct meaningfully human-like interactions.

Theoretical background

A foundational paper in the field of LLM agents is ‘ReAct: Synergizing Reasoning and Acting in Language Models.‘ This work introduced the central idea of the integration of reasoning and acting aspects of a bundled LLM. The ReAct framework enables a bundled LLM to interleave reasoning traces, actions, and observations when attaining goals.

ReAct Framework, source Yao et al., 2022

An example of ReAct framework in action can be seen below:

ReAct: HotpotQA example, source Yao et al., 2022

LLM agent implementation remains an active research area that explores diverse techniques. Here is an example of its implementation. LLM agents are coming into fashion very quickly, as the surge of research papers reporting their use and deployment testifies, according to a recent survey by Wang et al. (2023).

Growth trend of LLM agents papers, source Wang et al., 2023

Core Components of LLM Agents

These agents are created with the capacity to act in complex environments, solve problems, and interact with the users or other systems in a meaningful manner. Let’s rewind the diagram of how LLM agents interact with their environment. We can list the components:

• Inputs
• Brain (LLMs)
• Memory
• Knowledge
• Planning
• Tools

Let’s delve further:

1. Inputs:

This component is a crucial ingredient in LLM agents, which helps the system get the data. It is also the interface in which the user communicates their needs, questions, or commands. It includes prompts that contain detailed instructions, system guidelines, user preferences, and examples.

2. Brain (LLMs):

At the heart of every autonomous LLM agent is its LLM, an essential component that juggles a repertoire of critical functions, from planning, reasoning, and action execution to result evaluation and insight summarization. This component constitutes the intellectual core of the agent and brings together advanced linguistic reasoning with an immense bank of commonsense knowledge to understand and act out the most appropriate actions. Not necessarily one LLM needs to be assigned to all these functions; there can be many LLMs with different roles or specializations. This division increases the efficiency of production and controls costs much like specialized sectors of a brain, which may be broken down into:

3. Memory:

The memory component is helpful in making LLM agents learn, adjust, and remain consistent over time. It stores the logs of internal thinking, past actions, and interactions with the environment. The memory helps the LLM agent to adapt responses built for it, built on the previous work, and steadily improve the performance. Three general kinds of memory are:

• Short-term Memory: This is essentially a form of working memory, which holds information surrounding the agent’s immediate context. It may contain recent conversation history, previous steps in an ongoing task, or ad hoc information needed for the current intent. This is typically low-capacity because of LLM’s input limitations.
• Long-term Memory: This is the memory store that is more durable. It contains persistent memory of past behaviors, preference information, and learnings that should be referenced over long spans of time. Long-term memory often uses some form of external database or retrieval system to be able to access data effectively.
• Hybrid Memory: A significant number of LLM agents use both short-term and long-term memory in a single memory structure for sophisticated functionalities. Short-term memory provides linear reasoning, which an agent uses to decompose tasks and solve them sequentially, while long-term memory provides the system with historical perspective through general knowledge bases that act as a reference.

LLM Agent tools workflow, Author

4. Knowledge:

Knowledge is the fuel that energizes the competencies of LLM agents, which spans specialized, commonsense, and procedural knowledge. Knowledge can be integrated in several ways within the agent architecture:

• Exploitation of Inherent LLM Knowledge: The LLM at the agent’s core is well-versed with a vast range of general knowledge during its original learning from a wide and diverse set of datasets. An agent can leverage the use of this reservoir; he can now employ a generic understanding of a wide range of topics. This helps it understand and interact with the environment.
• Fine-tuned LLMs: Knowledge acquired by fine-tuning through domain-specific datasets considerably enhances the ability of the LLM to problem-solve and understand subject-specific information.
• External knowledge extraction: LLM agents can be connected to knowledge bases or search engines to extract information not residing within the LLM. Knowledge extraction on demand helps LLMs solve more extensive and difficult problems.
• Hybrid approaches: Various methods are used, such as combining fine-tuning knowledge with real-time extraction.

5. Planning:

The planning module in LLM agents is required to take user requests apart into small and more manageable subtasks; it uses reasoning methods like Chain of Thought and Tree of Thoughts to facilitate structured problem-solving. To get over the fallacies in classical planning, which lack consideration of constantly available feedback in vast, multi-step tasks, the module includes iterative reflection methods, like ReAct and Reflexion, to let the agent modify its strategies dynamically in light of past experience. This continuous loop of improvement is a necessity for real-life applications to let an agent adapt to an optimum approach, therefore increasing dependability and improving the precision of answers.

6. Tools:

Tools are an essential part of any LLM agent, bringing to the agent an array of functions, capabilities, and activities to accomplish any task or problem at hand. Tools provide functions that the LLM agent does not possess, such as the ability to access real-time information, perform calculations, and automate external processes. It is an essential module that dramatically increases the breadth of an agent’s operations in communicating with, manipulating, and extracting information from a number of other sources and environments.

LLM Agent tools workflow, Author

Tool types include:

• APIs: Connectors to services like Zapier, Notion, or specialized databases.
• Query engines: Tools for retrieving information (like RAG pipelines).
• Other LLMs: LLMs specializing in code generation, image creation, etc.
• Agents often execute multi-step workflows, combining different tools to gather information and solve complex problems.

Benefits of LLM Agents

• Actionable insights and task automation: LLM agents convert the vast knowledge residing within the LLM into concrete action and process automation. They perform tasks, saving a considerable amount of time and resources.
• Access to real-time information and improved problem-solving: Given that LLM agents are connected to search engines and databases, they have access to knowledge that is being constantly updated. They can apply a wide variety of tools in the resolution of complex problems, developing responses beyond the capabilities of LLMs alone.
• Interactivity and user engagement: Agents can be designed to promote greater interactivity so that the users can engage in dynamic dialogues and be responsive to the user input in real time. In this way, there is greater interactivity and user engagement, leading to a much more natural and delightful user experience, which in turn makes LLMs more accessible and user-friendly.

Benefits of LLM Agents overview, Author

• Error recovery and complex task handling: LLM agents are generalizable and adaptive and, therefore, will be robust to errors. They can interpret complex tasks and break them down into coherent, logical steps to ensure efficiency and success.
• Flexibility and specialization: LLM agents can, after fine-tuning, become specialized for the execution of tasks effectively in specific domains. At the same time, they are applicable to many tasks and may be called versatile and utility-oriented AI assistants.
• Ease of development and accessibility: LLM agents, for the most part, require less intensive coding compared to rule-based systems. Interactions mostly take place through natural language prompts; therefore, they are accessible for those users who do not have deep programming experience.
• Integration and interoperability: LLM agents interact with a diversity of tools, databases, and external APIs in a manner that has no parallel. They work in a plug-and-play manner in different ecosystems while drawing from and feeding into a richer web of information and functionalities.

Limitations of LLM Agents

While LLM agents make significant progress in the field of AI, they also have some associated limitations that are vital to understand while looking at a balanced view of their potential and limitations. Some limitations of LLM agents are:

LLM Agent Limitation overview, Author

• Wrong tool selection: LLM agents can often choose the wrong tool or resource when carrying out some task due to a misunderstanding or due to little expressiveness in the decision logic, resulting in suboptimal outputs or in the execution of that task.
• Infinite loop of tool optimization: For the process of choosing the best tools to apply, LLM agents can be stuck in an infinite loop of optimization, seeking slightly improved tools ad infinitum without actually making any progress toward task completion. This wastes computational resources and time, especially if there is not a well-defined criterion for satisfactory tool performance.
• Failed API calls: Even though LLM agents require several off-the-shelf APIs for their functioning, a downside of such an approach is that if an API call fails due to a network issue, the API server is down, or the interface of the API changes, then the operation of the LLM agent will be interrupted, causing tasks to be left incomplete. This requires an inbuilt fallback mechanism to gracefully handle such failures.
• Hallucinations: There is the risk that the LLM agents will hallucinate and yield misinformation, further deteriorating the agent’s reliability.

Examples of LLM Agents

Coding Agents

Coding open-sourced LLM agents include open interpreter, DemoGPT, GPT Engineer, GPT Pilot, and Sourcegraph Cody AI. Coding closed-sourced LLM agents include BitBuilder, GitWit, Codium, GitLab Duo, Copilot X, mutable.ai, and Codegen

General purpose Agents

General purpose open-sourced LLM agents include ChatGPT plugins, BabyAGI, MiniAGI, MultiGPT, and Web3 GPT, while closed source include B2 AI, Lutra, and ADEPT.

LLM Agents Tools

Following are some of the leading tools and frameworks that enable the development of LLM agents:

• LangChain is a general-purpose framework for building applications and agents using a variety of language models.
• AutoGPT provides tools to enable the building of AI agents that can solve more advanced problems, including investment analysis, product review, and sales lead generation.
• AutoGen allows users to easily build LLM applications through a framework supporting agent-to-agent communication for problem-solving.

LLM Agents tools overview. Author

• Langroid supports the development of LLM applications in a multiagent system with agent-to-agent communication.
• OpenAgents gives a place to deploy and host agents trained with different language models in realistic environments.
• LlamaIndex allows you to integrate custom data sources with LLMs to make them better at retrieving information.
• GPT Engineer generates code for developers in multiple coding environments on an automated basis.

AgentVerse: deploys many LLM-based agents over various use-case scenarios.

Implementation Steps

If you intend to develop an LLM Agent, this is how you do it right:

• Framework selection: Pick out a framework such as LlamaIndex or LangChain that would suit the needs of your LLM application. Evaluate how it fits your project objectives closely, focusing on features that are best suited for your application’s specific requirements.
• LLM selection for reasoning: Choose an LLM that aligns with the goals of your project based on language comprehension, inference speed, and integration potential. The performance of the selected LLM is crucial in determining the general effectiveness of the agent.
• Agent type selection: Select an appropriate type of agent, such as ReAct, or the calling of OpenAI functions, according to the specifics and complexity of the task. Apply tools-including the LangChain documentation-toward the implementation of various agent types to ensure that the same is done in line with the application’s goals and objectives for optimal performance.
• Tool integration: Enhance your agent’s capability to deal with external tools-be it APIs from Google Search, databases of vectors, or calculators. Make this integration secure and protect data privacy to enhance the tools with which the agent works without compromising the integrity of the data.
• Refining agent outputs: Use an iterative process to enhance agent output continuously. Such a process may include prompt design modifications based on user feedback and tool interaction upgrades. Make use of agile methodologies to drive the agent to adapt and change capabilities the right way.
• Evaluation and deployment: Carefully assess the agent to ascertain that it is in a good position to interpret the queries correctly, pick the right tools, make apt observations, and come up with the right results in line with the context. Once satisfied, deploy the agent, which is ready for real-world interactions.

By following these steps methodically, you will create an LLM agent that is not only functional but also customized to meet your application’s specific demands for a solid and effective AI solution.

Monitoring and Evaluating LLM Agents

With the development of LLM agents, ensuring efficiency and reliability during runtime applications is important. Bringing in best practices from testing and verifying the LLM agents can significantly increase their efficiency.

LLM Agents Quad

It is thus imperative to ensure the following focus is kept:

• Query translation accuracy: Set it up so that the tool API interactions the agent translated can be compared against the original user queries. This allows you to find mismatches that will help you know where to focus your efforts. Consider the translations for consistency of meaning to the original query and relevance to this query, including the correct representation of keywords. Utilize standard LLM evaluation metrics to evaluate the accuracy and alignment of the translation to the user intent.
• Appropriateness of tool choices: The benchmarks or criteria should be created to ascertain whether a particular tool fits the requirements of that query. Validate the functionalities of selected tools against the query’s needs to ensure the agent selects the most appropriate tool for an effective response.
• Checking context relevance of a tool’s response: Review the tool’s responses in context to the user query, emphasizing the relevance and correctness of the information provided. Use quality metrics to determine the appropriateness of the tool’s output; compare it to the query context with expected responses to assure relevancy.
• Groundedness of the final response: Ensure the agent’s final reply is grounded in the data obtained during the query processing. Use cross-referencing of source data and validation methods outside the dataset to ensure the concreteness of the reply and reduce the chance of producing wrong or hallucinated information.
• Relevance and helpfulness of the answer: Leverage direct user feedback, automated scoring systems, or comparisons with benchmark answers to evaluate relevance and helpfulness. Integrate a continuous feedback loop with user assessments to further finesse and develop the performance of the agent so that the relevance and helpfulness of responses persist.

Final Notes

In conclusion, it is becoming clear that we have opened a new chapter where LLM via agents can mirror human-like problem-solving abilities. Drawing inspiration from sophisticated AI systems like J.A.R.V.I.S. in Iron Man, similarly, the dynamic capabilities of LLM agents are increasingly such that they can synthesize a huge body of knowledge, create autonomous decisions, and execute sophisticated tasks to help humanity in many ways.