LlamaEdge Supports Tool Calls! Invoke External Tools

Discover how LlamaEdge enables tool calls, allowing LLMs to think, act, and execute real-world tasks using external tools in Python.

Tool invocation is one of the first truly "LLM-native" interaction modes.

It gives large language models the ability to both "think" and "act"—enabling them to learn new knowledge and perform real-world tasks.

This is essential for any agentic app.

Open-source LLMs are getting better at using tools.

The Llama 3 8B model makes reliable tool invocation possible, even on a developer's laptop!

With it, you can easily issue commands on a Mac using natural language to complete various tasks.

In this tutorial, we'll show a simple Python program that lets a local LLM run code and manipulate data on your machine.