LangChain’s Post

View organization page for LangChain, graphic

296,187 followers

🦙 Tool calling with Ollama We now have a partner package with Ollama to help you perform tool calling, which is now natively supported in Ollama. Tools are utilities (like APIs or custom functions) that enhance an LLM's capabilities. However, local LLMs struggle with both selecting the right tool and providing the correct input. In the video below, we use the new Ollama partner package to perform tool calling w/ the recent Groq fine-tune of Llama-3 8b. See how to create a simple tool calling agent in LangGraph with web search and vector-store retrieval tools that run locally. 🎥 Video: https://lnkd.in/erppcmdY 🐍 Partner package (Python): https://lnkd.in/ej7KUQCr 🦏 Partner package (JavaScript): https://lnkd.in/eY8giWBY 📓 Notebook: https://lnkd.in/ewfNM_dc

  • No alternative text description for this image

This is a great advancement in tool calling! The integration of the Ollama package will undoubtedly enhance the capabilities of local LLMs. Excited to see how this evolves and simplifies tasks for developers. #ToolCalling #TechInnovation

This is a fantastic partnership! The Ollama package will be a game-changer for local LLMs struggling with tool selection and input provision. Looking forward to seeing the impact this has on improving LLM capabilities. #Innovation #Partnership #TechAdvancement

Like
Reply
Adam DeStafeno

Aspiring Web Developer | Certified Full-Stack Developer (Java) | Proficient in HTML, CSS, JavaScript, and React | Eager to contribute to visually stunning and functional web projects through responsive design.

2mo

I've been waiting for a local model provider to be able to handle tool calling and am so happy it happened to be Ollama to do so. Couldn't be more excited to check this out, thanks for posting!!!

Like
Reply
İlkhan Yalçın Kökdemir

Localized Data Systems Supremacist / Decision Making Enthusiast / Industrial Engineering Student @ Bilkent University

2mo

Not specifically talking about Langchain x Ollama, but tool calling technology has much more unprecedented potential than it is perceived. It will be as revolutionary as the LLM itself. Reveals so much opportunities...

Like
Reply
Nanda Kumar

Chief Technology Officer | Driving Innovation and Transforming Ideas into Cutting-Edge Technology at Vish Gyana Technology Solutions

2mo

Finally, we can test tool calling locally with Ollama…

Like
Reply
Vuk Stjepanovic

Tech Enthusiast & Entrepreneur | 👨🏽💻 Steering AI Advancements

2mo

Excellent news. Test tool calling with local model is what we've waiting for.

Like
Reply
Karthikeya Kollu

building@Orian(Ollama WebUI)

2mo

Will it work on smaller models,such as gemma:2b?

Like
Reply

This is great 😀

Like
Reply
Vanessa T.

Product Solution Manager at PolyAI

2mo

So excited to use these new features!!!

Like
Reply
See more comments

To view or add a comment, sign in

Explore topics