A few weeks ago, I hosted a fireside chat with Dario Gil and Ruchir Puri where they spoke to the IBM technical community about the open sourcing of the Granite family of foundation models, and encouraged IBMers to experiment with them.
In the following weeks, a bunch of IBM’s best developers got excited about and started playing with the Granite code models. One of our best watsonx developers, Gabe Goodhart, ran an experiment to see if he could get a dev environment with the following attributes:
- Entirely open source
- Runs on his laptop
- Works offline
He got it working with the combination of VS Code, ollama, Continue, and Granite Code. A bunch of us have been playing with this configuration and adding to it, so I asked Gabe to write an external article on it. It’s below, and I hope you enjoy it, and of course we welcome your feedback.
Special thanks to the folks at VS Code, ollama, and Continue, for creating great open source tools that are individually great and better together, and even better now with Granite Code! 🙌🏻
https://lnkd.in/dqjAx4cc
cc Erich Gamma, Michael Chiang, Ty Dunn