📽️ New Podcast: The One with Two Guys talking about AI software engineering 📽️
As global as our aperture is, there are constant reminders of how it's a small world. I got to co-host a podcast episode of AI Native Development with two Israeli founders that I have and have had the pleasure of working for... at companies in the space of software development in the new era where computers can communicate with us in natural ways, and can write code.
And, Guy Gur-Ari of Augment and Guy Podjarny crossed paths back when they were both in Israel!
Guy Gur-Ari has a deep research background, and has built a world class research team at Augment, which I saw first hand. The team is amazing at applying research, and in the episode you get to hear about a lot of the learnings that have come from applying systems that include LLMs to the practice of real world enterprise software.
For example, many people talk about the importance of retrieval, but Augment has done the work to lead in this area. Context sure if king, but how do you make sure to get the right context?
I also really enjoyed the discussion around fine-tuning and RAG. Once again the details matter. What does it mean to fine-tune a model on your codebase? What does fine-tuning do well in this situation, and where does it fall down? Practically: how do you handle the fact that every engineer is working on their own branch with local changes?
And there is so much more in this episode. I think we could have kept rolling for another hour or so for sure... and we discussed open source vs. open weights and how *contribution* is possible or not. How do you "fix a bug" in this world?
What does the future look like, and what is the role of autonomous coding?
And the biggest question of all: would you want your kids to get a Comp Sci degree these days?
Pease join me in your podcast viewing/listening application of choice in the comment below. I'm curious for your thoughts across these topics too!
#ainativedev