Kong Inc.

🛑Stop your AI services from runaway token consumption. If your org is tapping into multiple models, you could be at risk of blowing through a lot of resources before you’ve realized it. In this video, I demo a hypothetical tiering system inside the Kong Inc. platform to show how you can: ✅ Rate-limit users based on token consumption ✅ Optimize costs by setting up access levels ✅ Ensure scalability without sacrificing performance Watch the video to see this tiering model in action and how it can help you better manage AI workloads. And let me know what you think! Drop a comment 👇  #APIManagement #AI #RateLimiting #Kong #TechInnovation

‼️ Kong Insomnia 11 is here! This release introduces powerful new features to take API security and collaboration to the next level: 🔐 Secure your secrets with third-party vault integrations 🔄 Collaborate seamlessly with project-level Git Sync 🖥 Work more efficiently with multi-tab support Read more about the Insomnia 11 updates here: https://bit.ly/4iY6bQW #KongPin #KongInsomnia #APISecurity #APICollaboration

The AI Semantic Cache plugin from Kong Inc. allows us to save responses in a database and save the related semantics in a vectorized way. This is done via a Redis database, as an example, where the embedded data from LLM models like the one I am using in this video gets verctorized and stores. The idea behind doing this is to detect if are making questions to our LLM model in different way, but at the same time requiring exactly the same response. If using AI is what we need to do, and we depend on responses from chatbots as an example, then we can save time and costs by making sure that we don't overload our LLM models with too much questions. In this example I am using Mistral to show how to use this plugig. The AI Semantic Cache plugin is easierly demonstrated using Kong Konnect and that makes this video something different than the Kong OSS examples that we saw before with the AI proxy plugin(https://lnkd.in/eF5wEPHH), the AI Prompt Guard plugin(https://lnkd.in/eSXJCzCX), the AI Prompt Template plugin(https://lnkd.in/eUUt-db2), and the AI Prompt Decorator plugin(https://lnkd.in/eP_QM-Uv). Enjoy the video and remember to stay tech, keep programming, be kind and have a good one everyone! #kong #apigateway #plugin

🦍 Advanced Kong configuration using k8s CRDs 💎 🚀 A new Kong Inc. YouTube Short just dropped! This video dives into advanced Kong configurations using Kubernetes CRDs. If you're using Kong Ingress Controller and need more than just hostname, port, and path configs, get familiar with these CRDs: 🔹 𝐊𝐨𝐧𝐠𝐈𝐧𝐠𝐫𝐞𝐬𝐬 – Enhances Ingress & Service resources with detailed route, service, and upstream settings. 🔹 𝐊𝐨𝐧𝐠𝐏𝐥𝐮𝐠𝐢𝐧 – Adds request modifications & traffic restrictions via plugins. 🔹 𝐊𝐨𝐧𝐠𝐂𝐥𝐮𝐬𝐭𝐞𝐫𝐏𝐥𝐮𝐠𝐢𝐧 – Cluster-wide version of KongPlugin for centralized control. 🔹 𝐊𝐨𝐧𝐠𝐂𝐨𝐧𝐬𝐮𝐦𝐞𝐫 – Represents a consumer in Kong, directly translating to a Consumer object. 🔹 𝐊𝐨𝐧𝐠𝐂𝐨𝐧𝐬𝐮𝐦𝐞𝐫𝐆𝐫𝐨𝐮𝐩 – Groups consumers to apply shared plugins (Enterprise 3.4+). 🔹 𝐓𝐂𝐏𝐈𝐧𝐠𝐫𝐞𝐬𝐬 / 𝐔𝐃𝐏𝐈𝐧𝐠𝐫𝐞𝐬𝐬 – Expose non-HTTP services via Kong. Read more about them here: https://lnkd.in/eVZ4h7QF 🔔 Stay Tuned for More! 🔔 Remember, I'll be releasing fresh tips every few days, so make sure you're subscribed to my channel to catch them all! 🔎 Looking for more Info? 📮 Make sure to check the description of the video on YouTube for links to docs, articles and information or DM me with any further questions Join our community and become a Kong Inc. master! #KongGateway #kic #kongingresscontroller #k8scrds #API #APIManagement #TechUpdates #kongmadeeasy #thegatewayguy

✨ Just when I thought Kong Inc. couldn’t impress me more - they go and do this! 🦍❤️ I was already honored to receive the 𝐊𝐨𝐧𝐠 𝐂𝐡𝐚𝐦𝐩𝐢𝐨𝐧 𝐌𝐕𝐏 award for my contributions to the community. But then, a stunning glass trophy with my name engraved on it arrived in the post - and wow, what a moment! 😍 Virtual recognition is always appreciated, but there’s something truly special about holding a physical award in your hands. It’s a tangible reminder of the passion, dedication, and effort that goes into building a thriving community. Moments like this reinforce why I love being part of Kong Inc. incredible ecosystem - not only do they drive innovation, but they also take the time to recognize and celebrate the people who make it happen. A huge thank you to everyone who has supported me on this journey—and a special shoutout to Daliya Spasova for her dedication and hard work in growing and supporting this amazing community. It wouldn’t be what it is today without you! 👏 This is just the beginning—I’m excited for what’s ahead! Let’s keep building together. 🙌 #KongChampion #MVP #Community #Recognition #Gratitude #KongAPI #TechCommunity #Innovation #kong #apigateway

👋 If you're at HumanX make sure to stop by booth #402! There is no AI without APIs and we can't wait to talk about it 🎉

⌛ Reacting quickly to critical service issues is crucial. Active Tracing in Kong Konnect is here to help. The new feature, now in tech preview: ✅ Helps to improve MTTR by instantly surfacing critical performance statistics in one place ✅ Provides unparalleled visibility allowing you to troubleshoot issues, optimize performance, and refine your configuration 👉 You can read more about Active Tracing here: https://bit.ly/4iBHmKu

And this week one more plugin about AI. The pattern is called decorator and it is applied in this case in the context of AI. The name of the plugin is the Kong Inc. AI Prompt Decorator plugin. Did you know that you can enrich your prompts to the LLM model of your choice with this particular pattern? Using a gateway we can do just that and in this video I am talking in very simple terms about applying that to AI. It kind of works like a template (https://lnkd.in/eUUt-db2), but it is really not, it is also not about limiting the requests for our chatbot (https://lnkd.in/eSXJCzCX), but still depends on our AI proxy(https://lnkd.in/eF5wEPHH). This is also my last video about simple AI plugins and simple patterns in API gateways using Kong for the time being. The following ones I will consider them to be more of medior and advanced categories. But that is for later, for now enjoy the video. Have a good one everyone! #kong #kongai

✨ In honor of International Women’s Day, Kong hosted a leadership panel earlier this week led by our Chief People Officer, Gunjan Aggarwal and our Chief Marketing Officer, Juliette Rizkallah. Here is some of the advice they shared: 🔹 There is value both in having confidence in what you do know and the humility to recognize the things you don’t know 🔹 Embrace discomfort and push yourself, and your team, toward change 🔹 Find your own champion, whether in your organization or outside, and allow them to push you 🔹 Don’t be afraid to take risks in order to get yourself where you want to be Part of being a leader is sharing what you’ve learned to help others grow and find their own success. A big thank you to Gunjan and Juliette for taking the time to share their own experiences!🎉

The series continues! 📈 Today, Michael Field and I are talking all things API analytics, and why they’re crucial for any API Platform strategy 📈 In the video, we cover the importance of: - Metrics for platform-wide visibility into things like request volume, status code volumes, etc. for trend identification and the beginnings of debugging - Logs for more in-depth details around individual requests, headers, payloads, etc. - Tracing for advanced debugging and visibility into exactly where issues might be within your network …and of course, we show it all working in Kong Inc. Konnect with a Dedicated Cloud Gateway (which is hands-down the coolest API Gateway offering on tap right now...just saying) Let us know what you think! #ItsAPIPlatformTime