Touchcast’s Post

View organization page for Touchcast, graphic

18,456 followers

Bloomberg just published a great piece about Touchcast and our innovative approach to making generative AI more cost-effective, efficient and accessible. In the article, Tom Giles and Saritha Rai explain how Touchcast's cognitive caching technology reduces the computational resources and energy needed to run powerful AI models like GPT-4o. By caching and serving up responses to common queries, CogCache allows developers and businesses to deploy AI more broadly, with up to 50% lower costs and up to 100x faster response times. In the process, developers gain complete control over their AI outputs - transforming LLMs from "black boxes" to "glass boxes." Together with Microsoft, we're bringing cognitive caching into every Azure data center worldwide, supercharging Azure OpenAI tools for customers while significantly reducing expenses. And we're only getting started! 🚀 Dive into the story here: https://lnkd.in/e2Adbedc #GenerativeAI #CognitiveCaching #AzureOpenAI #CogCache #SustainableAI

Microsoft Backs Startup Focused on Making AI More Efficient

Microsoft Backs Startup Focused on Making AI More Efficient

bloomberg.com

Godwin Josh

Co-Founder of Altrosyn and DIrector at CDTECH | Inventor | Manufacturer

5mo

Touchcast's innovative cognitive caching technology marks a significant stride in the quest for more efficient and cost-effective AI deployment. By reducing computational resources and energy consumption, CogCache not only enhances the accessibility of generative AI but also empowers developers with greater control over AI outputs. However, as AI becomes more pervasive, what measures do you foresee being essential to ensure the ethical and responsible use of such powerful technologies, especially considering their potential impact on society and privacy concerns?

Like
Reply
Stanley Russel

🛠️ Engineer & Manufacturer 🔑 | Internet Bonding routers to Video Servers | Network equipment production | ISP Independent IP address provider | Customized Packet level Encryption & Security 🔒 | On-premises Cloud ⛅

5mo

That's fantastic news! Touchcast's cognitive caching technology seems like a game-changer for generative AI. By reducing computational resources and energy usage, it addresses one of the key concerns about the sustainability of AI. The collaboration with Microsoft to integrate this technology into Azure data centers will undoubtedly enhance efficiency and accessibility for businesses using AI. It's exciting to see advancements that make AI more cost-effective and transparent. What future applications do you envision for cognitive caching, and how do you think it will further transform the AI landscape?

Like
Reply
Edo Segal

Founder and CEO at Touchcast

5mo

Thank you, Tom Giles and Saritha Rai

Like
Reply
Trevor McFarland

Product Management Leader, Leveraging Data to Build Productive Apps and Services

5mo

Congrats Edo Segal

See more comments

To view or add a comment, sign in

Explore topics