VP of Engineering & Chief Technical Architect at Gnani.ai | Generative AI LLMs | Speech Recognition | VoiP | Cloud | Kubernetes | System Design/Architecture
Extremely proud of the team @Gnani.ai. Its an incredible feat. There's a common misconception that simply using tools like API frameworks, message queues, and caching automatically grants scalability. If that were true, everyone would have cracked the code by now. In reality, achieving true scalability demands numerous optimizations and years of experience, along with a deep understanding of system architecture. Our pipelines are highly optimised at every layer enabling us to achieve this unparalleled scale. Ananth Nagaraj Ganesh Gopalan Santhosh Mahadevaiah Thoshith S Mahesh Kumar Pradeep Sreeram #gnani.ai #generativeAi #coversationalAI #AI #LLMs #VoiceAI
The importance of #AI at #scale : gnani.ai : Celebrating 30000 Concurrent #Voicebot channels. Whenever we talk of AI, we talk of the latest #aimodels, the optimization and the algorithms- the real value of AI comes when you can do real world things at scale. So many AI technical papers, but not many of those ideas work at scale. Recently, we scaled our telephony voicebots to 30k concurrent channels and handled about 20M+ voicebot conversations in a single day. This meant scaling individual software components (#ASR, #NLU, #TTS, language detection and more) to ensure that these high volume concurrent conversations happen at a #latency of less than 300ms. This post is a tribute to the amazing effort by the tech team to make this happen. Sleepless nights for many folks- but it sure felt great with the result. Great job, folks! Ananth Nagaraj Bharath Shankar Santhosh Mahadevaiah Thoshith S Sharath K R Sanjay Pai and many more who I have missed ! #greatteam #chatbot #voicebots #llm #conversationalai #bot #artificialintelligence #genai
Well done team! Impressive achievement. Scalability requires extensive expertise and optimizations. 👏🏼