Hopsworks reposted this
2/3 Real-time Data in LLM Yesterday we showed how to access Lakehouse Data with the LLM, Today, we are moving to real-time; this time, the diagram shows how models handle immediate data requests. When real-time information is needed, the system bypasses the lakehouse and directly queries current data or even a model! ************************************************* What does it mean: If I ask the LLM for real-time information - what's the current stock price, predict if a transaction is fraudulent, what's the best product to recommend right now - the system needs to access the most up-to-date data or even query a live model. By enabling direct access to real-time data sources and models we are empowering the LLM with new context and even futur predictions. ************************************************* Key points: - 1-5ms latency, - Enables instant decision making and personalization; next best action, next best offer, - Supports both batch and real-time AI workloads, - Ensures data freshness. #RealTimeAI #LLM #DataScience #AILakehouse
