Pathway reposted this
Director of Growth at Pathway | RAG and Stream Analytics | Open Education Evangelist
Latest addition to Pathway's App Templates: MultiModal RAG Pipeline (MM-RAG) for PDFs with Tables! 📄 Traditional RAG struggles with important details within tables which is addressed by the method used here. The responses are significantly superior, and this can be tweaked to support charts, images, or optimized with rerankers, adaptive RAG, etc. You can run the pipeline as a containerized solution via Docker or quickly test it out within Google Colab. The steps are here: https://lnkd.in/d4aYpsqi Pathway's incremental data pipeline here: – Extracts tables as images during the parsing process. – GPT-4o explains the content of the table in detail. – Saves the table content with the document chunk into the index, making it easily searchable. User queries are sent to the LLM with the relevant context including parsed tables. Pathway's in-memory incremental indexing preprocesses and indexes your data in real time, always providing up-to-date answers even if a new PDF is added or deleted from your data store. #RAG #finance #GPT4o #Pathway #multimodal #AI #GoogleColab #jupyter
