Muluken
Posted on Nov 16
Edited on Nov 16
I explore event driven, auto-updating RAG systems that solves real day to day problems. This includes document syncing, versioning and ensuring correct answers from AI. Based on my experimentation on AI tax awareness system on Ethiopian tax laws and regulation.
Creating Retrieval Augmented Generation (RAG) applications is one of the easiest ways to create AI applications that can leverage your organisational knowledge. One of the engineering challenges that can easily be overlooked is ensuring the AI will get the latest information.
If an organisation has thousands of documents stored in Amazon S3 and they are constantly being added, edited, and removed then re-processing your knowledge base each time would be inefficient, costly and challenging to scale. Instead we can create an event driven approach to our knowledge base:
Event Driven Approach
We can use AWS to create a solution that:
1. Stores our documents in Amazon S3.
2.…