Rag System, Large Language Models, Document Management.
embeddings and using clustering techniques to merge similar segments. Reducing Redundancy: Clustering helps reduce redundancy by ensuring each topic is uniquely represented, enhancing the overall coherence and accuracy of the segmentation. Algorithm Pseudocode Gap Score Calculation: Gap Score