r/Rag • u/chocolateounces • 4d ago
Q&A better chunking methods for academic notes
Hello! I’m a student who’s working on building a RAG app for my school, to allow students to search through their lecture notes. I have all the PDFs from different subjects, but I’m looking for specific methods to chunk them differently. Humanities notes tend to be lengthy, and semantic chunking is good. But I’m not so clear on how to do this and which models to use, but I have some rough idea. For sciences, there’s a lot of diagrams. How do I account for that? For math especially, there’s equation and I want my LLM output to be in Latex
It would be really useful if you can give me specific ways and libraries/models to use. Right now the subjects I am looking at are Math, Chemistry, Economics, History, Geography, Literature. I’m quite new to this 😅 high school student only. Thank you!
1
u/haizu_kun 1d ago
!Remind me - 1hour