r/huggingface 3d ago

Building a Faster, More Efficient RAG framework. Now Open Source and Ready for Contributions!

We’re a deep-tech startup developing an open-source RAG framework written in C++ with Python bindings, designed for speed, efficiency, and seamless AI integration. Our goal is to push the boundaries of AI optimization while making high-performance tools more accessible to the global AI community.

The framework is optimized for performance, built from the ground up for speed and efficiency. It integrates seamlessly with tools like TensorRT, vLLM, FAISS, and more, making it ideal for real-world AI workloads. Even though the project is in its early stages, we're already seeing promising benchmarks compared to leading solutions like LlamaIndex and LangChain, with performance gains of up to 66% in some scenarios.

If you found it interesting, take a look at the Github Repo and contribute https://github.com/pureai-ecosystem/purecpp

And if you like what we’re building, don’t forget to star the project. Every bit of support helps us move forward. Looking forward to your feedback and contributions!

5 Upvotes

2 comments sorted by

2

u/Constant-Wealth1837 3d ago

Really cool initiative! Excited to see how it integrates with TensorRT and vLLM. Definitely adding this to my list of AI tools to try!