What’s up, what’s down and what are you not sure about?
Let us know what you set up lately, what kind of problems you currently think about or are running into, what new device you added to your homelab or what interesting service or article you found.
I really want to self host a system that will let me upload documents to be indexed by a vector DB, then run natural language queries using some kind of RAG approach.
Pretty vanilla RAG/Vector DB use-case: Having a markdown software product and technical knowledge base and wanting quick answers to questions like “How should screen X behave if I am not a registered user?”.
Closest I’ve found is LlamaIndex but this is still more of a foundation than a turn-key solution and right now I’m too time poor to do the assembly required… I realise I’m describing close-to-frontier tech, but anything more turn-key out there yet?
Thanks for any suggestions!
Ollama + OpenWebUI also can do this.
I think I found my jam! AnythingLLM self-hostable