EF and (ideally Local) LLM?

Michael,

I know this opens giant can of worms, but EF with its index and structure seems ideal to be used by AI (LLM) for data mining. I have been experimenting with AI little bit and Mx macs are very good. Soon many will have Apple Foundation LLM model available and there are freely available some which can run quite nicely even on 16GB macs through Ollama or other back ends. Basically, required skills by now are pretty low to get your own local LLM - or for reasonable money one can buy access to bunch of providers on line.

Are you considering adding something like this in the future?

My use would be to get LLM to index a folder - or pull data from your index for the folder, if possible - and answer questions or summarize etc. Currently I have to feed pdf files or other documents manually to LLM app to be able to do this.

Yes, that’s on my radar, and I agree that it should be local.

Maybe it would be a good idea to focus on v2 before jumping on other ideas?

Yes, this would definitely be after 2.0. What I mean by radar is that I keep track of feature requests in my issue tracker, so that I can collect notes about what people want and what I ideas I have even if I won’t be working on them imminently.