Comment #⁨13⁩

Fully second all of that and would like to add that it would be great to be able to use an offline LLM - configured my PC especially so that it could run local LLMs - even just the ability to mimic openai calls would be great - as afr as I understand we can currently only input an API key that is directly put to the OpenAI servers(?)