Llama Windows

One local AI server for all your Windows apps Discussion | Link