Sharing expierence and advice request
I have been using OpenWebUI for a while with local models but seems like I am missing something. There are so many features but nome of them feels native for me. Small thing but statistics during and after generation would be useful for me.
Update model params? Not comfortable at all..
Setup:
- Models on LM Studio pointed to OWUI. Tried with llama.cpp as well.
- Mac m2 24gb unified memory.
- Since its work laptop so I run smaller models 4-20b depends on the task.
Skills? Installed several - not working.
System prompts? Not using since my LLMs have different use cases so need to swith fast. Here not really possible.
What
- works: scheduled tasks
- websearch
I know community like this tool. I will try testing for a week more to give it a second chance.
What are your use case’es? Help me like it as a daily driver.