|
- ollama - Reddit
Stop ollama from running in GPU I need to run ollama and whisper simultaneously As I have only 4GB of VRAM, I am thinking of running whisper in GPU and ollama in CPU How do I force ollama to stop using GPU and only use CPU Alternatively, is there any way to force ollama to not use VRAM?
- How to Uninstall models? : r ollama - Reddit
To get rid of the model I needed on install Ollama again and then run "ollama rm llama2" It should be transparent where it installs - so I can remove it later
- Local Ollama Text to Speech? : r robotics - Reddit
Yes, I was able to run it on a RPi Ollama works great Mistral, and some of the smaller models work Llava takes a bit of time, but works For text to speech, you’ll have to run an API from eleveabs for example I haven’t found a fast text to speech, speech to text that’s fully open source yet If you find one, please keep us in the loop
- What is the best small (4b-14b) uncensored model you know and use?
Hey guys, I am mainly using my models using Ollama and I am looking for suggestions when it comes to uncensored models that I can use with it Since there are a lot already, I feel a bit overwhelmed For me the perfect model would have the following properties
- How to manually install a model? : r ollama - Reddit
I'm currently downloading Mixtral 8x22b via torrent Until now, I've always ran ollama run somemodel:xb (or pull) So once those >200GB of glorious…
- Multiple GPUs supported? : r ollama - Reddit
Multiple GPU's supported? I’m running Ollama on an ubuntu server with an AMD Threadripper CPU and a single GeForce 4070 I have 2 more PCI slots and was wondering if there was any advantage adding additional GPUs Does Ollama even support that and if so do they need to be identical GPUs???
- Ollama GPU Support : r ollama - Reddit
I've just installed Ollama in my system and chatted with it a little Unfortunately, the response time is very slow even for lightweight models like…
- Request for Stop command for Ollama Server : r ollama - Reddit
Ok so ollama doesn't Have a stop or exit command We have to manually kill the process And this is not very useful especially because the server respawns immediately So there should be a stop command as well Edit: yes I know and use these commands But these are all system commands which vary from OS to OS I am talking about a single command
|
|
|