|
- ollama - Reddit
Stop ollama from running in GPU I need to run ollama and whisper simultaneously As I have only 4GB of VRAM, I am thinking of running whisper in GPU and ollama in CPU How do I force ollama to stop using GPU and only use CPU Alternatively, is there any way to force ollama to not use VRAM?
- r ollama on Reddit: Does anyone know how to change where your models . . .
I recently got ollama up and running, only thing is I want to change where my models are located as I have 2 SSDs and they're currently stored on the smaller one running the OS (currently Ubuntu 22 04 if that helps at all) Naturally I'd like to move them to my bigger storage SSD I've tried a symlink but didn't work If anyone has any suggestions they would be greatly appreciated
- Request for Stop command for Ollama Server : r ollama - Reddit
Ok so ollama doesn't Have a stop or exit command We have to manually kill the process And this is not very useful especially because the server respawns immediately So there should be a stop command as well Edit: yes I know and use these commands But these are all system commands which vary from OS to OS I am talking about a single command
- How to add web search to ollama model : r ollama - Reddit
How to add web search to ollama model Hello guys, does anyone know how to add an internet search option to ollama? I was thinking of using LangChain with a search tool like DuckDuckGo, what do you think?
- Best Model to locally run in a low end GPU with 4 GB RAM right now
I am a total newbie to LLM space As the title says, I am trying to get a decent model for coding fine tuning in a lowly Nvidia 1650 card I am excited about Phi-2 but some of the posts here indicate it is slow due to some reason despite being a small model EDIT: I have 4 GB GPU RAM and in addition to that 16 Gigs of ordinary DDR3 RAM I wasn't aware these 16 Gigs + CPU could be used until it
- Ollama Server Setup Guide : r LocalLLaMA - Reddit
I recently set up a language model server with Ollama on a box running Debian, a process that consisted of a pretty thorough crawl through many documentation sites and wiki forums
- Training a model with my own data : r LocalLLaMA - Reddit
I'm using ollama to run my models I want to use the mistral model, but create a lora to act as an assistant that primarily references data I've supplied during training This data will include things like test procedures, diagnostics help, and general process flows for what to do in different scenarios
- How to Uninstall models? : r ollama - Reddit
To get rid of the model I needed on install Ollama again and then run "ollama rm llama2" It should be transparent where it installs - so I can remove it later
|
|
|