Docker – Running REST API (Ollama) and Nginx reverse proxy
I want to run Ollama docker image. This exposes entire API with its endpoints. I want to secure it by adding reverse proxy on top of it and i have chosen Nginx for the job. So I need to add…
Ollama/Debian access by Windows 11 makes cURL error
I have Ollama installed on a Debian 12 machine. Local access is ok but fails on Windows 11. Works on Ollama server: http://localhost:11434/ WORKS http://[local ip]:11434/ WORKS curl https://www.google.com WORKS curl http://localhost:11434/api/generate -d '{ "model": "llava", "prompt": "Why is the…
Amazon web services – How to install and run Ollama server in AWS Kubernetes cluster (EKS)?
I can install and run Ollama service with GPU in an EC2 instance and make API calls to it from a web app in the following way: First I need to create a docker network, so that the Ollama service…
Docker – how to pull model automatically with container creation?
When trying to access the ollama container from another (node) service in my docker compose setup, I get the following error: ResponseError: model 'llama3' not found, try pulling it first I want the setup for the containers to be automatic…
How to create an ollama model using docker-compose?
I would like to make a docker-compose which starts ollama (like ollama serve) on port 11434 and creates mymodel from ./Modelfile. I found a similar question about how to run ollama with docker compose (Run ollama with docker-compose and using…
Running Ollama in Docker File for Python Langchain Application
Background Info I have a python application that uses langchain and Ollama. Running this locally works perfectly fine because I have the Ollama client running on my machine. What I want to do is host this application on a serverless…
Ollama in Docker pulls models via interactive shell but not via RUN command in the dockerfile
I have Ollama running in a Docker container that I spun up from the official image. I can successfully pull models in the container via interactive shell by typing commands at the command-line such as: ollama pull nomic-embed-text This command…
Docker – How to compose Ollama server with Nextjs?
I have been attempting to create a composition involving the Ollama server with LLMs such as Mistral and Llama2, along with a Next.js server to interact with it. I am building this project to learn Docker, and I am currently…
Javascript – Issue with calling a local Ollama API from Chrome Extension
I need your help. I'm currently developing a Chrome Extension, that will trigger a API call when clicking a button. The api that I want to call is a local instance of Ollama (https://ollama.ai/), that provides multiple API's. When calling…