Ollama - PromptGuard

The ollama/ namespace sends a request to the Ollama server named by the OLLAMA_BASE_URL environment variable of the PromptGuard deployment, default http://localhost:11434/v1. That variable is set by whoever runs PromptGuard, not by the caller, so this route is for a self-hosted PromptGuard running next to your Ollama server.

On PromptGuard Cloud, ollama/ models have nowhere to go: Cloud’s OLLAMA_BASE_URL is not set to your server, and Cloud cannot reach your network. To scan an Ollama server from Cloud, expose it over https and use the openai-compatible/ namespace, which sends requests to the host stored with your key.

Configure the deployment

Set OLLAMA_BASE_URL on the PromptGuard API to your Ollama server’s OpenAI-compatible base URL, including /v1:

OLLAMA_BASE_URL=http://ollama.internal:11434/v1

Send the request

Prefix the model id with ollama/. PromptGuard removes the prefix before forwarding, so the rest must be the model name your Ollama server knows (ollama list shows them). PromptGuard refuses a proxy request with an empty Authorization header, and Ollama ignores the header, so send any non-empty value if your server has no key.

import os
from openai import OpenAI

client = OpenAI(
    base_url=os.environ["PROMPTGUARD_BASE_URL"],  # your deployment, e.g. https://promptguard.internal/api/v1
    api_key="ollama",  # forwarded to Ollama; Ollama ignores it
    default_headers={"X-API-Key": os.environ["PROMPTGUARD_API_KEY"]},
)

response = client.chat.completions.create(
    model="ollama/llama3.2",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

import OpenAI from 'openai';

const client = new OpenAI({
  baseURL: process.env.PROMPTGUARD_BASE_URL, // your deployment, e.g. https://promptguard.internal/api/v1
  apiKey: 'ollama', // forwarded to Ollama; Ollama ignores it
  defaultHeaders: { 'X-API-Key': process.env.PROMPTGUARD_API_KEY },
});

const response = await client.chat.completions.create({
  model: 'ollama/llama3.2',
  messages: [{ role: 'user', content: 'Hello!' }],
});