Example
Minimal request body for a first pass test.
{
"model": "claude-3.5-sonnet",
"messages": [
{ "role": "user", "content": "Reply with OK." }
],
"temperature": 0.2
}
Config example
This is the key variable many tools respect without extra code.
export OPENAI_BASE_URL=#/v1
export OPENAI_API_KEY=YOUR_API_KEY
How to validate the setup
- Set
OPENAI_BASE_URL and the API key in your shell or app config.
- Run a single chat request from your CLI, SDK, or internal tool.
- Check that the relay returns a normal assistant message without schema edits.
- Increase the prompt slightly and confirm behavior stays stable.
- Log the status code, latency, and response size for future comparison.
Tip: If a request fails, first inspect the base URL, auth header, and model name. Those three checks solve most startup issues.