OpenAI
OpenAI offers chat completions and embeddings suport. Additionaly it covers STT/TTS and real time interaction API.
OpenAI is configured as default provider. The minimum setup required is an api key.
To obtain an OpenAI apikey see the OpenAI docs
Configure the Toolkit API
Locate the file ./config/api/.env
and add the following configurations
LLM_SERVICE=openai
LLM_EMBEDDINGS_SERVICE=openai
OPENAI_API_KEY='api key'
##
# The following are already set as defaults, skip if you do not want to change them.
##
# Used for embeddings extraction
OPENAI_EMBEDDINGS_MODEL='text-embedding-3-small'
# Supported chat models from OpenAI. Leave empty to allow all available.
OPENAI_CHAT_MODELS='gpt-4o,gpt-4o-mini,gpt-4,gpt-4-turbo,gpt-3.5-turbo,gpt-3.5-turbo-16k,o1-preview,o1-mini',
# OPENAI_MODEL Default OpenAI model used as fallback if not specified otherwise for a tag (see below)
OPENAI_MODEL='gpt-4o'