Whatever message this page gives is out now! Go check it out!
| Field | Required | Description |
|---|---|---|
| Config Alias | Yes | Unique identifier for this configuration. Alphanumeric, underscore, and hyphen characters only. Example: gpt4-prod, openaiconfig |
| Provider | Yes | Select the LLM provider from the dropdown. |
| Model Name | Conditional | Model identifier to use. Required for all providers except Azure OpenAI. |
| Field | Required | Description |
|---|---|---|
| API Key | Conditional | Authentication key for the provider API. Leave blank to supply at runtime. Not used by Ollama. |
| Endpoint URL | Conditional | Custom API endpoint URL. Required for Azure OpenAI and Ollama. |
| Deployment Name | Conditional | Azure OpenAI deployment name. Required for Azure only. |
| API Version | Conditional | Azure API version string (e.g., 2024-02-15-preview). Azure only. |
| Organization ID | Optional | OpenAI organization ID. OpenAI only. |
| Service Version | Optional | Azure OpenAI service version. Azure only. |
| Field | Description | Applicable providers |
|---|---|---|
| Temperature | Controls output randomness. Range: 0–2 typical. | All |
| Max Tokens | Maximum response length in tokens. | All |
| Top P | Nucleus sampling threshold (0–1 typical). | All |
| Top K | Number of top tokens to consider during sampling. | Gemini, Anthropic |
| Presence Penalty | Penalizes tokens based on appearance in text (>= 0). | OpenAI, Azure OpenAI |
| Repeat Penalty | Penalizes repeated tokens (>= 0). | Ollama |
| Seed | Random seed for deterministic outputs (> 0). | OpenAI, Azure OpenAI, Ollama |
| Response Format | Output format for model responses (Default or JSON). | OpenAI, Azure OpenAI, Ollama |
| Stop Sequences | Comma-separated strings that stop generation (e.g., \n\n, END). | All |
| Column | Description |
|---|---|
| Actions | Edit or delete the configuration |
| Config Alias | The unique name given to the configuration |
| Provider | The selected LLM provider |
| Model | The model name |
| API Key | Masked display of the stored API key |
<cfscript>
//add chat model config via admin ui/api/cfsetup with these 3 details , save config name as anth
//chatModelConfig = {
// PROVIDER: "anthropic",
// APIKEY: "#application.anthropicKey#",
// MODELNAME: "claude-sonnet-4-5"
// };
chatModel = ChatModel("anth");
response = chatModel.chat("What is 2 + 2?");
hasResponse = len(response.message ?: "") > 0;
containsFour = findNoCase("4", response.message ?: "") > 0 ||
findNoCase("four", response.message ?: "") > 0;
writeOutput("provider:anthropic | operation:basicChat | hasResponse:" & (hasResponse ? "YES" : "NO") & " | correctAnswer:" & (containsFour ? "YES" : "NO"));
agent = Agent({CHATMODEL : chatModel});
res = agent.chat("hello");
writeDump(res);
</cfscript>
<cfscript>
chatModel = ChatModel("myopenai", { apiKey : "#application.apiKey#" });
response = chatModel.chat("What is 2 + 3? how did to calculate it?");
writeDump(var=response);
</cfscript>