🗨️Chat Models

Chat models take a list of messages as input and return a model-generated message as output.

1) Azure ChatOpenAI

Prerequisite

1. Log in or sign up to Azure

2. Create your Azure OpenAI and wait for approval approximately 10 business days

3. Your API key will be available at Azure OpenAI > click name_azure_openai > click Click here to manage keys

Setup

1. Click Go to Azure OpenaAI Studio

2. Click Deployments

3. Click Create new deployment

4. Select as shown below and click Create

5. Successfully created Azure ChatOpenAI

· Deployment name: gpt-35-turbo

· Instance name: top right conner

1.Chat Models in Thub > drag Azure ChatOpenAI node

2. Copy & Paste each details (API Key, Instance & Deployment name, API Version) into Azure ChatOpenAI credential

2)ChatAnthropic

Prerequisite

1. Log in or sign up to Anthropic Console

2. Create an API key from the Anthropic dashboard

3. Copy the generated API key which will be used to connect the ChatAnthropic model in THub

Setup

1. Login to Anthropic and go to Claude Console and click Get API Key

1. Then click on + Create Key

1. Then name your API key and ADD

1. Chat Models in THub > drag ChatAnthropic node

2. Click Connect Credential > click Create New

3. Provide the required Anthropic API Key

4. Select the Model Name (for example: claude-3-haiku, claude-3-sonnet, or claude-3-opus)

5. Configure parameters such as Temperature or other optional settings if required

6. Click Save and the ChatAnthropic model will be ready to use

Successfully created ChatAnthropic

• Model name: claude-3-sonnet (example)

• Instance name: top right corner

3)ChatGoogleGenerativeAI

Prerequisite

1. Register a Google account

2. Create an API key

Chat Models > drag ChatGoogleGenerativeAI node

1) Connect Credential > click Create New

2) Fill in the Google AI credential

3) You can now use ChatGoogleGenerativeAI node in Thub

Safety Attributes Configuration

· Click Additonal Parameters

· When configuring Safety Attributes, the amount of selection in Harm Category & Harm Block Threshold should be the same amount. If not it will throw an error Harm Category & Harm Block Threshold are not the same length

· The combination of Safety Attributes below will result in Dangerous is set to Low and Above and Harassment is set to Medium and Above

4)ChatOpenAI

Prerequisite

• An OpenAI account

• Create an API key

Setup

• Chat Models > drag ChatOpenAI node

• Connect Credential > click Create New

• Fill in the ChatOpenAI credential

• you can now use ChatOpenAI node in THub

Custom base URL and headers

THub supports using custom base URL and headers for Chat OpenAI. Users can easily use integrations like OpenRouter, TogetherAI and others that support OpenAI API compatibility.

TogetherAI

• Refer to official docs from TogetherAI

• Create a new credential with TogetherAI API key

• Click Additional Parameters on ChatOpenAI node.

• Change the Base Path.

Open Router

• Refer to official docs from OpenRouter

• Create a new credential with OpenRouter API key

• Click Additional Parameters on ChatOpenAI node

• Change the Base Path and Base Options.

Custom Model

For models that are not supported on ChatOpenAI node, you can use ChatOpenAI Custom for that. This allow users to fill in model name such as mistralai/Mixtral-8x7B-Instruct-v0.1

Image Upload

• You can also allow images to be uploaded and analyzed by LLM. Under the hood, Flowise will use OpenAI Vison model to process the image.

• From the chat interface, you will now see a new image upload button

5) Chat DeepSeek

Prerequisite

1. Log in or sign up to DeepSeek

2. Create an API key from the DeepSeek dashboard

3. Copy the generated API key which will be used to connect the ChatDeepseek model in THub

1. Chat Models in THub > drag ChatDeepseek node

2. Click Connect Credential > click Create New

3. Select DeepseekAI API and provide the API Key

4. Select the Model Name (for example: deepseek-chat)

5. Configure parameters such as Temperature if required

6. Click Save and the ChatDeepseek model will be ready to use

Successfully created ChatDeepseek

• Model name: deepseek-chat

• Instance name: top right corner

6)GroqChat

Wrapper around Groq API with LPU Inference Engine.

Prerequisite

• An Groqchat account

• Create an API key

Setup

• Chat Models > drag GroqChat node

• Connect Credential > click Create New

• Fill in the Groqchat credential, Model name and temperature details.

• you can now use Groqchat node in THub.

Successfully created GroqChat

• Model name: Groq-chat

• Instance name: top right corner