LunaTranslator/guochandamoxing.md at e4b7c0720797e0941469eef4d86abaabc2e1da77

Public-Mirror/LunaTranslator

Fork 0

mirror of https://github.com/HIllya51/LunaTranslator.git synced 2024-12-29 00:24:13 +08:00

恍兮惚兮 e4b7c07207 fix

2024-10-31 16:42:38 +08:00

8.0 KiB

Raw Blame History

How to Use Large Model API for Translation

How to use multiple ChatGPT-compatible interfaces (or dedicated interfaces) simultaneously?

If you simply have multiple different keys and want to poll them, just separate them with a `|`.
However, sometimes you want to use multiple different API addresses/prompts/models/parameters at the same time to compare translation effects. The method is:
Click the "+" button at the bottom right

A window will pop up, select ChatGPT-compatible interface (or dedicated interface), and give it a name. This will copy the current ChatGPT-compatible interface (or dedicated interface) settings and API.

Activate the copied interface and you can make individual settings. The copied interface can run with the original interface, allowing you to use multiple different settings.

model can be selected from the drop-down list, and if it's not in the list, you can manually enter/modify it according to the official documentation of the interface.
Some interfaces can dynamically obtain the model list based on API Interface Address and API Key. After filling in these two items, click the refresh button next to model to get the list of available models.

ChatGPT-Compatible Interfaces

Most large model platforms use ChatGPT-compatible interfaces.
Since there are so many platforms, it's impossible to list them all. For other interfaces not listed, please refer to their documentation to fill in the corresponding parameters.

Foreign Large Model Interfaces

OpenAI

API Interface Address https://api.openai.com/v1

API Key https://platform.openai.com/api-keys

model https://platform.openai.com/docs/models

groq

API Interface Address https://api.groq.com/openai/v1/chat/completions

API Key https://console.groq.com/keys

model https://console.groq.com/docs/models Fill in Model ID

OpenRouter

API Interface Address https://openrouter.ai/api/v1/chat/completions

API Key https://openrouter.ai/settings/keys

model https://openrouter.ai/docs/models

Mistral AI

API Interface Address https://api.mistral.ai/v1/chat/completions

API Key https://console.mistral.ai/api-keys/

model https://docs.mistral.ai/getting-started/models/

Azure

API Endpoint URL https://{endpoint}.openai.azure.com/openai/deployments/{deployName}/chat/completions?api-version=2023-12-01-preview

Replace {endpoint} and {deployName} with your endpoint and deployName.

DeepInfra

API Endpoint https://api.deepinfra.com/v1/openai/chat/completions

API Key The API Key must be set to empty, otherwise it will result in an error.

Model You can view the currently available models at https://deepinfra.com/chat. As of the time of writing this document, the freely available models are: meta-llama/Meta-Llama-3.1-405B-Instruct meta-llama/Meta-Llama-3.1-70B-Instruct meta-llama/Meta-Llama-3.1-8B-Instruct mistralai/Mixtral-8x22B-Instruct-v0.1 mistralai/Mixtral-8x7B-Instruct-v0.1 microsoft/WizardLM-2-8x22B microsoft/WizardLM-2-7B Qwen/Qwen2.5-72B-Instruct Qwen/Qwen2-72B-Instruct Qwen/Qwen2-7B-Instruct microsoft/Phi-3-medium-4k-instruct google/gemma-2-27b-it openbmb/MiniCPM-Llama3-V-2_5 mistralai/Mistral-7B-Instruct-v0.3 lizpreciatior/lzlv_70b_fp16_hf openchat/openchat_3.5 openchat/openchat-3.6-8b Phind/Phind-CodeLlama-34B-v2 Gryphe/MythoMax-L2-13b cognitivecomputations/dolphin-2.9.1-llama-3-70b

Cerebras

API Endpoint https://api.cerebras.ai/v1/chat/completions

Model Supports llama3.1-8b llama3.1-70b

API Key After selecting a model and sending a message on https://inference.cerebras.ai, you can intercept the request and check the current Headers -> Request Headers -> Authorization value, which is Bearer demo-xxxxhahaha, where demo-xxxxhahaha is the API Key.