Using Oobabooga
You can find the full Oobabooga documentation here.
Step 1 - Install Oobabooga
Step 2 - Start the server
Step 3 - Configure Oobabooga
Open http://127.0.0.1:7860/ in your browser and configure the server.
Make sure you load the model in the "Model" tab.
Step 4 - Enable the server in the client
Set ChatBot Backend to ChatGPT in the client settings:
Next, set the OpenAI URL to http://localhost:5000
Last updated