gpt4 / main.md
antonovmaxim's picture
instructions
0287610
# GPT4
I have created a project that runs gpt4 through an open resource "[mindsdb](https://cloud.mindsdb.com/)". It runs with an api like [oobabooga](https://github.com/oobabooga/text-generation-webui), except there is no streaming mode.
The project is compatible with Sillytavern and TavernAi. To launch, insert the link "[located in the logs of this container]" as the Blocking API url of the Text Gen Webui interface (ooba).
---
## [Duplicate this space to skip the queue](https://huggingface.co/spaces/antonovmaxim/gpt4?duplicate=true)
To clone this project, you will need to create an account on [mindsdb](https://cloud.mindsdb.com/). Then run the code there
```sql
CREATE MODEL mindsdb.gpt4 -- mindsdb.[yourmodelname]
PREDICT response -- What we want from model a response!
USING -- Using WHAT?
engine = 'openai', -- OpenAI Engine
max_tokens = 6000, -- Adjusted max token size to 6k, you can make also temperature and more stuff...
-- api_key = demo instances already have one
model_name = 'gpt-4', -- you can also use text-davinci-003 or gpt-3.5-turbo
prompt_template = '{{text}}';
```
Then paste the login and password into secrets. The project will start.