You can very likely run Llama based models on your hardware even if it's not good. Q: How to get started? Will this run on my Ī: To get started, keep reading. Fine-tuned Llama models have scored high on benchmarks and can resemble GPT-3.5-Turbo. They should be prompted so that the expected answer is the natural continuation of the prompt. To learn more about Llama, read the Wikipedia page.Ī: The foundational Llama models are not fine-tuned for dialogue or question answering like ChatGPT. Discussion of other local LLMs is welcome. It was created to foster a community around Llama similar to communities dedicated to open source like Stable Diffusion. LocalLLaMA is a subreddit to discuss about Llama, the family of large language models created by Meta AI. If you're looking for the subreddit list of models, go to the wiki. If you're looking for the link to the new Discord server, it's here: These sections are everything below the Old Guide header. You can skip the sections on manually installing with text generation web UI, which was part of the old original guide from six months ago. This guide has been updated with the latest information, including the simplest ways to get started. August 2023 Update: If you're new to Llama and local LLMs, this post is for you.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |