diff options
Diffstat (limited to 'content/blog/2024-01-13-local-llm.org')
| -rw-r--r-- | content/blog/2024-01-13-local-llm.org | 6 |
1 files changed, 3 insertions, 3 deletions
diff --git a/content/blog/2024-01-13-local-llm.org b/content/blog/2024-01-13-local-llm.org index 7ed4f82..b5a15f6 100644 --- a/content/blog/2024-01-13-local-llm.org +++ b/content/blog/2024-01-13-local-llm.org @@ -34,7 +34,7 @@ to install and use so far: [[https://ollama.ai/][Ollama]] is a simple Go application for macOS and Linux that can run various LLMs locally. -For macOS, you can download the pplication on the [[https://ollama.ai/download/mac][Ollama download page]] and +For macOS, you can download the application on the [[https://ollama.ai/download/mac][Ollama download page]] and install it by unzipping the =Ollama.app= file and moving it to the =Applications= folder. @@ -49,7 +49,7 @@ mv ~/Downloads/Ollama.app /Applications/ After running the app, the app will ask you to open a terminal and run the default =llama2= model, which will open an interactive chat session in the -terminal. You can startfully using the application at this point. +terminal. You can start using the application at this point. If you don't want to use the default =llama2= model, you can download and run additional models found on the [[https://ollama.ai/library][Models]] page. @@ -84,6 +84,6 @@ Once you have a file downloaded, you simply create a new chat and select the downloaded model file and ensure the inference matches the requirement in the =models.md= file. -[[https://github.com/AugustDev/enchanted][Enchanted]] is also an iOS for private AI models, but it requires a public-facing +[[https://github.com/AugustDev/enchanted][Enchanted]] is also an iOS app for private AI models, but it requires a public-facing Ollama API, which did not meet my "on device requirement." Nonetheless, it's an interesting looking app and I will likely set it up to test soon. |