tldr/pages/common/llm.md

943 B

llm

Interact with Large Language Models (LLMs) via remote APIs and models that can be installed and run on your machine. More information: https://llm.datasette.io/en/stable/help.html.

  • Set up an OpenAI API Key:

llm keys set openai

  • Run a prompt:

llm "{{Ten fun names for a pet pelican}}"

  • Run a [s]ystem prompt against a file:

cat {{path/to/file.py}} | llm --system "{{Explain this code}}"

  • Install packages from PyPI into the same environment as LLM:

llm install {{package1 package2 ...}}

  • Download and run a prompt against a [m]odel:

llm --model {{orca-mini-3b-gguf2-q4_0}} "{{What is the capital of France?}}"

  • Create a [s]ystem prompt and [s]ave it with a template name:

llm --system '{{You are a sentient cheesecake}}' --save {{sentient_cheesecake}}

  • Have an interactive chat with a specific [m]odel using a specific [t]emplate:

llm chat --model {{chatgpt}} --template {{sentient_cheesecake}}