There's a collection of LLMs here: https://replicate.com/collections/language-models

Also available via API:

import requests
r = requests.get(
    "https://api.replicate.com/v1/collections/language-models",
    headers={"Authorization": "Token {}".format(token)
})
llm_models = r.json()['models']
version = llm_models[0]['latest_version']
version['openapi_schema']['components']['schemas']['Input']

Which produces the things that should be turned into options:

{'type': 'object',
 'title': 'Input',
 'required': ['prompt'],
 'properties': {'debug': {'type': 'boolean',
   'title': 'Debug',
   'default': False,
   'x-order': 5,
   'description': 'provide debugging output in logs'},
  'top_p': {'type': 'number',
   'title': 'Top P',
   'default': 1,
   'maximum': 1,
   'minimum': 0.01,
   'x-order': 3,
   'description': 'When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens'},
  'prompt': {'type': 'string',
   'title': 'Prompt',
   'x-order': 0,
   'description': 'Prompt to send to FLAN-T5.'},
  'max_length': {'type': 'integer',
   'title': 'Max Length',
   'default': 50,
   'minimum': 1,
   'x-order': 1,
   'description': 'Maximum number of tokens to generate. A word is generally 2-3 tokens'},
  'temperature': {'type': 'number',
   'title': 'Temperature',
   'default': 0.75,
   'maximum': 5,
   'minimum': 0.01,
   'x-order': 2,
   'description': 'Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.'},
  'repetition_penalty': {'type': 'number',
   'title': 'Repetition Penalty',
   'default': 1,
   'maximum': 5,
   'minimum': 0.01,
   'x-order': 4,
   'description': 'Penalty for repeated words in generated text; 1 is no penalty, values greater than 1 discourage repetition, less than 1 encourage it.'}}}

Uh oh!

Initial plugin #1

Description

Metadata

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Issue actions