Skip to content

xyproto/usermodel

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

usermodel

Given a task string (like code-completion), return the user-configured Ollama model for this task.

The user-configured Ollama model is found by examining ~/.config/llm-manager/llm.conf and /etc/llm.conf and if that does not work out, by executing llm-manager.

If no user-configured model is available, return a default model.

Example use

package main

import (
    "fmt"

    "github.com/xyproto/usermodel"
)

func main() {
    fmt.Println(usermodel.GetVisionModel())
}

Exported types

type Task string

Exported constants

ChatTask           = "chat"
CodeTask           = "code"
CodeCompletionTask = "code-completion"
TestTask           = "test"
TextGenerationTask = "text-generation"
ToolUseTask        = "tool-use"
TranslationTask    = "translation"
VisionTask         = "vision"

Exported functions

func AvailableTasks() []Task
func GetChatModel() string
func GetCodeModel() string
func GetCodeCompletionModel() string
func GetTestModel() string
func GetTextGenerationModel() string
func GetToolUseModel() string
func GetTranslationModel() string
func GetVisionModel() string
func Get(task Task) string

General info

About

Get per-task Ollama models

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages