yera.cli.model_discovery.llama_cpp

Llama-cpp model discovery handler.

Symbols

class LlamaCppModelDiscovery — Handler for discovering local GGUF models for Llama-cpp.

LlamaCppModelDiscovery

Inherits: BaseModelDiscovery

Handler for discovering local GGUF models for Llama-cpp.

This class crawls configured local directories, parses the binary headers of .gguf files to extract metadata.

Methods

discover — Recursively scans configured directories for GGUF models.

LlamaCppModelDiscovery.discover

discover() → DiscoveredModels

Recursively scans configured directories for GGUF models.

The discovery process: 1. Iterates through all configured model directories. 2. Recursively finds all *.gguf files. 3. Extracts binary metadata for each file. 4. Classifies the file as an LLM or Embeddings model.

Returns

type: DiscoveredModels

A DiscoveredModels object containing the discovered LLMs and embeddings.

Raises

TypeError

If the provided connection object is not a LlamaCppConnection.