embeddings

Class info

Classes

Name	Children	Inherits
EmbeddingProvider llmling_agent.embeddings Base class for streaming embedding providers.		ABC

🛈 DocStrings

Module providing different embedding model implementations.

EmbeddingProvider

Bases: ABC

Base class for streaming embedding providers.

Source code in src/llmling_agent/embeddings.py

class EmbeddingProvider(ABC):
    """Base class for streaming embedding providers."""

    @abstractmethod
    def embed_stream(
        self,
        texts: AsyncIterator[str],
        batch_size: int = 8,
    ) -> AsyncIterator[np.ndarray]:
        """Stream embeddings one at a time."""

embed_stream abstractmethod

embed_stream(texts: AsyncIterator[str], batch_size: int = 8) -> AsyncIterator[ndarray]

Stream embeddings one at a time.

Source code in src/llmling_agent/embeddings.py

@abstractmethod
def embed_stream(
    self,
    texts: AsyncIterator[str],
    batch_size: int = 8,
) -> AsyncIterator[np.ndarray]:
    """Stream embeddings one at a time."""