LLM

class pipecat.services.groq.llm.GroqLLMService(*, api_key, base_url='https://api.groq.com/openai/v1', model='llama-3.3-70b-versatile', **kwargs)[source]

Bases: OpenAILLMService

A service for interacting with Groq’s API using the OpenAI-compatible interface.

This service extends OpenAILLMService to connect to Groq’s API endpoint while maintaining full compatibility with OpenAI’s interface and functionality.

Parameters:

  • api_key (str) – The API key for accessing Groq’s API

  • base_url (str, optional) – The base URL for Groq API. Defaults to “https://api.groq.com/openai/v1”

  • model (str, optional) – The model identifier to use. Defaults to “llama-3.3-70b-versatile”

  • **kwargs – Additional keyword arguments passed to OpenAILLMService

create_client(api_key=None, base_url=None, **kwargs)[source]

Create OpenAI-compatible client for Groq API endpoint.