Batch class for managing chat processing

Usage

batch(
  prompts = list(),
  responses = list(),
  completed = integer(0),
  state_path = character(0),
  type_spec = NULL,
  echo = character(0),
  input_type = character(0),
  max_retries = integer(0),
  initial_delay = integer(0),
  max_delay = integer(0),
  backoff_factor = integer(0),
  chunk_size = integer(0),
  workers = integer(0),
  plan = character(0),
  state = list()
)

Arguments

prompts: List of prompts to process
responses: List to store responses
completed: Integer indicating number of completed prompts
state_path: Path to save state file
type_spec: Type specification for structured data extraction
echo: Level of output to display ("none", "text", "all")
input_type: Type of input ("vector" or "list")
max_retries: Maximum number of retry attempts
initial_delay: Initial delay before first retry
max_delay: Maximum delay between retries
backoff_factor: Factor to multiply delay by after each retry
chunk_size: Size of chunks for parallel processing
workers: Number of parallel workers
plan: Parallel backend plan
state: Internal state tracking