Skip to contents

Chat Processing

Functions for creating chat processors

chat_sequential()
Process a batch of prompts in sequence
chat_future()
Process a batch of prompts in parallel

Batch Processing

Methods for batch processing with different chat processors

batch()
Batch result class for managing chat processing results
batch.sequential_chat()
Process a batch of prompts with a sequential chat
batch.future_chat()
Process a batch of prompts with a parallel chat

Progress Tracking

Functions for monitoring progress

progress()
Get progress information from a batch result

Result Extraction

Functions for extracting data

chats()
Extract chat objects from a batch result
texts()
Extract texts or structured data from a batch result