Skip to contents

Process a lot of prompts with a parallel chat

Usage

process.future_chat(
  chat_env,
  prompts,
  type = NULL,
  file = tempfile("chat_", fileext = ".rds"),
  workers = NULL,
  chunk_size = 10,
  max_chunk_attempts = 3L,
  beep = TRUE,
  progress = TRUE,
  echo = FALSE,
  ...
)

Arguments

chat_env

The chat environment from chat_future

prompts

List of prompts to process

type

Type specification for structured data extraction

file

Path to save state file

workers

Number of parallel workers (default upper limit is parallel::detectCores())

chunk_size

Number of prompts each worker processes at a time (default: 10)

max_chunk_attempts

Maximum retries per failed chunk

beep

Whether to play a sound on completion

progress

Whether to show progress bars

echo

Whether to display chat outputs (when progress is FALSE)

...

Additional arguments passed to the chat method

Value

A process object with the processed results