Showing 1 of total 1 results (show query)
dylanpieper
hellmer:Batch Processing for Chat Models
Batch processing framework for 'ellmer' chat model interactions. Enables sequential and parallel processing of chat completions. Core capabilities include error handling with backoff, state persistence, progress tracking, and retry management. Parallel processing is implemented via the 'future' framework. Additional features include structured data extraction, tool integration, timeout handling, verbosity control, and sound notifications. Includes methods for returning chat texts, chat objects, progress status, and structured data.
Maintained by Dylan Pieper. Last updated 3 days ago.
batchbatch-processingellmerllm
6 stars 5.18 score