Overview
Small library and CLI for calling LLM APIs with retries, rate limiting, and structured logging. Supports multiple providers and formats. Useful for evals and batch jobs.
What's included
- Python package
- CLI
- Config schema
- Examples
Repository
Private GitHub repository. Access is emailed after purchase — create a marketplace account at checkout.
Related products
Repository
AI Agent Strategies
Reusable strategies and prompts for building robust AI agents: tool use, planning, and error handling.
$149View details
RepositoryBERT Base Fine-Tuning Kit
Production-ready fine-tuning pipeline for BERT-style models with configurable training and export.
$199View details
RepositoryVision Model Inference API
Fast inference server for vision models (CLIP, ViT) with batching and REST API.
$99View details