API Reference

• Generators
  • ConversationGenerator
  • StructuredGenerator
  • PersonaGenerator
• Instruction Generators
  • ContextualInstructionGeneratorCallback
  • PersonaInstructionGeneratorCallback
  • ToolCallingInstructionGeneratorCallback
• Respondent Prompt Modifiers
  • WithContextRespondentPromptModifier
  • WithRAGRespondentPromptModifier
• Stopping Callbacks
  • FixedNumberStoppingCallback
  • PersonaUsageStoppingCallback
  • ContextCoverageStoppingCallback
  • BudgetStoppingCallback
  • RateLimitStoppingCallback
• Providers
  • Document Providers
  • LLM Providers
  • Embedding providers
• Evaluators
  • ConversationJudge
  • ConversationJudgeConfig
  • default_embedding_provider_config()
  • Evaluation package (composite and metrics)
• Storage
  • BaseStorage
  • JSONLStorage
  • SQLStorage
• Monitoring
  • Alert
  • FileLogHandler
  • FileMetricHandler
  • GenerationMonitor
  • LogHandler
  • MetricHandler
  • ModelTokenUsage
  • TokenUsageReport
• Base Classes
  • BaseGenerator
  • BaseInstructionGeneratorCallback
  • BaseRespondentPromptModifierCallback
  • BaseStoppingCallback
• Types
  • Conversation
  • ConversationEntry
  • ConversationWithContext
  • Document
  • EvaluatedConversationWithContext
  • EvaluationEntrySchema
  • EvaluationSchema
  • GeneratedResponsePrompt
  • GenerationMetadata
  • GenerationState
  • GradeSchema
  • PersonaEntry
  • Role
  • StructuredGenerationRow