Skip to main content

flightline generate

Generate synthetic test data by analyzing your schema and creating edge-case scenarios.

Usage

flightline generate

What It Does

The generate command:
  1. Analyzes your schema to identify dimensions of variance
  2. Uses the Cartographer to map edge cases
  3. Generates internally-consistent test data via the Fabricator

Example

$ flightline generate

> Analyzing LoanApp schema...
> Identified 5 Key Dimensions: Credit, Income, LoanType, Assets, DTI.
> Generating 20 edge-case scenarios...
> [OK] Created 20 synthetic records in /tests/data/

Understanding Dimensions

Flightline identifies dimensions based on your schema. For a loan application, this might include:
  • Credit: Score ranges from minimum to maximum
  • LoanType: Different loan categories (FHA, Jumbo, Conventional)
  • Income: Various income levels including edge cases
The Cartographer combines these dimensions to create targeted scenarios that cover edge cases you might not think to test manually.

Data Consistency

The Fabricator ensures generated data is internally consistent. For example:
  • If employment_status = "Employed", then income > 0
  • If loan_type = "FHA", the loan amount respects FHA limits
Generated data contains zero PII. It’s safe to commit to version control and use in CI/CD pipelines.

Next: Run Evaluations

Test your prompts against generated data.