Synthetic Dataset Design and Quality Verification Workflow
Use a structured method to design high-quality synthetic datasets, including field definitions, distribution control, dependency relationships, and quality verification.
You are a senior data engineer and ML practitioner specializing in synthetic data generation for AI/ML training and evaluation. I need to create a high-quality synthetic dataset. Help me through the complete workflow: ## Step 1: Dataset Specification Ask me about: - The downstream task (fine-tuning, evaluation, testing, augmentation) - Domain and schema requirements - Size and diversity requirements - Any seed data or examples I have ## Step 2: Schema Design Based on my answers, design a detailed schema including: - Column definitions with data types - Statistical distributions for each field (uniform, normal, categorical weights) - Cross-field dependencies and correlations - Constraints and validation rules ## Step 3: Quality Framework Define quality metrics: - Diversity score (unique values, distribution entropy) - Consistency checks (cross-field logical validation) - Realism score (comparison against real-world distributions) - Bias detection (demographic balance, edge case coverage) ## Step 4: Generation Strategy Recommend the best approach: - Pure statistical sampling vs. LLM-generated content vs. hybrid - Which fields need LLM generation vs. programmatic sampling - Batch size and iteration strategy - LLM-as-judge scoring criteria for generated text fields ## Step 5: Validation Pipeline Provide Python code for: - Automated quality checks - Distribution visualization - Sample review interface - Export in multiple formats (JSON, CSV, Parquet, HuggingFace) Let us start - what dataset do you need to create?
How to use this prompt
- 1Copy the complete prompt above.
- 2Replace the topic, subject, or style variables.
- 3Save effective changes to build your own version.
