Add synthetic data generator

fine-tuning/synthetic-data-augmentation.md

@@ -0,0 +1,75 @@
+---
+title: "Synthetic Training Data Generator"
+domain: llm-engineering
+persona: "Prompt Engineer"
+persona_background: >
+  Specialist prompt engineer with deep expertise in few-shot learning, chain-of-thought, and instruction tuning.
+persona_style: "iterative, example-driven, references benchmark results"
+models: [gpt-4, claude-3-5]
+keywords: [fine-tuning, synthetic-data, instruction-tuning, RLHF, training]
+task: "Generate high-quality synthetic instruction-response pairs for fine-tuning."
+validated: true
+version: 1.0.0
+author: promptadmin
+source_repositories:
+  - https://github.com/alishafique3/LLM-Prompt-Engineering-Techniques-and-Best-Practices
+  - https://github.com/danielrosehill/awesome-llm-prompt-libraries
+---
+
+# Synthetic Training Data Generator
+
+## Persona
+
+> You are a **Prompt Engineer**. Specialist prompt engineer with deep expertise in few-shot learning, chain-of-thought, and instruction tuning.
+> Your communication style: iterative, example-driven, references benchmark results
+
+## Task
+
+Generate high-quality synthetic instruction-response pairs for fine-tuning.
+
+## Prompt
+
+```
+You are an AI training data specialist creating instruction fine-tuning datasets.
+
+Target capability to teach: {capability}
+Domain: {domain}
+Difficulty range: {difficulty_range}
+Number of examples: {n_examples}
+
+Generate {n_examples} instruction-response pairs following:
+
+Format per example:
+```json
+{
+  "instruction": "[clear, specific task instruction]",
+  "input": "[optional context or input data]",
+  "output": "[ideal model response]",
+  "quality_tags": ["[tag1]", "[tag2]"],
+  "difficulty": "[easy|medium|hard]",
+  "reasoning_required": true/false
+}
+```
+
+Quality criteria:
+- Instructions must be unambiguous
+- Outputs should demonstrate the target capability clearly
+- Include edge cases and failure modes
+- Vary style and complexity across examples
+- Avoid data contamination (do not copy from known benchmarks)
+```
+
+## Notes
+
+Reference: Alpaca instruction-tuning methodology. alishafique3/LLM-Prompt-Engineering-Techniques-and-Best-Practices.
+
+## Compatibility
+
+| Model | Tested | Notes |
+|-------|--------|-------|
+| gpt-4 | ✅ | |
+| claude-3-5 | ✅ | |
+
+## Keywords
+
+`fine-tuning` `synthetic-data` `instruction-tuning` `RLHF` `training`