FAQ Quality Report¶
Generated: 2026-10-09
Overall Statistics¶
- Total Questions: 98
- Overall Quality Score: 80/100
- Content Completeness Score: 100/100
- Concept Coverage: 49.9% (290/581 concepts, strict label match)
Content Completeness Assessment¶
| Input | Finding | Score |
|---|---|---|
| Course description | Title, audience, prerequisites, topics, out-of-scope list and outcomes at all six Bloom levels; its own assessment score is 96 | 25/25 |
| Learning graph | 581 concepts, 1,098 dependency edges, 13 categories; checked as a valid DAG (no cycles) | 25/25 |
| Glossary | 581 terms, 454 with an example | 15/15 |
| Content volume | About 456,000 words across all docs/**/*.md; the 27 chapters alone are about 256,000 |
20/20 |
| Chapter coverage of concepts | All 581 concept labels appear in the chapter text | 15/15 |
| Total | 100/100 |
Category Breakdown¶
| Category | Questions | Bloom levels | Avg words |
|---|---|---|---|
| Getting Started | 12 | 7 Remember, 5 Understand | 136 |
| Core Concepts | 31 | 6 Remember, 15 Understand, 8 Apply, 2 Analyze | 170 |
| Technical Details | 24 | 8 Remember, 7 Understand, 6 Apply, 3 Analyze | 183 |
| Common Challenges | 12 | 1 Remember, 3 Understand, 5 Apply, 3 Analyze | 172 |
| Best Practices | 11 | 1 Understand, 4 Apply, 3 Analyze, 2 Evaluate, 1 Create | 186 |
| Advanced Topics | 8 | 1 Apply, 2 Analyze, 3 Evaluate, 2 Create | 193 |
Bloom's Taxonomy Distribution¶
| Level | Count | Actual | Target | Deviation |
|---|---|---|---|---|
| Remember | 22 | 22.4% | 20% | +2.4% ✓ |
| Understand | 31 | 31.6% | 30% | +1.6% ✓ |
| Apply | 24 | 24.5% | 25% | -0.5% ✓ |
| Analyze | 13 | 13.3% | 15% | -1.7% ✓ |
| Evaluate | 5 | 5.1% | 7% | -1.9% ✓ |
| Create | 3 | 3.1% | 3% | +0.1% ✓ |
Total absolute deviation: 8.2%. Overall Bloom's Score: 25/25.
Answer Quality Analysis¶
- Examples: 82/98 (84%) - Target: 40%+ ✓
- Links: 98/98 (100%) - every answer ends with a Source line naming the chapter and the section the answer comes from - Target: 60%+ ✓
- MicroSim links: 55 answers point to the MicroSim lesson page that practices the idea (53 distinct lesson pages, including the learning graph viewer)
- Avg Length: 173 words (range 109 to 226) - Target: 100-300 ✓
- Complete Answers: 98/98 (100%) ✓
- Reading level: Flesch-Kincaid grade about 9.7, suitable for the adult professional audience
Answer Quality Score: 25/25
Accuracy Review¶
Every answer was written from the chapter text and checked against it; worked numbers were recomputed (for example 12,000 × 3.0 ÷ (6356 × 0.72) = 7.9 BHP, 530 ÷ 760 = 0.697, (1,780 ÷ 1,450)³ = 1.85, and the A-weighted sum of 92.5 dB). Values the chapters label illustrative are labeled illustrative in the FAQ. Where a chapter records a disagreement between FanPedia and the current catalog (the RBA air handling impeller's blade shape), the FAQ states it and follows the catalog. Each MicroSim reference was checked against that sim's own description.
Link Validation¶
- Links with
#anchors: 0 - Internal link and image references in the built FAQ page: 219 (87 unique targets), all resolve in the strict build; the two report pages add 29 more, also resolved
- Every chapter section cited on a Source line was checked to exist as a heading in that chapter
Concept Coverage¶
Coverage is measured by exact concept-label match (plurals and hyphen variants allowed) across questions and answers: 290 of 581 concepts (49.9%). The measure is conservative. At least 15 high-impact concepts are answered in substance under variant wording, such as "from the drive side" for Viewed From Drive Side and "Top Horizontal" for Top Horizontal Discharge; see FAQ Coverage Gaps.
Coverage Score: 10/30 (below 50%)
Organization Quality¶
- Logical categorization: ✓ six standard categories in learning order
- Progressive difficulty: ✓ from Remember/Understand in Getting Started to Evaluate/Create in Advanced Topics
- No duplicates: ✓ no exact duplicates and no question pairs above 80% similarity
- Clear questions: ✓ every question is 5 to 15 words and ends with a question mark
Organization Score: 20/20
Overall Quality Score: 80/100¶
- Coverage: 10/30
- Bloom's Distribution: 25/25
- Answer Quality: 25/25
- Organization: 20/20
Mascot Use¶
The FAQ is student-facing, so the CONTENT-GENERATION-GUIDE mascot rules apply. It uses two admonitions, a mascot-tip in Getting Started and a mascot-encourage at the start of Advanced Topics, never back-to-back, each two sentences with the image in the body. The book's validate-chapter-mascots.py reports no placement violations.
Recommendations¶
High Priority¶
- Add questions for the 11 high-impact concepts not yet answered in any form: Motor Base, Motor Efficiency Class, Catalog Structure, Hazardous Location Motor, Fan Pedestal, Arrangement 8, the pedestal plug arrangements (1P, 4P, 8P and 9P), Lab Exhaust Arrangements and Fan Family Selection.
- Use the exact glossary labels in the existing answers that already cover high-impact concepts under other wording; that alone lifts strict coverage above 50%.
Medium Priority¶
- Add a few Evaluate-level questions (currently 5.1% against a 7% target), for example on choosing between inlet vanes and a VFD on an existing constant-speed fan.
- Review the FAQ after any catalog edition change on tcf.com, since several answers quote current catalog models and limits.
Low Priority¶
- Consider questions on the medium-priority gaps listed in the coverage gaps report, grouped by chapter.
Suggested Additional Questions¶
- "How is a motor base chosen for a belt-driven fan?" (Technical Details)
- "What do TCF's Standard and Premium motor efficiency classes mean?" (Technical Details)
- "How is a Twin City Fan product catalog organized?" (Getting Started)
- "When does a fan need a hazardous location motor?" (Common Challenges)
- "What does a fan pedestal do, and when is a separated or bolt-on pedestal used?" (Technical Details)
- "When is Arrangement 8 chosen over Arrangement 1 or 4?" (Best Practices)
- "When should a plug fan be pedestal mounted (1P, 4P, 8P or 9P)?" (Best Practices)
- "Which arrangements are used for laboratory exhaust fans?" (Technical Details)
- "How do I choose the fan family before the size?" (Best Practices)
- "Should an existing constant-speed fan get inlet vanes or a VFD?" (Advanced Topics)
Companion Files¶
- FAQ
- FAQ Coverage Gaps
faq-chatbot-training.json: 98 questions with category, Bloom level, difficulty, matched concepts, keywords, source links, example flag and word count