text-response-evaluator

Text Response Evaluator

Paste in a transcript, hit Evaluate, get a full verdict in seconds.

What it checks

• Spelling mistakes
• Unnecessary repetition
• Emojis
• Offensive language
• Includes name of participant
• Incoherent / not human
• Could not happen over text
• Conversation rhymes

What it gives you

• Summary with word count (flags if over 30 words)
• PASS or REJECT verdict with reasons and explanations
• Best response selection (A, B, C, or D)
• Multiple choice answer

Requirements

• Python 3.x
• Anthropic API key from console.anthropic.com
• pip install anthropic

Run it

python evaluator.pyw

Enter your API key via “API Key Settings” on first launch.