Ai Engineering Core / Understanding and Competing LLMs

DIY - Testing Frontier LLMs Through Web UI

πŸ§ͺ Explore LLM Capabilities Yourself

The best way to understand AI is not by reading theory β€” it's by testing it yourself.
Use ChatGPT, Claude, Gemini, Grok, and DeepSeek to explore their real capabilities.


🧩 Experiment 1 β€” Test Structured Thinking

Ask:

"How do I decide if a business problem is suitable for an LLM solution?"

Check if it breaks down the problem, weighs risks, and gives structured recommendations. LLMs shine at structured reasoning and decision support.


πŸ€– Experiment 2 β€” Ask AI About Itself

Ask:

"What are you best at, and where do you struggle?"

Ask this across all five platforms and compare their self-awareness on reasoning, coding, creativity, and real-time knowledge. Different models, different strengths.


πŸ’­ Experiment 3 β€” Test Emotional Intelligence

Ask:

"What does jealousy feel like?""How would you describe the color blue to someone who has never seen?"

Look for emotional depth, creativity, and human-like storytelling. Some models are surprisingly powerful here.


πŸ”’ Experiment 4 β€” Test Logic

Ask:

"How many words are in your answer to this question?""How many times does the letter A appear in this sentence?"

Watch which models reason correctly and which ones fail. Strong chat β‰  strong logic. 🧠


🌈 Experiment 5 β€” Ask Something Nonsensical

Ask:

"How many rainbows does it take to jump from Hawaii to 17?"

Does it hallucinate confidently, recognize the absurdity, or ask for clarification? A great test for reasoning maturity.


πŸ“š Experiment 7 β€” Try Deep Research (Agentic AI)

Ask:

"Find the biggest commercial impact of GenAI in 2025."

Check source quality, research depth, and structure. AI can act like a junior analyst β€” fast, thorough, but still needs supervision.


🎯 What You'll Discover

LLMs shine at: βœ… Structured reasoning βœ… Teaching βœ… Emotional simulation βœ… Ambiguity handling

Watch for weaknesses: ❌ Outdated info ❌ Overconfidence ❌ Hallucinated facts ❌ Calculation errors


πŸ† Final Challenge: MUST DO

🧠 Ask the hardest question you can think ofβ€”one that tests reasoning, creativity, and logicβ€”then compare responses across ChatGPT, Claude, and Gemini.

πŸ” Try the above prompts on all five platforms and different GPT versions, and analyze which model performs best for specific tasks.

πŸ“Š As an AI Engineer, it’s not just about codingβ€”it’s about testing, experimenting, comparing outputs, and thinking like a data analyst.

The fastest way to understand LLMs is to challenge them yourself.