The History of AI

AI History (1940s-to present)

Dr. Dhaval U Patel

Welcome to AI History! 🎓

What You'll Learn Today:
  • How AI was born from a simple question: "Can machines think?"
  • The brilliant pioneers who dared to dream of intelligent machines
  • Why AI went through not one, but TWO "winters"
  • How overpromising and underdelivering nearly killed the field
  • Why understanding this history helps us appreciate today's AI revolution

The Early Days

When Computers Were Born (1940s-1950s)

The Foundation: ENIAC and Early Computing

ENIAC Computer Being Programmed

1940s The world's first electronic computer, ENIAC, filled an entire room and weighed 30 tons!

ENIAC was originally built to calculate artillery firing tables for the U.S. Army. From day one, military applications drove AI development!

This massive machine could do calculations faster than any human, but it was basically a very expensive calculator. The dream of true intelligence was still just that - a dream.

Key Insight: Even from the beginning, defense and military needs have been major drivers of AI progress and funding. This pattern continues today!

But here's what's amazing - some visionaries looked at these room-sized calculators and asked: "What if we could make them think like humans?" That question would change everything.

Alan Turing: The Father of Computer Science

Alan Turing

1950 Alan Turing! This brilliant British mathematician asked the question that started it all:

"Can machines think?"

But Turing was clever. He realized this question was too philosophical, so he created something practical: The Turing Test

The Turing Test in Simple Terms: If you're chatting with something and can't tell if it's human or machine, then for all practical purposes, it's intelligent!
  • It's a blind conversation test
  • Talking through text
  • If the machine fools us into thinking it's human, it passes!
  • This test is STILL used today to measure AI capabilities

The Birth of AI

Dartmouth Workshop 1956: Where It All Began

The Historic Dartmouth Workshop

1956 The most important summer camp in history! For two months at Dartmouth College, four brilliant minds gathered to officially create the field of Artificial Intelligence.

The Four Founding Fathers of AI
The Four Founding Fathers of AI:
  • John McCarthy - Coined the term "Artificial Intelligence"
  • Alan Newell - Logic and reasoning expert
  • Herbert Simon - Problem-solving pioneer
  • Marvin Minsky - Neural network visionary (more on him later!)
Historical Moment: This is when "Artificial Intelligence" got its name! Before this, people just called it "thinking machines" or "electronic brains."

These four visionaries believed they could create machines that could learn, reason, and solve problems just like humans. But they were too ambitious.

Early Progress

The First Wave of AI Innovation (1960s-1970s)

The First AI Stars

ELIZA (1964) 💬

ELIZA - The First Chatbot

1964

  • The world's first chatbot! ELIZA was like a very primitive therapist.
  • Could hold simple conversations
  • Mostly just repeated what you said as questions
  • People got surprisingly attached to it!
Example: You: "I'm sad." ELIZA: "Why are you sad?"

Shakey the Robot (1969) 🤖

Shakey the Robot - First General Purpose Mobile Robot

1969

  • The first general-purpose mobile robot - a true pioneer!
  • Could move around and navigate
  • Made decisions about its environment
  • Led to the A* algorithm (still used today!)
The A* algorithm developed for Shakey is still used in Google Maps to find route!

The First AI Winter

When the Dream Hit Reality (1974-1980)

The First Cold Snap: What Went Wrong?

1974-1980 After all the excitement, reality hit. The field entered what we now call the "First AI Winter"!

What is an "AI Winter"? It's a period when interest, funding, and confidence in AI research dramatically declined. It like a recession, but for AI research!
Three Major Problems That Caused the Freeze:
  • Machine Translation Failures: Computers couldn't translate languages properly. The famous example: "The spirit is willing but the flesh is weak" became "The vodka is good but the meat is rotten"!
  • Marvin Minsky's Neural Network Criticism: One of AI's founding fathers said neural networks couldn't even solve simple XOR problems
  • Speech Understanding Disappointments: Computers still couldn't understand human speech reliably
Marvin Minsky

Marvin Minsky

XOR Problem Illustration

The XOR Problem

The lesson? Promising too much too soon can really backfire! Researchers had to learn to be more realistic about what AI could actually achieve.

The Expert Systems Era

AI's Brief Comeback

Expert Systems

The Rise 📈

After the winter, AI found new hope in "Expert Systems" - computer programs that could capture human expertise!

  • Encoded human knowledge into logical rules
  • Could make decisions like human experts
  • Used in medical diagnosis, business decisions
  • Became a half-billion-dollar industry!
It's like having a digital doctor or lawyer who knew all the rules and could make expert recommendations!

The Fall 📉

But success was short-lived. The expert systems boom quickly went bust...

  • Too rigid - couldn't handle unexpected situations
  • Expensive and hard to maintain
  • Couldn't learn or adapt
  • Over-hyped by researchers making grand promises again

The Second AI Winter

No one wants AI

The Great Credibility Crisis

Late 1980s-1990s The second AI Winter was even worse than the first. This time, AI didn't just lose funding - it lost respectability!

The Root Problem: AI researchers kept making grand promises about "solving intelligence" and achieving "human-level capabilities" that they simply couldn't deliver.
How Bad Was It?
  • Theoretical computer scientists: "AI lacks mathematical rigor - it's not real science!"
  • Practical engineers: "AI solutions don't actually work in the real world!"
  • Funding agencies: "We've been burned too many times - no more AI grants!"
  • Conferences: AAAI attendance dropped from 5,000 to under 1,000!
The Great Escape: Sub-fields like computer vision, natural language processing, and machine learning started avoiding the "AI" label entirely! They rebranded themselves to escape AI's bad reputation.

Key Lessons from the AI Winters ❄️

Understand why these winters happened and what we can learn from them:

Lesson #1: Manage Expectations

Both winters were caused by overpromising and underdelivering. Researchers got so excited about possibilities that they forgot about practical limitations.

Lesson #2: Technology Needs Time to Mature

Many ideas from the early days (like neural networks) were actually good - they just needed more powerful computers and better algorithms to work properly.

Lesson #3: Credibility Is Fragile

It takes years to build trust and only a few failed promises to destroy it. The AI community learned this the hard way - twice!

Modern Connection: This is why today's AI researchers are generally more careful about their claims. They remember the winters!

The story doesn't end here though - those sub-fields that distanced themselves from AI? They kept working and eventually created the AI revolution we see today!

The Comeback! 🚀

Here's the amazing ending to our story: Remember those conferences that saw attendance drop to under 1,000? Well, the video mentions that modern AI conferences like NeurIPS now see massive growth!

The Irony: The "failed" sub-fields that ran away from the AI label are exactly what brought AI back to life!
  • Machine Learning: Became incredibly powerful with big data
  • Computer Vision: Now recognizes images better than humans
  • Natural Language Processing: Gave us ChatGPT and modern AI assistants
  • Neural Networks: The thing Minsky criticized? They're now the foundation of modern AI!

The 1990s Renaissance

AI Fights Back and Proves Its Worth

AI in the 1990s 🚀

After surviving two brutal AI winters, the field was ready for its comeback story. The 1990s marked a turning point where AI finally started delivering on some of its promises.

The Golden Rule of AI Progress: "If it works, it's not AI anymore!"

This decade introduced us to a fascinating phenomenon that continues today - once AI solves a problem, people suddenly decide it wasn't "real" AI after all! (Like a magic tricks)

First Victory: The Mathematical Proof (1996)

1996 Before 1996, AI faced serious skepticism. Critics said machines could never be truly creative or intelligent. Then something remarkable happened...

Mathematical theorem proving by AI
Historic Achievement: An AI algorithm called EQP formally proved a mathematical theorem that had been widely believed but never formally proven!

This was a watershed moment for logic-based AI. For the first time, a machine had made a genuine mathematical discovery that advanced human knowledge.

Media Response: Notice something interesting? The New York Times called it a "major mathematical proof by an Argonne lab program" - but carefully avoided words like "creative" or "intelligent being." Even in victory, AI struggled for recognition!

This reluctance to acknowledge machine intelligence would become a recurring theme. People were ready to accept AI's capabilities but not quite ready to call it "intelligent."

The Match That Changed Everything: Deep Blue vs. Kasparov

1997 Chess had been the true test of AI since the field began. If a machine could beat the world's best human chess player, surely that would prove machine intelligence, right?

Deep Blue vs Garry Kasparov chess match
The Epic Showdown:
  • 1996 First Match: Kasparov wins 4-2 against Deep Blue's predecessor "Deep Thought"
  • 1997 Rematch: Improved Deep Blue defeats Kasparov 3.5-2.5
  • Historic Moment: First time a machine beat a human world champion at chess
  • Kasparov's Quote: "I felt human-level intelligence across the room"
Reality Check: No human today can beat the best chess machines. What seemed impossible became routine in just a few years!

But here's where our story gets interesting - instead of celebrating machine intelligence, critics immediately said: "That's not real AI, it's just brute force search!" The goalposts had officially started moving.

"If It Works, It's Not AI" - The Moving Goalpost Problem

Here's one of the most important concepts in AI history. This phenomenon explains why AI researchers joke they'll "never be out of jobs!"

The Cycle of AI Denial:
  • Step 1: "Machines will never be able to [X]"
  • Step 2: AI achieves [X]
  • Step 3: "Well, that's not REAL intelligence, it's just [algorithm/brute force/pattern matching]"
  • Step 4: Focus shifts to new impossible task [Y]
Drew McDermott's Airplane Analogy: AI researcher Drew McDermott argued this was like saying an airplane isn't really flying because it doesn't flap wings like a bird. Different methods, same result!

This ensures that AI always appears to be just beyond our current capabilities, no matter how much we achieve!

The 2000s: Real-World Applications

From Space to Streets

AI Goes to Space: NASA's Pioneering Work

Deep Space 1 Mission (1998) 🚀

Deep Space 1 spacecraft

1998

  • NASA launched the Remote Agent system!
  • Could diagnose and repair spacecraft faults
  • Successfully fixed simulated problems
  • Operated millions of miles from Earth
  • Proved AI could work in extreme conditions

Mars Rover Intelligence 🤖

AI planning system for Mars rovers

Early Mars rovers were like remote-controlled toys - every action had to be planned on Earth!

  • 20-minute communication delay to Mars
  • Rovers sat idle when obstacles appeared
  • AI planner developed for autonomous operation
  • Eventually adopted for regular use
Success Story: Despite initial hesitation from operations teams, the AI planning system proved its worth and became standard!

The DARPA Grand Challenge: Autonomous Driving Pioneer

2005 Picture this: A 132-mile race through the Navajo desert with no human drivers allowed. This was the moment autonomous vehicles proved they could work in the real world!

The Challenge: Complete a long desert course entirely autonomously - no human control whatsoever!
Stanley - Winner of DARPA Grand Challenge

Stanley (Winner) - Stanford

Sandstorm - Carnegie Mellon's entry

Sandstorm (2nd Place) - CMU

  • Winner: Stanford's "Stanley" led by Sebastian Thrun (using probabilistic reasoning)
  • Expected Winner: Carnegie Mellon (had long history in self-driving cars)
  • Plot Twist: CMU's "Highlander" failed due to engine problems
  • Legacy Impact: Thrun joined Google, contributing to modern self-driving technology
Ripple Effect: This challenge led directly to the self-driving car technology we see in Tesla and other modern vehicles today!

IBM Watson: AI Becomes a Game Show Champion

2010s If chess was AI's first major victory, then Jeopardy! was its coming-of-age party. This time, AI had to understand natural language, context, and even wordplay!

IBM Watson on Jeopardy defeating human champions
Watson's Challenge: Answer complex questions quickly while competing against human champions Ken Jennings and Brad Rutter

Unlike chess, which is pure logic, Jeopardy! required Watson to:

  • Understand natural language and word games
  • Process vast amounts of knowledge instantly
  • Deal with ambiguity and context
  • Make strategic decisions about wagering
Cultural Moment: Watson's victory showcased AI's advancement in natural language processing and knowledge retrieval - skills much closer to human-like intelligence than chess playing.

This victory demonstrated that AI was moving beyond games into areas that required human-like language understanding and reasoning!

The Present Revolution

Deep Learning Changes Everything

The Three Ages of AI: A Historical Perspective

AI's journey can be understood through three distinct eras, each with its own dominant approach:

Age 1: Search and Early Neural Networks (1950s-1980s)

Focus on goal achievement through search algorithms and function representation through neural networks. Neural networks faced limitations due to computational constraints and reproducibility issues.

Age 2: Logic and Symbolic AI (1980s-1990s)

For about 30 years, logic-based or symbolic AI dominated, using combinatorial algorithms and rule-based systems.

Age 3: Probabilistic AI (Late 1990s-Early 2010s)

The rise of probabilistic AI, with Judea Pearl's groundbreaking work on Bayesian networks earning him a Turing Award.

Age 4: The Deep Learning Revolution (2010s-Present): Neural networks made a spectacular comeback and now dominate the field! Those "failed" networks from the 1980s became the foundation of modern AI.

The Modern AI Revolution: Key Breakthroughs

AlphaGo's Historic Victory 🎯

AlphaGo defeating Lee Sedol at Go

DeepMind's AlphaGo defeated top Go player Lee Sedol, discovering novel strategies that even surprised Go masters!

  • Go was thought to be decades away from AI mastery
  • More complex than chess (more possible positions than atoms in universe)
  • AI developed creative new strategies
  • Showed intuition-like decision making

Computer Vision Revolution 👁️

Object recognition error rates plummeted thanks to AlexNet and deep learning breakthroughs!

  • AlexNet: Developed by Alex Krizhevsky (Geoffrey Hinton's student)
  • GPU Power: Neural networks + graphics cards = breakthrough
  • Human Performance: AI now surpasses humans on certain datasets
  • Atari Games: Single algorithm mastered multiple games
Geoffrey Hinton's Persistence: He never gave up on neural networks during the "winter years" - his perseverance led to the deep learning revolution!

The Perfect Storm: Why AI Succeeded Now

You might wonder - why did AI suddenly explode in the 2010s?

The Three Pillars of Modern AI Success:
  • 💡 Algorithms: Many fundamental algorithms were actually developed in the 1990s - they just needed better conditions
  • ⚡ Compute Power: GPUs (graphics cards) provided massive parallel processing power needed for neural networks
  • 📊 Data: The internet age provided vast datasets necessary for training complex AI models
Perfect Timing!

AI Magic: What Seemed Impossible Yesterday

Today's AI can do things that would have seemed like pure magic just a decade ago. Let me show you some mind-blowing applications that are now routine:

Novel AI Capabilities That Amaze Us:
  • 🎨 Style Transfer: Combine the content of one image with the artistic style of another
  • ✏️ Doodle to Painting: Transform simple sketches into detailed, realistic artwork
  • 🌈 Image Colorization: Automatically add realistic color to black and white photographs
  • 📝 Image Captioning: Generate accurate, descriptive captions for any image

Each of these applications seemed impossible a few years ago, yet now they're available as smartphone apps. This rapid progression shows how quickly AI capabilities are advancing.

Reality Check: What AI Still Can't Do

Despite all the amazing progress, AI is definitely "not solved yet." Let me give you some perspective on current limitations and realistic concerns:

RoboCup robot soccer demonstrating current AI limitations
RoboCup Example: Robot soccer shows how much work remains in basic physical intelligence
  • 🚫 Killer Robots: Fears of AI enslaving humans are unrealistic science fiction
  • 💼 Job Displacement: More realistic concern - certain jobs (like truck driving) may be automated
  • 🏃 Robot Locomotion: Robots still struggle with basic movement and balance
  • 👁️ Perception: Understanding 3D environments remains challenging
  • 🎯 Strategy: Complex real-world planning and adaptation need work
Balanced Perspective: While AI will displace some jobs, it's also creating entirely new career paths and industries!

The key is maintaining realistic expectations while appreciating genuine progress. We're living through a remarkable period of AI advancement, but there's still a vast frontier of research ahead!

Your AI History Journey: Complete! 🎓

This is nearly 80 years of AI history, from room-sized computers to modern neural networks that surpass human performance.

Key Patterns:
  • 🎢 Cyclical Progress: AI advances in waves - winters and springs, setbacks and breakthroughs
  • 🎯 Moving Goalposts: "If it works, it's not AI" - success paradoxically diminishes perceived intelligence
  • ⏰ Timing Matters: Good ideas often need to wait for supporting technology
  • 🔄 Rediscovery: "Failed" approaches often become tomorrow's breakthroughs
  • 📏 Realistic Expectations: Overpromising leads to winters; steady progress builds trust

Questions & Discussion

What fascinating aspect of this AI journey would you like to explore further? 🤔

Slide 1 of 27