{ "cells": [ { "cell_type": "code", "execution_count": 23, "metadata": { "collapsed": false }, "outputs": [ { "data": { "text/html": [ "
\n", " | Show Number | \n", "Air Date | \n", "Round | \n", "Category | \n", "Value | \n", "Question | \n", "Answer | \n", "
---|---|---|---|---|---|---|---|
0 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$200 | \n", "For the last 8 years of his life, Galileo was ... | \n", "Copernicus | \n", "
1 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$200 | \n", "No. 2: 1912 Olympian; football star at Carlisl... | \n", "Jim Thorpe | \n", "
2 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EVERYBODY TALKS ABOUT IT... | \n", "$200 | \n", "The city of Yuma in this state has a record av... | \n", "Arizona | \n", "
3 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$200 | \n", "In 1963, live on \"The Art Linkletter Show\", th... | \n", "McDonald's | \n", "
4 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$200 | \n", "Signer of the Dec. of Indep., framer of the Co... | \n", "John Adams | \n", "
5 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$200 | \n", "In the title of an Aesop fable, this insect sh... | \n", "the ant | \n", "
6 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$400 | \n", "Built in 312 B.C. to link Rome & the South of ... | \n", "the Appian Way | \n", "
7 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$400 | \n", "No. 8: 30 steals for the Birmingham Barons; 2,... | \n", "Michael Jordan | \n", "
8 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EVERYBODY TALKS ABOUT IT... | \n", "$400 | \n", "In the winter of 1971-72, a record 1,122 inche... | \n", "Washington | \n", "
9 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$400 | \n", "This housewares store was named for the packag... | \n", "Crate & Barrel | \n", "
10 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$400 | \n", "\"And away we go\" | \n", "Jackie Gleason | \n", "
11 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$400 | \n", "Cows regurgitate this from the first stomach t... | \n", "the cud | \n", "
12 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$600 | \n", "In 1000 Rajaraja I of the Cholas battled to ta... | \n", "Ceylon (or Sri Lanka) | \n", "
13 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$600 | \n", "No. 1: Lettered in hoops, football & lacrosse ... | \n", "Jim Brown | \n", "
14 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EVERYBODY TALKS ABOUT IT... | \n", "$600 | \n", "On June 28, 1994 the nat'l weather service beg... | \n", "the UV index | \n", "
15 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$600 | \n", "This company's Accutron watch, introduced in 1... | \n", "Bulova | \n", "
16 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$600 | \n", "Outlaw: \"Murdered by a traitor and a coward wh... | \n", "Jesse James | \n", "
17 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$600 | \n", "A small demon, or a mischievous child (who mig... | \n", "imp | \n", "
18 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$800 | \n", "Karl led the first of these Marxist organizati... | \n", "the International | \n", "
19 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$800 | \n", "No. 10: FB/LB for Columbia U. in the 1920s; MV... | \n", "(Lou) Gehrig | \n", "
20 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EVERYBODY TALKS ABOUT IT... | \n", "$800 | \n", "Africa's lowest temperature was 11 degrees bel... | \n", "Morocco | \n", "
21 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$800 | \n", "Edward Teller & this man partnered in 1898 to ... | \n", "(Paul) Bonwit | \n", "
22 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$2,000 | \n", "1939 Oscar winner: \"...you are a credit to you... | \n", "Hattie McDaniel (for her role in Gone with the... | \n", "
23 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$800 | \n", "In geologic time one of these, shorter than an... | \n", "era | \n", "
24 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$1000 | \n", "This Asian political party was founded in 1885... | \n", "the Congress Party | \n", "
25 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$1000 | \n", "No. 5: Only center to lead the NBA in assists;... | \n", "(Wilt) Chamberlain | \n", "
26 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$1000 | \n", "The Kirschner brothers, Don & Bill, named this... | \n", "K2 | \n", "
27 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$1000 | \n", "Revolutionary War hero: \"His spirit is in Verm... | \n", "Ethan Allen | \n", "
28 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$1000 | \n", "A single layer of paper, or to perform one's c... | \n", "ply | \n", "
29 | \n", "4680 | \n", "2004-12-31 | \n", "Double Jeopardy! | \n", "DR. SEUSS AT THE MULTIPLEX | \n", "$400 | \n", "<a href=\"http://www.j-archive.com/media/2004-1... | \n", "Horton | \n", "
... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "
19969 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "AMERICAN HISTORY | \n", "$1200 | \n", "In 1960 the last of these locomotives was reti... | \n", "steam engines | \n", "
19970 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "MIND YOUR SHAKESPEARE \"P\"s & \"Q\"s | \n", "$1200 | \n", "Kate: \"if I be waspish, best beware my sting\";... | \n", "Petruchio | \n", "
19971 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ALMA MATERS | \n", "$1,500 | \n", "This private college in Northern California bo... | \n", "Stanford University | \n", "
19972 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ACTRESSES | \n", "$1200 | \n", "She voiced Princess Pea in \"The Tale of Desper... | \n", "Emma Watson | \n", "
19973 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "2-LETTER WORDS | \n", "$1200 | \n", "It's the name of the long-awaited new White Ho... | \n", "Bo | \n", "
19974 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ANGELS & DEMONS | \n", "$1200 | \n", "Langdon in \"Angels & Demons\" is looking for <a... | \n", "an antimatter bomb | \n", "
19975 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "AMERICAN HISTORY | \n", "$1600 | \n", "In the 1600s most of New York State was occupi... | \n", "the Iroquois | \n", "
19976 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "MIND YOUR SHAKESPEARE \"P\"s & \"Q\"s | \n", "$1600 | \n", "Marina's dad (need a hint? he rules Tyre) | \n", "Pericles | \n", "
19977 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ALMA MATERS | \n", "$1600 | \n", "Presidential kids are welcome at this New Orle... | \n", "Tulane | \n", "
19978 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ACTRESSES | \n", "$1600 | \n", "She didn't vamp it up & did a bella job as Em ... | \n", "Kristen Stewart | \n", "
19979 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "2-LETTER WORDS | \n", "$1600 | \n", "Third syllable intoned by the giant who smells... | \n", "fo | \n", "
19980 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ANGELS & DEMONS | \n", "$1600 | \n", "Much of \"Angels & Demons\" takes place at one o... | \n", "a conclave | \n", "
19981 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "AMERICAN HISTORY | \n", "$1,200 | \n", "In 1899 Secretary of State John Hay proclaimed... | \n", "open-door policy | \n", "
19982 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "MIND YOUR SHAKESPEARE \"P\"s & \"Q\"s | \n", "$2000 | \n", "Fruity surname of Peter in \"A Midsummer Night'... | \n", "Quince | \n", "
19983 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ALMA MATERS | \n", "$2000 | \n", "Quincy Jones, Kevin Eubanks & Branford Marsali... | \n", "Berklee | \n", "
19984 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ACTRESSES | \n", "$2000 | \n", "In 2009 she returned to being \"Fast & Furious\"... | \n", "Michelle Rodriguez | \n", "
19985 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "2-LETTER WORDS | \n", "$2000 | \n", "The book of Genesis says this ancient city \"of... | \n", "Ur | \n", "
19986 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ANGELS & DEMONS | \n", "$2000 | \n", "\"Habakkuk and the Angel\" is one of a series of... | \n", "Bernini | \n", "
19987 | \n", "5694 | \n", "2009-05-14 | \n", "Final Jeopardy! | \n", "SCIENCE TERMS | \n", "None | \n", "In medieval England, it meant the smallest uni... | \n", "atom | \n", "
19988 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "U.S. GEOGRAPHY | \n", "$100 | \n", "This Texas city is the largest in the U.S. to ... | \n", "Houston (Lee Brown) | \n", "
19989 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "POP MUSIC PAIRINGS | \n", "$100 | \n", "...& the Crickets | \n", "Buddy Holly | \n", "
19990 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "HISTORIC PEOPLE | \n", "$100 | \n", "In the 990s this son of Erik the Red brought C... | \n", "Leif Ericson | \n", "
19991 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "1998 QUOTATIONS | \n", "$100 | \n", "Concerning a failed Windows 98 demonstration, ... | \n", "Bill Gates | \n", "
19992 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "LLAMA-RAMA | \n", "$100 | \n", "This llama product is used to make hats, blank... | \n", "Wool | \n", "
19993 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "DING DONG | \n", "$100 | \n", "In 1967 this company introduced its chocolate-... | \n", "Hostess | \n", "
19994 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "U.S. GEOGRAPHY | \n", "$200 | \n", "Of 8, 12 or 18, the number of U.S. states that... | \n", "18 | \n", "
19995 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "POP MUSIC PAIRINGS | \n", "$200 | \n", "...& the New Power Generation | \n", "Prince | \n", "
19996 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "HISTORIC PEOPLE | \n", "$200 | \n", "In 1589 he was appointed professor of mathemat... | \n", "Galileo | \n", "
19997 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "1998 QUOTATIONS | \n", "$200 | \n", "Before the grand jury she said, \"I'm really so... | \n", "Monica Lewinsky | \n", "
19998 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "LLAMA-RAMA | \n", "$200 | \n", "Llamas are the heftiest South American members... | \n", "Camels | \n", "
19999 rows × 7 columns
\n", "\n", " | Show Number | \n", "Air Date | \n", "Round | \n", "Category | \n", "Value | \n", "Question | \n", "Answer | \n", "clean_question | \n", "clean_answer | \n", "clean_value | \n", "
---|---|---|---|---|---|---|---|---|---|---|
0 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$200 | \n", "For the last 8 years of his life, Galileo was ... | \n", "Copernicus | \n", "for the last 8 years of his life galileo was u... | \n", "copernicus | \n", "200 | \n", "
1 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$200 | \n", "No. 2: 1912 Olympian; football star at Carlisl... | \n", "Jim Thorpe | \n", "no 2 1912 olympian football star at carlisle i... | \n", "jim thorpe | \n", "200 | \n", "
2 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EVERYBODY TALKS ABOUT IT... | \n", "$200 | \n", "The city of Yuma in this state has a record av... | \n", "Arizona | \n", "the city of yuma in this state has a record av... | \n", "arizona | \n", "200 | \n", "
3 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$200 | \n", "In 1963, live on \"The Art Linkletter Show\", th... | \n", "McDonald's | \n", "in 1963 live on the art linkletter show this c... | \n", "mcdonalds | \n", "200 | \n", "
4 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$200 | \n", "Signer of the Dec. of Indep., framer of the Co... | \n", "John Adams | \n", "signer of the dec of indep framer of the const... | \n", "john adams | \n", "200 | \n", "
5 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$200 | \n", "In the title of an Aesop fable, this insect sh... | \n", "the ant | \n", "in the title of an aesop fable this insect sha... | \n", "the ant | \n", "200 | \n", "
6 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$400 | \n", "Built in 312 B.C. to link Rome & the South of ... | \n", "the Appian Way | \n", "built in 312 bc to link rome the south of ita... | \n", "the appian way | \n", "400 | \n", "
7 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$400 | \n", "No. 8: 30 steals for the Birmingham Barons; 2,... | \n", "Michael Jordan | \n", "no 8 30 steals for the birmingham barons 2306 ... | \n", "michael jordan | \n", "400 | \n", "
8 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EVERYBODY TALKS ABOUT IT... | \n", "$400 | \n", "In the winter of 1971-72, a record 1,122 inche... | \n", "Washington | \n", "in the winter of 197172 a record 1122 inches o... | \n", "washington | \n", "400 | \n", "
9 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$400 | \n", "This housewares store was named for the packag... | \n", "Crate & Barrel | \n", "this housewares store was named for the packag... | \n", "crate barrel | \n", "400 | \n", "
10 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$400 | \n", "\"And away we go\" | \n", "Jackie Gleason | \n", "and away we go | \n", "jackie gleason | \n", "400 | \n", "
11 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$400 | \n", "Cows regurgitate this from the first stomach t... | \n", "the cud | \n", "cows regurgitate this from the first stomach t... | \n", "the cud | \n", "400 | \n", "
12 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$600 | \n", "In 1000 Rajaraja I of the Cholas battled to ta... | \n", "Ceylon (or Sri Lanka) | \n", "in 1000 rajaraja i of the cholas battled to ta... | \n", "ceylon or sri lanka | \n", "600 | \n", "
13 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$600 | \n", "No. 1: Lettered in hoops, football & lacrosse ... | \n", "Jim Brown | \n", "no 1 lettered in hoops football lacrosse at s... | \n", "jim brown | \n", "600 | \n", "
14 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EVERYBODY TALKS ABOUT IT... | \n", "$600 | \n", "On June 28, 1994 the nat'l weather service beg... | \n", "the UV index | \n", "on june 28 1994 the natl weather service began... | \n", "the uv index | \n", "600 | \n", "
15 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$600 | \n", "This company's Accutron watch, introduced in 1... | \n", "Bulova | \n", "this companys accutron watch introduced in 196... | \n", "bulova | \n", "600 | \n", "
16 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$600 | \n", "Outlaw: \"Murdered by a traitor and a coward wh... | \n", "Jesse James | \n", "outlaw murdered by a traitor and a coward whos... | \n", "jesse james | \n", "600 | \n", "
17 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$600 | \n", "A small demon, or a mischievous child (who mig... | \n", "imp | \n", "a small demon or a mischievous child who might... | \n", "imp | \n", "600 | \n", "
18 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$800 | \n", "Karl led the first of these Marxist organizati... | \n", "the International | \n", "karl led the first of these marxist organizati... | \n", "the international | \n", "800 | \n", "
19 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$800 | \n", "No. 10: FB/LB for Columbia U. in the 1920s; MV... | \n", "(Lou) Gehrig | \n", "no 10 fblb for columbia u in the 1920s mvp for... | \n", "lou gehrig | \n", "800 | \n", "
20 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EVERYBODY TALKS ABOUT IT... | \n", "$800 | \n", "Africa's lowest temperature was 11 degrees bel... | \n", "Morocco | \n", "africas lowest temperature was 11 degrees belo... | \n", "morocco | \n", "800 | \n", "
21 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$800 | \n", "Edward Teller & this man partnered in 1898 to ... | \n", "(Paul) Bonwit | \n", "edward teller this man partnered in 1898 to s... | \n", "paul bonwit | \n", "800 | \n", "
22 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$2,000 | \n", "1939 Oscar winner: \"...you are a credit to you... | \n", "Hattie McDaniel (for her role in Gone with the... | \n", "1939 oscar winner you are a credit to your cra... | \n", "hattie mcdaniel for her role in gone with the ... | \n", "2000 | \n", "
23 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$800 | \n", "In geologic time one of these, shorter than an... | \n", "era | \n", "in geologic time one of these shorter than an ... | \n", "era | \n", "800 | \n", "
24 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "HISTORY | \n", "$1000 | \n", "This Asian political party was founded in 1885... | \n", "the Congress Party | \n", "this asian political party was founded in 1885... | \n", "the congress party | \n", "1000 | \n", "
25 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "ESPN's TOP 10 ALL-TIME ATHLETES | \n", "$1000 | \n", "No. 5: Only center to lead the NBA in assists;... | \n", "(Wilt) Chamberlain | \n", "no 5 only center to lead the nba in assists tr... | \n", "wilt chamberlain | \n", "1000 | \n", "
26 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "THE COMPANY LINE | \n", "$1000 | \n", "The Kirschner brothers, Don & Bill, named this... | \n", "K2 | \n", "the kirschner brothers don bill named this sk... | \n", "k2 | \n", "1000 | \n", "
27 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "EPITAPHS & TRIBUTES | \n", "$1000 | \n", "Revolutionary War hero: \"His spirit is in Verm... | \n", "Ethan Allen | \n", "revolutionary war hero his spirit is in vermon... | \n", "ethan allen | \n", "1000 | \n", "
28 | \n", "4680 | \n", "2004-12-31 | \n", "Jeopardy! | \n", "3-LETTER WORDS | \n", "$1000 | \n", "A single layer of paper, or to perform one's c... | \n", "ply | \n", "a single layer of paper or to perform ones cra... | \n", "ply | \n", "1000 | \n", "
29 | \n", "4680 | \n", "2004-12-31 | \n", "Double Jeopardy! | \n", "DR. SEUSS AT THE MULTIPLEX | \n", "$400 | \n", "<a href=\"http://www.j-archive.com/media/2004-1... | \n", "Horton | \n", "a hrefhttpwwwjarchivecommedia20041231dj23mp3be... | \n", "horton | \n", "400 | \n", "
... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "
19969 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "AMERICAN HISTORY | \n", "$1200 | \n", "In 1960 the last of these locomotives was reti... | \n", "steam engines | \n", "in 1960 the last of these locomotives was reti... | \n", "steam engines | \n", "1200 | \n", "
19970 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "MIND YOUR SHAKESPEARE \"P\"s & \"Q\"s | \n", "$1200 | \n", "Kate: \"if I be waspish, best beware my sting\";... | \n", "Petruchio | \n", "kate if i be waspish best beware my sting his ... | \n", "petruchio | \n", "1200 | \n", "
19971 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ALMA MATERS | \n", "$1,500 | \n", "This private college in Northern California bo... | \n", "Stanford University | \n", "this private college in northern california bo... | \n", "stanford university | \n", "1500 | \n", "
19972 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ACTRESSES | \n", "$1200 | \n", "She voiced Princess Pea in \"The Tale of Desper... | \n", "Emma Watson | \n", "she voiced princess pea in the tale of despere... | \n", "emma watson | \n", "1200 | \n", "
19973 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "2-LETTER WORDS | \n", "$1200 | \n", "It's the name of the long-awaited new White Ho... | \n", "Bo | \n", "its the name of the longawaited new white hous... | \n", "bo | \n", "1200 | \n", "
19974 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ANGELS & DEMONS | \n", "$1200 | \n", "Langdon in \"Angels & Demons\" is looking for <a... | \n", "an antimatter bomb | \n", "langdon in angels demons is looking for a hre... | \n", "an antimatter bomb | \n", "1200 | \n", "
19975 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "AMERICAN HISTORY | \n", "$1600 | \n", "In the 1600s most of New York State was occupi... | \n", "the Iroquois | \n", "in the 1600s most of new york state was occupi... | \n", "the iroquois | \n", "1600 | \n", "
19976 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "MIND YOUR SHAKESPEARE \"P\"s & \"Q\"s | \n", "$1600 | \n", "Marina's dad (need a hint? he rules Tyre) | \n", "Pericles | \n", "marinas dad need a hint he rules tyre | \n", "pericles | \n", "1600 | \n", "
19977 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ALMA MATERS | \n", "$1600 | \n", "Presidential kids are welcome at this New Orle... | \n", "Tulane | \n", "presidential kids are welcome at this new orle... | \n", "tulane | \n", "1600 | \n", "
19978 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ACTRESSES | \n", "$1600 | \n", "She didn't vamp it up & did a bella job as Em ... | \n", "Kristen Stewart | \n", "she didnt vamp it up did a bella job as em in... | \n", "kristen stewart | \n", "1600 | \n", "
19979 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "2-LETTER WORDS | \n", "$1600 | \n", "Third syllable intoned by the giant who smells... | \n", "fo | \n", "third syllable intoned by the giant who smells... | \n", "fo | \n", "1600 | \n", "
19980 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ANGELS & DEMONS | \n", "$1600 | \n", "Much of \"Angels & Demons\" takes place at one o... | \n", "a conclave | \n", "much of angels demons takes place at one of a... | \n", "a conclave | \n", "1600 | \n", "
19981 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "AMERICAN HISTORY | \n", "$1,200 | \n", "In 1899 Secretary of State John Hay proclaimed... | \n", "open-door policy | \n", "in 1899 secretary of state john hay proclaimed... | \n", "opendoor policy | \n", "1200 | \n", "
19982 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "MIND YOUR SHAKESPEARE \"P\"s & \"Q\"s | \n", "$2000 | \n", "Fruity surname of Peter in \"A Midsummer Night'... | \n", "Quince | \n", "fruity surname of peter in a midsummer nights ... | \n", "quince | \n", "2000 | \n", "
19983 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ALMA MATERS | \n", "$2000 | \n", "Quincy Jones, Kevin Eubanks & Branford Marsali... | \n", "Berklee | \n", "quincy jones kevin eubanks branford marsalis ... | \n", "berklee | \n", "2000 | \n", "
19984 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ACTRESSES | \n", "$2000 | \n", "In 2009 she returned to being \"Fast & Furious\"... | \n", "Michelle Rodriguez | \n", "in 2009 she returned to being fast furious as... | \n", "michelle rodriguez | \n", "2000 | \n", "
19985 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "2-LETTER WORDS | \n", "$2000 | \n", "The book of Genesis says this ancient city \"of... | \n", "Ur | \n", "the book of genesis says this ancient city of ... | \n", "ur | \n", "2000 | \n", "
19986 | \n", "5694 | \n", "2009-05-14 | \n", "Double Jeopardy! | \n", "ANGELS & DEMONS | \n", "$2000 | \n", "\"Habakkuk and the Angel\" is one of a series of... | \n", "Bernini | \n", "habakkuk and the angel is one of a series of a... | \n", "bernini | \n", "2000 | \n", "
19987 | \n", "5694 | \n", "2009-05-14 | \n", "Final Jeopardy! | \n", "SCIENCE TERMS | \n", "None | \n", "In medieval England, it meant the smallest uni... | \n", "atom | \n", "in medieval england it meant the smallest unit... | \n", "atom | \n", "0 | \n", "
19988 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "U.S. GEOGRAPHY | \n", "$100 | \n", "This Texas city is the largest in the U.S. to ... | \n", "Houston (Lee Brown) | \n", "this texas city is the largest in the us to ha... | \n", "houston lee brown | \n", "100 | \n", "
19989 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "POP MUSIC PAIRINGS | \n", "$100 | \n", "...& the Crickets | \n", "Buddy Holly | \n", "the crickets | \n", "buddy holly | \n", "100 | \n", "
19990 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "HISTORIC PEOPLE | \n", "$100 | \n", "In the 990s this son of Erik the Red brought C... | \n", "Leif Ericson | \n", "in the 990s this son of erik the red brought c... | \n", "leif ericson | \n", "100 | \n", "
19991 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "1998 QUOTATIONS | \n", "$100 | \n", "Concerning a failed Windows 98 demonstration, ... | \n", "Bill Gates | \n", "concerning a failed windows 98 demonstration h... | \n", "bill gates | \n", "100 | \n", "
19992 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "LLAMA-RAMA | \n", "$100 | \n", "This llama product is used to make hats, blank... | \n", "Wool | \n", "this llama product is used to make hats blanke... | \n", "wool | \n", "100 | \n", "
19993 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "DING DONG | \n", "$100 | \n", "In 1967 this company introduced its chocolate-... | \n", "Hostess | \n", "in 1967 this company introduced its chocolatec... | \n", "hostess | \n", "100 | \n", "
19994 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "U.S. GEOGRAPHY | \n", "$200 | \n", "Of 8, 12 or 18, the number of U.S. states that... | \n", "18 | \n", "of 8 12 or 18 the number of us states that tou... | \n", "18 | \n", "200 | \n", "
19995 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "POP MUSIC PAIRINGS | \n", "$200 | \n", "...& the New Power Generation | \n", "Prince | \n", "the new power generation | \n", "prince | \n", "200 | \n", "
19996 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "HISTORIC PEOPLE | \n", "$200 | \n", "In 1589 he was appointed professor of mathemat... | \n", "Galileo | \n", "in 1589 he was appointed professor of mathemat... | \n", "galileo | \n", "200 | \n", "
19997 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "1998 QUOTATIONS | \n", "$200 | \n", "Before the grand jury she said, \"I'm really so... | \n", "Monica Lewinsky | \n", "before the grand jury she said im really sorry... | \n", "monica lewinsky | \n", "200 | \n", "
19998 | \n", "3582 | \n", "2000-03-14 | \n", "Jeopardy! | \n", "LLAMA-RAMA | \n", "$200 | \n", "Llamas are the heftiest South American members... | \n", "Camels | \n", "llamas are the heftiest south american members... | \n", "camels | \n", "200 | \n", "
19999 rows × 10 columns
\n", "" ], "text/plain": [ " Show Number Air Date Round \\\n", "0 4680 2004-12-31 Jeopardy! \n", "1 4680 2004-12-31 Jeopardy! \n", "2 4680 2004-12-31 Jeopardy! \n", "3 4680 2004-12-31 Jeopardy! \n", "4 4680 2004-12-31 Jeopardy! \n", "5 4680 2004-12-31 Jeopardy! \n", "6 4680 2004-12-31 Jeopardy! \n", "7 4680 2004-12-31 Jeopardy! \n", "8 4680 2004-12-31 Jeopardy! \n", "9 4680 2004-12-31 Jeopardy! \n", "10 4680 2004-12-31 Jeopardy! \n", "11 4680 2004-12-31 Jeopardy! \n", "12 4680 2004-12-31 Jeopardy! \n", "13 4680 2004-12-31 Jeopardy! \n", "14 4680 2004-12-31 Jeopardy! \n", "15 4680 2004-12-31 Jeopardy! \n", "16 4680 2004-12-31 Jeopardy! \n", "17 4680 2004-12-31 Jeopardy! \n", "18 4680 2004-12-31 Jeopardy! \n", "19 4680 2004-12-31 Jeopardy! \n", "20 4680 2004-12-31 Jeopardy! \n", "21 4680 2004-12-31 Jeopardy! \n", "22 4680 2004-12-31 Jeopardy! \n", "23 4680 2004-12-31 Jeopardy! \n", "24 4680 2004-12-31 Jeopardy! \n", "25 4680 2004-12-31 Jeopardy! \n", "26 4680 2004-12-31 Jeopardy! \n", "27 4680 2004-12-31 Jeopardy! \n", "28 4680 2004-12-31 Jeopardy! \n", "29 4680 2004-12-31 Double Jeopardy! \n", "... ... ... ... \n", "19969 5694 2009-05-14 Double Jeopardy! \n", "19970 5694 2009-05-14 Double Jeopardy! \n", "19971 5694 2009-05-14 Double Jeopardy! \n", "19972 5694 2009-05-14 Double Jeopardy! \n", "19973 5694 2009-05-14 Double Jeopardy! \n", "19974 5694 2009-05-14 Double Jeopardy! \n", "19975 5694 2009-05-14 Double Jeopardy! \n", "19976 5694 2009-05-14 Double Jeopardy! \n", "19977 5694 2009-05-14 Double Jeopardy! \n", "19978 5694 2009-05-14 Double Jeopardy! \n", "19979 5694 2009-05-14 Double Jeopardy! \n", "19980 5694 2009-05-14 Double Jeopardy! \n", "19981 5694 2009-05-14 Double Jeopardy! \n", "19982 5694 2009-05-14 Double Jeopardy! \n", "19983 5694 2009-05-14 Double Jeopardy! \n", "19984 5694 2009-05-14 Double Jeopardy! \n", "19985 5694 2009-05-14 Double Jeopardy! \n", "19986 5694 2009-05-14 Double Jeopardy! \n", "19987 5694 2009-05-14 Final Jeopardy! \n", "19988 3582 2000-03-14 Jeopardy! \n", "19989 3582 2000-03-14 Jeopardy! \n", "19990 3582 2000-03-14 Jeopardy! \n", "19991 3582 2000-03-14 Jeopardy! \n", "19992 3582 2000-03-14 Jeopardy! \n", "19993 3582 2000-03-14 Jeopardy! \n", "19994 3582 2000-03-14 Jeopardy! \n", "19995 3582 2000-03-14 Jeopardy! \n", "19996 3582 2000-03-14 Jeopardy! \n", "19997 3582 2000-03-14 Jeopardy! \n", "19998 3582 2000-03-14 Jeopardy! \n", "\n", " Category Value \\\n", "0 HISTORY $200 \n", "1 ESPN's TOP 10 ALL-TIME ATHLETES $200 \n", "2 EVERYBODY TALKS ABOUT IT... $200 \n", "3 THE COMPANY LINE $200 \n", "4 EPITAPHS & TRIBUTES $200 \n", "5 3-LETTER WORDS $200 \n", "6 HISTORY $400 \n", "7 ESPN's TOP 10 ALL-TIME ATHLETES $400 \n", "8 EVERYBODY TALKS ABOUT IT... $400 \n", "9 THE COMPANY LINE $400 \n", "10 EPITAPHS & TRIBUTES $400 \n", "11 3-LETTER WORDS $400 \n", "12 HISTORY $600 \n", "13 ESPN's TOP 10 ALL-TIME ATHLETES $600 \n", "14 EVERYBODY TALKS ABOUT IT... $600 \n", "15 THE COMPANY LINE $600 \n", "16 EPITAPHS & TRIBUTES $600 \n", "17 3-LETTER WORDS $600 \n", "18 HISTORY $800 \n", "19 ESPN's TOP 10 ALL-TIME ATHLETES $800 \n", "20 EVERYBODY TALKS ABOUT IT... $800 \n", "21 THE COMPANY LINE $800 \n", "22 EPITAPHS & TRIBUTES $2,000 \n", "23 3-LETTER WORDS $800 \n", "24 HISTORY $1000 \n", "25 ESPN's TOP 10 ALL-TIME ATHLETES $1000 \n", "26 THE COMPANY LINE $1000 \n", "27 EPITAPHS & TRIBUTES $1000 \n", "28 3-LETTER WORDS $1000 \n", "29 DR. SEUSS AT THE MULTIPLEX $400 \n", "... ... ... \n", "19969 AMERICAN HISTORY $1200 \n", "19970 MIND YOUR SHAKESPEARE \"P\"s & \"Q\"s $1200 \n", "19971 ALMA MATERS $1,500 \n", "19972 ACTRESSES $1200 \n", "19973 2-LETTER WORDS $1200 \n", "19974 ANGELS & DEMONS $1200 \n", "19975 AMERICAN HISTORY $1600 \n", "19976 MIND YOUR SHAKESPEARE \"P\"s & \"Q\"s $1600 \n", "19977 ALMA MATERS $1600 \n", "19978 ACTRESSES $1600 \n", "19979 2-LETTER WORDS $1600 \n", "19980 ANGELS & DEMONS $1600 \n", "19981 AMERICAN HISTORY $1,200 \n", "19982 MIND YOUR SHAKESPEARE \"P\"s & \"Q\"s $2000 \n", "19983 ALMA MATERS $2000 \n", "19984 ACTRESSES $2000 \n", "19985 2-LETTER WORDS $2000 \n", "19986 ANGELS & DEMONS $2000 \n", "19987 SCIENCE TERMS None \n", "19988 U.S. GEOGRAPHY $100 \n", "19989 POP MUSIC PAIRINGS $100 \n", "19990 HISTORIC PEOPLE $100 \n", "19991 1998 QUOTATIONS $100 \n", "19992 LLAMA-RAMA $100 \n", "19993 DING DONG $100 \n", "19994 U.S. GEOGRAPHY $200 \n", "19995 POP MUSIC PAIRINGS $200 \n", "19996 HISTORIC PEOPLE $200 \n", "19997 1998 QUOTATIONS $200 \n", "19998 LLAMA-RAMA $200 \n", "\n", " Question \\\n", "0 For the last 8 years of his life, Galileo was ... \n", "1 No. 2: 1912 Olympian; football star at Carlisl... \n", "2 The city of Yuma in this state has a record av... \n", "3 In 1963, live on \"The Art Linkletter Show\", th... \n", "4 Signer of the Dec. of Indep., framer of the Co... \n", "5 In the title of an Aesop fable, this insect sh... \n", "6 Built in 312 B.C. to link Rome & the South of ... \n", "7 No. 8: 30 steals for the Birmingham Barons; 2,... \n", "8 In the winter of 1971-72, a record 1,122 inche... \n", "9 This housewares store was named for the packag... \n", "10 \"And away we go\" \n", "11 Cows regurgitate this from the first stomach t... \n", "12 In 1000 Rajaraja I of the Cholas battled to ta... \n", "13 No. 1: Lettered in hoops, football & lacrosse ... \n", "14 On June 28, 1994 the nat'l weather service beg... \n", "15 This company's Accutron watch, introduced in 1... \n", "16 Outlaw: \"Murdered by a traitor and a coward wh... \n", "17 A small demon, or a mischievous child (who mig... \n", "18 Karl led the first of these Marxist organizati... \n", "19 No. 10: FB/LB for Columbia U. in the 1920s; MV... \n", "20 Africa's lowest temperature was 11 degrees bel... \n", "21 Edward Teller & this man partnered in 1898 to ... \n", "22 1939 Oscar winner: \"...you are a credit to you... \n", "23 In geologic time one of these, shorter than an... \n", "24 This Asian political party was founded in 1885... \n", "25 No. 5: Only center to lead the NBA in assists;... \n", "26 The Kirschner brothers, Don & Bill, named this... \n", "27 Revolutionary War hero: \"His spirit is in Verm... \n", "28 A single layer of paper, or to perform one's c... \n", "29 5]\n", " match_count = 0\n", " for word in split_question:\n", " if word in terms_used:\n", " match_count += 1\n", " for word in split_question:\n", " terms_used.add(word)\n", " if len(split_question) > 0:\n", " match_count /= len(split_question)\n", " question_overlap.append(match_count)\n", "jeopardy[\"question_overlap\"] = question_overlap\n", "\n", "jeopardy[\"question_overlap\"].mean()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Question overlap\n", "\n", "There is about `70%` overlap between terms in new questions and terms in old questions. This only looks at a small set of questions, and it doesn't look at phrases, it looks at single terms. This makes it relatively insignificant, but it does mean that it's worth looking more into the recycling of questions." ] }, { "cell_type": "code", "execution_count": 62, "metadata": { "collapsed": false }, "outputs": [], "source": [ "def determine_value(row):\n", " value = 0\n", " if row[\"clean_value\"] > 800:\n", " value = 1\n", " return value\n", "\n", "jeopardy[\"high_value\"] = jeopardy.apply(determine_value, axis=1)" ] }, { "cell_type": "code", "execution_count": 84, "metadata": { "collapsed": false }, "outputs": [ { "data": { "text/plain": [ "[(1, 2), (0, 1), (1, 0), (0, 1), (1, 1)]" ] }, "execution_count": 84, "metadata": {}, "output_type": "execute_result" } ], "source": [ "def count_usage(term):\n", " low_count = 0\n", " high_count = 0\n", " for i, row in jeopardy.iterrows():\n", " if term in row[\"clean_question\"].split(\" \"):\n", " if row[\"high_value\"] == 1:\n", " high_count += 1\n", " else:\n", " low_count += 1\n", " return high_count, low_count\n", "\n", "comparison_terms = list(terms_used)[:5]\n", "observed_expected = []\n", "for term in comparison_terms:\n", " observed_expected.append(count_usage(term))\n", "\n", "observed_expected" ] }, { "cell_type": "code", "execution_count": 86, "metadata": { "collapsed": false }, "outputs": [ { "data": { "text/plain": [ "[(0.031881167234403623, 0.85828871632352932),\n", " (0.40196284612688399, 0.52607729857054686),\n", " (2.4877921171956752, 0.11473257634454047),\n", " (0.40196284612688399, 0.52607729857054686),\n", " (0.44487748166127949, 0.50477764875459963)]" ] }, "execution_count": 86, "metadata": {}, "output_type": "execute_result" } ], "source": [ "from scipy.stats import chisquare\n", "import numpy as np\n", "\n", "high_value_count = jeopardy[jeopardy[\"high_value\"] == 1].shape[0]\n", "low_value_count = jeopardy[jeopardy[\"high_value\"] == 0].shape[0]\n", "\n", "chi_squared = []\n", "for obs in observed_expected:\n", " total = sum(obs)\n", " total_prop = total / jeopardy.shape[0]\n", " high_value_exp = total_prop * high_value_count\n", " low_value_exp = total_prop * low_value_count\n", " \n", " observed = np.array([obs[0], obs[1]])\n", " expected = np.array([high_value_exp, low_value_exp])\n", " chi_squared.append(chisquare(observed, expected))\n", "\n", "chi_squared" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Chi-squared results\n", "\n", "None of the terms had a significant difference in usage between high value and low value rows. Additionally, the frequencies were all lower than `5`, so the chi-squared test isn't as valid. It would be better to run this test with only terms that have higher frequencies." ] } ], "metadata": { "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.4.2" } }, "nbformat": 4, "nbformat_minor": 0 }