Sentiment Classification - Mini Project 1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Sentiment Classification & How To \"Frame Problems\" for a Neural Network\n",
    "\n",
    "by Andrew Trask\n",
    "\n",
    "- **Twitter**: @iamtrask\n",
    "- **Blog**: http://iamtrask.github.io"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### What You Should Already Know\n",
    "\n",
    "- neural networks, forward and back-propagation\n",
    "- stochastic gradient descent\n",
    "- mean squared error\n",
    "- and train/test splits\n",
    "\n",
    "### Where to Get Help if You Need it\n",
    "- Re-watch previous Udacity Lectures\n",
    "- Leverage the recommended Course Reading Material - [Grokking Deep Learning](https://www.manning.com/books/grokking-deep-learning) (40% Off: **traskud17**)\n",
    "- Shoot me a tweet @iamtrask\n",
    "\n",
    "\n",
    "### Tutorial Outline:\n",
    "\n",
    "- Intro: The Importance of \"Framing a Problem\"\n",
    "\n",
    "\n",
    "- Curate a Dataset\n",
    "- Developing a \"Predictive Theory\"\n",
    "- **PROJECT 1**: Quick Theory Validation\n",
    "\n",
    "\n",
    "- Transforming Text to Numbers\n",
    "- **PROJECT 2**: Creating the Input/Output Data\n",
    "\n",
    "\n",
    "- Putting it all together in a Neural Network\n",
    "- **PROJECT 3**: Building our Neural Network\n",
    "\n",
    "\n",
    "- Understanding Neural Noise\n",
    "- **PROJECT 4**: Making Learning Faster by Reducing Noise\n",
    "\n",
    "\n",
    "- Analyzing Inefficiencies in our Network\n",
    "- **PROJECT 5**: Making our Network Train and Run Faster\n",
    "\n",
    "\n",
    "- Further Noise Reduction\n",
    "- **PROJECT 6**: Reducing Noise by Strategically Reducing the Vocabulary\n",
    "\n",
    "\n",
    "- Analysis: What's going on in the weights?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "nbpresent": {
     "id": "56bb3cba-260c-4ebe-9ed6-b995b4c72aa3"
    }
   },
   "source": [
    "# Lesson: Curate a Dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false,
    "nbpresent": {
     "id": "eba2b193-0419-431e-8db9-60f34dd3fe83"
    }
   },
   "outputs": [],
   "source": [
    "def pretty_print_review_and_label(i):\n",
    "    print(labels[i] + \"\\t:\\t\" + reviews[i][:80] + \"...\")\n",
    "\n",
    "g = open('reviews.txt','r') # What we know!\n",
    "reviews = list(map(lambda x:x[:-1],g.readlines()))\n",
    "g.close()\n",
    "\n",
    "g = open('labels.txt','r') # What we WANT to know!\n",
    "labels = list(map(lambda x:x[:-1].upper(),g.readlines()))\n",
    "g.close()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "25000"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(reviews)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false,
    "nbpresent": {
     "id": "bb95574b-21a0-4213-ae50-34363cf4f87f"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'bromwell high is a cartoon comedy . it ran at the same time as some other programs about school life  such as  teachers  . my   years in the teaching profession lead me to believe that bromwell high  s satire is much closer to reality than is  teachers  . the scramble to survive financially  the insightful students who can see right through their pathetic teachers  pomp  the pettiness of the whole situation  all remind me of the schools i knew and their students . when i saw the episode in which a student repeatedly tried to burn down the school  i immediately recalled . . . . . . . . . at . . . . . . . . . . high . a classic line inspector i  m here to sack one of your teachers . student welcome to bromwell high . i expect that many adults of my age think that bromwell high is far fetched . what a pity that it isn  t   '"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "reviews[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false,
    "nbpresent": {
     "id": "e0408810-c424-4ed4-afb9-1735e9ddbd0a"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'POSITIVE'"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "labels[0]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Lesson: Develop a Predictive Theory"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false,
    "nbpresent": {
     "id": "e67a709f-234f-4493-bae6-4fb192141ee0"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "labels.txt \t : \t reviews.txt\n",
      "\n",
      "NEGATIVE\t:\tthis movie is terrible but it has some good effects .  ...\n",
      "POSITIVE\t:\tadrian pasdar is excellent is this film . he makes a fascinating woman .  ...\n",
      "NEGATIVE\t:\tcomment this movie is impossible . is terrible  very improbable  bad interpretat...\n",
      "POSITIVE\t:\texcellent episode movie ala pulp fiction .  days   suicides . it doesnt get more...\n",
      "NEGATIVE\t:\tif you haven  t seen this  it  s terrible . it is pure trash . i saw this about ...\n",
      "POSITIVE\t:\tthis schiffer guy is a real genius  the movie is of excellent quality and both e...\n"
     ]
    }
   ],
   "source": [
    "print(\"labels.txt \\t : \\t reviews.txt\\n\")\n",
    "pretty_print_review_and_label(2137)\n",
    "pretty_print_review_and_label(12816)\n",
    "pretty_print_review_and_label(6267)\n",
    "pretty_print_review_and_label(21934)\n",
    "pretty_print_review_and_label(5297)\n",
    "pretty_print_review_and_label(4998)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Project 1: Quick Theory Validation"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "from collections import Counter\n",
    "import numpy as np"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "positive_counts = Counter()\n",
    "negative_counts = Counter()\n",
    "total_counts = Counter()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "for i in range(len(reviews)):\n",
    "    if (labels[i] == 'POSITIVE'):\n",
    "        for word in reviews[i].split(' '):\n",
    "            positive_counts[word] += 1\n",
    "            total_counts[word] += 1\n",
    "    else:\n",
    "        for word in reviews[i].split(' '):\n",
    "            negative_counts[word] += 1\n",
    "            total_counts[word] += 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "pos_neg_ratios = Counter()\n",
    "\n",
    "for term, cnt in list(total_counts.most_common()):\n",
    "    if (cnt > 300):\n",
    "        pos_neg_ratios[term] = positive_counts[term] / float(negative_counts[term] + 1)\n",
    "        \n",
    "for word, ratio in pos_neg_ratios.most_common():\n",
    "    if (ratio > 1):\n",
    "        pos_neg_ratios[word] = np.log(ratio)\n",
    "    else:\n",
    "        pos_neg_ratios[word] = -np.log((1 / (ratio + 0.01)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[('wonderfully', 2.0218960560332353),\n",
       " ('beautifully', 1.7626953362841438),\n",
       " ('superb', 1.7091514458966952),\n",
       " ('touching', 1.637217476541176),\n",
       " ('stewart', 1.6119987332957739),\n",
       " ('wonderful', 1.5645425925262093),\n",
       " ('fantastic', 1.5048433868558566),\n",
       " ('terrific', 1.5026699370083942),\n",
       " ('noir', 1.493925025312256),\n",
       " ('outstanding', 1.4910053152089213),\n",
       " ('excellent', 1.4647538505723599),\n",
       " ('gem', 1.3932148039644643),\n",
       " ('amazing', 1.3919815802404802),\n",
       " ('kelly', 1.3461743673304654),\n",
       " ('powerful', 1.2999662776313934),\n",
       " ('remarkable', 1.2883688239495823),\n",
       " ('favorite', 1.2668956297860055),\n",
       " ('stunning', 1.2622417124499117),\n",
       " ('perfect', 1.246742480713785),\n",
       " ('favourite', 1.2411123512753928),\n",
       " ('journey', 1.2367626271489269),\n",
       " ('bond', 1.2321436812926323),\n",
       " ('brilliant', 1.2287554137664785),\n",
       " ('recommended', 1.2163953243244932),\n",
       " ('perfectly', 1.1971931173405572),\n",
       " ('emotions', 1.1753049094563641),\n",
       " ('subtle', 1.1734135017508081),\n",
       " ('rare', 1.1566438362402944),\n",
       " ('loved', 1.1563661500586044),\n",
       " ('highly', 1.1420208631618658),\n",
       " ('tony', 1.1397491942285991),\n",
       " ('today', 1.1050431789984001),\n",
       " ('helps', 1.1023091505494358),\n",
       " ('awesome', 1.0931328229034842),\n",
       " ('unique', 1.0881409888008142),\n",
       " ('tragic', 1.0871835928444868),\n",
       " ('intense', 1.0870514662670339),\n",
       " ('provides', 1.0797081340289569),\n",
       " ('davis', 1.0541605260972757),\n",
       " ('beauty', 1.050410186850232),\n",
       " ('fascinating', 1.0414538748281612),\n",
       " ('greatest', 1.0248947127715422),\n",
       " ('portrayal', 1.0189810189761024),\n",
       " ('deeply', 1.0094845087721023),\n",
       " ('incredible', 1.0061677561461084),\n",
       " ('harry', 0.99176919305006062),\n",
       " ('sweet', 0.98966110487955483),\n",
       " ('oscar', 0.98721905111049713),\n",
       " ('unusual', 0.97788374278196932),\n",
       " ('complex', 0.97761897738147796),\n",
       " ('solid', 0.97537964824416146),\n",
       " ('beautiful', 0.97326301262841053),\n",
       " ('tears', 0.95977584381389391),\n",
       " ('feelings', 0.95551144502743635),\n",
       " ('winning', 0.95471810900804055),\n",
       " ('paris', 0.95278479030472663),\n",
       " ('heart', 0.95238806924516806),\n",
       " ('masterpiece', 0.94155039863339296),\n",
       " ('themes', 0.94118828349588235),\n",
       " ('danny', 0.93967118051821874),\n",
       " ('charming', 0.92520609553210742),\n",
       " ('impact', 0.91815814604895041),\n",
       " ('treat', 0.91193342650519937),\n",
       " ('loving', 0.90967549275543591),\n",
       " ('surprising', 0.90937028902958128),\n",
       " ('funniest', 0.90078654533818991),\n",
       " ('season', 0.89827222637147675),\n",
       " ('compelling', 0.89462923509297576),\n",
       " ('castle', 0.88967708335606499),\n",
       " ('great', 0.88810470901464589),\n",
       " ('tragedy', 0.88563699078315261),\n",
       " ('arthur', 0.87546873735389985),\n",
       " ('gorgeous', 0.8731725250935497),\n",
       " ('enjoyed', 0.87070195951624607),\n",
       " ('natural', 0.86997924506912838),\n",
       " ('moving', 0.85566611005772031),\n",
       " ('lovely', 0.85290640004681306),\n",
       " ('memorable', 0.84801189112086062),\n",
       " ('episodes', 0.84223712084137292),\n",
       " ('strong', 0.84167135777060931),\n",
       " ('smith', 0.83959811108590054),\n",
       " ('apartment', 0.83333115290549531),\n",
       " ('adventure', 0.83150561393278388),\n",
       " ('adds', 0.82485652591452319),\n",
       " ('childhood', 0.82208086393583857),\n",
       " ('realistic', 0.80807714723392232),\n",
       " ('cry', 0.80011930011211307),\n",
       " ('impressed', 0.79258107754813223),\n",
       " ('edge', 0.789774016249017),\n",
       " ('jean', 0.78845736036427028),\n",
       " ('frank', 0.78275933924963248),\n",
       " ('tale', 0.77010822169607374),\n",
       " ('fresh', 0.76158434211317383),\n",
       " ('animated', 0.75768570169751648),\n",
       " ('enjoyable', 0.75246375771636476),\n",
       " ('performances', 0.74883252516063137),\n",
       " ('simple', 0.74641420974143258),\n",
       " ('relationship', 0.74484232345601786),\n",
       " ('supporting', 0.74357803418683721),\n",
       " ('emotional', 0.73678211645681524),\n",
       " ('brings', 0.73142936713096229),\n",
       " ('henry', 0.72642196944481741),\n",
       " ('society', 0.72433010799663333),\n",
       " ('available', 0.72415741730250549),\n",
       " ('best', 0.72347034060446314),\n",
       " ('magic', 0.71878961117328299),\n",
       " ('delivers', 0.71846498854423513),\n",
       " ('jim', 0.71783979315031676),\n",
       " ('relationships', 0.71393795022901896),\n",
       " ('charlie', 0.71024161391924534),\n",
       " ('atmosphere', 0.70744773070214162),\n",
       " ('genius', 0.706392407309966),\n",
       " ('surprisingly', 0.6995780708902356),\n",
       " ('sky', 0.69780919366575667),\n",
       " ('romantic', 0.69664981111114743),\n",
       " ('match', 0.69566924999265523),\n",
       " ('meets', 0.69314718055994529),\n",
       " ('love', 0.69198533541937324),\n",
       " ('paul', 0.68980827929443067),\n",
       " ('andy', 0.68846333124751902),\n",
       " ('performance', 0.68797386327972465),\n",
       " ('unlike', 0.68546468438792907),\n",
       " ('award', 0.6824518914431974),\n",
       " ('ride', 0.68229716453587952),\n",
       " ('dreams', 0.67599410133369586),\n",
       " ('effective', 0.67565402311242806),\n",
       " ('works', 0.67445504754779284),\n",
       " ('master', 0.67015766233524654),\n",
       " ('easy', 0.66895995494594152),\n",
       " ('city', 0.66820823221269321),\n",
       " ('england', 0.66387679825983203),\n",
       " ('sees', 0.66263163663399482),\n",
       " ('both', 0.66248336767382998),\n",
       " ('definitely', 0.66199789483898808),\n",
       " ('appreciate', 0.66083893732728749),\n",
       " ('future', 0.65834665141052828),\n",
       " ('douglas', 0.65540685257709819),\n",
       " ('inspired', 0.65459851044271034),\n",
       " ('marriage', 0.65392646740666405),\n",
       " ('father', 0.65172321672194655),\n",
       " ('page', 0.65123628494430852),\n",
       " ('era', 0.6495567444850836),\n",
       " ('joan', 0.64891392558311978),\n",
       " ('fantasy', 0.64726757480925168),\n",
       " ('personal', 0.64355023942057321),\n",
       " ('william', 0.64083139119578469),\n",
       " ('jack', 0.63838309514997038),\n",
       " ('jane', 0.63443957973316734),\n",
       " ('gives', 0.63383568159497883),\n",
       " ('animation', 0.63208692379869902),\n",
       " ('classic', 0.62504956428050518),\n",
       " ('impressive', 0.62211140744319349),\n",
       " ('artist', 0.62168821657780038),\n",
       " ('moved', 0.6197197120051281),\n",
       " ('innocent', 0.61851219917136446),\n",
       " ('eddie', 0.61691981517206107),\n",
       " ('nature', 0.61594514653194088),\n",
       " ('brian', 0.61344043794920278),\n",
       " ('offers', 0.61207935747116349),\n",
       " ('pleasure', 0.61195702582993206),\n",
       " ('images', 0.61159731359583758),\n",
       " ('games', 0.61067095873570676),\n",
       " ('fine', 0.60496962268013299),\n",
       " ('job', 0.59845562125168661),\n",
       " ('believable', 0.59566072133302495),\n",
       " ('always', 0.59470710774669278),\n",
       " ('touch', 0.58122926435596001),\n",
       " ('lives', 0.5810976767513224),\n",
       " ('pre', 0.57700753064729182),\n",
       " ('young', 0.57531672344534313),\n",
       " ('french', 0.5720692490067093),\n",
       " ('war', 0.56843317302781682),\n",
       " ('knowing', 0.56489284503626647),\n",
       " ('true', 0.56281525180810066),\n",
       " ('jr', 0.56220982311246936),\n",
       " ('grand', 0.55961578793542266),\n",
       " ('sent', 0.55961578793542266),\n",
       " ('brothers', 0.55891181043362848),\n",
       " ('david', 0.55693122256475369),\n",
       " ('charm', 0.55288175575407861),\n",
       " ('twists', 0.55244729845681018),\n",
       " ('family', 0.55116244510065526),\n",
       " ('thanks', 0.55049088015842218),\n",
       " ('world', 0.54744234723432639),\n",
       " ('life', 0.54695514434959924),\n",
       " ('color', 0.54405127139431109),\n",
       " ('superior', 0.54333490233128523),\n",
       " ('york', 0.54318235866536513),\n",
       " ('jackson', 0.54232429082536171),\n",
       " ('enjoy', 0.54124285135906114),\n",
       " ('stands', 0.5389965007326869),\n",
       " ('each', 0.5388212312554177),\n",
       " ('different', 0.53709860682460819),\n",
       " ('share', 0.53408248593025787),\n",
       " ('series', 0.5325809226575603),\n",
       " ('fellow', 0.5323318289869543),\n",
       " ('loves', 0.53062825106217038),\n",
       " ('century', 0.53002783074992665),\n",
       " ('musical', 0.52966871156747064),\n",
       " ('approach', 0.52806743020049673),\n",
       " ('moves', 0.5279372642387119),\n",
       " ('tells', 0.52415107836314001),\n",
       " ('uncle', 0.52354439617376536),\n",
       " ('deep', 0.52309571635780505),\n",
       " ('famous', 0.52118841080153722),\n",
       " ('epic', 0.51919387343650736),\n",
       " ('adult', 0.519167695083386),\n",
       " ('shows', 0.51915322220375304),\n",
       " ('human', 0.51851411224987087),\n",
       " ('desire', 0.51607497965213445),\n",
       " ('fox', 0.51557622652458857),\n",
       " ('dirty', 0.51557622652458857),\n",
       " ('fun', 0.51439068993048687),\n",
       " ('south', 0.51420972175023116),\n",
       " ('present', 0.51341965894303732),\n",
       " ('ring', 0.51082562376599072),\n",
       " ('alan', 0.51082562376599072),\n",
       " ('begins', 0.51015650363396647),\n",
       " ('success', 0.50900578704900468),\n",
       " ('recently', 0.50714914903668207),\n",
       " ('finding', 0.50637127341661037),\n",
       " ('among', 0.50334004951332734),\n",
       " ('viewing', 0.50302139827440906),\n",
       " ('finds', 0.50128303100539795),\n",
       " ('plays', 0.49975983848890226),\n",
       " ('age', 0.49941323171424595),\n",
       " ('roles', 0.49839716550752178),\n",
       " ('james', 0.49837216269470402),\n",
       " ('brought', 0.49783842823917956),\n",
       " ('hilarious', 0.49714551986191058),\n",
       " ('brutal', 0.49681488669639234),\n",
       " ('dance', 0.49581998314812048),\n",
       " ('thoroughly', 0.49414593456733524),\n",
       " ('fully', 0.49213349075383811),\n",
       " ('romance', 0.4901589869574316),\n",
       " ('happy', 0.4898997500608791),\n",
       " ('crime', 0.48977221456815834),\n",
       " ('singing', 0.4893852925281213),\n",
       " ('especially', 0.48901267837860624),\n",
       " ('detail', 0.48609484250827351),\n",
       " ('necessary', 0.48302334245403883),\n",
       " ('drama', 0.48221998493060503),\n",
       " ('pictures', 0.47929937011921681),\n",
       " ('history', 0.47732966933780852),\n",
       " ('episode', 0.47529620261150429),\n",
       " ('role', 0.47520268270188676),\n",
       " ('spirit', 0.47477690799839323),\n",
       " ('ways', 0.47323464982718205),\n",
       " ('familiar', 0.47241617565111949),\n",
       " ('dream', 0.46608972992459924),\n",
       " ('critics', 0.46430560813109778),\n",
       " ('born', 0.46411383518967209),\n",
       " ('detective', 0.4636633473511525),\n",
       " ('remains', 0.46262352194811296),\n",
       " ('information', 0.46034171833399862),\n",
       " ('struggle', 0.45911782160048453),\n",
       " ('language', 0.45902121257712653),\n",
       " ('visual', 0.45823514408822852),\n",
       " ('social', 0.45720078250735313),\n",
       " ('reality', 0.45719346885019546),\n",
       " ('hidden', 0.45675840249571492),\n",
       " ('sometimes', 0.45563021171182794),\n",
       " ('modern', 0.45500247579345005),\n",
       " ('popular', 0.45410691533051023),\n",
       " ('surprised', 0.4534409399850382),\n",
       " ('follows', 0.45245361754408348),\n",
       " ('keeps', 0.45234869400701483),\n",
       " ('john', 0.4520909494482197),\n",
       " ('justice', 0.45142724367280018),\n",
       " ('years', 0.44919197032104968),\n",
       " ('lose', 0.44658335503763702),\n",
       " ('caught', 0.44610275383999071),\n",
       " ('chinese', 0.44507424620321018),\n",
       " ('puts', 0.44279106572085081),\n",
       " ('criminal', 0.4412745608048752),\n",
       " ('minor', 0.4409224199448939),\n",
       " ('liked', 0.44074991514020723),\n",
       " ('de', 0.43983275161237217),\n",
       " ('flaws', 0.43983275161237217),\n",
       " ('light', 0.43884433018199892),\n",
       " ('slowly', 0.43785660389939979),\n",
       " ('comedic', 0.43721380642274466),\n",
       " ('married', 0.43658501682196887),\n",
       " ('murder', 0.4353180712578455),\n",
       " ('physical', 0.4353180712578455),\n",
       " ('johnny', 0.43483971678806865),\n",
       " ('silent', 0.43395706390247063),\n",
       " ('comedies', 0.43395706390247063),\n",
       " ('played', 0.43387244114515305),\n",
       " ('vision', 0.43286408229627887),\n",
       " ('intelligent', 0.43196704885367099),\n",
       " ('also', 0.43036720209769169),\n",
       " ('miss', 0.43006426712153217),\n",
       " ('experience', 0.4291068711652048),\n",
       " ('often', 0.42840667735057109),\n",
       " ('disney', 0.42758990438880029),\n",
       " ('dancing', 0.42744401482693967),\n",
       " ('events', 0.42744401482693967),\n",
       " ('boss', 0.42348361361084275),\n",
       " ('key', 0.42306086999854398),\n",
       " ('michael', 0.41985384556026406),\n",
       " ('pace', 0.41907076016394307),\n",
       " ('equally', 0.41702593050924036),\n",
       " ('late', 0.41510042009183645),\n",
       " ('business', 0.41479229098330311),\n",
       " ('later', 0.41304664556056209),\n",
       " ('own', 0.41293340271569018),\n",
       " ('wise', 0.41243377742425769),\n",
       " ('likable', 0.41197978912935806),\n",
       " ('support', 0.41181433578682319),\n",
       " ('live', 0.41137116554424646),\n",
       " ('score', 0.4111262635429026),\n",
       " ('glad', 0.4091619699894905),\n",
       " ('important', 0.40904292945604837),\n",
       " ('well', 0.40898417332336018),\n",
       " ('dark', 0.40787765451354829),\n",
       " ('queen', 0.40786031883411922),\n",
       " ('wild', 0.40739003651774874),\n",
       " ('catch', 0.40732557376108414),\n",
       " ('battle', 0.40546510810816438),\n",
       " ('younger', 0.40215931997366489),\n",
       " ('particular', 0.40204630135937885),\n",
       " ('small', 0.39990251475094907),\n",
       " ('recommend', 0.39947706626354179),\n",
       " ('documentary', 0.39935422047536423),\n",
       " ('studio', 0.39903421777787396),\n",
       " ('political', 0.3986391430377646),\n",
       " ('older', 0.39786050872294498),\n",
       " ('rarely', 0.3975599286010511),\n",
       " ('robert', 0.39584544494568491),\n",
       " ('festival', 0.39505918694704767),\n",
       " ('mary', 0.39227810382621064),\n",
       " ('herself', 0.39212473581937829),\n",
       " ('animals', 0.39122275139262125),\n",
       " ('son', 0.38952363011047619),\n",
       " ('details', 0.3892704221881837),\n",
       " ('early', 0.38837067474886433),\n",
       " ('photography', 0.38711596943996779),\n",
       " ('including', 0.3865071943635503),\n",
       " ('cinema', 0.38486877748306314),\n",
       " ('heaven', 0.38473897759104753),\n",
       " ('culture', 0.38367044828074415),\n",
       " ('jerry', 0.38358239685865669),\n",
       " ('between', 0.3826616190905876),\n",
       " ('proves', 0.3823693933135151),\n",
       " ('still', 0.38004251519484533),\n",
       " ('view', 0.37962387692427707),\n",
       " ('released', 0.37935836227044345),\n",
       " ('song', 0.37910443841709585),\n",
       " ('step', 0.37879686102600307),\n",
       " ('media', 0.3782154656607889),\n",
       " ('ford', 0.3782154656607889),\n",
       " ('become', 0.37747619820593153),\n",
       " ('exciting', 0.37647757123491205),\n",
       " ('collection', 0.37647757123491205),\n",
       " ('system', 0.37634770953743713),\n",
       " ('parents', 0.37609921330379997),\n",
       " ('release', 0.37564284664554326),\n",
       " ('team', 0.37525132951166773),\n",
       " ('cold', 0.37496165381474977),\n",
       " ('adam', 0.37267528528517352),\n",
       " ('taylor', 0.37129621249291445),\n",
       " ('successful', 0.3705962824573405),\n",
       " ('genre', 0.37042019954698968),\n",
       " ('lord', 0.36987416300546178),\n",
       " ('although', 0.36979962340393463),\n",
       " ('soundtrack', 0.36747898929207806),\n",
       " ('entertaining', 0.36694353008558095),\n",
       " ('u', 0.36617739103512864),\n",
       " ('seven', 0.36615368789327618),\n",
       " ('humour', 0.36602337605686763),\n",
       " ('country', 0.36551305709644938),\n",
       " ('very', 0.36505258934423584),\n",
       " ('becoming', 0.36503153852967385),\n",
       " ('form', 0.36428919392397774),\n",
       " ('german', 0.36372550193539915),\n",
       " ('return', 0.36290549368936847),\n",
       " ('uses', 0.36251372091256512),\n",
       " ('may', 0.36162314149237229),\n",
       " ('win', 0.36161322557931491),\n",
       " ('stories', 0.36120076939693646),\n",
       " ('ago', 0.35972909878548015),\n",
       " ('includes', 0.35894509247327155),\n",
       " ('past', 0.35821222325761887),\n",
       " ('chemistry', 0.35815899071122737),\n",
       " ('starring', 0.35767444427181588),\n",
       " ('boys', 0.35589032247831454),\n",
       " ('peter', 0.35478040595495058),\n",
       " ('bill', 0.3543734469504532),\n",
       " ('day', 0.35384658780188777),\n",
       " ('became', 0.35319667956240758),\n",
       " ('normal', 0.35296436454219671),\n",
       " ('british', 0.35289422109882629),\n",
       " ('mother', 0.35269246157441486),\n",
       " ('cinematography', 0.3524892921304002),\n",
       " ('th', 0.35211912740287166),\n",
       " ('summer', 0.35020242943311497),\n",
       " ('actions', 0.34967374847974886),\n",
       " ('his', 0.34931337328072987),\n",
       " ('theme', 0.34865470192789649),\n",
       " ('personally', 0.347988678682772),\n",
       " ('plenty', 0.34785755884633829),\n",
       " ('stage', 0.34751146559807738),\n",
       " ('recent', 0.34719619998418855),\n",
       " ('throughout', 0.34705434595174994),\n",
       " ('building', 0.34687094384211148),\n",
       " ('whose', 0.34585871262957568),\n",
       " ('escape', 0.34540086736551434),\n",
       " ('element', 0.34432910811643308),\n",
       " ('western', 0.34333332700115821),\n",
       " ('certain', 0.34274184963480825),\n",
       " ('helped', 0.3417492937220567),\n",
       " ('richard', 0.34092658697059319),\n",
       " ('bruce', 0.33821288109899689),\n",
       " ('various', 0.33703896942187339),\n",
       " ('professional', 0.33647223662121289),\n",
       " ('truly', 0.33568591851504065),\n",
       " ('songs', 0.33534080146374112),\n",
       " ('meet', 0.33493495730232653),\n",
       " ('fiction', 0.33431628896614474),\n",
       " ('allen', 0.33393309010253663),\n",
       " ('working', 0.33259208516974553),\n",
       " ('indeed', 0.33220581630751173),\n",
       " ('brother', 0.33213383502261484),\n",
       " ('others', 0.33131869289821475),\n",
       " ('created', 0.33079219610550942),\n",
       " ('length', 0.32935476885234893),\n",
       " ('japanese', 0.3293037471426003),\n",
       " ('engaging', 0.32880936387564386),\n",
       " ('dramatic', 0.3262157364540238),\n",
       " ('addition', 0.32466107569286828),\n",
       " ('chance', 0.32430819419122453),\n",
       " ('america', 0.3237870770938972),\n",
       " ('central', 0.32317195743373167),\n",
       " ('led', 0.32302143889708984),\n",
       " ('change', 0.32294408442016082),\n",
       " ('memory', 0.32197114593041304),\n",
       " ('lived', 0.3212730168878164),\n",
       " ('audiences', 0.3207125981282628),\n",
       " ('deal', 0.3202582428863936),\n",
       " ('tough', 0.3193534162894322),\n",
       " ('our', 0.31888367222322705),\n",
       " ('man', 0.31820087291645405),\n",
       " ('red', 0.31766290466371677),\n",
       " ('known', 0.3174542307854511),\n",
       " ('terms', 0.3159667862903629),\n",
       " ('personality', 0.31527002897060996),\n",
       " ('thriller', 0.31436767808346239),\n",
       " ('contains', 0.31321537445694564),\n",
       " ('comic', 0.31295066662666593),\n",
       " ('manages', 0.31069459372438463),\n",
       " ('town', 0.31052454575399091),\n",
       " ('mr', 0.31026367714849018),\n",
       " ('ray', 0.30932124755526214),\n",
       " ('able', 0.30715417586460125),\n",
       " ('issues', 0.30715417586460125),\n",
       " ('situation', 0.3068631313036248),\n",
       " ('friend', 0.30589751234312218),\n",
       " ('overall', 0.30555419721790278),\n",
       " ('tom', 0.30553968985178742),\n",
       " ('creative', 0.30538164955118191),\n",
       " ('states', 0.30501352880342086),\n",
       " ('similar', 0.30479991596874945),\n",
       " ('viewers', 0.30475113250633357),\n",
       " ('adults', 0.30472353830663262),\n",
       " ('rock', 0.30368241379822197),\n",
       " ('earlier', 0.30351353766846162),\n",
       " ('living', 0.30305010268009497),\n",
       " ('bit', 0.3020130715164977),\n",
       " ('top', 0.30189358591274129),\n",
       " ('rich', 0.30158497762077241),\n",
       " ('portrayed', 0.30126133057816179),\n",
       " ('places', 0.29904583110209598),\n",
       " ('eye', 0.29795965521002121),\n",
       " ('somewhat', 0.29794476439690809),\n",
       " ('wars', 0.29644637044536915),\n",
       " ('soon', 0.29626581614317243),\n",
       " ('quite', 0.29407984725856462),\n",
       " ('period', 0.29376111852816317),\n",
       " ('whom', 0.29310213992112011),\n",
       " ('trip', 0.29004893746204713),\n",
       " ('remember', 0.28973757163387698),\n",
       " ('television', 0.28961818147864732),\n",
       " ('narrative', 0.28905475626375304),\n",
       " ('together', 0.28352406230311722),\n",
       " ('us', 0.28306738959710842),\n",
       " ('game', 0.28223246768421617),\n",
       " ('new', 0.28146331508444461),\n",
       " ('himself', 0.27958486221916151),\n",
       " ('men', 0.27822068644413961),\n",
       " ('art', 0.27774073436393321),\n",
       " ('hit', 0.27750250423831679),\n",
       " ('music', 0.27737860408205628),\n",
       " ('her', 0.27597567116772548),\n",
       " ('follow', 0.2758476148047781),\n",
       " ('drawn', 0.27551153683152568),\n",
       " ('makes', 0.27520789822660519),\n",
       " ('number', 0.27379296029111383),\n",
       " ('truth', 0.27271919977506848),\n",
       " ('filled', 0.26973963860864258),\n",
       " ('setting', 0.26933293378358436),\n",
       " ('tone', 0.26907688462074658),\n",
       " ('told', 0.26851915373053697),\n",
       " ('george', 0.26747936513426146),\n",
       " ('will', 0.26732095172091325),\n",
       " ('takes', 0.26696419994803383),\n",
       " ('intriguing', 0.26646623330150837),\n",
       " ('style', 0.26623060455034442),\n",
       " ('shown', 0.26485403989558004),\n",
       " ('stone', 0.26484258048195813),\n",
       " ('surprise', 0.26409415492730509),\n",
       " ('times', 0.26394848811968658),\n",
       " ('certainly', 0.26381459104513749),\n",
       " ('story', 0.26358920318924967),\n",
       " ('sister', 0.2627963232342036),\n",
       " ('him', 0.26262336538874875),\n",
       " ('williams', 0.26236426446749106),\n",
       " ('yet', 0.26229999918036373),\n",
       " ('pure', 0.26079317223544984),\n",
       " ('dvd', 0.25889596573330381),\n",
       " ('many', 0.25786034905155958),\n",
       " ('billy', 0.25671984684781407),\n",
       " ('joe', 0.2557197217488224),\n",
       " ('italian', 0.25565282987950433),\n",
       " ('spot', 0.25398822666530829),\n",
       " ('side', 0.25350239533973568),\n",
       " ('soul', 0.25312438352614564),\n",
       " ('hotel', 0.25259075264051079),\n",
       " ('deserves', 0.25131442828090617),\n",
       " ('office', 0.25086809932906462),\n",
       " ('king', 0.25080344206641508),\n",
       " ('nice', 0.25068363282694878),\n",
       " ('latter', 0.24921579162398483),\n",
       " ('law', 0.24882003935973376),\n",
       " ('attention', 0.24851173586333228),\n",
       " ('former', 0.24783616390458127),\n",
       " ('features', 0.24697088739476736),\n",
       " ('street', 0.24696186428206401),\n",
       " ('picture', 0.24498908024018978),\n",
       " ('boy', 0.24334625863172918),\n",
       " ('as', 0.24332065954522725),\n",
       " ('fans', 0.24310302905381345),\n",
       " ('indian', 0.24195982311368577),\n",
       " ('moments', 0.24125949896069235),\n",
       " ('american', 0.24072508936400988),\n",
       " ('forever', 0.24033595185458262),\n",
       " ('full', 0.2393382372341904),\n",
       " ('began', 0.23862591546258669),\n",
       " ('difficult', 0.23673159603124905),\n",
       " ('humor', 0.23620664528893415),\n",
       " ('independent', 0.23601006190745993),\n",
       " ('prison', 0.23590580292806096),\n",
       " ('wife', 0.23555300701683429),\n",
       " ('leading', 0.23543138210790299),\n",
       " ('typical', 0.23470437371528577),\n",
       " ('its', 0.23445785826028542),\n",
       " ('sequence', 0.23393779644509025),\n",
       " ('usual', 0.23293155768037266),\n",
       " ('message', 0.23236520603166388),\n",
       " ('thank', 0.23233197736861597),\n",
       " ('hasn', 0.23159260580073729),\n",
       " ('reminded', 0.23090555664969903),\n",
       " ('charles', 0.23084859768861493),\n",
       " ('opinion', 0.23017757797158969),\n",
       " ('violent', 0.23001643060197177),\n",
       " ('cast', 0.22984669865679985),\n",
       " ('showed', 0.22957444164450017),\n",
       " ('husband', 0.22884157242884745),\n",
       " ('along', 0.22846608320530892),\n",
       " ('emotion', 0.22767870647960098),\n",
       " ('final', 0.22687173729661503),\n",
       " ('asks', 0.22587953113308443),\n",
       " ('once', 0.22584782184384555),\n",
       " ('play', 0.22515360224223399),\n",
       " ('honest', 0.22501096548900512),\n",
       " ('leads', 0.2249437318183577),\n",
       " ('focus', 0.2249118983709518),\n",
       " ('moral', 0.22436979303745413),\n",
       " ('mark', 0.22384017272865772),\n",
       " ('note', 0.22377031410501885),\n",
       " ('wedding', 0.22314355131420976),\n",
       " ('costumes', 0.22206188544346864),\n",
       " ('presented', 0.22206188544346864),\n",
       " ('returns', 0.22168263067453486),\n",
       " ('heroes', 0.22032267497256833),\n",
       " ('clever', 0.21808878065258569),\n",
       " ('inside', 0.21715550946958723),\n",
       " ('scott', 0.21622310846963599),\n",
       " ('hollywood', 0.21583133569283269),\n",
       " ('most', 0.21576949086149472),\n",
       " ('powers', 0.21465693743689096),\n",
       " ('viewer', 0.21459649073575129),\n",
       " ('everybody', 0.21440987134545511),\n",
       " ('films', 0.21413624545873913),\n",
       " ('smart', 0.21209371512762482),\n",
       " ('lover', 0.21184399606027632),\n",
       " ('steve', 0.21108962697039713),\n",
       " ('elements', 0.20995150453662395),\n",
       " ('suicide', 0.20895891632225325),\n",
       " ('learn', 0.20879968206178118),\n",
       " ('feature', 0.20781540562017428),\n",
       " ('include', 0.20763936477824455),\n",
       " ('several', 0.20763936477824455),\n",
       " ('children', 0.20736236925456764),\n",
       " ('thus', 0.20697069206860877),\n",
       " ('members', 0.20688303044242937),\n",
       " ('against', 0.20641312305500026),\n",
       " ('star', 0.2061007485600686),\n",
       " ('o', 0.20536995223024557),\n",
       " ('event', 0.20391218938632222),\n",
       " ('showing', 0.20171209102619739),\n",
       " ('actresses', 0.20121819068524419),\n",
       " ('moment', 0.20012618142746136),\n",
       " ('find', 0.19954652319879115),\n",
       " ('died', 0.19948936041632001),\n",
       " ('english', 0.19944143900742142),\n",
       " ('copy', 0.19822014286175296),\n",
       " ('americans', 0.19735943415849519),\n",
       " ('year', 0.19707910617291846),\n",
       " ('everyone', 0.19667468614876915),\n",
       " ('commentary', 0.19497267434751336),\n",
       " ('days', 0.19446394361968003),\n",
       " ('changed', 0.1944245789651983),\n",
       " ('leaves', 0.19358474907266526),\n",
       " ('named', 0.19285520124940034),\n",
       " ('home', 0.19228354952270224),\n",
       " ('historical', 0.19129022677671509),\n",
       " ('knows', 0.19126834278376073),\n",
       " ('career', 0.19105523676270922),\n",
       " ('sets', 0.19049188820406651),\n",
       " ('friends', 0.1903044054499502),\n",
       " ('books', 0.19029550263309888),\n",
       " ('has', 0.18887466019234553),\n",
       " ('she', 0.18812315883348638),\n",
       " ('and', 0.18744824888788403),\n",
       " ('within', 0.18540322333136275),\n",
       " ('imagination', 0.18540322333136275),\n",
       " ('interested', 0.18457127652797004),\n",
       " ('developed', 0.18322694390876712),\n",
       " ('based', 0.18206550763111667),\n",
       " ('show', 0.18127315550973783),\n",
       " ('willing', 0.18117935221517753),\n",
       " ('while', 0.18101161831162818),\n",
       " ('eventually', 0.18079600348511757),\n",
       " ('won', 0.17904823144898546),\n",
       " ('power', 0.17768117723745241),\n",
       " ('child', 0.17706493935013418),\n",
       " ('aspects', 0.17589066646366419),\n",
       " ('race', 0.17531101230773724),\n",
       " ('subject', 0.17509385367250144),\n",
       " ('west', 0.17233299891044881),\n",
       " ('teenage', 0.17220342662836996),\n",
       " ('j', 0.17095779814363948),\n",
       " ('manner', 0.17072980863016957),\n",
       " ('london', 0.16960278438617996),\n",
       " ('continue', 0.16923392203858686),\n",
       " ('entertainment', 0.16857992894165819),\n",
       " ('haven', 0.16829735046773628),\n",
       " ('though', 0.16811984981797709),\n",
       " ('real', 0.16793949493155988),\n",
       " ('affair', 0.16753776060971765),\n",
       " ('mystery', 0.16725130387295642),\n",
       " ('course', 0.16712103026988581),\n",
       " ('above', 0.16623541904233033),\n",
       " ('version', 0.16534322025953679),\n",
       " ('artistic', 0.16507975035944861),\n",
       " ('pieces', 0.16507975035944861),\n",
       " ('parts', 0.16480151437379129),\n",
       " ('feel', 0.16432541490121119),\n",
       " ('two', 0.16221957782822941),\n",
       " ('short', 0.16211092086564666),\n",
       " ('ones', 0.16194799028728998),\n",
       " ('class', 0.16142343915633808),\n",
       " ('he', 0.16126968303520792),\n",
       " ('soldier', 0.16126814759612232),\n",
       " ('feeling', 0.16090472414323376),\n",
       " ('compare', 0.15984870094189604),\n",
       " ('roll', 0.15963014559188393),\n",
       " ('following', 0.15906469462968728),\n",
       " ('limited', 0.15822400521489419),\n",
       " ('towards', 0.15706189003471671),\n",
       " ('party', 0.15639787178416298),\n",
       " ('slightly', 0.15529288440603525),\n",
       " ('again', 0.15399622774570954),\n",
       " ('turns', 0.15365624223992966),\n",
       " ('considered', 0.15287435546765354),\n",
       " ('presence', 0.15113862935726671),\n",
       " ('secret', 0.15061085312213432),\n",
       " ('particularly', 0.1504220077889464),\n",
       " ('until', 0.14997094542455039),\n",
       " ('christopher', 0.14967639943233715),\n",
       " ('fear', 0.14842000511827322),\n",
       " ('image', 0.14763599880606468),\n",
       " ('comedy', 0.14624098022947199),\n",
       " ('their', 0.14569896839951851),\n",
       " ('work', 0.14566166450234702),\n",
       " ('due', 0.14531009181713533),\n",
       " ('adaptation', 0.14531009181713533),\n",
       " ('la', 0.14518200984449789),\n",
       " ('ahead', 0.14489135441446163),\n",
       " ('lady', 0.14394650965301667),\n",
       " ('band', 0.14364270222884329),\n",
       " ('al', 0.14348172347769078),\n",
       " ('worth', 0.14328986169246002),\n",
       " ('ben', 0.14263615961744186),\n",
       " ('novel', 0.1422015630045293),\n",
       " ('background', 0.14217448878054254),\n",
       " ('hope', 0.14111769970861912),\n",
       " ('who', 0.13963110655212385),\n",
       " ('mysterious', 0.13815033848081718),\n",
       " ('date', 0.13783247452391326),\n",
       " ('in', 0.13773074964958743),\n",
       " ('stand', 0.13747099062860288),\n",
       " ('trust', 0.13685918271719735),\n",
       " ('saw', 0.1365755350057507),\n",
       " ('despite', 0.13647516866853593),\n",
       " ('sexy', 0.13473259397015666),\n",
       " ('finally', 0.13422849965867853),\n",
       " ('mood', 0.13415001312058869),\n",
       " ('came', 0.13401143103681315),\n",
       " ('is', 0.13363870656907434),\n",
       " ('process', 0.13264447460629469),\n",
       " ('action', 0.13249384115269827),\n",
       " ('brief', 0.13150230839774157),\n",
       " ('technical', 0.13090557054685498),\n",
       " ('by', 0.12853075861071547),\n",
       " ('land', 0.12689175185462376),\n",
       " ('extra', 0.12675170563914381),\n",
       " ('voice', 0.12635626636687172),\n",
       " ('must', 0.12628259646883916),\n",
       " ('mid', 0.12516314295400599),\n",
       " ('scared', 0.12475170497247684),\n",
       " ('disturbing', 0.12361395596717663),\n",
       " ('easily', 0.12333640177293873),\n",
       " ('aspect', 0.12296171113483492),\n",
       " ('fit', 0.12260232209233228),\n",
       " ('held', 0.12260232209233228),\n",
       " ('playing', 0.12255217541328564),\n",
       " ('matter', 0.12071374740446419),\n",
       " ('other', 0.12061743163780955),\n",
       " ('road', 0.11940773138338527),\n",
       " ('forgotten', 0.11844815041319409),\n",
       " ('choice', 0.11689375147149943),\n",
       " ('questions', 0.11679926774625068),\n",
       " ('seeing', 0.11632145801691783),\n",
       " ('those', 0.11592359847967949),\n",
       " ('planet', 0.11543616764656794),\n",
       " ('bring', 0.11506932978478729),\n",
       " ('introduced', 0.11477551459242825),\n",
       " ('four', 0.11415890536299227),\n",
       " ('twice', 0.11352382629698717),\n",
       " ('force', 0.11274062295544887),\n",
       " ('mainly', 0.11179140598811663),\n",
       " ('becomes', 0.11162917008200528),\n",
       " ('directed', 0.11131812921379115),\n",
       " ('coming', 0.11112078583096703),\n",
       " ('fan', 0.1109924669366235),\n",
       " ('more', 0.11097538681569005),\n",
       " ('constantly', 0.11042381761437305),\n",
       " ('hold', 0.11000089521432849),\n",
       " ('during', 0.1099181377350741),\n",
       " ('police', 0.10939859440710656),\n",
       " ('murders', 0.10880285984879917),\n",
       " ('beginning', 0.10852293076233929),\n",
       " ('immediately', 0.10809649547670099),\n",
       " ('negative', 0.10775286129644605),\n",
       " ('of', 0.10766910804438501),\n",
       " ('post', 0.10754154160418654),\n",
       " ('with', 0.10743222230268429),\n",
       " ('telling', 0.10742024862083691),\n",
       " ('upon', 0.10707894004043897),\n",
       " ('area', 0.10660973505825827),\n",
       " ('eyes', 0.10518719041257044),\n",
       " ('sequences', 0.1044905721492862),\n",
       " ('large', 0.10422350587075116),\n",
       " ('respect', 0.10409389104263336),\n",
       " ('green', 0.10379679368164356),\n",
       " ('last', 0.10370566043971788),\n",
       " ('when', 0.1028897983398213),\n",
       " ('dog', 0.10168404092851775),\n",
       " ('serial', 0.10161017641078243),\n",
       " ('from', 0.10106647591230367),\n",
       " ('company', 0.10086061033497386),\n",
       " ('see', 0.099917524764184903),\n",
       " ('needs', 0.099845334969716121),\n",
       " ('strange', 0.099219247635743829),\n",
       " ('design', 0.099206650083448103),\n",
       " ('numbers', 0.099090902644230969),\n",
       " ('first', 0.098955089925380019),\n",
       " ('six', 0.098781544559783718),\n",
       " ('perhaps', 0.098596115569284243),\n",
       " ('cross', 0.098238439583413259),\n",
       " ('lot', 0.097564755867877814),\n",
       " ('stars', 0.096659404205090227),\n",
       " ('listen', 0.096460266187562316),\n",
       " ('week', 0.095725203674154269),\n",
       " ('an', 0.095336742933817303),\n",
       " ('place', 0.094597844501735473),\n",
       " ('wall', 0.093218128832100788),\n",
       " ('screen', 0.093090423066012035),\n",
       " ('three', 0.092400179829382326),\n",
       " ('mix', 0.092206193866733843),\n",
       " ('fred', 0.092170459799657101),\n",
       " ('missed', 0.091937495325685639),\n",
       " ('help', 0.089675228287008593),\n",
       " ('since', 0.089468159841429057),\n",
       " ('convincing', 0.088947486016496116),\n",
       " ('changes', 0.087911872322879892),\n",
       " ('water', 0.087647307058755675),\n",
       " ('big', 0.087462267506023539),\n",
       " ('whether', 0.086401434915215417),\n",
       " ('depth', 0.085990447855522512),\n",
       " ('cute', 0.085815919584856126),\n",
       " ('problems', 0.085637885161817195),\n",
       " ('film', 0.085618555650856729),\n",
       " ('government', 0.084956722475965391),\n",
       " ('wish', 0.083555885690973566),\n",
       " ('falling', 0.083381608939051),\n",
       " ('wants', 0.082280679513991054),\n",
       " ('situations', 0.082013151660835074),\n",
       " ('which', 0.080721093142199482),\n",
       " ('set', 0.080695491821007242),\n",
       " ('rate', 0.079787116617831902),\n",
       " ('captain', 0.079552631701953688),\n",
       " ('kate', 0.079512062927733607),\n",
       " ('lost', 0.078598068066187896),\n",
       " ('agent', 0.077386663615420195),\n",
       " ('part', 0.076751339578802424),\n",
       " ('chris', 0.0758657507747134),\n",
       " ('little', 0.07583626238355369),\n",
       " ('my', 0.075531730165573088),\n",
       " ('keep', 0.074941421292118657),\n",
       " ('public', 0.074370542721069938),\n",
       " ('dad', 0.073203404023294921),\n",
       " ('ex', 0.072526444068262585),\n",
       " ('consider', 0.070067562616716844),\n",
       " ('devil', 0.069869679960486),\n",
       " ('decides', 0.069497794496921506),\n",
       " ('s', 0.069425993723984988),\n",
       " ('close', 0.069418765871583257),\n",
       " ('faces', 0.069391993423999793),\n",
       " ('difference', 0.068992871486951421),\n",
       " ('actress', 0.068879678889626456),\n",
       " ('witch', 0.068137805167218041),\n",
       " ('took', 0.067236944784686545),\n",
       " ('does', 0.066343124451621341),\n",
       " ('creepy', 0.065751377562780433),\n",
       " ('room', 0.065632014958942553),\n",
       " ('provide', 0.065382759262851711),\n",
       " ('martin', 0.065240521868400944),\n",
       " ('odd', 0.065203193810762075),\n",
       " ('death', 0.065012406669236716),\n",
       " ('tim', 0.064538521137571164),\n",
       " ('effect', 0.063112423310056259),\n",
       " ('runs', 0.062276929521514507),\n",
       " ('station', 0.062131781107006179),\n",
       " ('create', 0.062010074784212534),\n",
       " ('ultimately', 0.061321890874318948),\n",
       " ('heavy', 0.060870715087025913),\n",
       " ('filmed', 0.060148846690498754),\n",
       " ('food', 0.059898141581069014),\n",
       " ('the', 0.05902269426102881),\n",
       " ('woman', 0.058672047052498608),\n",
       " ('sci', 0.057679111586677989),\n",
       " ('now', 0.056463107132025653),\n",
       " ('second', 0.05605134890532238),\n",
       " ('flying', 0.055880458394456628),\n",
       " ('knew', 0.05563169598614863),\n",
       " ('taking', 0.054406722207164263),\n",
       " ('a', 0.053580080386005403),\n",
       " ('type', 0.053298581724361922),\n",
       " ('themselves', 0.052332615458067437),\n",
       " ('white', 0.050949356293016494),\n",
       " ('order', 0.050537068996355794),\n",
       " ('local', 0.050124387182568605),\n",
       " ('buy', 0.049683420146647027),\n",
       " ('back', 0.049084671607873435),\n",
       " ('done', 0.048443439922053785),\n",
       " ('fi', 0.04834778415779363),\n",
       " ('time', 0.047946314631421037),\n",
       " ('without', 0.045921750585639701),\n",
       " ('under', 0.04529627491517621),\n",
       " ('state', 0.044951387862266268),\n",
       " ('seen', 0.044318629823975407),\n",
       " ('r', 0.04401688541677426),\n",
       " ('reasons', 0.043557974339129939),\n",
       " ('martial', 0.042559614418795903),\n",
       " ('old', 0.041976562407206243),\n",
       " ('third', 0.04060097562223966),\n",
       " ('suspect', 0.039740328649514121),\n",
       " ('good', 0.039096368552785317),\n",
       " ('one', 0.038825331788165052),\n",
       " ('pop', 0.037740327982847113),\n",
       " ('suspense', 0.037740327982847113),\n",
       " ('right', 0.037421385048146454),\n",
       " ('g', 0.037387532071620412),\n",
       " ('we', 0.037205027697895854),\n",
       " ('means', 0.036749542208741437),\n",
       " ('producer', 0.03653374333245607),\n",
       " ('co', 0.036488293263136684),\n",
       " ('shocking', 0.035297782081023896),\n",
       " ('arts', 0.032157111634531443),\n",
       " ('added', 0.03174869831458027),\n",
       " ('stephen', 0.030583423372080185),\n",
       " ('however', 0.030545361154190185),\n",
       " ('opportunity', 0.030459207484708439),\n",
       " ('found', 0.029528174839205171),\n",
       " ('scenery', 0.029413885206293407),\n",
       " ('comes', 0.028170876966696224),\n",
       " ('high', 0.025903390948847894),\n",
       " ('meaning', 0.025317807984289786),\n",
       " ('sexual', 0.025176154892474188),\n",
       " ('control', 0.023438572972017596),\n",
       " ('outside', 0.023373351185308804),\n",
       " ('fall', 0.023347363996991107),\n",
       " ('fight', 0.022629338130759902),\n",
       " ('for', 0.022010630594166601),\n",
       " ('acted', 0.021180822079447045),\n",
       " ('baby', 0.020202707317519469),\n",
       " ('super', 0.019960742562538152),\n",
       " ('leave', 0.01987418620708363),\n",
       " ('face', 0.01944168161458559),\n",
       " ('such', 0.017527225708960321),\n",
       " ('further', 0.017331456351639941),\n",
       " ('l', 0.016529301951210506),\n",
       " ('mad', 0.01600034134644112),\n",
       " ('directors', 0.014771317320312503),\n",
       " ('cinematic', 0.014528100562909808),\n",
       " ('produced', 0.014388737452099671),\n",
       " ('dr', 0.014265577158822439),\n",
       " ('actor', 0.014232136417008196),\n",
       " ('mind', 0.014028286163188054),\n",
       " ('before', 0.013410605605792105),\n",
       " ('sam', 0.013129291441792802),\n",
       " ('house', 0.012808958292581241),\n",
       " ('are', 0.012436027214787634),\n",
       " ('across', 0.012345835822299362),\n",
       " ('tv', 0.01221718393859185),\n",
       " ('taken', 0.01214589830210812),\n",
       " ('open', 0.012012156448003434),\n",
       " ('location', 0.011834457647002798),\n",
       " ('way', 0.011462871589590532),\n",
       " ('compared', 0.011131840368844199),\n",
       " ('pain', 0.009950330853168092),\n",
       " ('extreme', 0.009950330853168092),\n",
       " ('leaving', 0.009950330853168092),\n",
       " ('next', 0.009950330853168092),\n",
       " ('appearance', 0.009950330853168092),\n",
       " ('longer', 0.009950330853168092),\n",
       " ('jason', 0.009950330853168092),\n",
       " ('nearly', 0.009950330853168092),\n",
       " ('followed', 0.009950330853168092),\n",
       " ('previous', 0.0095087879690273561),\n",
       " ('climax', 0.0094787439545437387),\n",
       " ('daughter', 0.0087796876520457728),\n",
       " ('come', 0.0087088349396226093),\n",
       " ('camp', 0.0086207430439069546),\n",
       " ('ending', 0.0082707872940947814),\n",
       " ('night', 0.0081219093681359142),\n",
       " ('gone', 0.0079470616925319398),\n",
       " ('agree', 0.0064945441606811486),\n",
       " ('x', 0.0056338177182560642),\n",
       " ('batman', 0.0053345829859778888),\n",
       " ('church', 0.0050850882115993515),\n",
       " ('opera', 0.0049625405735024882),\n",
       " ('things', 0.0048793807840934881),\n",
       " ('into', 0.004734832512818153),\n",
       " ('direct', 0.0045548283930798373),\n",
       " ('ms', 0.0043088852243872884),\n",
       " ('likes', 0.0042826617920009493),\n",
       " ('almost', 0.0042765567672601937),\n",
       " ('sad', 0.0039920212695374498),\n",
       " ('sight', 0.0038198555473073497),\n",
       " ('it', 0.0037234021851994979),\n",
       " ('talented', 0.0034071583216143558),\n",
       " ('think', 0.0030141138040299391),\n",
       " ('forget', 0.0027816429618767705),\n",
       " ('general', 0.0026143805740708936),\n",
       " ('clear', 0.0025412974286725481),\n",
       " ('all', 0.0021054500073594685),\n",
       " ('character', 0.0019940186068644495),\n",
       " ('hear', 0.0018681725776140919),\n",
       " ('track', 4.9750006229032023e-05),\n",
       " ('after', -0.00015890817094967843),\n",
       " ('never', -0.00042954009189880412),\n",
       " ('on', -0.00076048219514009423),\n",
       " ('these', -0.0013770945485872725),\n",
       " ('characters', -0.0013866871936003551),\n",
       " ('having', -0.0017110649105308326),\n",
       " ('where', -0.0046068686345385919),\n",
       " ('bar', -0.0053991646777706015),\n",
       " ('common', -0.0055797401723610184),\n",
       " ('hands', -0.0056901393722997495),\n",
       " ('beat', -0.0067827273122747639),\n",
       " ('screenplay', -0.0071192992723728126),\n",
       " ('tension', -0.0082823795918927513),\n",
       " ('expect', -0.0085236179997016364),\n",
       " ('accident', -0.0086710252899960139),\n",
       " ('fighting', -0.009589809529572859),\n",
       " ('', -0.0096289787666572688),\n",
       " ...]"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# words most frequently seen in a review with \"POSITIVE\" label\n",
    "pos_neg_ratios.most_common()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[('waste', -2.4907515123361046),\n",
       " ('pointless', -2.3451073877136341),\n",
       " ('redeeming', -2.2667790015910296),\n",
       " ('worst', -2.1930856334332267),\n",
       " ('laughable', -2.172468615469592),\n",
       " ('awful', -2.1385076866397488),\n",
       " ('poorly', -2.1326133844207011),\n",
       " ('lame', -1.9117232884159072),\n",
       " ('horrible', -1.844894301366784),\n",
       " ('pathetic', -1.8356498920533246),\n",
       " ('wasted', -1.7773187850732606),\n",
       " ('crap', -1.7677639636718392),\n",
       " ('badly', -1.6974777654416224),\n",
       " ('worse', -1.6820086052689358),\n",
       " ('terrible', -1.6742829939664696),\n",
       " ('mess', -1.6373136300125852),\n",
       " ('garbage', -1.6342944202026248),\n",
       " ('stupid', -1.6042380193725321),\n",
       " ('dull', -1.5370486519863287),\n",
       " ('avoid', -1.5285820410306898),\n",
       " ('wooden', -1.5231262936001064),\n",
       " ('whatsoever', -1.4673642120941253),\n",
       " ('excuse', -1.4656396376364811),\n",
       " ('ridiculous', -1.4643037391798193),\n",
       " ('boring', -1.4475226133603798),\n",
       " ('bother', -1.3837974809213034),\n",
       " ('dumb', -1.3830343745326832),\n",
       " ('annoying', -1.3279306437993517),\n",
       " ('bad', -1.3181383703873577),\n",
       " ('unless', -1.3136186458671415)]"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# words most frequently seen in a review with a \"NEGATIVE\" label\n",
    "list(reversed(pos_neg_ratios.most_common()))[0:30]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python [default]",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}