Real_or_Fake_News.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# PROBLEM STATEMENT\n",
    "\n",
    "To build a model to accurately classify a piece of news as REAL or FAKE.\n",
    "\n",
    "Using sklearn,  build a TfidfVectorizer on the provided dataset. Then, initialize a PassiveAggressive Classifier and fit the model. In the end, the accuracy score and the confusion matrix tell us how well our model fares."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>1. Importing Libraries"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:09.931097Z",
     "start_time": "2020-05-01T16:19:07.320008Z"
    }
   },
   "outputs": [],
   "source": [
    "import numpy as np; import pandas as pd; import matplotlib.pyplot as plt; import seaborn as sns"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>2. Reading the Data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:10.424843Z",
     "start_time": "2020-05-01T16:19:09.934920Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unnamed: 0</th>\n",
       "      <th>title</th>\n",
       "      <th>text</th>\n",
       "      <th>label</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>8476</td>\n",
       "      <td>You Can Smell Hillary’s Fear</td>\n",
       "      <td>Daniel Greenfield, a Shillman Journalism Fello...</td>\n",
       "      <td>FAKE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>10294</td>\n",
       "      <td>Watch The Exact Moment Paul Ryan Committed Pol...</td>\n",
       "      <td>Google Pinterest Digg Linkedin Reddit Stumbleu...</td>\n",
       "      <td>FAKE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>3608</td>\n",
       "      <td>Kerry to go to Paris in gesture of sympathy</td>\n",
       "      <td>U.S. Secretary of State John F. Kerry said Mon...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>10142</td>\n",
       "      <td>Bernie supporters on Twitter erupt in anger ag...</td>\n",
       "      <td>— Kaydee King (@KaydeeKing) November 9, 2016 T...</td>\n",
       "      <td>FAKE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>875</td>\n",
       "      <td>The Battle of New York: Why This Primary Matters</td>\n",
       "      <td>It's primary day in New York and front-runners...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6330</td>\n",
       "      <td>4490</td>\n",
       "      <td>State Department says it can't find emails fro...</td>\n",
       "      <td>The State Department told the Republican Natio...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6331</td>\n",
       "      <td>8062</td>\n",
       "      <td>The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...</td>\n",
       "      <td>The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...</td>\n",
       "      <td>FAKE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6332</td>\n",
       "      <td>8622</td>\n",
       "      <td>Anti-Trump Protesters Are Tools of the Oligarc...</td>\n",
       "      <td>Anti-Trump Protesters Are Tools of the Oligar...</td>\n",
       "      <td>FAKE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6333</td>\n",
       "      <td>4021</td>\n",
       "      <td>In Ethiopia, Obama seeks progress on peace, se...</td>\n",
       "      <td>ADDIS ABABA, Ethiopia —President Obama convene...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6334</td>\n",
       "      <td>4330</td>\n",
       "      <td>Jeb Bush Is Suddenly Attacking Trump. Here's W...</td>\n",
       "      <td>Jeb Bush Is Suddenly Attacking Trump. Here's W...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>6335 rows × 4 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      Unnamed: 0                                              title  \\\n",
       "0           8476                       You Can Smell Hillary’s Fear   \n",
       "1          10294  Watch The Exact Moment Paul Ryan Committed Pol...   \n",
       "2           3608        Kerry to go to Paris in gesture of sympathy   \n",
       "3          10142  Bernie supporters on Twitter erupt in anger ag...   \n",
       "4            875   The Battle of New York: Why This Primary Matters   \n",
       "...          ...                                                ...   \n",
       "6330        4490  State Department says it can't find emails fro...   \n",
       "6331        8062  The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...   \n",
       "6332        8622  Anti-Trump Protesters Are Tools of the Oligarc...   \n",
       "6333        4021  In Ethiopia, Obama seeks progress on peace, se...   \n",
       "6334        4330  Jeb Bush Is Suddenly Attacking Trump. Here's W...   \n",
       "\n",
       "                                                   text label  \n",
       "0     Daniel Greenfield, a Shillman Journalism Fello...  FAKE  \n",
       "1     Google Pinterest Digg Linkedin Reddit Stumbleu...  FAKE  \n",
       "2     U.S. Secretary of State John F. Kerry said Mon...  REAL  \n",
       "3     — Kaydee King (@KaydeeKing) November 9, 2016 T...  FAKE  \n",
       "4     It's primary day in New York and front-runners...  REAL  \n",
       "...                                                 ...   ...  \n",
       "6330  The State Department told the Republican Natio...  REAL  \n",
       "6331  The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...  FAKE  \n",
       "6332   Anti-Trump Protesters Are Tools of the Oligar...  FAKE  \n",
       "6333  ADDIS ABABA, Ethiopia —President Obama convene...  REAL  \n",
       "6334  Jeb Bush Is Suddenly Attacking Trump. Here's W...  REAL  \n",
       "\n",
       "[6335 rows x 4 columns]"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "news = pd.read_csv('news.csv')\n",
    "news"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:10.435415Z",
     "start_time": "2020-05-01T16:19:10.427836Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(6335, 4)"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Finding observations of the Data\n",
    "news.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So we have 6335 rows and 4 columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:10.574017Z",
     "start_time": "2020-05-01T16:19:10.437800Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Unnamed: 0    6335\n",
       "title         6335\n",
       "text          6335\n",
       "label         6335\n",
       "dtype: int64"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "news.count()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:10.769856Z",
     "start_time": "2020-05-01T16:19:10.578004Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "REAL    3171\n",
       "FAKE    3164\n",
       "Name: label, dtype: int64"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "news['label'].value_counts()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So we have 3171 real and 3164 fake news"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:11.186868Z",
     "start_time": "2020-05-01T16:19:10.779756Z"
    }
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYsAAAEGCAYAAACUzrmNAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8QZhcZAAAWCElEQVR4nO3df7DddX3n8eeLgFXBCpTEpQQIo9k1hMVgYsCyi4AFAtIN/hzSVVKVibuLu6XT3RnsH8WVZW214IhaOnRIBX+QMiprFAY2olK1CiQ0QACBKChXsnBpImJRIeG9f5zvxZPk3vu9wXvOvcl5PmbOnPN9fz/f73mfzEle+f48qSokSRrPXlPdgCRp+jMsJEmtDAtJUivDQpLUyrCQJLXae6ob6IWDDjqo5syZM9VtSNJuZd26dU9U1czR5u2RYTFnzhzWrl071W1I0m4lyY/GmuduqAH0y1/+ksWLF/Oa17yG+fPnc+GFFwLwyU9+kle96lUk4YknnthumW9+85ssWLCA+fPn84Y3vGG7edu2beOYY47hzDPP7Ntn0J5rV7+fH/3oR1mwYAELFizgqKOOYsaMGWzevBmA97znPcyaNYujjjpqSj7LHqWq9rjHwoULS2N77rnn6qmnnqqqqmeeeaYWL15c3/3ud+uOO+6ohx56qA4//PAaHh5+fvyWLVtq3rx59aMf/aiqqh577LHt1nfJJZfUsmXL6k1velP/PoT2WLv6/ey2evXqOumkk56fvuWWW2rdunU1f/78vvS+uwPW1hj/rrplMYCSsN9++wHw7LPP8uyzz5KEY445htGO9Xz+85/nLW95C4cddhgAs2bNen7e0NAQ119/Peeee25feteeb1e/n92uueYali1b9vz0CSecwIEHHtjLdgeGYTGgtm3bxoIFC5g1axannHIKxx577JhjH3jgAbZs2cKJJ57IwoULufrqq5+fd/755/ORj3yEvfbyq6TJsyvfzxFPP/00N954I29961v70OHg8W/4gJoxYwbr169naGiI2267jQ0bNow5duvWraxbt47rr7+em266iYsuuogHHniAr371q8yaNYuFCxf2sXMNgl35fo74yle+wvHHH++WRI8YFgNu//3358QTT+TGG28cc8zs2bNZsmQJ++67LwcddBAnnHACd955J9/5zndYvXo1c+bM4eyzz+brX/8673znO/vYvfZ0E/l+jli1atV2u6A0uQyLATQ8PMxPf/pTAH7xi1/wta99jVe/+tVjjl+6dCnf+ta32Lp1K08//TS33nor8+bN48Mf/jBDQ0M8/PDDrFq1ipNPPpnPfvaz/foY2kPt6vcT4Mknn+SWW25h6dKl/WhxIBkWA2jTpk2cdNJJHH300bzuda/jlFNO4cwzz+Syyy5j9uzZDA0NcfTRRz9/0HrevHksWbKEo48+msWLF3Puued6KqJ6Zle/nwDXXXcdp556Kvvuu+9261q2bBmvf/3ruf/++5k9ezZXXnllvz/OHiO1B/6exaJFi8qL8iRp1yRZV1WLRpu3R17BPRkW/o+r2wdp4Kz76DlT3QIAP/7Qv53qFjQNHfbnd/ds3e6GkiS1MiwkSa0MC0lSK8NCktTKsJAktTIsJEmtDAtJUquehUWSFye5LcmdSe5J8j+b+hFJbk3yYJK/T/Kipv5bzfTGZv6crnV9oKnfn+S0XvUsSRpdL7csfgWcXFWvARYAS5IcB/wl8LGqmgtsAd7bjH8vsKWqXgV8rBlHkiOBs4H5wBLgr5PM6GHfkqQd9Cwsmh9e+nkzuU/zKOBk4AtN/SrgrOb10maaZv4bk6Spr6qqX1XVQ8BGYHGv+pYk7aynxyySzEiyHngcWAP8APhpVW1thgwBhzSvDwEeAWjmPwn8Tnd9lGW632tFkrVJ1g4PD/fi40jSwOppWFTVtqpaAMymszUwb7RhzXPGmDdWfcf3uqKqFlXVopkzZ77QliVJo+jL2VBV9VPgm8BxwP5JRm5gOBt4tHk9BBwK0Mx/ObC5uz7KMpKkPujl2VAzk+zfvH4J8PvAfcA3gLc1w5YDX25er26maeZ/vTr3T18NnN2cLXUEMBe4rVd9S5J21stblB8MXNWcubQXcG1VfTXJvcCqJP8L+Cdg5NdIrgQ+k2QjnS2KswGq6p4k1wL3AluB86pqWw/7liTtoGdhUVV3AceMUv8ho5zNVFW/BN4+xrouBi6e7B4lSRPjFdySpFaGhSSplWEhSWplWEiSWhkWkqRWhoUkqZVhIUlqZVhIkloZFpKkVoaFJKmVYSFJamVYSJJaGRaSpFaGhSSplWEhSWplWEiSWhkWkqRWhoUkqZVhIUlqZVhIkloZFpKkVoaFJKmVYSFJatWzsEhyaJJvJLkvyT1J/ripfzDJT5Ksbx5ndC3zgSQbk9yf5LSu+pKmtjHJBb3qWZI0ur17uO6twJ9W1R1JXgasS7Kmmfexqvqr7sFJjgTOBuYDvwt8Lcm/bmZ/CjgFGAJuT7K6qu7tYe+SpC49C4uq2gRsal4/leQ+4JBxFlkKrKqqXwEPJdkILG7mbayqHwIkWdWMNSwkqU/6cswiyRzgGODWpvT+JHclWZnkgKZ2CPBI12JDTW2suiSpT3oeFkn2A74InF9VPwMuB14JLKCz5XHJyNBRFq9x6ju+z4oka5OsHR4enpTeJUkdPQ2LJPvQCYrPVdWXAKrqsaraVlXPAX/Lr3c1DQGHdi0+G3h0nPp2quqKqlpUVYtmzpw5+R9GkgZYL8+GCnAlcF9VXdpVP7hr2JuBDc3r1cDZSX4ryRHAXOA24HZgbpIjkryIzkHw1b3qW5K0s16eDXU88C7g7iTrm9qfAcuSLKCzK+lh4H0AVXVPkmvpHLjeCpxXVdsAkrwfuAmYAaysqnt62LckaQe9PBvq24x+vOGGcZa5GLh4lPoN4y0nSeotr+CWJLUyLCRJrQwLSVIrw0KS1MqwkCS1MiwkSa0MC0lSK8NCktTKsJAktTIsJEmtDAtJUivDQpLUyrCQJLUyLCRJrQwLSVIrw0KS1MqwkCS1MiwkSa0MC0lSK8NCktTKsJAktTIsJEmtDAtJUivDQpLUqmdhkeTQJN9Icl+Se5L8cVM/MMmaJA82zwc09SS5LMnGJHcleW3XupY34x9MsrxXPUuSRtfLLYutwJ9W1TzgOOC8JEcCFwA3V9Vc4OZmGuB0YG7zWAFcDp1wAS4EjgUWAxeOBIwkqT96FhZVtamq7mhePwXcBxwCLAWuaoZdBZzVvF4KXF0d3wP2T3IwcBqwpqo2V9UWYA2wpFd9S5J21pdjFknmAMcAtwKvqKpN0AkUYFYz7BDgka7FhpraWPUd32NFkrVJ1g4PD0/2R5CkgdbzsEiyH/BF4Pyq+tl4Q0ep1Tj17QtVV1TVoqpaNHPmzBfWrCRpVD0NiyT70AmKz1XVl5ryY83uJZrnx5v6EHBo1+KzgUfHqUuS+qSXZ0MFuBK4r6ou7Zq1Ghg5o2k58OWu+jnNWVHHAU82u6luAk5NckBzYPvUpiZJ6pO9e7ju44F3AXcnWd/U/gz4C+DaJO8Ffgy8vZl3A3AGsBF4Gng3QFVtTnIRcHsz7kNVtbmHfUuSdtCzsKiqbzP68QaAN44yvoDzxljXSmDl5HUnSdoVXsEtSWplWEiSWhkWkqRWhoUkqZVhIUlqNaGwSHLzRGqSpD3TuKfOJnkx8FLgoOaCuJFTYX8b+N0e9yZJmibarrN4H3A+nWBYx6/D4mfAp3rYlyRpGhk3LKrq48DHk/zXqvpEn3qSJE0zE7qCu6o+keT3gDndy1TV1T3qS5I0jUwoLJJ8BnglsB7Y1pQLMCwkaQBM9N5Qi4Ajm/s3SZIGzESvs9gA/KteNiJJmr4mumVxEHBvktuAX40Uq+o/9KQrSdK0MtGw+GAvm5AkTW8TPRvqll43IkmaviZ6NtRTdM5+AngRsA/wL1X1271qTJI0fUx0y+Jl3dNJzgIW96QjSdK084LuOltV/wc4eZJ7kSRNUxPdDfWWrsm96Fx34TUXkjQgJno21B90vd4KPAwsnfRuJEnT0kSPWby7141Ikqavif740ewk1yV5PMljSb6YZHavm5MkTQ8TPcD9d8BqOr9rcQjwlaYmSRoAEw2LmVX1d1W1tXl8Gpg53gJJVjZbIhu6ah9M8pMk65vHGV3zPpBkY5L7k5zWVV/S1DYmuWAXP58kaRJMNCyeSPLOJDOaxzuBf25Z5tPAklHqH6uqBc3jBoAkRwJnA/ObZf565L3o/CLf6cCRwLJmrCSpjyYaFu8B3gH8P2AT8DZg3IPeVfUPwOYJrn8psKqqflVVDwEb6Vz0txjYWFU/rKpngFV4FpYk9d1Ew+IiYHlVzayqWXTC44Mv8D3fn+SuZjfVAU3tEOCRrjFDTW2s+k6SrEiyNsna4eHhF9iaJGk0Ew2Lo6tqy8hEVW0GjnkB73c5nV/cW0BnC+WSpp5RxtY49Z2LVVdU1aKqWjRz5riHUyRJu2iiYbFX11YASQ5k4hf0Pa+qHquqbVX1HPC3/Pr+UkPAoV1DZwOPjlOXJPXRRP/BvwT4xyRfoPM/+3cAF+/qmyU5uKo2NZNvpvMLfNA5LffzSS6lc3ruXOA2OlsWc5McAfyEzkHwP9zV95Uk/WYmegX31UnW0rl5YIC3VNW94y2T5BrgROCgJEPAhcCJSRbQCZyHgfc1678nybXAvXRuJ3JeVW1r1vN+4CZgBrCyqu7Z1Q8pSfrNTHhXUhMO4wbEDuOXjVK+cpzxFzPK1kpzeu0NE31fSdLke0G3KJckDRbDQpLUyrCQJLUyLCRJrQwLSVIrw0KS1MqwkCS1MiwkSa0MC0lSK8NCktTKsJAktTIsJEmtDAtJUivDQpLUyrCQJLUyLCRJrQwLSVIrw0KS1MqwkCS1MiwkSa0MC0lSK8NCktTKsJAktepZWCRZmeTxJBu6agcmWZPkweb5gKaeJJcl2ZjkriSv7VpmeTP+wSTLe9WvJGlsvdyy+DSwZIfaBcDNVTUXuLmZBjgdmNs8VgCXQydcgAuBY4HFwIUjASNJ6p+ehUVV/QOweYfyUuCq5vVVwFld9aur43vA/kkOBk4D1lTV5qraAqxh5wCSJPVYv49ZvKKqNgE0z7Oa+iHAI13jhpraWPWdJFmRZG2StcPDw5PeuCQNsulygDuj1Gqc+s7FqiuqalFVLZo5c+akNidJg67fYfFYs3uJ5vnxpj4EHNo1bjbw6Dh1SVIf9TssVgMjZzQtB77cVT+nOSvqOODJZjfVTcCpSQ5oDmyf2tQkSX20d69WnOQa4ETgoCRDdM5q+gvg2iTvBX4MvL0ZfgNwBrAReBp4N0BVbU5yEXB7M+5DVbXjQXNJUo/1LCyqatkYs944ytgCzhtjPSuBlZPYmiRpF02XA9ySpGnMsJAktTIsJEmtDAtJUivDQpLUyrCQJLUyLCRJrQwLSVIrw0KS1MqwkCS1MiwkSa0MC0lSK8NCktTKsJAktTIsJEmtDAtJUivDQpLUyrCQJLUyLCRJrQwLSVIrw0KS1MqwkCS1MiwkSa0MC0lSqykJiyQPJ7k7yfoka5vagUnWJHmweT6gqSfJZUk2JrkryWunomdJGmRTuWVxUlUtqKpFzfQFwM1VNRe4uZkGOB2Y2zxWAJf3vVNJGnDTaTfUUuCq5vVVwFld9aur43vA/kkOnooGJWlQTVVYFPB/k6xLsqKpvaKqNgE0z7Oa+iHAI13LDjW17SRZkWRtkrXDw8M9bF2SBs/eU/S+x1fVo0lmAWuSfH+csRmlVjsVqq4ArgBYtGjRTvMlSS/clGxZVNWjzfPjwHXAYuCxkd1LzfPjzfAh4NCuxWcDj/avW0lS38Miyb5JXjbyGjgV2ACsBpY3w5YDX25erwbOac6KOg54cmR3lSSpP6ZiN9QrgOuSjLz/56vqxiS3A9cmeS/wY+DtzfgbgDOAjcDTwLv737IkDba+h0VV/RB4zSj1fwbeOEq9gPP60JokaQzT6dRZSdI0ZVhIkloZFpKkVoaFJKmVYSFJamVYSJJaGRaSpFaGhSSplWEhSWplWEiSWhkWkqRWhoUkqZVhIUlqZVhIkloZFpKkVoaFJKmVYSFJamVYSJJaGRaSpFaGhSSplWEhSWplWEiSWhkWkqRWhoUkqdVuExZJliS5P8nGJBdMdT+SNEh2i7BIMgP4FHA6cCSwLMmRU9uVJA2O3SIsgMXAxqr6YVU9A6wClk5xT5I0MPae6gYm6BDgka7pIeDY7gFJVgArmsmfJ7m/T70NgoOAJ6a6iekgf7V8qlvQzvx+jrgwv+kaDh9rxu4SFqP9CdR2E1VXAFf0p53BkmRtVS2a6j6k0fj97I/dZTfUEHBo1/Rs4NEp6kWSBs7uEha3A3OTHJHkRcDZwOop7kmSBsZusRuqqrYmeT9wEzADWFlV90xxW4PE3Xuazvx+9kGqqn2UJGmg7S67oSRJU8iwkCS1MiwGUJJtSdZ3PeZ0zft4kp8k2aur9kdJPtm83ivJVUlWpuPhJHd3reuy/n8i7Um6vp8bknwlyf5NfU6SX+zw3T2na7ljklSS03ZY38/7/Rn2RLvFAW5Nul9U1YIdi01AvJnOBZAnAN/cYX6AvwH2Ad5dVdUpcVJVeVGUJsvz388kVwHnARc3834w2ne3sQz4dvN8U8+7HDBuWajbScAG4HI6f+F29HHgd4Bzquq5fjamgfVdOndwGFfzH5m3AX8EnJrkxT3ua+AYFoPpJV2b8dd11ZcB1wDXAWcm2adr3h8CC4Gzq2rrDuv7Rtf6/qS3rWtQNDcQfSPbX1P1yh12Q/37pn488FBV/YDOFvEZ/e12z+duqMG0026o5mLHM4A/qaqnktwKnApc3wy5A3g1nZs6fmeH9bkbSpPpJUnWA3OAdcCarnlj7YZaRucGozTP7wK+1MsmB41bFhqxBHg5cHeSh4F/x/a7or4PvAP4+yTz+9+eBsjIf2YOB15E55jFmJotkLcCf958dz8BnJ7kZb1udJAYFhqxDDi3quZU1RzgCDr7fl86MqCq/hH4T8D1SQ6bmjY1KKrqSeC/Af99h12iO/p94M6qOrT5/h4OfBE4qx99Dgp3Q4kmEE4D3jdSq6p/SfJt4A+6x1bVV5PMBG7s2l/8jSTbmtd3VdU5SJOgqv4pyZ107gf3LZpjFl1DVgKvpXOcrdsXgf8MfAZ4aZKhrnmXVtWlPWx7j+TtPiRJrdwNJUlqZVhIkloZFpKkVoaFJKmVYSFJamVYSJOg7c6mzR1TN+ziOj+d5G2/WWfS5DAsJEmtDAtpEiXZL8nNSe5ofudjadfsvZvfArkryRdGro5PsjDJLUnWJbkpycFT1L40JsNCmly/BN5cVa+lc8v3S5rbZwP8G+CKqjoa+BnwX5rbWHwCeFtVLaRzRfLFo6xXmlLe7kOaXAH+d5ITgOfo/BbDK5p5j1TVyB17P0vnvkc3AkcBa5pMmQFs6mvH0gQYFtLk+o/ATGBhVT3b3AV15Id4dry3TtEJl3uq6vX9a1Hade6GkibXy4HHm6A4ic5ttkcclmQkFEZ+AvR+YOZIPck+3gJe05FhIU2uzwGLkqyls5Xx/a559wHLk9wFHAhcXlXP0Pk50L9s7q66Hvi9PvcstfKus5KkVm5ZSJJaGRaSpFaGhSSplWEhSWplWEiSWhkWkqRWhoUkqdX/B8dbxWXn1OCEAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "#Visualising that\n",
    "# plt.figure(figsize=(6, 8))\n",
    "splot = sns.countplot(news['label'])\n",
    "for p in splot.patches:\n",
    "    splot.annotate(p.get_height(), (p.get_x() + p.get_width() / 2., \n",
    "                                               p.get_height()), ha = 'center', va = 'center', \n",
    "               xytext = (0, 5), textcoords = 'offset points')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:11.212156Z",
     "start_time": "2020-05-01T16:19:11.191981Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Unnamed: 0    0\n",
       "title         0\n",
       "text          0\n",
       "label         0\n",
       "dtype: int64"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Checking for Null Values\n",
    "news.isnull().sum()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So we have no null values here"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:11.373688Z",
     "start_time": "2020-05-01T16:19:11.215135Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "OnPolitics | 's politics blog                                                                         5\n",
       "Michael Moore Owes Me $4.99                                                                           3\n",
       "Hillary’s “Big Tent” is Obama’s “Grand Bargain” on Steroids                                           3\n",
       "Get Ready For Civil Unrest: Survey Finds That Most Americans Are Concerned About Election Violence    3\n",
       "Fighting Ghost Fascists While Aiding Real Ones                                                        2\n",
       "                                                                                                     ..\n",
       "Washington's Embargo on Cuba Not Effective, Isolated US - White House                                 1\n",
       "Biden previews battle against Clinton                                                                 1\n",
       "NATO calls for more troops for face-off against Putin                                                 1\n",
       "Why the death of GOP 'loyalty pledge' matters                                                         1\n",
       "Biden backers to naysayers: Not so fast                                                               1\n",
       "Name: title, Length: 6256, dtype: int64"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Checking unique entries in 'Text' and 'Title'\n",
    "news['title'].value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:11.575683Z",
     "start_time": "2020-05-01T16:19:11.383881Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Killing Obama administration rules, dismantling Obamacare and pushing through tax reform are on the early to-do list.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         58\n",
       "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              36\n",
       "A verdict in 2017 could have sweeping consequences for tech startups.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         23\n",
       "The election in 232 photos, 43 numbers and 131 quotes, from the two candidates at the center of it all.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       17\n",
       "On this day in 1973, J. Fred Buzhardt, a lawyer defending President Richard Nixon in the Watergate case, revealed that a key White House tape had an 18...                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    12\n",
       "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              ..\n",
       "Julian Assange canceled a dramatic London balcony address on Tuesday in favor of a video presentation in Berlin after WikiLeaks developed \"specific information\" regarding Assange's safety, the leaked emails clearinghouse tweeted on Monday afternoon.\\n\\nSome believe the video announcement by the WikiLeaks founder could be an \"October surprise\" geared towards the U.S. presidential election. Supporters of GOP presidential candidate Donald Trump have said they believe the announcement will be damaging to the candidacy of Democratic rival Hillary Clinton.\\n\\nAssange, 45, who has lived in the Ecuadorean Embassy in London for five years as officials in Sweden have sought him on criminal charges, is set to address supporters in Berlin via a video link at 3 a.m. ET.\\n\\n“I don’t want to give it away,” Assange told Fox News Channel’s Megyn Kelly in August, when he indicated he had a major scoop that could influence the race. “But it’s a variety of documents, from different types of institutions that are associated with the election campaign, some quite unexpected angles, some quite interesting, some even entertaining.”\\n\\nIn a subsequent interview with Fox News Channel’s Sean Hannity last month, Assange said his next round of revelations was coming “reasonably soon.”\\n\\n“The first batch is reasonably soon,” he told Hannity. “We are quite confident about it now.”\\n\\nAssange has already played a key role in the presidential race, with the release of 20,000 internal emails that indicated the Democratic National Committee appeared to conspire to prevent Bernie Sanders from winning the nomination. Those revelations surfaced in August, just before the party’s convention, proving embarrassing to Clinton’s campaign. They also led to the resignation of DNC Chairwoman Debbie Wasserman Schultz.\\n\\nThough no recent public revelations directly tie to Assange's security fears, various U.S. officials and pundits have made threatening statements directed at him in the past. WikiLeaks on Monday tweeted an alleged quote from a 2010 State Department meeting at which then-Secretary of State Hillary Clinton asked if Assange could be killed in a drone strike. That same year, former Democrat strategist Bob Beckel said on Fox News Channel that \"a dead man can't leak stuff.\"\\n\\nAssange also has hinted that deceased DNC staffer Seth Rich may have been a source for WikiLeaks. Rich, 27, was found with multiple gunshot wounds to the back at a Washington, D.C., intersection in July. He died soon thereafter. Authorities believe Rich was the target of a botched robbery, but his death has inspired conspiracy theories.\\n\\n\\n\\nWikiLeaks has published more than 10 million leaked emails, including sensitive information about prisoners at Guantanamo Bay, U.S. military operations in Iraq and Afghanistan and a cache of diplomatic cables from U.S. embassies around the world.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    1\n",
       "Print \\nBefore you applaud me for my integrity or condemn me for selling out, allow me to explain my decision to vote for Donald Trump on Nov. 8. \\nFirst, I’m writing this because I have been asked incessantly for months how I would be voting, not because I think I’m someone special or that what I do should influence you. \\nSecond, I’m not endorsing Donald Trump. In my mind, there’s a world of difference between endorsing a candidate and voting for a candidate. \\nThird, I respect those in the #NeverTrump camp and share many of their concerns, including the possibility of his further vulgarizing and degrading the nation, the possibility of him deepening our ethnic and racial divides, and the possibility of him alienating our allies and unnecessarily provoking our enemies, just to name a few. Among the #NeverTrump voices I respect are columnists like David French and Ben Shapiro, bloggers like Matt Walsh and evangelical leaders like Russell Moore and Beth Moore. \\nFourth, I take strong exception to evangelicals who have fawned over Trump as if he were some kind of savior figure, supporting him as if he were St. Donald. I also take issue with evangelical leaders who want us to minimize some of Trump’s failings, constantly saying, “Let him who is without sin cast the first one” (see John 8:7). This is not a question of condemning the man but rather a question of making a moral assessment as to his readiness to serve our nation. \\nFifth, my decision to vote for Trump, barring something earth-shattering between now and Nov. 8, is consistent with my position, which has been: 1) During the GOP primaries, I issued strong warnings against voting for Trump while we had other excellent choices. I did this in writing , on video and on the radio, but always stating that if Trump won the nomination, I would re-evaluate my position. 2) Once Trump became the Republican candidate, I wrote that I was rooting for him to take steps in the right direction and thereby win my vote. 3) I have stated repeatedly that under no circumstances would I vote for Hillary. (For two strong warnings about Hillary, see here and here .) \\nSo, what has convinced me that I should now vote for Donald Trump? \\nThe culture war is not over! Gain hope, courage and practical advice in Michael Brown’s latest book, “Outlasting the Gay Revolution: Where Homosexual Activism Is Really Going and How to Turn the Tide” \\nFirst, I believe that he actually is serious about appointing pro-life, pro-Constitution Supreme Court justices. When he said during the last debate that if you’re pro-life, you want to see Roe v. Wade overturned, and when he reiterated at his Gettysburg speech that he will be drawing from his list of 20 potential appointees, he helped me feel more confident that he would not suddenly flip-flop if elected. \\nSecond, one reason I endorsed Sen. Ted Cruz was because he took on the political establishment, both Democratic and Republican, to the point of calling it the Washington cartel. Trump is an absolute wrecking ball to the negative parts of the political system (although, unfortunately, he’s been a wrecking ball to some of the good parts of the system), so my vote for him is also a protest vote. \\nThird, I am voting for the Republican platform, not the Republican Party, which means I’m in agreement with the platform while at the same time having very little confidence in the party as a whole. \\nFourth, while I have always felt that the line, “We’re electing a president, not a pastor,” was overstated and superficial, if we rephrased it to say, “We’re electing a general to train hand-to-hand combat warriors, not a pastor,” it might have more relevance. In other words, we are not looking for Trump to be a moral reformer (even if hedoes appoint righteous judges), and, at this point, he certainly is anything but a moral example (although we pray he will be truly converted and become one). Rather, out of our choices for president, which are stark, we are voting for the one most likely to defeat Hillary and make some good decisions for the nation, not be the savior. And with things so messed up in America, the hand-to-hand combat analogy is closer to home. \\nFifth, within the first few minutes of the last debate, the massive differences between Hillary and Trump were there for the world to see, she a pro-abortion radical and an extreme supporter of the LGBT agenda and he unashamedly speaking out against late-term abortions and wanting to appoint justices who would defend our essential liberties. Since I have the opportunity to vote, I feel that I should vote for Trump. \\nSixth, Trump continues to be drawn to conservative Christians, and not just ones who tickle his ears. One of my dear friends has spent hours with Trump and members of his family, and he has told me that in 55 years of ministry, no one has received him as openly and graciously as has Trump. Yet my friend continues to speak the truth to him in the clearest possible terms. While I am not one of those claiming that Trump is a born-again Christian (I see absolutely no evidence of this), the fact that he continues to listen to godly men and open the door to their counsel indicates that something positive could possibly be going on. It also indicates that these godly leaders might be a positive influence on him if he were elected president. \\nSeventh, although I’m quite aware that a president could do great harm or good to the nation, I’m far more concerned with what we as God’s people do with our own lives and witnesses, and for me, the state of the church of America is much more important than the state of the White House. In that context, I echo the words (and warning) of Dr. Martin Luther King Jr.: “The church must be reminded that it is not the master or the servant of the state, but rather the conscience of the state. It must be the guide and the critic of the state, and never its tool. If the church does not recapture its prophetic zeal, it will become an irrelevant social club without moral or spiritual authority.” \\nSo, in sum: 1) My hope is in God, not Donald Trump, and I do recognize that either Hillary or Trump has the potential to do great harm to America; 2) My urgent call is for us as followers of Jesus to get our own act together so we can be the salt and light of the nation; 3) I will continue to urge all believers not to vote for Hillary Clinton, whose policies will certainly do us great harm; and 4) Ultimately, the most effective way to defeat Hillary is to vote for Trump, while also praying that God will use him for good , not for evil. \\nIn the end, if Trump gets elected and fails miserably, I will be grieved but not devastated. If he does well, I will rejoice. \\nEither way, though, my vote is just that: a vote. My greater role is to live a life pleasing to God with the hope of advancing a gospel-based moral and cultural revolution. Receive Michael Brown's commentaries in your email BONUS: By signing up for Michael Brown's alerts, you will also be signed up for news and special offers from WND via email. Name *     1\n",
       "The big release of the latest National Review edition, with a cover declaring “Against Trump,” on Thursday night was above all other things a wonderful gift not just to liberals, but anyone who lives outside of the conservative tribe. Because it gives us a glimpse, however temporary, of what it feels like to be a Trump supporter. I defy readers to take one look at the cover and not feel an overwhelming surge of contempt for these establishment conservatives who love to pander to the camo-crowd when it suits them, but get fussy when the rubes rise up and start demanding real skin in the game. You want to rub their smug little faces right in Donald Trump’s ridiculous hair and ask how they like those apples.\\n\\nAny discerning reader knows that, on some level, you’re meant to root for the monster to turn on Dr. Frankenstein, for the Pied Piper to take the children away, for Satan to finally come for Dr. Faustus. And so it’s impossible not to take pleasure in watching the conservative base come extract its pound of Trump-shaped flesh out of the establishment.\\n\\nIt’s no mystery why the National Review and their supporters hate Trump. He’s vulgar and embarrassing and he does an even better job of exploiting the right-wing rubes and their racism and their provincialism and their ridiculous sense of oppression than they do. They are, in other words, haters. And Trump dismissed them as the haters they are with ease during his press conference Thursday night where he called the National Review a “dead paper” that almost no one reads anymore.\\n\\nThis impression is driven home by actually reading the issue. The editors can’t quite seem to decide what their exact objections to Trump are. Is it that he’s driving the right too far in the direction of fascism or that he’s a secret liberal in disguise? Both! Whatever you need to hear! The strategy is argument through overwhelming. They’ll throw everything they’ve got, even contradictory stuff, at the reader and hope the sheer volume of words impresses them enough to vote for Marco Rubio or Jeb Bush.\\n\\nThe everything-and-the-kitchen-sink strategy produces some hilarious contradictions. The main anti-Trump editorial, written by the editors, darkly warns that Trump isn’t the racist that his followers think he is. “Trump says he will put a big door in his beautiful wall, an implicit endorsement of the dismayingly conventional view that current levels of legal immigration are fine,” they write, even trying to get the reader to believe that Trump’s mass deportation plan is “poorly disguised amnesty”.\\n\\nBut then, in the writer round-up, we’re hearing a different story. “Not since George Wallace has there been a presidential candidate who made racial and religious scapegoating so central to his campaign,” David Boaz sniffs, adding that America “aspired to rise above such prejudices and guarantee life, liberty, and the pursuit of happiness to everyone.”\\n\\nSo which is it, guys? Is Trump offensive because he’s too nativist or because he’s not devoted enough to keeping the foreigners out? Whatever will make you not vote for him, I guess.\\n\\nA similar question emerges when it comes to the conservative obsession with masculinity, which they confuse with strength. The editors write that Trump “has an astonishing weakness for flattery, falling for Vladimir Putin after a few coquettish bats of the eyelashes from the Russian thug.”\\n\\nOn the other hand, Ben Domenech worries that Trump is “a tyrannical monarch” who he believes is too eager to “impose [his] will on the nation”. Mona Charen chimes in agreement, saying “conservatism implies a certain modesty about government.” So which is it? Does a big ego make one weak or is the problem that it makes one too strong and authoritarian? Both, I guess! Depends on if you’re more of an anxious masculinity conservative or if you’re one who likes to delude yourself into believing you’re a libertarian sort. Either way, don’t vote Trump! The self-contradictions are particularly amusing, to me at least, on the issue of women. Charen denounces Trump for his need to “constantly to insult and belittle others including, or perhaps especially, women”. But she and many of the other writers also warn the reader about Trump’s pro-choice past, insinuating that he’s not on board with the anti-choice movement. A movement, may I remind you, that is passing mandatory ultrasound and waiting period laws and other medically unnecessary regulations, for the purpose of insulting and shaming women. This self-important National Review manifesto can’t even decide how to feel about the practice of insulting and belittling people. On one hand, as Charen writes, they believe it’s a sign of “a pitifully insecure person”. What then to make of the fact that much of the anti-Trump argument is rooted in cheap shots at the man, from the you’re-a-girl insult regarding his behavior around Putin to Mark Helprin’s swipe at Trump for having “hair like the tinsel on discarded Christmas trees”. I guess everyone at the National Review is a “pitifully insecure person”, so why is it only a crime when said insulter is Donald Trump? Is it because he’s better at it than you guys? It’s tough to say what the National Review expected out of this, besides selling more issues. And even that has a strong possibility of backfiring, as this attack gave Trump an opportunity to imply, with cause, that they are using his name to bolster their declining sales. If the idea was to pry base voters off Trump, good luck with that. All this does is confirm base voter suspicions that the conservative establishment sees them as a bunch of useful idiots who are to be slapped down the second they start thinking they have a real voice in the movement. If the idea was to take a stand and lay out a clear line between the bellicose base and the more refined party elite, well, that’s backfiring, too, as the RNC reacted to all this by disinviting the National Review to partner with them in the Republican debates. In his anti-Trump screed, Ben Domenech gets on his high horse about how ours is supposed to be a “government of the people, by the people,”  which he claims Trump is threatening. Keep telling yourself that, buddy. Because it looks a whole lot like Trump’s popularity is due to “the people” revolting against a system where the establishment calls all the shots. And National Review’s flailing shows that the establishment has no idea what to do with that.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           1\n",
       "Share on Twitter \\nChloe Lattanzi, actress and daughter of Grammy-winning singer and Hollywood actress, Olivia Newton-John, is talking openly about the body image struggles she had as a teenager—and the things she did to combat her poor self-image. Image Credit: Screenshot/ YouTube \\nAppearing on Wednesday's episode of “The Doctors,” Lattanzi revealed that she had implants and plastic surgery when she was younger because she suffered from body dysmorphia . \\nBody dysmorphia is a disorder which makes people obsess over parts of their body. \\nPeople with the disorder imagine their bodies to be severely flawed, to the point that it makes it difficult for them to function normally. \\nLattanzi spoke about her particular experience with the disorder as a teenager, and the anorexia, anxiety, obsessive-compulsive disorder, and depression that accompanied it: \\n“I went through this sort of chubby phase [as a kid]- I ate to comfort myself. I would see comments in magazines about how I was chubby. So around 16 I started to restrict food, exercise more.” Image Credit: Chris Weeks/Getty Images \\nOver one summer in particular, Lattanzi lost a lot of weight, but her new thinness brought with it problems, too. \\nShe said she turned to plastic surgery and implants: \\n“When I was in the height of my body dysmorphia, I had a whole bunch of fillers. I’ve had that all removed from my face because I like the way I look naturally.” \\nRecently, Lattanzi saw some photographs of herself as a teenager and doesn't understand why she thought her appearance was so defective. Image Credit: Kevin Winter/Getty Images \\nShe says she's never shown the pictures to anyone before, but that they're a valuable tool for providing context to the mental illness from which she was suffering. \\nNow, having recovered from body dysmorphia and anorexia, the 30-year-old says she regrets making so many changes to her appearance: \\n“I look back at myself and I as a teenager and I’m like, 'What a beautiful young woman.' What was I thinking? Why was I so insecure?” Image Credit: Screenshot/ YouTube \\nLattanzi feels that social media's focus on appearance is a major culprit when it comes to young women struggling with negative self-image: \\n“I think so many young girls are going through body dysmorphia — we’re constantly told how we’re supposed to look via Instagram and filters. There’s constant pressure for us to look perfect.” \\nNow, Lattanzi says she's “stable and in a loving relationship,” but she's still plagued by some anxiety. \\nShe says the memory of her illness is a wound that may never completely heal. Image Credit: David Livingston/Getty Images \\nBody dysmorphia affects about 1.7% to 2.4% of the general population—or one in 50 people. \\nIt is often accompanied by eating disorders, depression, and anxiety disorders, such as obsessive-compulsive disorder. \\nSurprisingly, according to some studies, cases of body dysmorphia are more often found in men than women.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     1\n",
       "October 28, 2016 French Jews urged to rally over UNESCO resolutions \\nThe main Jewish groups in France urged members to rally in front of the headquarters of the country’s Foreign Ministry to protest its failure to oppose UN resolutions that ignore Jewish ties to Jerusalem, JTA reported on Thursday. \\nOn Wednesday, UNESCO’s World Heritage Committee passed a resolution denying the Jewish connection to the Temple Mount in Jerusalem. \\nOn October 13, the executive board of the UNESCO passed a similar resolution which refers to the Western Wall and the Temple Mount only by their Arabic-language names. \\nFrance was among 26 countries that abstained from voting during the first resolution. \\nCRIF, the political lobby group representing French Jewish communities, was joined in a rare move by the Consistoire, French Jewry’s organ responsible for religious services, in organizing a protest rally for Thursday opposite the Quai d’Orsay in Paris in reaction to the passing of the two resolutions on Jerusalem. \\n“We were shocked by the anti-Israeli obsession of UNESCO and are now revolted by its disavowal of its own values,” CRIF President Francis Kalifat wrote Wednesday in his call for French Jews to rally outside Quai d’Orsay.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             1\n",
       "Name: text, Length: 6060, dtype: int64"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "news['text'].value_counts()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So we have some common entries but most are unique"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:11.677277Z",
     "start_time": "2020-05-01T16:19:11.578674Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unnamed: 0</th>\n",
       "      <th>title</th>\n",
       "      <th>text</th>\n",
       "      <th>label</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>14</td>\n",
       "      <td>1571</td>\n",
       "      <td>Trump takes on Cruz, but lightly</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>90</td>\n",
       "      <td>1661</td>\n",
       "      <td>Exclusive: GOP campaigns plot revolt against RNC</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>157</td>\n",
       "      <td>1329</td>\n",
       "      <td>How Clinton plans to stop Sanders' momentum</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>316</td>\n",
       "      <td>1570</td>\n",
       "      <td>Rand Paul is flatlining</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>323</td>\n",
       "      <td>1610</td>\n",
       "      <td>Jeb Bush loses TV ad edge to Marco Rubio</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>399</td>\n",
       "      <td>1597</td>\n",
       "      <td>Trump treads on tradition in New Hampshire</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>485</td>\n",
       "      <td>2376</td>\n",
       "      <td>Gaming Obamacare</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>514</td>\n",
       "      <td>1590</td>\n",
       "      <td>Strong jobs number holds risks for Clinton</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1052</td>\n",
       "      <td>1742</td>\n",
       "      <td>Sanders’ challenge: Winning over Obama supporters</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1239</td>\n",
       "      <td>1406</td>\n",
       "      <td>GOP insiders: It was a rough night for Ted Cruz</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1314</td>\n",
       "      <td>1437</td>\n",
       "      <td>Iowa’s Des Moines Register endorses Clinton, R...</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1407</td>\n",
       "      <td>1546</td>\n",
       "      <td>Ted Cruz tackles the Wall Street Journal</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1545</td>\n",
       "      <td>1636</td>\n",
       "      <td>Insiders: Rubio wins, Kasich bombs</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1597</td>\n",
       "      <td>1644</td>\n",
       "      <td>5 things to watch in tonight’s debate</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2089</td>\n",
       "      <td>2405</td>\n",
       "      <td>Senate GOP prepared to replace Obamacare subsi...</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2133</td>\n",
       "      <td>1498</td>\n",
       "      <td>Bush donors await green light to jump ship</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2289</td>\n",
       "      <td>1616</td>\n",
       "      <td>Rubio battles Cruz for Iowa edge</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2293</td>\n",
       "      <td>1344</td>\n",
       "      <td>Insiders: Marco Rubio crashed and burned</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2337</td>\n",
       "      <td>1615</td>\n",
       "      <td>Clinton’s Iowa dilemma</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2444</td>\n",
       "      <td>2426</td>\n",
       "      <td>Obamacare case: All eyes on 2 justices</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2640</td>\n",
       "      <td>1660</td>\n",
       "      <td>GOP campaigns push to take more control of deb...</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2665</td>\n",
       "      <td>1349</td>\n",
       "      <td>Think the Iowa polls were bad? Wait until New ...</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2668</td>\n",
       "      <td>2406</td>\n",
       "      <td>Conservatives fear leaders soft on Obamacare</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2688</td>\n",
       "      <td>1508</td>\n",
       "      <td>5 things to watch in tonight’s GOP debate</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2811</td>\n",
       "      <td>1409</td>\n",
       "      <td>Five takeaways from the GOP debate</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2849</td>\n",
       "      <td>1655</td>\n",
       "      <td>Jeb Bush's view from the bottom</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2908</td>\n",
       "      <td>2382</td>\n",
       "      <td>Are Democrats crippling Obamacare?</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2911</td>\n",
       "      <td>1566</td>\n",
       "      <td>GOP contenders prep for loud, ugly holiday season</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2980</td>\n",
       "      <td>1306</td>\n",
       "      <td>GOP establishment stares into the abyss</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3324</td>\n",
       "      <td>2399</td>\n",
       "      <td>Senate GOP prepared to replace Obamacare subsi...</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3346</td>\n",
       "      <td>1525</td>\n",
       "      <td>Donald Trump's year of tweeting dangerously</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3364</td>\n",
       "      <td>2412</td>\n",
       "      <td>Obamacare group slashes staff</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3437</td>\n",
       "      <td>1591</td>\n",
       "      <td>Trump relents after withholding medical records</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3518</td>\n",
       "      <td>1715</td>\n",
       "      <td>Hillary’s cash flow issue</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3539</td>\n",
       "      <td>1549</td>\n",
       "      <td>14 key moments from the Democratic debate</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3566</td>\n",
       "      <td>1720</td>\n",
       "      <td>7 takeaways from the first Democratic debate</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3633</td>\n",
       "      <td>1673</td>\n",
       "      <td>Ben Carson vs. Ben Carson</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3740</td>\n",
       "      <td>2396</td>\n",
       "      <td>Obamacare's unlikely No. 1 city</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3744</td>\n",
       "      <td>1550</td>\n",
       "      <td>Sanders gets the fight he wanted</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3770</td>\n",
       "      <td>1355</td>\n",
       "      <td>Everything you need to know about the next Dem...</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3883</td>\n",
       "      <td>1608</td>\n",
       "      <td>The 2016 ballot wars begin</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4012</td>\n",
       "      <td>1545</td>\n",
       "      <td>Talk radio rallies around Ted Cruz</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4313</td>\n",
       "      <td>1468</td>\n",
       "      <td>Dem insiders: Sanders failed to dent Clinton</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4404</td>\n",
       "      <td>1322</td>\n",
       "      <td>Insiders: Sanders and Trump will win New Hamps...</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4457</td>\n",
       "      <td>1555</td>\n",
       "      <td>Bush v. Trump: Behind the Vegas rumble</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4490</td>\n",
       "      <td>1327</td>\n",
       "      <td>Rubio’s problem: An excess of caution</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4615</td>\n",
       "      <td>1540</td>\n",
       "      <td>Cruz and Trump battle for the South</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4633</td>\n",
       "      <td>1291</td>\n",
       "      <td>5 things to watch in tonight's debate</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4921</td>\n",
       "      <td>1276</td>\n",
       "      <td>How Cruz rescued Carson</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5427</td>\n",
       "      <td>2379</td>\n",
       "      <td>Alaska scrambles to prevent Obamacare collapse</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5708</td>\n",
       "      <td>1372</td>\n",
       "      <td>Clinton ekes out win in Iowa against Sanders</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5725</td>\n",
       "      <td>1496</td>\n",
       "      <td>Rand Paul: I won the debate last night</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5820</td>\n",
       "      <td>1367</td>\n",
       "      <td>Rand Paul drops out of White House race</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5908</td>\n",
       "      <td>1387</td>\n",
       "      <td>Insiders: Trump and Clinton will carry Iowa</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5927</td>\n",
       "      <td>2450</td>\n",
       "      <td>GOP searches for Obamacare fix</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6062</td>\n",
       "      <td>1307</td>\n",
       "      <td>5 takeaways from New Hampshire</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6194</td>\n",
       "      <td>1736</td>\n",
       "      <td>Rand Paul's all-too-familiar campaign</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6270</td>\n",
       "      <td>1743</td>\n",
       "      <td>Inside Bernie Sanders’ unorthodox debate prep</td>\n",
       "      <td>Killing Obama administration rules, dismantlin...</td>\n",
       "      <td>REAL</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      Unnamed: 0                                              title  \\\n",
       "14          1571                   Trump takes on Cruz, but lightly   \n",
       "90          1661   Exclusive: GOP campaigns plot revolt against RNC   \n",
       "157         1329        How Clinton plans to stop Sanders' momentum   \n",
       "316         1570                            Rand Paul is flatlining   \n",
       "323         1610           Jeb Bush loses TV ad edge to Marco Rubio   \n",
       "399         1597         Trump treads on tradition in New Hampshire   \n",
       "485         2376                                   Gaming Obamacare   \n",
       "514         1590         Strong jobs number holds risks for Clinton   \n",
       "1052        1742  Sanders’ challenge: Winning over Obama supporters   \n",
       "1239        1406    GOP insiders: It was a rough night for Ted Cruz   \n",
       "1314        1437  Iowa’s Des Moines Register endorses Clinton, R...   \n",
       "1407        1546           Ted Cruz tackles the Wall Street Journal   \n",
       "1545        1636                 Insiders: Rubio wins, Kasich bombs   \n",
       "1597        1644              5 things to watch in tonight’s debate   \n",
       "2089        2405  Senate GOP prepared to replace Obamacare subsi...   \n",
       "2133        1498         Bush donors await green light to jump ship   \n",
       "2289        1616                   Rubio battles Cruz for Iowa edge   \n",
       "2293        1344           Insiders: Marco Rubio crashed and burned   \n",
       "2337        1615                             Clinton’s Iowa dilemma   \n",
       "2444        2426             Obamacare case: All eyes on 2 justices   \n",
       "2640        1660  GOP campaigns push to take more control of deb...   \n",
       "2665        1349  Think the Iowa polls were bad? Wait until New ...   \n",
       "2668        2406       Conservatives fear leaders soft on Obamacare   \n",
       "2688        1508          5 things to watch in tonight’s GOP debate   \n",
       "2811        1409                 Five takeaways from the GOP debate   \n",
       "2849        1655                    Jeb Bush's view from the bottom   \n",
       "2908        2382                 Are Democrats crippling Obamacare?   \n",
       "2911        1566  GOP contenders prep for loud, ugly holiday season   \n",
       "2980        1306            GOP establishment stares into the abyss   \n",
       "3324        2399  Senate GOP prepared to replace Obamacare subsi...   \n",
       "3346        1525        Donald Trump's year of tweeting dangerously   \n",
       "3364        2412                      Obamacare group slashes staff   \n",
       "3437        1591    Trump relents after withholding medical records   \n",
       "3518        1715                          Hillary’s cash flow issue   \n",
       "3539        1549          14 key moments from the Democratic debate   \n",
       "3566        1720       7 takeaways from the first Democratic debate   \n",
       "3633        1673                          Ben Carson vs. Ben Carson   \n",
       "3740        2396                    Obamacare's unlikely No. 1 city   \n",
       "3744        1550                   Sanders gets the fight he wanted   \n",
       "3770        1355  Everything you need to know about the next Dem...   \n",
       "3883        1608                         The 2016 ballot wars begin   \n",
       "4012        1545                 Talk radio rallies around Ted Cruz   \n",
       "4313        1468       Dem insiders: Sanders failed to dent Clinton   \n",
       "4404        1322  Insiders: Sanders and Trump will win New Hamps...   \n",
       "4457        1555             Bush v. Trump: Behind the Vegas rumble   \n",
       "4490        1327              Rubio’s problem: An excess of caution   \n",
       "4615        1540                Cruz and Trump battle for the South   \n",
       "4633        1291              5 things to watch in tonight's debate   \n",
       "4921        1276                            How Cruz rescued Carson   \n",
       "5427        2379     Alaska scrambles to prevent Obamacare collapse   \n",
       "5708        1372       Clinton ekes out win in Iowa against Sanders   \n",
       "5725        1496             Rand Paul: I won the debate last night   \n",
       "5820        1367            Rand Paul drops out of White House race   \n",
       "5908        1387        Insiders: Trump and Clinton will carry Iowa   \n",
       "5927        2450                     GOP searches for Obamacare fix   \n",
       "6062        1307                     5 takeaways from New Hampshire   \n",
       "6194        1736              Rand Paul's all-too-familiar campaign   \n",
       "6270        1743      Inside Bernie Sanders’ unorthodox debate prep   \n",
       "\n",
       "                                                   text label  \n",
       "14    Killing Obama administration rules, dismantlin...  REAL  \n",
       "90    Killing Obama administration rules, dismantlin...  REAL  \n",
       "157   Killing Obama administration rules, dismantlin...  REAL  \n",
       "316   Killing Obama administration rules, dismantlin...  REAL  \n",
       "323   Killing Obama administration rules, dismantlin...  REAL  \n",
       "399   Killing Obama administration rules, dismantlin...  REAL  \n",
       "485   Killing Obama administration rules, dismantlin...  REAL  \n",
       "514   Killing Obama administration rules, dismantlin...  REAL  \n",
       "1052  Killing Obama administration rules, dismantlin...  REAL  \n",
       "1239  Killing Obama administration rules, dismantlin...  REAL  \n",
       "1314  Killing Obama administration rules, dismantlin...  REAL  \n",
       "1407  Killing Obama administration rules, dismantlin...  REAL  \n",
       "1545  Killing Obama administration rules, dismantlin...  REAL  \n",
       "1597  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2089  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2133  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2289  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2293  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2337  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2444  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2640  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2665  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2668  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2688  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2811  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2849  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2908  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2911  Killing Obama administration rules, dismantlin...  REAL  \n",
       "2980  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3324  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3346  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3364  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3437  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3518  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3539  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3566  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3633  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3740  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3744  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3770  Killing Obama administration rules, dismantlin...  REAL  \n",
       "3883  Killing Obama administration rules, dismantlin...  REAL  \n",
       "4012  Killing Obama administration rules, dismantlin...  REAL  \n",
       "4313  Killing Obama administration rules, dismantlin...  REAL  \n",
       "4404  Killing Obama administration rules, dismantlin...  REAL  \n",
       "4457  Killing Obama administration rules, dismantlin...  REAL  \n",
       "4490  Killing Obama administration rules, dismantlin...  REAL  \n",
       "4615  Killing Obama administration rules, dismantlin...  REAL  \n",
       "4633  Killing Obama administration rules, dismantlin...  REAL  \n",
       "4921  Killing Obama administration rules, dismantlin...  REAL  \n",
       "5427  Killing Obama administration rules, dismantlin...  REAL  \n",
       "5708  Killing Obama administration rules, dismantlin...  REAL  \n",
       "5725  Killing Obama administration rules, dismantlin...  REAL  \n",
       "5820  Killing Obama administration rules, dismantlin...  REAL  \n",
       "5908  Killing Obama administration rules, dismantlin...  REAL  \n",
       "5927  Killing Obama administration rules, dismantlin...  REAL  \n",
       "6062  Killing Obama administration rules, dismantlin...  REAL  \n",
       "6194  Killing Obama administration rules, dismantlin...  REAL  \n",
       "6270  Killing Obama administration rules, dismantlin...  REAL  "
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "news[news['text'] == 'Killing Obama administration rules, dismantling Obamacare and pushing through tax reform are on the early to-do list.']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>3. Preprocessing and Standardising the data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:11.859837Z",
     "start_time": "2020-05-01T16:19:11.680195Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unnamed: 0</th>\n",
       "      <th>title</th>\n",
       "      <th>text</th>\n",
       "      <th>label</th>\n",
       "      <th>label_num</th>\n",
       "      <th>data</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>8476</td>\n",
       "      <td>You Can Smell Hillary’s Fear</td>\n",
       "      <td>Daniel Greenfield, a Shillman Journalism Fello...</td>\n",
       "      <td>FAKE</td>\n",
       "      <td>0</td>\n",
       "      <td>You Can Smell Hillary’s Fear Daniel Greenfield...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>10294</td>\n",
       "      <td>Watch The Exact Moment Paul Ryan Committed Pol...</td>\n",
       "      <td>Google Pinterest Digg Linkedin Reddit Stumbleu...</td>\n",
       "      <td>FAKE</td>\n",
       "      <td>0</td>\n",
       "      <td>Watch The Exact Moment Paul Ryan Committed Pol...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>3608</td>\n",
       "      <td>Kerry to go to Paris in gesture of sympathy</td>\n",
       "      <td>U.S. Secretary of State John F. Kerry said Mon...</td>\n",
       "      <td>REAL</td>\n",
       "      <td>1</td>\n",
       "      <td>Kerry to go to Paris in gesture of sympathy U....</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>10142</td>\n",
       "      <td>Bernie supporters on Twitter erupt in anger ag...</td>\n",
       "      <td>— Kaydee King (@KaydeeKing) November 9, 2016 T...</td>\n",
       "      <td>FAKE</td>\n",
       "      <td>0</td>\n",
       "      <td>Bernie supporters on Twitter erupt in anger ag...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>875</td>\n",
       "      <td>The Battle of New York: Why This Primary Matters</td>\n",
       "      <td>It's primary day in New York and front-runners...</td>\n",
       "      <td>REAL</td>\n",
       "      <td>1</td>\n",
       "      <td>The Battle of New York: Why This Primary Matte...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Unnamed: 0                                              title  \\\n",
       "0        8476                       You Can Smell Hillary’s Fear   \n",
       "1       10294  Watch The Exact Moment Paul Ryan Committed Pol...   \n",
       "2        3608        Kerry to go to Paris in gesture of sympathy   \n",
       "3       10142  Bernie supporters on Twitter erupt in anger ag...   \n",
       "4         875   The Battle of New York: Why This Primary Matters   \n",
       "\n",
       "                                                text label  label_num  \\\n",
       "0  Daniel Greenfield, a Shillman Journalism Fello...  FAKE          0   \n",
       "1  Google Pinterest Digg Linkedin Reddit Stumbleu...  FAKE          0   \n",
       "2  U.S. Secretary of State John F. Kerry said Mon...  REAL          1   \n",
       "3  — Kaydee King (@KaydeeKing) November 9, 2016 T...  FAKE          0   \n",
       "4  It's primary day in New York and front-runners...  REAL          1   \n",
       "\n",
       "                                                data  \n",
       "0  You Can Smell Hillary’s Fear Daniel Greenfield...  \n",
       "1  Watch The Exact Moment Paul Ryan Committed Pol...  \n",
       "2  Kerry to go to Paris in gesture of sympathy U....  \n",
       "3  Bernie supporters on Twitter erupt in anger ag...  \n",
       "4  The Battle of New York: Why This Primary Matte...  "
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Adding a label as 0 for fake and 1 for real\n",
    "news['label_num'] = news['label'].map({'FAKE':0, 'REAL':1})\n",
    "\n",
    "#Another column with all texts including title and text\n",
    "news['data'] = news['title']+' '+ news['text']\n",
    "news.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:11.905534Z",
     "start_time": "2020-05-01T16:19:11.863827Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>title</th>\n",
       "      <th>text</th>\n",
       "      <th>data</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>You Can Smell Hillary’s Fear</td>\n",
       "      <td>Daniel Greenfield, a Shillman Journalism Fello...</td>\n",
       "      <td>You Can Smell Hillary’s Fear Daniel Greenfield...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>Watch The Exact Moment Paul Ryan Committed Pol...</td>\n",
       "      <td>Google Pinterest Digg Linkedin Reddit Stumbleu...</td>\n",
       "      <td>Watch The Exact Moment Paul Ryan Committed Pol...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>Kerry to go to Paris in gesture of sympathy</td>\n",
       "      <td>U.S. Secretary of State John F. Kerry said Mon...</td>\n",
       "      <td>Kerry to go to Paris in gesture of sympathy U....</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>Bernie supporters on Twitter erupt in anger ag...</td>\n",
       "      <td>— Kaydee King (@KaydeeKing) November 9, 2016 T...</td>\n",
       "      <td>Bernie supporters on Twitter erupt in anger ag...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>The Battle of New York: Why This Primary Matters</td>\n",
       "      <td>It's primary day in New York and front-runners...</td>\n",
       "      <td>The Battle of New York: Why This Primary Matte...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6330</td>\n",
       "      <td>State Department says it can't find emails fro...</td>\n",
       "      <td>The State Department told the Republican Natio...</td>\n",
       "      <td>State Department says it can't find emails fro...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6331</td>\n",
       "      <td>The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...</td>\n",
       "      <td>The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...</td>\n",
       "      <td>The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6332</td>\n",
       "      <td>Anti-Trump Protesters Are Tools of the Oligarc...</td>\n",
       "      <td>Anti-Trump Protesters Are Tools of the Oligar...</td>\n",
       "      <td>Anti-Trump Protesters Are Tools of the Oligarc...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6333</td>\n",
       "      <td>In Ethiopia, Obama seeks progress on peace, se...</td>\n",
       "      <td>ADDIS ABABA, Ethiopia —President Obama convene...</td>\n",
       "      <td>In Ethiopia, Obama seeks progress on peace, se...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>6334</td>\n",
       "      <td>Jeb Bush Is Suddenly Attacking Trump. Here's W...</td>\n",
       "      <td>Jeb Bush Is Suddenly Attacking Trump. Here's W...</td>\n",
       "      <td>Jeb Bush Is Suddenly Attacking Trump. Here's W...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>6335 rows × 3 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                  title  \\\n",
       "0                          You Can Smell Hillary’s Fear   \n",
       "1     Watch The Exact Moment Paul Ryan Committed Pol...   \n",
       "2           Kerry to go to Paris in gesture of sympathy   \n",
       "3     Bernie supporters on Twitter erupt in anger ag...   \n",
       "4      The Battle of New York: Why This Primary Matters   \n",
       "...                                                 ...   \n",
       "6330  State Department says it can't find emails fro...   \n",
       "6331  The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...   \n",
       "6332  Anti-Trump Protesters Are Tools of the Oligarc...   \n",
       "6333  In Ethiopia, Obama seeks progress on peace, se...   \n",
       "6334  Jeb Bush Is Suddenly Attacking Trump. Here's W...   \n",
       "\n",
       "                                                   text  \\\n",
       "0     Daniel Greenfield, a Shillman Journalism Fello...   \n",
       "1     Google Pinterest Digg Linkedin Reddit Stumbleu...   \n",
       "2     U.S. Secretary of State John F. Kerry said Mon...   \n",
       "3     — Kaydee King (@KaydeeKing) November 9, 2016 T...   \n",
       "4     It's primary day in New York and front-runners...   \n",
       "...                                                 ...   \n",
       "6330  The State Department told the Republican Natio...   \n",
       "6331  The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...   \n",
       "6332   Anti-Trump Protesters Are Tools of the Oligar...   \n",
       "6333  ADDIS ABABA, Ethiopia —President Obama convene...   \n",
       "6334  Jeb Bush Is Suddenly Attacking Trump. Here's W...   \n",
       "\n",
       "                                                   data  \n",
       "0     You Can Smell Hillary’s Fear Daniel Greenfield...  \n",
       "1     Watch The Exact Moment Paul Ryan Committed Pol...  \n",
       "2     Kerry to go to Paris in gesture of sympathy U....  \n",
       "3     Bernie supporters on Twitter erupt in anger ag...  \n",
       "4     The Battle of New York: Why This Primary Matte...  \n",
       "...                                                 ...  \n",
       "6330  State Department says it can't find emails fro...  \n",
       "6331  The ‘P’ in PBS Should Stand for ‘Plutocratic’ ...  \n",
       "6332  Anti-Trump Protesters Are Tools of the Oligarc...  \n",
       "6333  In Ethiopia, Obama seeks progress on peace, se...  \n",
       "6334  Jeb Bush Is Suddenly Attacking Trump. Here's W...  \n",
       "\n",
       "[6335 rows x 3 columns]"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "news[['title','text','data']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:13.049230Z",
     "start_time": "2020-05-01T16:19:11.907937Z"
    }
   },
   "outputs": [],
   "source": [
    "# Splitting the Dataset\n",
    "from sklearn.model_selection import train_test_split\n",
    "\n",
    "X=news['data']\n",
    "Y=news['label']\n",
    "x_train,x_test,y_train,y_test=train_test_split(X,Y, test_size=0.3, random_state=1705)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:13.064003Z",
     "start_time": "2020-05-01T16:19:13.052085Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0    You Can Smell Hillary’s Fear Daniel Greenfield...\n",
       "1    Watch The Exact Moment Paul Ryan Committed Pol...\n",
       "2    Kerry to go to Paris in gesture of sympathy U....\n",
       "3    Bernie supporters on Twitter erupt in anger ag...\n",
       "4    The Battle of New York: Why This Primary Matte...\n",
       "Name: data, dtype: object"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:13.157908Z",
     "start_time": "2020-05-01T16:19:13.066922Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "('Kerry to go to Paris in gesture of sympathy U.S. Secretary of State John F. Kerry said Monday that he will stop in Paris later this week, amid criticism that no top American officials attended Sunday’s unity march against terrorism.\\n\\nKerry said he expects to arrive in Paris Thursday evening, as he heads home after a week abroad. He said he will fly to France at the conclusion of a series of meetings scheduled for Thursday in Sofia, Bulgaria. He plans to meet the next day with Foreign Minister Laurent Fabius and President Francois Hollande, then return to Washington.\\n\\nThe visit by Kerry, who has family and childhood ties to the country and speaks fluent French, could address some of the criticism that the United States snubbed France in its darkest hour in many years.\\n\\nThe French press on Monday was filled with questions about why neither President Obama nor Kerry attended Sunday’s march, as about 40 leaders of other nations did. Obama was said to have stayed away because his own security needs can be taxing on a country, and Kerry had prior commitments.\\n\\nAmong roughly 40 leaders who did attend was Israeli Prime Minister Benjamin Netanyahu, no stranger to intense security, who marched beside Hollande through the city streets. The highest ranking U.S. officials attending the march were Jane Hartley, the ambassador to France, and Victoria Nuland, the assistant secretary of state for European affairs. Attorney General Eric H. Holder Jr. was in Paris for meetings with law enforcement officials but did not participate in the march.\\n\\nKerry spent Sunday at a business summit hosted by India’s prime minister, Narendra Modi. The United States is eager for India to relax stringent laws that function as barriers to foreign investment and hopes Modi’s government will act to open the huge Indian market for more American businesses.\\n\\nIn a news conference, Kerry brushed aside criticism that the United States had not sent a more senior official to Paris as “quibbling a little bit.” He noted that many staffers of the American Embassy in Paris attended the march, including the ambassador. He said he had wanted to be present at the march himself but could not because of his prior commitments in India.\\n\\n“But that is why I am going there on the way home, to make it crystal clear how passionately we feel about the events that have taken place there,” he said.\\n\\n“And I don’t think the people of France have any doubts about America’s understanding of what happened, of our personal sense of loss and our deep commitment to the people of France in this moment of trauma.”',\n",
       " 'REAL')"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X[2],Y[2]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>4. Defining Tfidf Vectorizer"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:20.148973Z",
     "start_time": "2020-05-01T16:19:13.164542Z"
    }
   },
   "outputs": [],
   "source": [
    "#Inititalise Tfidf Vectorizer\n",
    "from sklearn.feature_extraction.text import TfidfVectorizer\n",
    "import pickle\n",
    "\n",
    "\n",
    "# tf-idf based vectors\n",
    "tfidf_vectorizer = TfidfVectorizer(analyzer='word', stop_words = \"english\")\n",
    "tfidf_train=tfidf_vectorizer.fit_transform(x_train) \n",
    "tfidf_test=tfidf_vectorizer.transform(x_test)\n",
    "\n",
    "# \"\"\"\n",
    "#For saving Vocabulary ? Completely optional\n",
    "# Dump the file\n",
    "pickle.dump(tfidf_vectorizer, open(\"tfidf1.pkl\", \"wb\"))\n",
    "# \"\"\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:20.231885Z",
     "start_time": "2020-05-01T16:19:20.151794Z"
    }
   },
   "outputs": [],
   "source": [
    "# \"\"\"\n",
    "# Testing phase\n",
    "tf1 = pickle.load(open(\"tfidf1.pkl\", 'rb'))\n",
    "\n",
    "# Create new tfidfVectorizer with old vocabulary\n",
    "tf1_new = TfidfVectorizer(analyzer='word', stop_words = \"english\", vocabulary = tf1.vocabulary_)\n",
    "# \"\"\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:20.445977Z",
     "start_time": "2020-05-01T16:19:20.236783Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'revealing': 43716,\n",
       " 'interview': 27116,\n",
       " 'trump': 52911,\n",
       " 'predicts': 40088,\n",
       " 'massive': 32256,\n",
       " 'recession': 42313,\n",
       " 'intends': 26920,\n",
       " 'eliminate': 17370,\n",
       " 'national': 34979,\n",
       " 'debt': 13860,\n",
       " 'years': 57242,\n",
       " 'donald': 16147,\n",
       " 'said': 44899,\n",
       " 'economic': 17010,\n",
       " 'conditions': 11614,\n",
       " 'perilous': 38483,\n",
       " 'country': 12596,\n",
       " 'headed': 23946,\n",
       " 'terrible': 51311,\n",
       " 'time': 51885,\n",
       " 'right': 43966,\n",
       " 'invest': 27249,\n",
       " 'stock': 49302,\n",
       " 'market': 32072,\n",
       " 'embracing': 17507,\n",
       " 'distinctly': 15825,\n",
       " 'gloomy': 22245,\n",
       " 'view': 55163,\n",
       " 'economy': 17018,\n",
       " 'counters': 12581,\n",
       " 'mainstream': 31615,\n",
       " 'forecasts': 20645,\n",
       " 'new': 35369,\n",
       " 'york': 57346,\n",
       " 'billionaire': 6766,\n",
       " 'dismissed': 15623,\n",
       " 'concern': 11546,\n",
       " 'comments': 11270,\n",
       " 'exceedingly': 18665,\n",
       " 'unusual': 54325,\n",
       " 'unprecedented': 54125,\n",
       " 'major': 31641,\n",
       " 'party': 37971,\n",
       " 'runner': 44664,\n",
       " 'potentially': 39869,\n",
       " 'affect': 2647,\n",
       " 'financial': 20008,\n",
       " 'markets': 32083,\n",
       " 'know': 29223,\n",
       " 'wall': 55681,\n",
       " 'street': 49499,\n",
       " 'people': 38404,\n",
       " 'probably': 40476,\n",
       " 'better': 6595,\n",
       " 'anybody': 3972,\n",
       " 'knows': 29235,\n",
       " 'misfired': 33567,\n",
       " 'predictions': 40084,\n",
       " 'past': 38019,\n",
       " 'don': 16144,\n",
       " 'need': 35147,\n",
       " 'instincts': 26820,\n",
       " 'consistent': 11889,\n",
       " 'refrain': 42682,\n",
       " 'lone': 30956,\n",
       " 'ranger': 41851,\n",
       " 'point': 39469,\n",
       " '96': 1726,\n",
       " 'minute': 33479,\n",
       " 'thursday': 51782,\n",
       " 'talked': 50743,\n",
       " 'candidly': 8937,\n",
       " 'aggressive': 2780,\n",
       " 'style': 49673,\n",
       " 'campaigning': 8876,\n",
       " 'offered': 36450,\n",
       " 'details': 14832,\n",
       " 'president': 40247,\n",
       " 'real': 42107,\n",
       " 'estate': 18356,\n",
       " 'mogul': 33872,\n",
       " 'aides': 2870,\n",
       " 'son': 48110,\n",
       " 'jr': 28239,\n",
       " 'gathered': 21656,\n",
       " 'lunch': 31251,\n",
       " 'makeshift': 31657,\n",
       " 'conference': 11647,\n",
       " 'table': 50602,\n",
       " 'set': 46293,\n",
       " 'amid': 3471,\n",
       " 'construction': 11960,\n",
       " 'debris': 13859,\n",
       " 'soon': 48135,\n",
       " 'finished': 20044,\n",
       " 'hotel': 25043,\n",
       " 'blocks': 7134,\n",
       " 'white': 56309,\n",
       " 'house': 25067,\n",
       " 'just': 28376,\n",
       " 'met': 33024,\n",
       " 'foreign': 20661,\n",
       " 'policy': 39533,\n",
       " 'advisers': 2596,\n",
       " 'visited': 55320,\n",
       " 'officials': 36468,\n",
       " 'republican': 43314,\n",
       " 'committee': 11295,\n",
       " 'signs': 47125,\n",
       " 'spite': 48531,\n",
       " 'best': 6557,\n",
       " 'manner': 31884,\n",
       " 'political': 39548,\n",
       " 'novice': 35978,\n",
       " 'making': 31663,\n",
       " 'efforts': 17141,\n",
       " 'build': 8339,\n",
       " 'rounded': 44459,\n",
       " 'bid': 6683,\n",
       " 'read': 42081,\n",
       " 'transcript': 52460,\n",
       " 'course': 12620,\n",
       " 'discussion': 15500,\n",
       " 'candidate': 8934,\n",
       " 'clear': 10593,\n",
       " 'govern': 22534,\n",
       " 'nontraditional': 35798,\n",
       " 'way': 55932,\n",
       " 'campaigned': 8872,\n",
       " 'tossing': 52236,\n",
       " 'aside': 4638,\n",
       " 'decades': 13879,\n",
       " 'american': 3439,\n",
       " 'custom': 13329,\n",
       " 'favor': 19525,\n",
       " 'trumpian': 52925,\n",
       " 'approach': 4157,\n",
       " 'world': 56866,\n",
       " '100': 107,\n",
       " 'days': 13742,\n",
       " 'cut': 13336,\n",
       " 'taxes': 50975,\n",
       " 'renegotiate': 43126,\n",
       " 'trade': 52361,\n",
       " 'deals': 13809,\n",
       " 'military': 33311,\n",
       " 'including': 26128,\n",
       " 'altering': 3303,\n",
       " 'role': 44269,\n",
       " 'north': 35864,\n",
       " 'atlantic': 4883,\n",
       " 'treaty': 52635,\n",
       " 'organization': 36888,\n",
       " 'insisted': 26754,\n",
       " 'able': 1937,\n",
       " 'rid': 43922,\n",
       " 'nation': 34978,\n",
       " '19': 483,\n",
       " 'trillion': 52753,\n",
       " 'period': 38488,\n",
       " 'economists': 17017,\n",
       " 'consider': 11873,\n",
       " 'impossible': 25949,\n",
       " 'require': 43347,\n",
       " 'taking': 50713,\n",
       " 'year': 57233,\n",
       " 'annual': 3790,\n",
       " 'budget': 8292,\n",
       " 'pay': 38180,\n",
       " 'holders': 24719,\n",
       " 'vehemently': 54903,\n",
       " 'disagrees': 15350,\n",
       " 'renegotiating': 43128,\n",
       " 'big': 6706,\n",
       " 'doing': 16078,\n",
       " 'badly': 5472,\n",
       " 'china': 10136,\n",
       " '505': 1239,\n",
       " 'billion': 6765,\n",
       " 'growth': 22973,\n",
       " 'foresees': 20679,\n",
       " 'consequence': 11851,\n",
       " 'renegotiated': 43127,\n",
       " 'enable': 17651,\n",
       " 'united': 53987,\n",
       " 'states': 49008,\n",
       " 'exact': 18630,\n",
       " 'opposite': 36773,\n",
       " 'war': 55756,\n",
       " 'crippling': 12919,\n",
       " 'lost': 31064,\n",
       " 'standing': 48912,\n",
       " 'make': 31651,\n",
       " 'respect': 43484,\n",
       " 'want': 55748,\n",
       " 'leader': 30002,\n",
       " 'asked': 4651,\n",
       " 'cited': 10427,\n",
       " 'aura': 5058,\n",
       " 'personality': 38593,\n",
       " 'group': 22948,\n",
       " 'leaders': 30006,\n",
       " 'attended': 4948,\n",
       " 'obama': 36193,\n",
       " 'nuclear': 36034,\n",
       " 'security': 45957,\n",
       " 'summit': 50001,\n",
       " 'mile': 33285,\n",
       " 'away': 5235,\n",
       " 'like': 30556,\n",
       " 'support': 50140,\n",
       " 'scale': 45366,\n",
       " 'disarmament': 15372,\n",
       " 'quickly': 41484,\n",
       " 'added': 2371,\n",
       " 'love': 31109,\n",
       " 'practical': 39954,\n",
       " 'standpoint': 48921,\n",
       " 'going': 22373,\n",
       " 'happen': 23600,\n",
       " 'elected': 17281,\n",
       " 'high': 24434,\n",
       " 'level': 30330,\n",
       " 'employees': 17618,\n",
       " 'federal': 19627,\n",
       " 'government': 22538,\n",
       " 'sign': 47100,\n",
       " 'legally': 30143,\n",
       " 'binding': 6789,\n",
       " 'nondisclosure': 35744,\n",
       " 'agreements': 2822,\n",
       " 'staffers': 48828,\n",
       " 'couldn': 12511,\n",
       " 'write': 57001,\n",
       " 'insider': 26730,\n",
       " 'accounts': 2163,\n",
       " 'inside': 26728,\n",
       " 'chosen': 10225,\n",
       " 'man': 31783,\n",
       " 'levels': 30335,\n",
       " 'leave': 30066,\n",
       " 'book': 7486,\n",
       " 'say': 45335,\n",
       " 'lot': 31065,\n",
       " 'things': 51611,\n",
       " 'really': 42138,\n",
       " 'guarded': 23036,\n",
       " 'personal': 38591,\n",
       " 'campaign': 8871,\n",
       " 'struggling': 49600,\n",
       " 'challenging': 9745,\n",
       " 'stretches': 49523,\n",
       " 'week': 56056,\n",
       " 'manager': 31789,\n",
       " 'charged': 9838,\n",
       " 'battery': 6006,\n",
       " 'grabbing': 22573,\n",
       " 'reporter': 43258,\n",
       " 'criticized': 12951,\n",
       " 'mocking': 33802,\n",
       " 'looks': 30991,\n",
       " 'opponent': 36759,\n",
       " 'wife': 56422,\n",
       " 'compared': 11362,\n",
       " 'spouse': 48631,\n",
       " 'backtracked': 5435,\n",
       " 'abortion': 1968,\n",
       " 'offended': 36438,\n",
       " 'close': 10742,\n",
       " 'family': 19343,\n",
       " 'friends': 21106,\n",
       " 'urging': 54473,\n",
       " 'tone': 52115,\n",
       " 'attacks': 4932,\n",
       " 'reach': 42062,\n",
       " 'rivals': 44092,\n",
       " 'reassure': 42206,\n",
       " 'wary': 55828,\n",
       " 'voters': 55483,\n",
       " 'begin': 6232,\n",
       " 'difficult': 15154,\n",
       " 'process': 40500,\n",
       " 'unifying': 53935,\n",
       " 'sworn': 50465,\n",
       " 'does': 16051,\n",
       " 'intend': 26917,\n",
       " 'advice': 2590,\n",
       " 'overtures': 37392,\n",
       " 'overrated': 37309,\n",
       " 'think': 51612,\n",
       " 'thing': 51610,\n",
       " 'win': 56528,\n",
       " 'winning': 56586,\n",
       " 'solves': 48082,\n",
       " 'problems': 40490,\n",
       " 'left': 30116,\n",
       " 'remaining': 43042,\n",
       " 'sen': 46119,\n",
       " 'ted': 51088,\n",
       " 'cruz': 13114,\n",
       " 'texas': 51398,\n",
       " 'ohio': 36509,\n",
       " 'gov': 22530,\n",
       " 'john': 28104,\n",
       " 'kasich': 28621,\n",
       " 'break': 7876,\n",
       " 'egg': 17156,\n",
       " 'eggs': 17160,\n",
       " 'did': 15113,\n",
       " 'offer': 36449,\n",
       " 'concessions': 11556,\n",
       " 'realities': 42127,\n",
       " 'saying': 45342,\n",
       " 'pick': 38898,\n",
       " 'outsider': 37168,\n",
       " 'vice': 55101,\n",
       " 'presidential': 40249,\n",
       " 'running': 44666,\n",
       " 'mate': 32294,\n",
       " 'somebody': 48094,\n",
       " 'walk': 55668,\n",
       " 'senate': 46121,\n",
       " 'friendly': 21105,\n",
       " 'guys': 23213,\n",
       " '25': 807,\n",
       " '95': 1716,\n",
       " 'percent': 38425,\n",
       " 'picking': 38907,\n",
       " 'person': 38587,\n",
       " 'opposed': 36770,\n",
       " 'outside': 37167,\n",
       " 'plans': 39202,\n",
       " 'announce': 3777,\n",
       " 'list': 30707,\n",
       " '10': 106,\n",
       " '12': 205,\n",
       " 'judges': 28277,\n",
       " 'vacancies': 54643,\n",
       " 'supreme': 50162,\n",
       " 'court': 12622,\n",
       " 'allay': 3178,\n",
       " 'concerns': 11549,\n",
       " 'conservatives': 11865,\n",
       " 'wouldn': 56916,\n",
       " 'choose': 10204,\n",
       " 'liking': 30572,\n",
       " 'getting': 21939,\n",
       " 'names': 34858,\n",
       " 'federalist': 19631,\n",
       " 'good': 22428,\n",
       " 'heritage': 24279,\n",
       " 'foundation': 20825,\n",
       " 'particular': 37940,\n",
       " 'order': 36854,\n",
       " 'guarantee': 23028,\n",
       " 'tell': 51171,\n",
       " 'worried': 56886,\n",
       " 'oh': 36505,\n",
       " 'maybe': 32422,\n",
       " 'll': 30804,\n",
       " 'wrong': 57014,\n",
       " 'judge': 28273,\n",
       " 'series': 46250,\n",
       " 'violent': 55265,\n",
       " 'incidents': 26104,\n",
       " 'rallies': 41768,\n",
       " 'supporters': 50144,\n",
       " 'protesters': 40852,\n",
       " 'acknowledged': 2230,\n",
       " 'little': 30762,\n",
       " 'tried': 52738,\n",
       " 'calm': 8824,\n",
       " 've': 54877,\n",
       " 'purposefully': 41206,\n",
       " 'kept': 28796,\n",
       " 'crowds': 13044,\n",
       " 'gone': 22415,\n",
       " 'small': 47691,\n",
       " 'venues': 54967,\n",
       " 'turning': 53139,\n",
       " 'thousands': 51681,\n",
       " 'hate': 23815,\n",
       " 'didn': 15117,\n",
       " 'protest': 40844,\n",
       " 'room': 44335,\n",
       " '000': 1,\n",
       " 'pretty': 40313,\n",
       " 'question': 41462,\n",
       " 'posed': 39772,\n",
       " 'decision': 13944,\n",
       " 'run': 44657,\n",
       " 'start': 48971,\n",
       " 'movie': 34351,\n",
       " 'wry': 57029,\n",
       " 'smile': 47732,\n",
       " 'spread': 48648,\n",
       " 'face': 19151,\n",
       " 'repeated': 43206,\n",
       " 'moment': 33934,\n",
       " 'decided': 13925,\n",
       " 'turn': 53129,\n",
       " 'long': 30962,\n",
       " 'flirtation': 20357,\n",
       " 'presidency': 40246,\n",
       " 'critical': 12943,\n",
       " 'answered': 3831,\n",
       " 'interior': 27001,\n",
       " 'dialogue': 15053,\n",
       " 'thought': 51674,\n",
       " 'look': 30985,\n",
       " 'polls': 39585,\n",
       " 'number': 36070,\n",
       " 'started': 48972,\n",
       " 'summer': 49994,\n",
       " '2014': 656,\n",
       " 'busy': 8580,\n",
       " 'hit': 24606,\n",
       " 'nbc': 35079,\n",
       " 'reality': 42128,\n",
       " 'apprentice': 4154,\n",
       " 'ambition': 3395,\n",
       " 'slowly': 47654,\n",
       " 'thinking': 51618,\n",
       " 'early': 16892,\n",
       " 'hired': 24573,\n",
       " 'months': 34075,\n",
       " 'formally': 20744,\n",
       " 'jumped': 28326,\n",
       " 'experience': 18892,\n",
       " 'wasn': 55849,\n",
       " '1987': 589,\n",
       " 'speech': 48422,\n",
       " 'hampshire': 23490,\n",
       " 'forgot': 20727,\n",
       " 'delivering': 14311,\n",
       " 'daily': 13463,\n",
       " 'newspapers': 35419,\n",
       " 'printed': 40417,\n",
       " 'online': 36660,\n",
       " 'articles': 4531,\n",
       " 'preferred': 40121,\n",
       " 'method': 33072,\n",
       " 'reading': 42091,\n",
       " 'tabs': 50617,\n",
       " 'cable': 8682,\n",
       " 'news': 35393,\n",
       " 'felt': 19718,\n",
       " 'pull': 41066,\n",
       " 'obviously': 36334,\n",
       " 'public': 41018,\n",
       " 'recalled': 42275,\n",
       " 'kicked': 28932,\n",
       " 'yes': 57280,\n",
       " 'monetary': 33972,\n",
       " 'february': 19619,\n",
       " 'announced': 3778,\n",
       " 'steve': 49204,\n",
       " 'burke': 8488,\n",
       " 'great': 22748,\n",
       " 'guy': 23210,\n",
       " 'comcast': 11186,\n",
       " 'came': 8850,\n",
       " 'wanted': 55749,\n",
       " 'extend': 19004,\n",
       " 'contract': 12098,\n",
       " 'told': 52069,\n",
       " 'instead': 26805,\n",
       " 'frustrated': 21194,\n",
       " 'saw': 45321,\n",
       " 'stupidity': 49659,\n",
       " 'iran': 27349,\n",
       " 'negotiations': 35195,\n",
       " 'dominated': 16127,\n",
       " 'persians': 38577,\n",
       " 'negotiators': 35197,\n",
       " 'melania': 32787,\n",
       " 'heard': 24001,\n",
       " 'complaints': 11417,\n",
       " 'enthused': 17956,\n",
       " 'life': 30493,\n",
       " 'sort': 48188,\n",
       " 'job': 28078,\n",
       " 'later': 29852,\n",
       " 'hope': 24927,\n",
       " 'according': 2151,\n",
       " 'nomination': 35712,\n",
       " 'sight': 47089,\n",
       " 'giving': 22132,\n",
       " 'different': 15144,\n",
       " 'ivanka': 27611,\n",
       " 'similar': 47177,\n",
       " 'guidance': 23075,\n",
       " 'story': 49393,\n",
       " 'share': 46524,\n",
       " 'couple': 12605,\n",
       " 'weeks': 56065,\n",
       " 'ago': 2807,\n",
       " 'friend': 21101,\n",
       " 'famous': 19345,\n",
       " 'athlete': 4871,\n",
       " 'called': 8810,\n",
       " 'beat': 6119,\n",
       " 'marco': 31983,\n",
       " 'rubio': 44573,\n",
       " 'florida': 20397,\n",
       " 'senator': 46122,\n",
       " 'home': 24782,\n",
       " 'state': 48996,\n",
       " 'beating': 6124,\n",
       " 'forget': 20709,\n",
       " 'future': 21384,\n",
       " 'hey': 24365,\n",
       " 'kill': 28977,\n",
       " 'everybody': 18549,\n",
       " 'doesn': 16052,\n",
       " 'initially': 26604,\n",
       " 'adding': 2381,\n",
       " 'opponents': 36760,\n",
       " 'secure': 45949,\n",
       " 'willing': 56498,\n",
       " 'reaching': 42066,\n",
       " 'easing': 16936,\n",
       " 'suggested': 49923,\n",
       " 'comfortable': 11210,\n",
       " 'old': 36550,\n",
       " 'tv': 53177,\n",
       " 'radio': 41639,\n",
       " 'masked': 32224,\n",
       " 'vigilante': 55178,\n",
       " 'fought': 20821,\n",
       " 'law': 29933,\n",
       " 'immediately': 25774,\n",
       " 'concurred': 11582,\n",
       " 'understand': 53710,\n",
       " 'works': 56858,\n",
       " 'coalition': 10858,\n",
       " 'general': 21757,\n",
       " 'election': 17283,\n",
       " 'responded': 43500,\n",
       " 'hasn': 23785,\n",
       " 'focused': 20501,\n",
       " 'hillary': 24480,\n",
       " 'clinton': 10691,\n",
       " 'implication': 25910,\n",
       " 'starts': 48979,\n",
       " 'attacking': 4931,\n",
       " 'rally': 41769,\n",
       " 'pressed': 40260,\n",
       " 'incumbent': 26207,\n",
       " 'tame': 50769,\n",
       " 'anger': 3691,\n",
       " 'bring': 8037,\n",
       " 'rage': 41673,\n",
       " 'asset': 4738,\n",
       " 'liability': 30396,\n",
       " 'unity': 53996,\n",
       " 'ultimately': 53364,\n",
       " 'occasions': 36345,\n",
       " 'hated': 23816,\n",
       " 'human': 25199,\n",
       " 'end': 17715,\n",
       " 'happening': 23603,\n",
       " 'rough': 44447,\n",
       " 'nasty': 34958,\n",
       " 'debates': 13841,\n",
       " 'relationships': 42948,\n",
       " 'likely': 30563,\n",
       " 'repair': 43187,\n",
       " 'harder': 23649,\n",
       " 'necessary': 35131,\n",
       " 'reel': 42579,\n",
       " 'governor': 22541,\n",
       " 'jeb': 27878,\n",
       " 'bush': 8540,\n",
       " 'competing': 11395,\n",
       " 'sure': 50174,\n",
       " 'low': 31124,\n",
       " 'energy': 17783,\n",
       " 'devastating': 14931,\n",
       " 'unsure': 54278,\n",
       " 'fit': 20141,\n",
       " 'category': 9390,\n",
       " 'noted': 35923,\n",
       " 'gotten': 22516,\n",
       " 'quite': 41524,\n",
       " 'ambivalent': 3400,\n",
       " 'beats': 6129,\n",
       " 'help': 24181,\n",
       " 'congratulate': 11755,\n",
       " '17': 354,\n",
       " '16': 325,\n",
       " 'okay': 36529,\n",
       " 'admitted': 2495,\n",
       " 'needed': 35148,\n",
       " 'outreach': 37159,\n",
       " 'honestly': 24859,\n",
       " 'calling': 8816,\n",
       " 'certain': 9650,\n",
       " 'extent': 19013,\n",
       " 'shouldn': 46874,\n",
       " 'ben': 6382,\n",
       " 'carson': 9237,\n",
       " 'jersey': 27958,\n",
       " 'chris': 10237,\n",
       " 'christie': 10255,\n",
       " 'supporting': 50145,\n",
       " 'loved': 31111,\n",
       " 'specifically': 48382,\n",
       " 'uncertain': 53514,\n",
       " 'politics': 39562,\n",
       " 'successful': 49855,\n",
       " 'building': 8342,\n",
       " 'true': 52896,\n",
       " 'arms': 4428,\n",
       " 'folded': 20527,\n",
       " 'familiar': 19339,\n",
       " 'dark': 13612,\n",
       " 'suit': 49940,\n",
       " 'shirt': 46755,\n",
       " 'red': 42470,\n",
       " 'tie': 51830,\n",
       " 'sat': 45224,\n",
       " 'hopes': 24936,\n",
       " 'newest': 35380,\n",
       " 'trophy': 52837,\n",
       " 'agree': 2817,\n",
       " 'turned': 53134,\n",
       " 'stories': 49381,\n",
       " 'boxing': 7710,\n",
       " 'muhammad': 34461,\n",
       " 'ali': 3127,\n",
       " 'football': 20591,\n",
       " 'coaching': 10851,\n",
       " 'icon': 25521,\n",
       " 'vince': 55226,\n",
       " 'lombardi': 30948,\n",
       " 'earned': 16899,\n",
       " 'having': 23870,\n",
       " 'goods': 22442,\n",
       " 'watched': 55872,\n",
       " 'ring': 44006,\n",
       " 'talk': 50740,\n",
       " 'scream': 45740,\n",
       " 'ugly': 53331,\n",
       " 'bear': 6104,\n",
       " 'anymore': 3973,\n",
       " 'seen': 45994,\n",
       " 'fighters': 19919,\n",
       " 'terms': 51294,\n",
       " 'talking': 50747,\n",
       " 'beautiful': 6138,\n",
       " 'flamboyant': 20206,\n",
       " 'knocked': 29210,\n",
       " 'guess': 23061,\n",
       " 'sitting': 47333,\n",
       " 'place': 39153,\n",
       " 'tough': 52267,\n",
       " 'players': 39256,\n",
       " 'strong': 49578,\n",
       " 'cookies': 12229,\n",
       " 'young': 57357,\n",
       " 'screaming': 45742,\n",
       " 'times': 51899,\n",
       " 'bigger': 6711,\n",
       " 'literally': 30734,\n",
       " 'physical': 38873,\n",
       " 'whisked': 56294,\n",
       " 'thrown': 51740,\n",
       " 'window': 56543,\n",
       " 'seconds': 45921,\n",
       " 'player': 39255,\n",
       " 'shaking': 46455,\n",
       " 'walked': 55670,\n",
       " 'angry': 3714,\n",
       " 'grabbed': 22571,\n",
       " 'wow': 56927,\n",
       " 'realized': 42132,\n",
       " 'got': 22507,\n",
       " 'won': 56764,\n",
       " 'contended': 12036,\n",
       " 'trouble': 52857,\n",
       " 'sees': 46000,\n",
       " 'overvalued': 37399,\n",
       " 'grown': 22969,\n",
       " 'pessimistic': 38663,\n",
       " 'late': 29846,\n",
       " 'bearish': 6115,\n",
       " 'investing': 27263,\n",
       " 'warning': 55800,\n",
       " 'americans': 3446,\n",
       " 'bubble': 8251,\n",
       " 'specifying': 48388,\n",
       " 'sector': 45940,\n",
       " 'large': 29795,\n",
       " 'asserted': 4723,\n",
       " 'bullish': 8384,\n",
       " 'based': 5909,\n",
       " 'skewed': 47397,\n",
       " 'employment': 17622,\n",
       " 'numbers': 36073,\n",
       " 'inflated': 26468,\n",
       " 'unemployment': 53791,\n",
       " 'twenties': 53202,\n",
       " 'devised': 14970,\n",
       " 'statistically': 49036,\n",
       " 'politicians': 39552,\n",
       " 'presidents': 40253,\n",
       " 'kind': 29017,\n",
       " 'bizarre': 6927,\n",
       " 'optimism': 36802,\n",
       " 'theory': 51535,\n",
       " 'assertion': 4725,\n",
       " 'match': 32288,\n",
       " 'data': 13669,\n",
       " 'bureau': 8458,\n",
       " 'labor': 29541,\n",
       " 'statistics': 49039,\n",
       " 'analysis': 3578,\n",
       " 'joblessness': 28080,\n",
       " 'unemployed': 53790,\n",
       " 'marginally': 32003,\n",
       " 'attached': 4922,\n",
       " 'workers': 56845,\n",
       " 'dropped': 16524,\n",
       " 'force': 20622,\n",
       " 'nationally': 34992,\n",
       " 'month': 34071,\n",
       " 'runs': 44670,\n",
       " 'counter': 12540,\n",
       " 'consensus': 11846,\n",
       " '20': 630,\n",
       " 'chance': 9768,\n",
       " 'slipping': 47608,\n",
       " 'largely': 29797,\n",
       " 'remains': 43043,\n",
       " 'weak': 55965,\n",
       " 'journal': 28202,\n",
       " 'survey': 50236,\n",
       " 'march': 31973,\n",
       " 'aren': 4311,\n",
       " 'overly': 37290,\n",
       " 'imminent': 25792,\n",
       " 'downturn': 16351,\n",
       " 'creation': 12812,\n",
       " 'starting': 48975,\n",
       " 'wages': 55587,\n",
       " 'grow': 22964,\n",
       " 'reserve': 43396,\n",
       " 'cautious': 9456,\n",
       " 'shifting': 46691,\n",
       " 'rate': 41962,\n",
       " 'stance': 48900,\n",
       " 'helped': 24182,\n",
       " 'stimulate': 49264,\n",
       " 'haven': 23862,\n",
       " 'worked': 56842,\n",
       " '2012': 653,\n",
       " 'instance': 26798,\n",
       " 'predicted': 40081,\n",
       " 'reelected': 42581,\n",
       " 'oil': 36515,\n",
       " 'gas': 21628,\n",
       " 'prices': 40355,\n",
       " 'roof': 44328,\n",
       " '2011': 652,\n",
       " 'health': 23982,\n",
       " 'care': 9122,\n",
       " 'took': 52147,\n",
       " 'effect': 17120,\n",
       " 'higher': 24435,\n",
       " 'investments': 27266,\n",
       " 'housing': 25084,\n",
       " 'bust': 8570,\n",
       " 'nonetheless': 35753,\n",
       " 'precarious': 40020,\n",
       " 'reason': 42182,\n",
       " 'ripped': 44033,\n",
       " 'countries': 12595,\n",
       " 'ends': 17765,\n",
       " 'stop': 49355,\n",
       " 'living': 30792,\n",
       " 'believe': 6317,\n",
       " 'totally': 52247,\n",
       " 'controlled': 12150,\n",
       " 'lobbyists': 30843,\n",
       " 'special': 48366,\n",
       " 'interests': 26987,\n",
       " 'unless': 54035,\n",
       " 'changes': 9783,\n",
       " 'fix': 20161,\n",
       " 'firmly': 20106,\n",
       " 'believes': 6321,\n",
       " 'turnaround': 53131,\n",
       " 'beginning': 6235,\n",
       " 'solution': 48074,\n",
       " 'looming': 30997,\n",
       " 'mentions': 32905,\n",
       " 'trans': 52438,\n",
       " 'pacific': 37488,\n",
       " 'partnership': 37963,\n",
       " 'pact': 37515,\n",
       " 'seek': 45985,\n",
       " 'putting': 41260,\n",
       " 'odds': 36401,\n",
       " 'congressional': 11770,\n",
       " 'republicans': 43316,\n",
       " 'supported': 50142,\n",
       " 'fast': 19458,\n",
       " 'track': 52347,\n",
       " 'authority': 5100,\n",
       " 'coupled': 12606,\n",
       " 'push': 41228,\n",
       " 'tax': 50971,\n",
       " 'unveiled': 54331,\n",
       " 'september': 46207,\n",
       " 'proposal': 40752,\n",
       " 'increases': 26184,\n",
       " 'rich': 43890,\n",
       " 'reduces': 42556,\n",
       " 'taxpayers': 50985,\n",
       " 'corporate': 12364,\n",
       " '15': 284,\n",
       " 'woo': 56783,\n",
       " 'companies': 11349,\n",
       " 'incentive': 26083,\n",
       " 'deeply': 14061,\n",
       " 'discounted': 15458,\n",
       " 'longer': 30964,\n",
       " 'allow': 3232,\n",
       " 'corporations': 12368,\n",
       " 'defer': 14125,\n",
       " 'income': 26139,\n",
       " 'overseas': 37332,\n",
       " 'center': 9596,\n",
       " 'washington': 55842,\n",
       " 'attending': 4951,\n",
       " 'reducing': 42557,\n",
       " 'stockpiles': 49313,\n",
       " 'day': 13731,\n",
       " 'earlier': 16889,\n",
       " 'headlines': 23956,\n",
       " 'msnbc': 34402,\n",
       " 'forum': 20801,\n",
       " 'possibly': 39805,\n",
       " 'use': 54523,\n",
       " 'weapon': 55984,\n",
       " 'japan': 27789,\n",
       " 'south': 48243,\n",
       " 'korea': 29313,\n",
       " 'acquiring': 2259,\n",
       " 'disengaging': 15528,\n",
       " 'protector': 40835,\n",
       " 'promptly': 40689,\n",
       " 'catastrophic': 9368,\n",
       " '2010': 650,\n",
       " 'greatest': 22751,\n",
       " 'worry': 56890,\n",
       " 'device': 14958,\n",
       " 'exploding': 18933,\n",
       " 'city': 10443,\n",
       " 'dig': 15162,\n",
       " 'funny': 21338,\n",
       " 'interesting': 26985,\n",
       " 'surprised': 50210,\n",
       " 'recently': 42301,\n",
       " 'biggest': 6712,\n",
       " 'problem': 40486,\n",
       " 'global': 22220,\n",
       " 'warming': 55789,\n",
       " 'disagree': 15344,\n",
       " 'solemn': 48036,\n",
       " 'topic': 52166,\n",
       " 'threat': 51694,\n",
       " 'single': 47250,\n",
       " 'peace': 38226,\n",
       " 'hiroshima': 24579,\n",
       " 'multiply': 34525,\n",
       " 'thousand': 51680,\n",
       " 'head': 23940,\n",
       " 'simultaneously': 47226,\n",
       " 'open': 36707,\n",
       " 'eliminating': 17373,\n",
       " 'weapons': 55991,\n",
       " 'held': 24149,\n",
       " 'equal': 18096,\n",
       " 'basis': 5946,\n",
       " 'absolutely': 2007,\n",
       " 'caveat': 9466,\n",
       " 'supports': 50147,\n",
       " 'idea': 25537,\n",
       " 'feasible': 19603,\n",
       " 'current': 13284,\n",
       " 'climate': 10657,\n",
       " 'russia': 44702,\n",
       " 'pakistan': 37589,\n",
       " 'unwilling': 54348,\n",
       " 'relinquish': 43009,\n",
       " 'spending': 48448,\n",
       " 'tremendous': 52651,\n",
       " 'money': 33977,\n",
       " 'ideal': 25538,\n",
       " 'wonderful': 56767,\n",
       " 'easily': 16934,\n",
       " 'free': 20995,\n",
       " 'redoing': 42532,\n",
       " 'entire': 17966,\n",
       " 'arsenal': 4501,\n",
       " 'vladimir': 55377,\n",
       " 'putin': 41248,\n",
       " 'continues': 12077,\n",
       " 'appreciate': 4143,\n",
       " 'praise': 39981,\n",
       " 'rights': 43977,\n",
       " 'record': 42414,\n",
       " 'incursions': 26216,\n",
       " 'ukraine': 53346,\n",
       " 'alarmed': 3013,\n",
       " 'respects': 43493,\n",
       " 'strength': 49505,\n",
       " 'fool': 20579,\n",
       " 'feel': 19656,\n",
       " 'lines': 30637,\n",
       " 'jeffrey': 27902,\n",
       " 'goldberg': 22382,\n",
       " 'quotes': 41550,\n",
       " 'power': 39912,\n",
       " 'means': 32620,\n",
       " 'exert': 18776,\n",
       " 'violence': 55264,\n",
       " 'listened': 30710,\n",
       " 'carefully': 9131,\n",
       " 'truth': 52974,\n",
       " 'word': 56826,\n",
       " 'fear': 19587,\n",
       " 'sadly': 44848,\n",
       " 'depleted': 14570,\n",
       " 'cuts': 13344,\n",
       " 'noting': 35944,\n",
       " 'frequently': 21057,\n",
       " 'advertisements': 2584,\n",
       " 'bases': 5920,\n",
       " 'available': 5156,\n",
       " 'purchase': 41166,\n",
       " 'afraid': 2711,\n",
       " 'retreat': 43654,\n",
       " 'reevaluate': 42613,\n",
       " 'international': 27036,\n",
       " 'groups': 22954,\n",
       " 'alliances': 3214,\n",
       " 'nato': 35005,\n",
       " 'obsolete': 36309,\n",
       " 'today': 52030,\n",
       " 'terrorism': 51331,\n",
       " 'soviet': 48263,\n",
       " 'union': 53968,\n",
       " 'mounting': 34303,\n",
       " 'calls': 8822,\n",
       " 'ones': 36649,\n",
       " 'fellow': 19708,\n",
       " 'fight': 19916,\n",
       " 'natural': 35009,\n",
       " 'inclination': 26120,\n",
       " 'recognize': 42361,\n",
       " 'falling': 19303,\n",
       " 'asleep': 4659,\n",
       " 'bored': 7559,\n",
       " 'jim': 28028,\n",
       " 'tankersley': 50823,\n",
       " 'evelyn': 18526,\n",
       " 'duffy': 16646,\n",
       " 'contributed': 12136,\n",
       " 'report': 43254,\n",
       " 'media': 32670,\n",
       " 'ignores': 25636,\n",
       " 'change': 9777,\n",
       " 'rmuse': 44124,\n",
       " 'thu': 51750,\n",
       " 'oct': 36383,\n",
       " '27th': 860,\n",
       " '2016': 658,\n",
       " '36': 1019,\n",
       " 'avoid': 5202,\n",
       " 'ending': 17739,\n",
       " 'temperature': 51193,\n",
       " 'rise': 44042,\n",
       " 'transition': 52494,\n",
       " 'fossil': 20811,\n",
       " 'fuels': 21243,\n",
       " 'embrace': 17504,\n",
       " 'renewable': 43131,\n",
       " 'clean': 10579,\n",
       " 'sources': 48237,\n",
       " 'twitter': 53225,\n",
       " 'print': 40415,\n",
       " 'post': 39807,\n",
       " 'following': 20550,\n",
       " 'opinion': 36742,\n",
       " 'column': 11149,\n",
       " 'muse': 34623,\n",
       " 'dearth': 13820,\n",
       " ...}"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tfidf_vectorizer.vocabulary_"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>5. Defining PassiveAggressive Classifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:20.781923Z",
     "start_time": "2020-05-01T16:19:20.450262Z"
    }
   },
   "outputs": [],
   "source": [
    "#Initialize a PassiveAggressiveClassifier\n",
    "from sklearn.linear_model import PassiveAggressiveClassifier\n",
    "from sklearn.metrics import accuracy_score, confusion_matrix\n",
    "\n",
    "pac=PassiveAggressiveClassifier(max_iter=100)\n",
    "pac.fit(tfidf_train,y_train)\n",
    "\n",
    "y_pred=pac.predict(tfidf_test)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:20.795129Z",
     "start_time": "2020-05-01T16:19:20.785629Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(1901, 58136)"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tfidf_test.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:20.895913Z",
     "start_time": "2020-05-01T16:19:20.799061Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(4434, 58136)"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tfidf_train.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:21.009184Z",
     "start_time": "2020-05-01T16:19:20.899895Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "sklearn.linear_model.passive_aggressive.PassiveAggressiveClassifier"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "type(pac)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>6. Checking Accuracy"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:21.161700Z",
     "start_time": "2020-05-01T16:19:21.016908Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Accuracy: 94.16%\n"
     ]
    }
   ],
   "source": [
    "Score=accuracy_score(y_test,y_pred)\n",
    "print(f'Accuracy: {round(Score*100,2)}%')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:21.306114Z",
     "start_time": "2020-05-01T16:19:21.169275Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[890,  51],\n",
       "       [ 60, 900]], dtype=int64)"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Build confusion matrix\n",
    "confusion_matrix(y_test,y_pred, labels=['FAKE','REAL'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:21.395930Z",
     "start_time": "2020-05-01T16:19:21.310927Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "3442    Here’s How Goldman Sachs Lays People Off | Fin...\n",
       "5522    Texas Cop Fired For Feeding ‘Feces’ Sandwich T...\n",
       "848     California & Oregon Want To Secede From The U....\n",
       "478     Gauis Publius: TPP Has Picked Up a Powerful En...\n",
       "1967    How To Repair Strained Or Broken Relationships...\n",
       "5653    Reflections on US Political Tragedies Reflecti...\n",
       "2329    ATTENTION WESTERN WORLD: If You Care About You...\n",
       "315     Trump Family Say Trump Brand Has NOT Been Dama...\n",
       "3910    YIKES! Megyn Kelly Receives RUDE AWAKENING- Re...\n",
       "3882    Libertarian Party VP insults Trump, practicall...\n",
       "982     Baby Bonds: A Plan for Black/White Wealth Equa...\n",
       "5615    Liberty or State Control? You Decide Op-Ed by ...\n",
       "151     Classless Obama Refuses Photo-Op of White Hous...\n",
       "5123    What Does It Take to Survive Where You Live? L...\n",
       "2521    All we need to know about Trump’s demise we le...\n",
       "5674    FOX: Latinos Are Already CRUSHING Trump At The...\n",
       "1254    Pentagon Seeks Another $6 Billion for Overseas...\n",
       "3217    Gay man finds it in himself to tolerate religi...\n",
       "5124    Homeschool Families Targeted In District’s ‘Op...\n",
       "4834    Donald Trump Likely to End Aid for Rebels Figh...\n",
       "4978    Time does nothing All this time of thoughts an...\n",
       "3791    Clinton Campaign In FULL PANIC After Bill’s Al...\n",
       "5857    Memo to Trump: 'Action This Day!'   => \\n“In v...\n",
       "3221    General is most senior Army officer to kill se...\n",
       "3960    Hillary Clinton’s Wall Street Fundraising Bene...\n",
       "3809    Saudis Foil ISIS Terror Attacks on Packed Stad...\n",
       "2961    Load of manure dumped at Democratic headquarte...\n",
       "136     Suspect captured in ‘ambush-style’ killings of...\n",
       "2173    Politicians Will Feel the Heat From Rising Tem...\n",
       "231     Comment on Tainted Measles Vaccine Kills More ...\n",
       "1355    Anyone from the family who can understand what...\n",
       "4217    US Officials Try to Scare Voters With Terror T...\n",
       "850     The NRA Just Admitted It Was Always Lying Abou...\n",
       "2159    Dozens Of Syrian Children Dead After Receiving...\n",
       "4744    A Mormon Reader Says Most Mormons Will Still B...\n",
       "832     Seven World-Historical Achievements of the Ira...\n",
       "2857    Little-Loved by Scholars, Trump Also Gets Litt...\n",
       "3438    President Obama Gets Real, Not Revenge, On Rep...\n",
       "3853    The Ruthlessly Effective Rebranding of Europe’...\n",
       "2879    Monetary Policy at the Time of Elections by Yv...\n",
       "1565    President al-Assad: United States and its West...\n",
       "893     Public vs. Media on War Email \\nA new poll fro...\n",
       "4728    The Old Democrat Wall Street Plus Identity Pol...\n",
       "5922    US ‘Laying Groundwork’ For Raqqa Offensive In ...\n",
       "3275    Israel Tracked ‘Anti-Government’ Journalists O...\n",
       "2082    Hezbollah’s Candidate Becomes Lebanese Preside...\n",
       "4622    Trump accuses Obama, Hillary Clinton of foundi...\n",
       "1609    Terrorism Threat: Trump is Right — Profile, Pr...\n",
       "6083    Biden Blames “Lazy American Women” For The Eco...\n",
       "5943    Biden Blames “Lazy American Women” For The Eco...\n",
       "1513    Donald Trump May Have Broken The Law To Avoid ...\n",
       "Name: data, dtype: object"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# print message text for the false positives (real incorrectly classified as fake)\n",
    "x_test[y_test < y_pred]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:21.585793Z",
     "start_time": "2020-05-01T16:19:21.398171Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "5609    If you really want to save energy at home, for...\n",
       "3614    Extreme weather to cause extreme food shortage...\n",
       "2652    Mali: At least 20 dead after gunmen storm luxu...\n",
       "2938    Trump’s Hitlerian disregard for the truth The ...\n",
       "2277    Hot dogs, bacon and other processed meats caus...\n",
       "4122    Families To Roof: 'I Forgive You, And Have Mer...\n",
       "3897    Clinton Camp Tries to Deflect Suspicion as FBI...\n",
       "1327    Conservatives in a meltdown: National Review’s...\n",
       "1134    Adelson's Review-Journal Gives Trump First Maj...\n",
       "2088    Trump Gives Victory Speech, Liberals Rediscove...\n",
       "799     Kentucky governor: Electing Hillary Clinton ma...\n",
       "3021    NATO and Putin: Downed Russian bomber is big t...\n",
       "5638    The White House Easter Egg Roll exists because...\n",
       "4138    Trump’s misleading claim that 58 percent of bl...\n",
       "741     Debating the Future of American Power Abroad T...\n",
       "3522    Listen to the Donald Trump voters: It has take...\n",
       "1784    As His Campaign Crumbles, Trump Is Spending Hi...\n",
       "533     Lawmakers caught in battle between House ethic...\n",
       "5039    Trump protests intensify, as doubts swirl abou...\n",
       "4420    Why Hillary Clinton was told not to be a trial...\n",
       "1739    Memo To Trump And Clinton: Use Tough Love To W...\n",
       "5199    Another Brian Williams Story Comes Into Questi...\n",
       "1853    Delta State shooting: Shannon Lamb kills himse...\n",
       "5497    Bill Maher on Charlie Hebdo attacks: “There ar...\n",
       "5527    Exclusive Trump op-ed: We must clean up this c...\n",
       "5776    Do Trump's Groping, Clinton's Lying, &amp; Joh...\n",
       "3638    Hillary Clinton: The Alt-Right Has 'Effectivel...\n",
       "6127    Fox News and the Duggars reach a disgusting ne...\n",
       "2624    How Trump overshadowed Clinton's bad weekend (...\n",
       "2261    7 Times Obama Failed to Support Israel Should ...\n",
       "6187    Penny Nance: Trump vs. Miss Universe -- I can’...\n",
       "1713    TRUMP CALLED IT MONTHS AGO: Anthony Weiner thr...\n",
       "4216    Who rules the world? America is no longer the ...\n",
       "2430    The unemployment rate is now lower than it was...\n",
       "5875    The Trump Network sought to make people rich, ...\n",
       "2477    The worst election ever Dragging on for an exc...\n",
       "5407    Donald Trump and the $12.7 million Ukraine con...\n",
       "441     2 deaths possibly linked to 'superbug' at UCLA...\n",
       "5136    Fact Check: Did Hillary Clinton Introduce A Ne...\n",
       "3378    Clinton campaign: WikiLeaks hack gets ‘closer ...\n",
       "5960    Heart disease kills way more people than war, ...\n",
       "6088    Reuters/Ipsos Poll: Trump Closes in on Clinton...\n",
       "2801    It's National Health Care Decisions Day: Who w...\n",
       "3588    Man burned by fajitas while praying can't sue ...\n",
       "3357    Playing the “rigged” card: Trump, Jones and ot...\n",
       "4639    Why you should be skeptical of wacky new studi...\n",
       "393     Miracles Man: Metaxas Vs. Closed Minds And A C...\n",
       "4237    Obama Has Hit The DGAF Portion Of His Presiden...\n",
       "3348    National Review disses Donald Trump: Why the m...\n",
       "4573    Worth a shot: Former Pennsylvania police offic...\n",
       "1957    Picking Mike Pence Really Was A Grand Slam For...\n",
       "5169    NYDN Calls Out 'Traitor' Senate Republicans Ru...\n",
       "2972    #MemeOfTheWeek: That Article From The Onion Ab...\n",
       "1125    Tics and tricks: Here's what Trump and Clinton...\n",
       "932     Christie Hides $800,000 in Travel Bills New Je...\n",
       "490     Press must share the blame: The shallow, ratin...\n",
       "3289    Report: Solar industry added jobs 20 times fas...\n",
       "5474    Kate Steinle's death and sanctuary cities: Wha...\n",
       "5624    India is building millions of toilets, but tha...\n",
       "6137    Florida Once Again a Focus in 2016 Campaign SA...\n",
       "Name: data, dtype: object"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# print message text for the false negatives (fake incorrectly classified as real)\n",
    "x_test[y_test > y_pred]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:21.736976Z",
     "start_time": "2020-05-01T16:19:21.597781Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Young Fellas Made Of Nothing These Days, Finds Scientific Study We Use Cookies: Our policy [X] Young Fellas Made Of Nothing These Days, Finds Scientific Study November 10, 2016 - BREAKING NEWS , HEALTH Share 0 Add Comment \n",
      "DOCTORS studying the make-up of young fellas have found that they are made of nothing these days, in contrast to the men of old. \n",
      "The scientific study, carried out by a team of genetic experts at Trinity College Dublin, found that the majority of Irish males aged between 16-30 have grown a lot weaker physically and less resilient to cold temperatures over the past 60 years. Of 100 Irish males tested in physical work environments, 67% percent moaned about being tired and fatigued after just two minutes. \n",
      "“We put the study group to work on a local farm picking spuds, weeding gardens and doing general old time shit,” lead researcher Professor Conor Tracey explains, “We even made them travel to work in their bare feet. The results we got back were absolutely appalling to tell you the truth. Only a small minority of the men got on with their chores without complaining”. \n",
      "In fact, further testing found that 89% of those studied were ‘perishers’, a trait increasing in modern day males. \n",
      "“Nearly every one of them began whinging about the cold during the picking stones in the frost task,” Dr. Tracey added, “They began complaining that their ikkle fingies were sore, and that they couldn’t feel their hands or feet from the cold. Poor pets. Several lads even tried to pretend they were sick in a bid to get out of the job, and one 18-year-old subject began crying for his mammy like a big baby, so he did”. \n",
      "The study concluded that 92% of Irish men were found to be made of nothing these days, compared to the young fellas of years ago who used to walk to school in their bare feet, before then going to work in the mines for 18 hours a day. FAKE\n"
     ]
    }
   ],
   "source": [
    "print(x_test.tolist()[3],y_test.tolist()[3])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>7. Saving the model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:19:21.863053Z",
     "start_time": "2020-05-01T16:19:21.744950Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Test score: 94.16 %\n"
     ]
    }
   ],
   "source": [
    "# Save to file in the current working directory\n",
    "import pickle\n",
    "pkl_filename = \"model.pkl\"\n",
    "with open(pkl_filename, 'wb') as file:\n",
    "    pickle.dump(pac, file)\n",
    "\n",
    "# Load from file\n",
    "with open(pkl_filename, 'rb') as file:\n",
    "    pickle_model = pickle.load(file)\n",
    "    \n",
    "# Calculate the accuracy score and predict target values\n",
    "score = pickle_model.score(tfidf_test, y_test)\n",
    "print(\"Test score: {0:.2f} %\".format(100 * score))\n",
    "Ypredict = pickle_model.predict(tfidf_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>8. Trying out stuff"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:21:35.025965Z",
     "start_time": "2020-05-01T16:19:21.866934Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Write a bit of news: Hillary is hillarious\n",
      "Text is: Hillary is hillarious\n",
      "Loading Model...\n",
      "Model Loaded.\n",
      "['FAKE']\n"
     ]
    }
   ],
   "source": [
    "import pickle\n",
    "from sklearn.feature_extraction.text import TfidfVectorizer\n",
    "\n",
    "text = input(\"Write a bit of news: \")\n",
    "print(\"Text is:\",text)\n",
    "print(\"Loading Model...\")\n",
    "pkl_filename = \"model.pkl\"\n",
    "try:\n",
    "    with open(pkl_filename, 'rb') as file:\n",
    "        model = pickle.load(file)\n",
    "        tf1 = pickle.load(open(\"tfidf1.pkl\", 'rb'))\n",
    "    print(\"Model Loaded.\")\n",
    "except:\n",
    "    print(\"Error: Model not found\")\n",
    "    \n",
    "\n",
    "\n",
    "# Create new tfidfVectorizer with old vocabulary\n",
    "tf1_new = TfidfVectorizer(analyzer='word', stop_words = \"english\", vocabulary = tf1.vocabulary_)\n",
    "\n",
    "X_temp = tf1_new.fit_transform([text])\n",
    "X_temp.toarray()\n",
    "predict = model.predict(X_temp)\n",
    "print(predict)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:21:35.037228Z",
     "start_time": "2020-05-01T16:21:35.028923Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "('Kerry to go to Paris in gesture of sympathy U.S. Secretary of State John F. Kerry said Monday that he will stop in Paris later this week, amid criticism that no top American officials attended Sunday’s unity march against terrorism.\\n\\nKerry said he expects to arrive in Paris Thursday evening, as he heads home after a week abroad. He said he will fly to France at the conclusion of a series of meetings scheduled for Thursday in Sofia, Bulgaria. He plans to meet the next day with Foreign Minister Laurent Fabius and President Francois Hollande, then return to Washington.\\n\\nThe visit by Kerry, who has family and childhood ties to the country and speaks fluent French, could address some of the criticism that the United States snubbed France in its darkest hour in many years.\\n\\nThe French press on Monday was filled with questions about why neither President Obama nor Kerry attended Sunday’s march, as about 40 leaders of other nations did. Obama was said to have stayed away because his own security needs can be taxing on a country, and Kerry had prior commitments.\\n\\nAmong roughly 40 leaders who did attend was Israeli Prime Minister Benjamin Netanyahu, no stranger to intense security, who marched beside Hollande through the city streets. The highest ranking U.S. officials attending the march were Jane Hartley, the ambassador to France, and Victoria Nuland, the assistant secretary of state for European affairs. Attorney General Eric H. Holder Jr. was in Paris for meetings with law enforcement officials but did not participate in the march.\\n\\nKerry spent Sunday at a business summit hosted by India’s prime minister, Narendra Modi. The United States is eager for India to relax stringent laws that function as barriers to foreign investment and hopes Modi’s government will act to open the huge Indian market for more American businesses.\\n\\nIn a news conference, Kerry brushed aside criticism that the United States had not sent a more senior official to Paris as “quibbling a little bit.” He noted that many staffers of the American Embassy in Paris attended the march, including the ambassador. He said he had wanted to be present at the march himself but could not because of his prior commitments in India.\\n\\n“But that is why I am going there on the way home, to make it crystal clear how passionately we feel about the events that have taken place there,” he said.\\n\\n“And I don’t think the people of France have any doubts about America’s understanding of what happened, of our personal sense of loss and our deep commitment to the people of France in this moment of trauma.”',\n",
       " 'REAL')"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "n=2\n",
    "X[n],Y[n]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2020-05-01T16:22:00.298936Z",
     "start_time": "2020-05-01T16:22:00.227714Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['REAL']\n"
     ]
    }
   ],
   "source": [
    "X_temp = tf1_new.fit_transform([X[n]])\n",
    "X_temp.toarray()\n",
    "predict = model.predict(X_temp)\n",
    "print(predict)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The END"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.4"
  },
  "toc": {
   "base_numbering": 1,
   "nav_menu": {},
   "number_sections": false,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {},
   "toc_section_display": true,
   "toc_window_display": false
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}