Fake News Classifier Using NLP.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Fake News Classifier Using Natural Language Processing ( NLP ) :"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### I will be dividing This Project into 2 parts , First i will try to come up with solution of this classification via Normal algorithms stepwise,then i will create another section by using pipeline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Basic Data Exploration : "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [],
   "source": [
    "import seaborn as sns\n",
    "import numpy as np\n",
    "import pandas as pd\n",
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "df=pd.read_csv('fake-news/train.csv')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>title</th>\n",
       "      <th>author</th>\n",
       "      <th>text</th>\n",
       "      <th>label</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>House Dem Aide: We Didn’t Even See Comey’s Let...</td>\n",
       "      <td>Darrell Lucus</td>\n",
       "      <td>House Dem Aide: We Didn’t Even See Comey’s Let...</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>FLYNN: Hillary Clinton, Big Woman on Campus - ...</td>\n",
       "      <td>Daniel J. Flynn</td>\n",
       "      <td>Ever get the feeling your life circles the rou...</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2</td>\n",
       "      <td>Why the Truth Might Get You Fired</td>\n",
       "      <td>Consortiumnews.com</td>\n",
       "      <td>Why the Truth Might Get You Fired October 29, ...</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3</td>\n",
       "      <td>15 Civilians Killed In Single US Airstrike Hav...</td>\n",
       "      <td>Jessica Purkiss</td>\n",
       "      <td>Videos 15 Civilians Killed In Single US Airstr...</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>4</td>\n",
       "      <td>Iranian woman jailed for fictional unpublished...</td>\n",
       "      <td>Howard Portnoy</td>\n",
       "      <td>Print \\nAn Iranian woman has been sentenced to...</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   id                                              title              author  \\\n",
       "0   0  House Dem Aide: We Didn’t Even See Comey’s Let...       Darrell Lucus   \n",
       "1   1  FLYNN: Hillary Clinton, Big Woman on Campus - ...     Daniel J. Flynn   \n",
       "2   2                  Why the Truth Might Get You Fired  Consortiumnews.com   \n",
       "3   3  15 Civilians Killed In Single US Airstrike Hav...     Jessica Purkiss   \n",
       "4   4  Iranian woman jailed for fictional unpublished...      Howard Portnoy   \n",
       "\n",
       "                                                text  label  \n",
       "0  House Dem Aide: We Didn’t Even See Comey’s Let...      1  \n",
       "1  Ever get the feeling your life circles the rou...      0  \n",
       "2  Why the Truth Might Get You Fired October 29, ...      1  \n",
       "3  Videos 15 Civilians Killed In Single US Airstr...      1  \n",
       "4  Print \\nAn Iranian woman has been sentenced to...      1  "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['id', 'title', 'author', 'text', 'label'], dtype='object')"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>label</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>count</th>\n",
       "      <td>20800.000000</td>\n",
       "      <td>20800.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean</th>\n",
       "      <td>10399.500000</td>\n",
       "      <td>0.500625</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std</th>\n",
       "      <td>6004.587135</td>\n",
       "      <td>0.500012</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25%</th>\n",
       "      <td>5199.750000</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50%</th>\n",
       "      <td>10399.500000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75%</th>\n",
       "      <td>15599.250000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max</th>\n",
       "      <td>20799.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                 id         label\n",
       "count  20800.000000  20800.000000\n",
       "mean   10399.500000      0.500625\n",
       "std     6004.587135      0.500012\n",
       "min        0.000000      0.000000\n",
       "25%     5199.750000      0.000000\n",
       "50%    10399.500000      1.000000\n",
       "75%    15599.250000      1.000000\n",
       "max    20799.000000      1.000000"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 20800 entries, 0 to 20799\n",
      "Data columns (total 5 columns):\n",
      " #   Column  Non-Null Count  Dtype \n",
      "---  ------  --------------  ----- \n",
      " 0   id      20800 non-null  int64 \n",
      " 1   title   20242 non-null  object\n",
      " 2   author  18843 non-null  object\n",
      " 3   text    20761 non-null  object\n",
      " 4   label   20800 non-null  int64 \n",
      "dtypes: int64(2), object(3)\n",
      "memory usage: 812.6+ KB\n"
     ]
    }
   ],
   "source": [
    "df.info()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Some Exploratory Data Analysis :"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "id           0\n",
       "title      558\n",
       "author    1957\n",
       "text        39\n",
       "label        0\n",
       "dtype: int64"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.isnull().sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x21a70c549d0>"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY0AAAEECAYAAADUGGjBAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+j8jraAAAUk0lEQVR4nO3dbUxb593H8Z9tME1sE4RKpbWJo9HG0qKFloeRTQpMeVGxapqGqjbB3kizKZ2Esk7QlhB1DaxpNUAZVqVMLFvEGoXNMLZmWjUpb0orUEmGKmtJWrZ0FZryNLp6JLmLnYIdOPeLJV7ZmnCl4IeE7+dVfXwR/y0d8e05Bx/bLMuyBACAAXumBwAA3D6IBgDAGNEAABgjGgAAY0QDAGAsJ9MDpNLc3JxmZ/njMAC4Fbm5jhs+d0dHY3bW0uXLVzI9BgDcVoqKPDd8jtNTAABjRAMAYIxoAACMEQ0AgDGiAQAwRjQAAMaIBgDAGNEAABgjGgAAY3f0J8KXgjv/Lq3Iy830GMgyH88kFP1oOqMzFK7KlcN5V0ZnQPaZjU/r4v8lUvbvE40FrMjLVXnz4UyPgSwT3rdNUWU2Gg7nXTq7d0NGZ0D28ba+Iyl10eD0FADAGNEAABgjGgAAYymLxsmTJ1VfXy9JOnPmjPx+vwKBgNra2jQ3NydJGhgY0KOPPqotW7bozTfflCRNT0/rqaeeUiAQ0JNPPqmLFy9Kkk6cOKHHH39cdXV1+ulPf5qqsQEAN5GSaBw8eFDPP/+8ZmZmJEnt7e1qbGxUKBSSZVkaHBxUJBJRb2+v+vv71dPTo2AwqHg8rr6+Pvl8PoVCIdXW1qq7u1uS1NbWpq6uLvX19enkyZMaGxtLxegAgJtISTS8Xq/279+ffDw2NqbKykpJUnV1tY4dO6ZTp06ptLRUTqdTHo9HXq9Xp0+fVjgcVlVVVXLt8ePHFY1GFY/H5fV6ZbPZtGnTJh0/fjwVowMAbiIlf3JbU1Oj8+fPJx9bliWbzSZJcrlcmpqaUjQalcfzn2+Hcrlcikaj87Z/cq3b7Z639ty5cwvO4XDYVFCwcqneFjAP+xayVSr3zbR8TsNu/88BTSwWU35+vtxut2Kx2LztHo9n3vabrc3Pz1/wdZfi615v9rWHWN4y/VXC7Ju4kVT+3kvLX0+tX79eo6OjkqTh4WFVVFSopKRE4XBYMzMzmpqa0vj4uHw+n8rKyjQ0NJRcW15eLrfbrdzcXJ09e1aWZemtt95SRUVFOkYHAHxCWo40WlpatGfPHgWDQRUXF6umpkYOh0P19fUKBAKyLEtNTU3Ky8uT3+9XS0uL/H6/cnNz1dXVJUl64YUX9Oyzz2p2dlabNm3Sgw8+mI7RAQCfYLMsy8r0EKmSSMwuyWEatxHBfwvv26ZIZCqjMxQVebiNCP6Ht/WdRe+bGT89BQC4MxANAIAxogEAMEY0AADGiAYAwBjRAAAYIxoAAGNEAwBgjGgAAIwRDQCAMaIBADBGNAAAxogGAMAY0QAAGCMaAABjRAMAYIxoAACMEQ0AgDGiAQAwRjQAAMaIBgDAGNEAABgjGgAAY0QDAGCMaAAAjBENAIAxogEAMEY0AADGiAYAwBjRAAAYIxoAAGNEAwBgLCddL5RIJLR7925duHBBdrtdL774onJycrR7927ZbDatW7dObW1tstvtGhgYUH9/v3JyctTQ0KDNmzdrenpazc3NmpyclMvlUmdnpwoLC9M1PgBAaTzSGBoa0tWrV9Xf36+dO3fq5ZdfVnt7uxobGxUKhWRZlgYHBxWJRNTb26v+/n719PQoGAwqHo+rr69PPp9PoVBItbW16u7uTtfoAIBr0haNz3/+85qdndXc3Jyi0ahycnI0NjamyspKSVJ1dbWOHTumU6dOqbS0VE6nUx6PR16vV6dPn1Y4HFZVVVVy7fHjx9M1OgDgmrSdnlq5cqUuXLigRx55RJcuXdKBAwf09ttvy2azSZJcLpempqYUjUbl8XiSP+dyuRSNRudtv752IQ6HTQUFK1PzhrDssW8hW6Vy30xbNA4dOqRNmzbpmWee0cTEhJ544gklEonk87FYTPn5+XK73YrFYvO2ezyeeduvr13I7Kyly5evLGruoiLPwouwLC1231os9k3cSCp/76Xt9FR+fn7ySGHVqlW6evWq1q9fr9HRUUnS8PCwKioqVFJSonA4rJmZGU1NTWl8fFw+n09lZWUaGhpKri0vL0/X6ACAa9J2pLF9+3Y999xzCgQCSiQSampq0he/+EXt2bNHwWBQxcXFqqmpkcPhUH19vQKBgCzLUlNTk/Ly8uT3+9XS0iK/36/c3Fx1dXWla3QAwDU2y7KsTA+RKonE7JIcppU3H16iiXCnCO/bpkhk4etqqVRU5NHZvRsyOgOyj7f1nUXvm1lxegoAcPsjGgAAY0QDAGCMaAAAjBENAIAxogEAMEY0AADGiAYAwBjRAAAYIxoAAGNEAwBgjGgAAIwRDQCAMaIBADBGNAAAxogGAMAY0QAAGCMaAABjRAMAYIxoAACMEQ0AgDGiAQAwRjQAAMaIBgDAGNEAABgjGgAAY0QDAGCMaAAAjBENAIAxogEAMEY0AADGiAYAwFhOOl/s5z//ud544w0lEgn5/X5VVlZq9+7dstlsWrdundra2mS32zUwMKD+/n7l5OSooaFBmzdv1vT0tJqbmzU5OSmXy6XOzk4VFhamc3wAWPbSdqQxOjqqP//5z+rr61Nvb68++OADtbe3q7GxUaFQSJZlaXBwUJFIRL29verv71dPT4+CwaDi8bj6+vrk8/kUCoVUW1ur7u7udI0OALgmbUcab731lnw+n3bu3KloNKpdu3ZpYGBAlZWVkqTq6mqNjIzIbrertLRUTqdTTqdTXq9Xp0+fVjgc1o4dO5JrTaLhcNhUULAype8Lyxf7FrJVKvdNo2j89re/1eOPP558fPjwYW3btu2WXujSpUv6xz/+oQMHDuj8+fNqaGiQZVmy2WySJJfLpampKUWjUXk8nuTPuVwuRaPReduvr13I7Kyly5ev3NKc/62oyLPwIixLi923Fot9EzeSyt97N43GH//4R73xxhsaHR3Vn/70J0nS7Oys3n///VuORkFBgYqLi+V0OlVcXKy8vDx98MEHyedjsZjy8/PldrsVi8Xmbfd4PPO2X18LAEivm0ajqqpKRUVFunz5srZu3SpJstvtWrNmzS2/UHl5uQ4fPqzvfOc7+vDDD/Xxxx/rK1/5ikZHR7Vx40YNDw/ry1/+skpKSvTyyy9rZmZG8Xhc4+Pj8vl8Kisr09DQkEpKSjQ8PKzy8vLP9o4BAJ/ZTaOxatUqbdy4URs3btTk5KRmZmYk/fto41Zt3rxZb7/9th577DFZlqXW1latXr1ae/bsUTAYVHFxsWpqauRwOFRfX69AICDLstTU1KS8vDz5/X61tLTI7/crNzdXXV1dn+0dAwA+M5tlWdZCi1544QUNDQ3pnnvuSV6H6O/vT8d8i5JIzC7Jub3y5sNLNBHuFOF92xSJLHxdLZWKijw6u3dDRmdA9vG2vrPoffMzX9O47uTJk3r99ddlt/NZQABYzowqsHbt2uSpKQDA8mV0pDExMaHNmzdr7dq1knTbnJ4CACwto2hw0RkAIBlG4/e///3/bPv+97+/5MMAALKbUTTuvvtuSZJlWfrLX/6iubm5lA4FAMhORtGoq6ub9/j6PaAAAMuLUTT+/ve/J/87EoloYmIiZQMBALKXUTRaW1uT/52Xl6ddu3albCAAQPYyikZvb68uXbqkc+fOafXq1Xz5EQAsU0Yf7jt69Kjq6up04MABbd26VX/4wx9SPRcAIAsZHWkcOnRIR44cSX63xRNPPKFvfvObqZ4NAJBljI40bDabXC6XJMntdisvLy+lQwEAspPRkYbX61VHR4cqKioUDofl9XpTPRcAIAsZHWls2bJFq1at0rFjx3TkyBF961vfSvVcAIAsZBSNjo4OPfzww2ptbdXvfvc7dXR0pHouAEAWMopGTk6OHnjgAUnSmjVr+F4NAFimjK5p3HvvvQoGg3rooYd06tQp3XPPPameCwCQhYwOGdrb21VYWKihoSEVFhaqvb091XMBALKQ0ZFGXl6etm/fnuJRAADZjosTAABjRAMAYIxoAACMEQ0AgDGiAQAwRjQAAMaIBgDAGNEAABgjGgAAY0QDAGCMaAAAjBENAICxtEdjcnJSX/3qVzU+Pq4zZ87I7/crEAiora1Nc3NzkqSBgQE9+uij2rJli958801J0vT0tJ566ikFAgE9+eSTunjxYrpHB4BlL63RSCQSam1t1V133SXp37dcb2xsVCgUkmVZGhwcVCQSUW9vr/r7+9XT06NgMKh4PK6+vj75fD6FQiHV1taqu7s7naMDAGR4a/Sl0tnZqbq6Ov3iF7+QJI2NjamyslKSVF1drZGREdntdpWWlsrpdMrpdMrr9er06dMKh8PasWNHcq1JNBwOmwoKVqbuDWFZY99Ctkrlvpm2aBw5ckSFhYWqqqpKRsOyLNlsNkmSy+XS1NSUotGoPB5P8udcLpei0ei87dfXLmR21tLly1cWNXdRkWfhRViWFrtvLRb7Jm4klb/30haNV199VTabTcePH9df//pXtbS0zLsuEYvFlJ+fL7fbrVgsNm+7x+OZt/36WgBAeqXtmsavf/1r/epXv1Jvb6++8IUvqLOzU9XV1RodHZUkDQ8Pq6KiQiUlJQqHw5qZmdHU1JTGx8fl8/lUVlamoaGh5Nry8vJ0jQ4AuCat1zT+W0tLi/bs2aNgMKji4mLV1NTI4XCovr5egUBAlmWpqalJeXl58vv9amlpkd/vV25urrq6ujI5OgAsSzbLsqxMD5EqicTskpzbK28+vEQT4U4R3rdNkcjC19VSqajIo7N7N2R0BmQfb+s7i943b3ZNgw/3AQCMEQ0AgDGiAQAwRjQAAMaIBgDAGNEAABgjGgAAY0QDAGCMaAAAjBENAIAxogEAMEY0AADGiAYAwBjRAAAYIxoAAGNEAwBgjGgAAIwRDQCAMaIBADBGNAAAxogGAMAY0QAAGCMaAABjRAMAYIxoAACMEQ0AgDGiAQAwRjQAAMaIBgDAGNEAABgjGgAAYznpeqFEIqHnnntOFy5cUDweV0NDgx544AHt3r1bNptN69atU1tbm+x2uwYGBtTf36+cnBw1NDRo8+bNmp6eVnNzsyYnJ+VyudTZ2anCwsJ0jQ8AUBqPNF577TUVFBQoFArp4MGDevHFF9Xe3q7GxkaFQiFZlqXBwUFFIhH19vaqv79fPT09CgaDisfj6uvrk8/nUygUUm1trbq7u9M1OgDgmrQdaXzta19TTU1N8rHD4dDY2JgqKyslSdXV1RoZGZHdbldpaamcTqecTqe8Xq9Onz6tcDisHTt2JNcSDQBIv7RFw+VySZKi0ah+8IMfqLGxUZ2dnbLZbMnnp6amFI1G5fF45v1cNBqdt/362oU4HDYVFKxMwbsBxL6FrJXKfTNt0ZCkiYkJ7dy5U4FAQN/4xje0b9++5HOxWEz5+flyu92KxWLztns8nnnbr69dyOyspcuXryxq5qIiz8KLsCwtdt9aLPZN3Egqf++l7ZrGv/71L333u99Vc3OzHnvsMUnS+vXrNTo6KkkaHh5WRUWFSkpKFA6HNTMzo6mpKY2Pj8vn86msrExDQ0PJteXl5ekaHQBwTdqONA4cOKCPPvpI3d3dyesRP/zhD/XSSy8pGAyquLhYNTU1cjgcqq+vVyAQkGVZampqUl5envx+v1paWuT3+5Wbm6uurq50jQ4AuMZmWZaV6SFSJZGYXZLDtPLmw0s0Ee4U4X3bFIksfF0tlYqKPDq7d0NGZ0D28ba+s+h9MytOTwEAbn9EAwBgjGgAAIwRDQCAMaIBADBGNAAAxogGAMAY0QAAGCMaAABjRAMAYIxoAACMEQ0AgDGiAQAwRjQAAMaIBgDAGNEAABgjGgAAY0QDAGCMaAAAjBENAIAxogEAMEY0AADGiAYAwBjRAAAYIxoAAGNEAwBgjGgAAIwRDQCAMaIBADBGNAAAxogGAMAY0QAAGMvJ9AC3Ym5uTj/60Y/03nvvyel06qWXXtLatWszPRYALBu31ZHG66+/rng8rt/85jd65pln1NHRkemRAGBZua2iEQ6HVVVVJUl66KGH9O6772Z4IgBYXm6r01PRaFRutzv52OFw6OrVq8rJ+fS3kZvrUFGRZ9GvG963bdH/Bu48S7FvLZa39Z1Mj4AslMp987Y60nC73YrFYsnHc3NzNwwGAGDp3VbRKCsr0/DwsCTpxIkT8vl8GZ4IAJYXm2VZVqaHMHX9r6f+9re/ybIs/fjHP9b999+f6bEAYNm4raIBAMis2+r0FAAgs4gGAMAY0QAAGCMaWNDc3JxaW1u1detW1dfX68yZM5keCZjn5MmTqq+vz/QYywIfcsCCPnn7lhMnTqijo0M/+9nPMj0WIEk6ePCgXnvtNa1YsSLToywLHGlgQdy+BdnM6/Vq//79mR5j2SAaWNCNbt8CZIOamhruDJFGRAML4vYtAK4jGlgQt28BcB3/u4gFPfzwwxoZGVFdXV3y9i0AliduIwIAMMbpKQCAMaIBADBGNAAAxogGAMAY0QAAGCMawBI7cuSIfvKTn3zqc/v371dfX5/Rv3Mra4F0IRoAAGN8uA9Ika6uLr377ruKxWK6//771d7eLunfdw0+evSopqen9fzzz6ukpERHjx7VoUOHZLfbVV5ermeffTbD0wOfjmgAKZBIJHT33XfrlVde0dzcnL7+9a/rn//8pyTpvvvu0969e/X+++9r165deuWVV7R//369+uqrWrFihZqbmzUyMpLhdwB8OqIBpIDNZtPFixf19NNPa+XKlbpy5YoSiYQk6Utf+pIkad26dYpEIjp79qwuXryo733ve5KkWCymc+fOZWx24Ga4pgGkwOjoqCYmJhQMBvX0009renpa1+/Yc+rUKUnSe++9p3vvvVerV6/W5z73Of3yl79Ub2+vvv3tb+vBBx/M5PjADXGkAaTAhg0bNDY2pi1btsjpdGrNmjX68MMPJUnnz5/Xtm3bFI/HtXfvXhUWFmr79u2qr6/X7Oys7rvvPj3yyCMZfgfAp+OGhQAAY5yeAgAYIxoAAGNEAwBgjGgAAIwRDQCAMaIBADBGNAAAxv4fJURND2Q1S4gAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "sns.set_style('darkgrid')\n",
    "sns.countplot(x='label',data=df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>title</th>\n",
       "      <th>author</th>\n",
       "      <th>text</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>label</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>10387</td>\n",
       "      <td>10387</td>\n",
       "      <td>10361</td>\n",
       "      <td>10387</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>10413</td>\n",
       "      <td>9855</td>\n",
       "      <td>8482</td>\n",
       "      <td>10374</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "          id  title  author   text\n",
       "label                             \n",
       "0      10387  10387   10361  10387\n",
       "1      10413   9855    8482  10374"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.groupby('label').count()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "df['length']=df['title'].astype(str).apply(len)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x21a70d5f430>"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYAAAAD3CAYAAAAUl4NyAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+j8jraAAAZK0lEQVR4nO3de2yb1eHG8a/jXGhtZ1G1Ik3aPBbAEh0Ky2XRJiUplTbCBIioakPtyWxiVNChsmSjS2gbAmpZibRY04rCpYo0ySUJEaBd1E1sdFVC1xAhjyZa1GwiGi3lsqUtFX5dYqfO+/tjv9pLttWNceM25/n8hY/Py3vO09RP/foSh23bNiIiYpyCfC9ARETyQwUgImIoFYCIiKFUACIihlIBiIgYqjDfC7hUc3NzJJOLf8OS0+nI6rjlSFmkKYs0ZZG2HLMoKnL+z/uumgJIJm3Onj236OPKylZmddxypCzSlEWaskhbjlmsXu35n/fpEpCIiKFUACIihlIBiIgYSgUgImIoFYCIiKFUACIihlIBiIgYSgUgImIoFYCIiKGumk8CX63cpStYUbL0MX8SP4/18SdLfl4RuXqoAC6zFSWFXNd+YMnP+85Td2At+VlF5GqiS0AiIoZSAYiIGEoFICJiqEsqgLGxMYLB4Lyx3/zmN9xzzz2p24ODg6xfv57m5mYOHToEwMzMDFu3biUQCLB582bOnDkDwNGjR9m4cSObNm3i6aefztVeRERkETIWwL59+9i5cyfxeDw1duzYMV566SVs+1+/OGF6eppwOMzAwAC9vb2EQiESiQT9/f34fD76+vpoamqip6cHgM7OTrq7u+nv72dsbIyJiYnLtD0REflfMhaA1+tl7969qdsfffQRP/3pT9m+fXtqbHx8nMrKSoqLi/F4PHi9XiYnJ4lEItTX1wPQ0NDAyMgIlmWRSCTwer04HA7q6uoYGRm5DFsTEZGLyfg20MbGRk6ePAlAMplkx44dbN++nZKSktQcy7LweNK/dcblcmFZ1rxxl8tFNBrFsizcbve8ue+++27GhTqdDsrKVl76zlLHFWR13HKwcN8mZ7GQskhTFmmmZbGozwFMTExw/PhxHn/8ceLxOG+//TZPPvkkX/va14jFYql5sVgMj8eD2+1OjcdiMUpLS+eN/ft4Jlfrr4S82K9ju9wW7jvfWVxJlEWaskhbjlnk7FdCVlRUcODAAcLhMKFQiBtuuIEdO3ZQUVFBJBIhHo8TjUaZmprC5/NRVVXF0NAQAMPDw1RXV+N2uykqKuLEiRPYts3hw4epqan5dDsUEZFFy8kngVevXk0wGCQQCGDbNq2trZSUlOD3+2lra8Pv91NUVER3dzcATzzxBI888gjJZJK6ujpuueWWXCxDREQWwWFfeCvPFW52NnnVXgLK11dBTE9H543lO4sribJIUxZpyzGLnF0CEhGR5UMFICJiKBWAiIihVAAiIoZSAYiIGEoFICJiKBWAiIihVAAiIoZSAYiIGEoFICJiKBWAiIihVAAiIoZSAYiIGEoFICJiKBWAiIihVAAiIoZSAYiIGEoFICJiKBWAiIihVAAiIoZSAYiIGOqSCmBsbIxgMAjAsWPHCAQCBINBvve973Hq1CkABgcHWb9+Pc3NzRw6dAiAmZkZtm7dSiAQYPPmzZw5cwaAo0ePsnHjRjZt2sTTTz99OfYlIiIZZCyAffv2sXPnTuLxOABPPvkkHR0dhMNhvvnNb7Jv3z6mp6cJh8MMDAzQ29tLKBQikUjQ39+Pz+ejr6+PpqYmenp6AOjs7KS7u5v+/n7GxsaYmJi4vLsUEZH/UJhpgtfrZe/evfz4xz8GIBQKce211wKQTCYpKSlhfHycyspKiouLKS4uxuv1Mjk5SSQS4f777wegoaGBnp4eLMsikUjg9XoBqKurY2RkhC9/+csXXYfT6aCsbOWiN+h0FmR13HKwcN8mZ7GQskhTFmmmZZGxABobGzl58mTq9oUH/z//+c/s37+fF154gddffx2Px5Oa43K5sCwLy7JS4y6Xi2g0imVZuN3ueXPffffdjAtNJm3Onj136Tv7f2VlK7M6LldWr/ZknnSZLNx3vrO4kiiLNGWRthyzuNhjUMYC+G9++9vf8swzz/D888+zatUq3G43sVgsdX8sFsPj8cwbj8VilJaW/te5paWl2SxDREQ+hUW/C+hXv/oV+/fvJxwO84UvfAGAiooKIpEI8XicaDTK1NQUPp+PqqoqhoaGABgeHqa6uhq3201RUREnTpzAtm0OHz5MTU1NbnclIiIZLeoZQDKZ5Mknn+Rzn/scW7duBeCrX/0qDz/8MMFgkEAggG3btLa2UlJSgt/vp62tDb/fT1FREd3d3QA88cQTPPLIIySTSerq6rjllltyvzMREbkoh23bdr4XcSlmZ5NX7WsA17UfWPLzvvPUHUxPR+eN5TuLK4mySFMWacsxi4u9BqAPgomIGEoFICJiKBWAiIihVAAiIoZSAYiIGEoFICJiKBWAiIihVAAiIoZSAYiIGEoFICJiKBWAiIihVAAiIoZSAYiIGEoFICJiKBWAiIihVAAiIoZSAYiIGEoFICJiKBWAiIihVAAiIoa6pAIYGxsjGAwCcPz4cfx+P4FAgM7OTubm5gAYHBxk/fr1NDc3c+jQIQBmZmbYunUrgUCAzZs3c+bMGQCOHj3Kxo0b2bRpE08//fTl2JeIiGSQsQD27dvHzp07icfjAOzZs4eWlhb6+vqwbZuDBw8yPT1NOBxmYGCA3t5eQqEQiUSC/v5+fD4ffX19NDU10dPTA0BnZyfd3d309/czNjbGxMTE5d2liIj8h4wF4PV62bt3b+r2xMQEtbW1ADQ0NHDkyBHGx8eprKykuLgYj8eD1+tlcnKSSCRCfX19au7IyAiWZZFIJPB6vTgcDurq6hgZGblM2xMRkf+lMNOExsZGTp48mbpt2zYOhwMAl8tFNBrFsiw8Hk9qjsvlwrKseeP/Ptftds+b++6772ZcqNPpoKxs5aXvLHVcQVbHLQcL921yFgspizRlkWZaFhkLYKGCgvSThlgsRmlpKW63m1gsNm/c4/HMG7/Y3NLS0oznTSZtzp49t9jlUla2MqvjcmX1ak/mSZfJwn3nO4sribJIUxZpyzGLiz0GLfpdQGvWrGF0dBSA4eFhampqqKioIBKJEI/HiUajTE1N4fP5qKqqYmhoKDW3uroat9tNUVERJ06cwLZtDh8+TE1NTZZbExGRbC36GUBbWxsdHR2EQiHKy8tpbGzE6XQSDAYJBALYtk1rayslJSX4/X7a2trw+/0UFRXR3d0NwBNPPMEjjzxCMpmkrq6OW265JecbExGRi3PYtm3nexGXYnY2edVeArqu/cCSn/edp+5gejo6byzfWVxJlEWaskhbjlnk9BKQiIgsDyoAERFDqQBERAylAhARMZQKQETEUCoAERFDqQBERAylAhARMZQKQETEUCoAERFDqQBERAylAhARMZQKQETEUCoAERFDqQBERAylAhARMZQKQETEUCoAERFDqQBERAylAhARMVRhNgfNzs7S3t7Oe++9R0FBAbt27aKwsJD29nYcDgc33ngjnZ2dFBQUMDg4yMDAAIWFhWzZsoV169YxMzPDtm3bOH36NC6Xi66uLlatWpXrvYmIyEVk9QxgaGiI8+fPMzAwwEMPPcTPfvYz9uzZQ0tLC319fdi2zcGDB5meniYcDjMwMEBvby+hUIhEIkF/fz8+n4++vj6ampro6enJ9b5ERCSDrArgS1/6Eslkkrm5OSzLorCwkImJCWprawFoaGjgyJEjjI+PU1lZSXFxMR6PB6/Xy+TkJJFIhPr6+tTckZGR3O1IREQuSVaXgFauXMl7773Ht771LT766COeffZZ3nzzTRwOBwAul4toNIplWXg8ntRxLpcLy7LmjV+Ym4nT6aCsbOWi1+p0FmR13HKwcN8mZ7GQskhTFmmmZZFVAfziF7+grq6OH/3oR3zwwQd85zvfYXZ2NnV/LBajtLQUt9tNLBabN+7xeOaNX5ibSTJpc/bsuUWvtaxsZVbH5crq1Z7Mky6ThfvOdxZXEmWRpizSlmMWF3sMyuoSUGlpaepf8J/5zGc4f/48a9asYXR0FIDh4WFqamqoqKggEokQj8eJRqNMTU3h8/moqqpiaGgoNbe6ujqbZYiIyKeQ1TOA7373u2zfvp1AIMDs7Cytra3cfPPNdHR0EAqFKC8vp7GxEafTSTAYJBAIYNs2ra2tlJSU4Pf7aWtrw+/3U1RURHd3d673JSIiGThs27bzvYhLMTubvGovAV3XfmDJz/vOU3cwPT3/tZV8Z3ElURZpyiJtOWaR80tAIiJy9VMBiIgYSgUgImIoFYCIiKFUACIihlIBiIgYSgUgImIoFYCIiKFUACIihlIBiIgYSgUgImIoFYCIiKFUACIihlIBiIgYSgUgImIoFYCIiKFUACIihlIBiIgYSgUgImIoFYCIiKFUACIihirM9sDnnnuOP/7xj8zOzuL3+6mtraW9vR2Hw8GNN95IZ2cnBQUFDA4OMjAwQGFhIVu2bGHdunXMzMywbds2Tp8+jcvloquri1WrVuVyXyIikkFWzwBGR0d566236O/vJxwO8+GHH7Jnzx5aWlro6+vDtm0OHjzI9PQ04XCYgYEBent7CYVCJBIJ+vv78fl89PX10dTURE9PT673JSIiGWRVAIcPH8bn8/HQQw/x4IMPcuuttzIxMUFtbS0ADQ0NHDlyhPHxcSorKykuLsbj8eD1epmcnCQSiVBfX5+aOzIykrsdiYjIJcnqEtBHH33E+++/z7PPPsvJkyfZsmULtm3jcDgAcLlcRKNRLMvC4/GkjnO5XFiWNW/8wtxMnE4HZWUrF71Wp7Mgq+OWg4X7NjmLhZRFmrJIMy2LrAqgrKyM8vJyiouLKS8vp6SkhA8//DB1fywWo7S0FLfbTSwWmzfu8XjmjV+Ym0kyaXP27Lks1royq+NyZfVqT+ZJl8nCfec7iyuJskhTFmnLMYuLPQZldQmourqa119/Hdu2+cc//sEnn3zC17/+dUZHRwEYHh6mpqaGiooKIpEI8XicaDTK1NQUPp+PqqoqhoaGUnOrq6uzWYaIiHwKWT0DWLduHW+++SYbNmzAtm0ee+wxPv/5z9PR0UEoFKK8vJzGxkacTifBYJBAIIBt27S2tlJSUoLf76etrQ2/309RURHd3d253peIiGTgsG3bzvciLsXsbPKqvQR0XfuBJT/vO0/dwfT0/NdW8p3FlURZpCmLtOWYRc4vAYmIyNVPBSAiYigVgIiIoVQAIiKGUgGIiBhKBSAiYigVgIiIoVQAIiKGUgGIiBhKBSAiYigVgIiIoVQAIiKGUgGIiBhKBSAiYigVgIiIoVQAIiKGUgGIiBhKBSAiYigVgIiIoVQAIiKG+lQFcPr0adauXcvU1BTHjx/H7/cTCATo7Oxkbm4OgMHBQdavX09zczOHDh0CYGZmhq1btxIIBNi8eTNnzpz59DsREZFFyboAZmdneeyxx7jmmmsA2LNnDy0tLfT19WHbNgcPHmR6eppwOMzAwAC9vb2EQiESiQT9/f34fD76+vpoamqip6cnZxsSEZFLk3UBdHV1sWnTJq699loAJiYmqK2tBaChoYEjR44wPj5OZWUlxcXFeDwevF4vk5OTRCIR6uvrU3NHRkZysBUREVmMwmwOeuWVV1i1ahX19fU8//zzANi2jcPhAMDlchGNRrEsC4/HkzrO5XJhWda88QtzM3E6HZSVrVz0Wp3OgqyOWw4W7tvkLBZSFmnKIs20LLIqgJdffhmHw8HIyAjHjh2jra1t3nX8WCxGaWkpbrebWCw2b9zj8cwbvzA3k2TS5uzZc4tea1nZyqyOy5XVqz2ZJ10mC/ed7yyuJMoiTVmkLccsLvYYlNUloBdeeIH9+/cTDoe56aab6OrqoqGhgdHRUQCGh4epqamhoqKCSCRCPB4nGo0yNTWFz+ejqqqKoaGh1Nzq6upsliEiIp9CVs8A/pu2tjY6OjoIhUKUl5fT2NiI0+kkGAwSCASwbZvW1lZKSkrw+/20tbXh9/spKiqiu7s7V8sQEZFL5LBt2873Ii7F7Gzyqr0EdF37gSU/7ztP3cH09PzXVvKdxZVEWaQpi7TlmEXOLwGJiMjVTwUgImIoFYCIiKFUACIihlIBiIgYSgUgImIoFYCIiKFUACIihlIBiIgYKmdfBXGlc5euYEWJMdtlZjb5Xz8BuBRfTvdJ/DzWx59c9vOIyKdjzCPiipLCvH0lQz5cU+TMy37hX3u28nJmEVkMXQISETGUCkBExFAqABERQ6kAREQMpQIQETGUCkBExFAqABERQ6kAREQMpQIQETGUCkBExFBZfRXE7Ows27dv57333iORSLBlyxZuuOEG2tvbcTgc3HjjjXR2dlJQUMDg4CADAwMUFhayZcsW1q1bx8zMDNu2beP06dO4XC66urpYtWpVrvcmIiIXkdUzgF//+teUlZXR19fHvn372LVrF3v27KGlpYW+vj5s2+bgwYNMT08TDocZGBigt7eXUChEIpGgv78fn89HX18fTU1N9PT05HpfIiKSQVbPAG6//XYaGxtTt51OJxMTE9TW1gLQ0NDAn/70JwoKCqisrKS4uJji4mK8Xi+Tk5NEIhHuv//+1NxLKQCn00FZ2cpFr9XpLMjqOPl0rvTM9XORpizSTMsiqwJwuVwAWJbFww8/TEtLC11dXTgcjtT90WgUy7LweDzzjrMsa974hbmZJJM2Z8+eW/Ray8pWcvbsuSX5GmRJy+bPaild+LkQZfHvlmMWF3vsy/pF4A8++IB7772Xu+++m7vuuouCgvT/KhaLUVpaitvtJhaLzRv3eDzzxi/MFRGRpZVVAZw6dYr77ruPbdu2sWHDBgDWrFnD6OgoAMPDw9TU1FBRUUEkEiEejxONRpmamsLn81FVVcXQ0FBqbnV1dY62IyIilyqrS0DPPvssH3/8MT09Panr9zt27GD37t2EQiHKy8tpbGzE6XQSDAYJBALYtk1rayslJSX4/X7a2trw+/0UFRXR3d2d002JiEhmWRXAzp072blz53+M79+//z/GmpubaW5unje2YsUKfv7zn2dzahERyRF9EExExFAqABERQ6kAREQMpQIQETGUCkBExFAqABERQ6kAREQMpQIQETGUCkBExFAqABERQ6kAREQMpQIQETGUCkBExFAqABERQ6kAREQMpQIQETGUCkBExFAqABERQ6kAREQMpQIQETFUVr8UPhfm5uZ4/PHH+etf/0pxcTG7d+/mi1/8Yr6WIyJinLwVwGuvvUYikeDFF1/k6NGjPPXUUzzzzDP5Wo7k0MxsktWrPUt+3k/i57E+/mTJzytytcpbAUQiEerr6wH4yle+wl/+8pd8LUVy7JoiJ9e1H1jy807uun1RxZPLklL5yNXIYdu2nY8T79ixg9tuu421a9cCcOutt/Laa69RWJi3ThIRMUreXgR2u93EYrHU7bm5OT34i4gsobwVQFVVFcPDwwAcPXoUn8+Xr6WIiBgpb5eALrwL6G9/+xu2bfOTn/yE66+/Ph9LERExUt4KQERE8ksfBBMRMZQKQETEUCoAERFDLcsCmJub47HHHuOee+4hGAxy/PjxfC9pyYyNjREMBgE4fvw4fr+fQCBAZ2cnc3NzAAwODrJ+/Xqam5s5dOhQPpd72czOzrJt2zYCgQAbNmzg4MGDxuaRTCZ59NFH2bRpE9/+9rc5ceKEsVlccPr0adauXcvU1JTZWdjL0Kuvvmq3tbXZtm3bb731lv3ggw/meUVL4/nnn7fvvPNOe+PGjbZt2/YDDzxgv/HGG7Zt23ZHR4f9+9//3v7nP/9p33nnnXY8Hrc//vjj1H8vNy+99JK9e/du27Zt+8yZM/batWuNzeMPf/iD3d7ebtu2bb/xxhv2gw8+aGwWtm3biUTC/v73v2/fdttt9ttvv210FsvyGYCpXzPh9XrZu3dv6vbExAS1tbUANDQ0cOTIEcbHx6msrKS4uBiPx4PX62VycjJfS75sbr/9dn7wgx+kbjudTmPz+MY3vsGuXbsAeP/99/nsZz9rbBYAXV1dbNq0iWuvvRYw++/JsiwAy7Jwu92p206nk/Pnz+dxRUujsbFx3qepbdvG4XAA4HK5iEajWJaFx5P+DhyXy4VlWUu+1svN5XLhdruxLIuHH36YlpYWo/MoLCykra2NXbt20djYaGwWr7zyCqtWrUr9AxHM/nuyLAtAXzPxLwUF6T/eWCxGaWnpf2QTi8Xm/aAvJx988AH33nsvd999N3fddZfxeXR1dfHqq6/S0dFBPB5PjZuUxcsvv8yRI0cIBoMcO3aMtrY2zpw5k7rfpCxgmRaAvmbiX9asWcPo6CgAw8PD1NTUUFFRQSQSIR6PE41GmZqaWpb5nDp1ivvuu49t27axYcMGwNw8fvnLX/Lcc88BsGLFChwOBzfffLORWbzwwgvs37+fcDjMTTfdRFdXFw0NDUZmAcv0k8Amf83EyZMn+eEPf8jg4CB///vf6ejoYHZ2lvLycnbv3o3T6WRwcJAXX3wR27Z54IEHaGxszPeyc2737t387ne/o7y8PDW2Y8cOdu/ebVwe586d49FHH+XUqVOcP3+ezZs3c/311xv7s3FBMBjk8ccfp6CgwNgslmUBiIhIZsvyEpCIiGSmAhARMZQKQETEUCoAERFDqQBERAylAhARMZQKQETEUP8Hd+VRDnZOYbcAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "df['length'].hist()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "df=df.dropna()\n",
    "messages=df.copy()\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "messages.reset_index(inplace=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>index</th>\n",
       "      <th>id</th>\n",
       "      <th>title</th>\n",
       "      <th>author</th>\n",
       "      <th>text</th>\n",
       "      <th>label</th>\n",
       "      <th>length</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>House Dem Aide: We Didn’t Even See Comey’s Let...</td>\n",
       "      <td>Darrell Lucus</td>\n",
       "      <td>House Dem Aide: We Didn’t Even See Comey’s Let...</td>\n",
       "      <td>1</td>\n",
       "      <td>81</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>FLYNN: Hillary Clinton, Big Woman on Campus - ...</td>\n",
       "      <td>Daniel J. Flynn</td>\n",
       "      <td>Ever get the feeling your life circles the rou...</td>\n",
       "      <td>0</td>\n",
       "      <td>55</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>Why the Truth Might Get You Fired</td>\n",
       "      <td>Consortiumnews.com</td>\n",
       "      <td>Why the Truth Might Get You Fired October 29, ...</td>\n",
       "      <td>1</td>\n",
       "      <td>33</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>15 Civilians Killed In Single US Airstrike Hav...</td>\n",
       "      <td>Jessica Purkiss</td>\n",
       "      <td>Videos 15 Civilians Killed In Single US Airstr...</td>\n",
       "      <td>1</td>\n",
       "      <td>63</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>Iranian woman jailed for fictional unpublished...</td>\n",
       "      <td>Howard Portnoy</td>\n",
       "      <td>Print \\nAn Iranian woman has been sentenced to...</td>\n",
       "      <td>1</td>\n",
       "      <td>93</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>Jackie Mason: Hollywood Would Love Trump if He...</td>\n",
       "      <td>Daniel Nussbaum</td>\n",
       "      <td>In these trying times, Jackie Mason is the Voi...</td>\n",
       "      <td>0</td>\n",
       "      <td>124</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>7</td>\n",
       "      <td>7</td>\n",
       "      <td>Benoît Hamon Wins French Socialist Party’s Pre...</td>\n",
       "      <td>Alissa J. Rubin</td>\n",
       "      <td>PARIS  —   France chose an idealistic, traditi...</td>\n",
       "      <td>0</td>\n",
       "      <td>87</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>9</td>\n",
       "      <td>9</td>\n",
       "      <td>A Back-Channel Plan for Ukraine and Russia, Co...</td>\n",
       "      <td>Megan Twohey and Scott Shane</td>\n",
       "      <td>A week before Michael T. Flynn resigned as nat...</td>\n",
       "      <td>0</td>\n",
       "      <td>93</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>10</td>\n",
       "      <td>10</td>\n",
       "      <td>Obama’s Organizing for Action Partners with So...</td>\n",
       "      <td>Aaron Klein</td>\n",
       "      <td>Organizing for Action, the activist group that...</td>\n",
       "      <td>0</td>\n",
       "      <td>96</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>11</td>\n",
       "      <td>11</td>\n",
       "      <td>BBC Comedy Sketch \"Real Housewives of ISIS\" Ca...</td>\n",
       "      <td>Chris Tomlinson</td>\n",
       "      <td>The BBC produced spoof on the “Real Housewives...</td>\n",
       "      <td>0</td>\n",
       "      <td>58</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   index  id                                              title  \\\n",
       "0      0   0  House Dem Aide: We Didn’t Even See Comey’s Let...   \n",
       "1      1   1  FLYNN: Hillary Clinton, Big Woman on Campus - ...   \n",
       "2      2   2                  Why the Truth Might Get You Fired   \n",
       "3      3   3  15 Civilians Killed In Single US Airstrike Hav...   \n",
       "4      4   4  Iranian woman jailed for fictional unpublished...   \n",
       "5      5   5  Jackie Mason: Hollywood Would Love Trump if He...   \n",
       "6      7   7  Benoît Hamon Wins French Socialist Party’s Pre...   \n",
       "7      9   9  A Back-Channel Plan for Ukraine and Russia, Co...   \n",
       "8     10  10  Obama’s Organizing for Action Partners with So...   \n",
       "9     11  11  BBC Comedy Sketch \"Real Housewives of ISIS\" Ca...   \n",
       "\n",
       "                         author  \\\n",
       "0                 Darrell Lucus   \n",
       "1               Daniel J. Flynn   \n",
       "2            Consortiumnews.com   \n",
       "3               Jessica Purkiss   \n",
       "4                Howard Portnoy   \n",
       "5               Daniel Nussbaum   \n",
       "6               Alissa J. Rubin   \n",
       "7  Megan Twohey and Scott Shane   \n",
       "8                   Aaron Klein   \n",
       "9               Chris Tomlinson   \n",
       "\n",
       "                                                text  label  length  \n",
       "0  House Dem Aide: We Didn’t Even See Comey’s Let...      1      81  \n",
       "1  Ever get the feeling your life circles the rou...      0      55  \n",
       "2  Why the Truth Might Get You Fired October 29, ...      1      33  \n",
       "3  Videos 15 Civilians Killed In Single US Airstr...      1      63  \n",
       "4  Print \\nAn Iranian woman has been sentenced to...      1      93  \n",
       "5  In these trying times, Jackie Mason is the Voi...      0     124  \n",
       "6  PARIS  —   France chose an idealistic, traditi...      0      87  \n",
       "7  A week before Michael T. Flynn resigned as nat...      0      93  \n",
       "8  Organizing for Action, the activist group that...      0      96  \n",
       "9  The BBC produced spoof on the “Real Housewives...      0      58  "
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "messages.head(10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>author</th>\n",
       "      <th># 1 NWO Hatr</th>\n",
       "      <th>-NO AUTHOR-</th>\n",
       "      <th>10 Habits That Will Make Your Life Easier &amp;amp; More Peaceful - Wellness Solutions</th>\n",
       "      <th>10 More Beautiful Images That Remind You We Still Live In A Beautiful World, With Beautiful People - Upside Down Media</th>\n",
       "      <th>10 Movies That Could Change Your Understanding Of Life - Upside Down Media</th>\n",
       "      <th>10 Nutritious Foods That Help Reduce Asthma Attacks &amp;amp; Boost Your Health - Health Alternative Solutions</th>\n",
       "      <th>10 Presidents &amp;amp; Politicians Who Told Us That A “Secret Government” Controls The World &amp;amp; What They Said - Upside Down Media</th>\n",
       "      <th>10 Shocking Facts About Society That We Absurdly Accept As Normal – Digital Flow</th>\n",
       "      <th>11 Things To Let Go Of Before The New Year</th>\n",
       "      <th>11 Things To Let Go Of Before The New Year – Motivate3.com</th>\n",
       "      <th>...</th>\n",
       "      <th>Леонтина Литвинова</th>\n",
       "      <th>Светлана Якн</th>\n",
       "      <th>Тьерри Мейсан</th>\n",
       "      <th>Юлия Громова</th>\n",
       "      <th>برنامه ریزی ضمیر ناخوداگاه</th>\n",
       "      <th>تييري ميسان</th>\n",
       "      <th>جنگ ارزی آمریکا علیه ایران / مورد مطالعاتی سال 1390 - کدآمایی</th>\n",
       "      <th>سعيد هلال الشريفي</th>\n",
       "      <th>“SHOOT FIRST ASK QUESTIONS LATER” : WHAT HAPPENS TO A UFO WHEN TRACKED ON MILITARY RADAR - Black Barth</th>\n",
       "      <th>“Shoot First Ask Questions Later” : What Happens To A UFO When Tracked on Military Radar – Mystical Shire</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>id</th>\n",
       "      <td>17</td>\n",
       "      <td>54</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>title</th>\n",
       "      <td>17</td>\n",
       "      <td>37</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>author</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>text</th>\n",
       "      <td>17</td>\n",
       "      <td>53</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>label</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>length</th>\n",
       "      <td>16</td>\n",
       "      <td>24</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>6 rows × 3838 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "author  # 1 NWO Hatr  -NO AUTHOR-  \\\n",
       "id                17           54   \n",
       "title             17           37   \n",
       "author             1            1   \n",
       "text              17           53   \n",
       "label              1            1   \n",
       "length            16           24   \n",
       "\n",
       "author  10 Habits That Will Make Your Life Easier &amp; More Peaceful - Wellness Solutions  \\\n",
       "id                                                      1                                    \n",
       "title                                                   1                                    \n",
       "author                                                  1                                    \n",
       "text                                                    1                                    \n",
       "label                                                   1                                    \n",
       "length                                                  1                                    \n",
       "\n",
       "author  10 More Beautiful Images That Remind You We Still Live In A Beautiful World, With Beautiful People - Upside Down Media  \\\n",
       "id                                                      1                                                                        \n",
       "title                                                   1                                                                        \n",
       "author                                                  1                                                                        \n",
       "text                                                    1                                                                        \n",
       "label                                                   1                                                                        \n",
       "length                                                  1                                                                        \n",
       "\n",
       "author  10 Movies That Could Change Your Understanding Of Life - Upside Down Media  \\\n",
       "id                                                      1                            \n",
       "title                                                   1                            \n",
       "author                                                  1                            \n",
       "text                                                    1                            \n",
       "label                                                   1                            \n",
       "length                                                  1                            \n",
       "\n",
       "author  10 Nutritious Foods That Help Reduce Asthma Attacks &amp; Boost Your Health - Health Alternative Solutions  \\\n",
       "id                                                      1                                                            \n",
       "title                                                   1                                                            \n",
       "author                                                  1                                                            \n",
       "text                                                    1                                                            \n",
       "label                                                   1                                                            \n",
       "length                                                  1                                                            \n",
       "\n",
       "author  10 Presidents &amp; Politicians Who Told Us That A “Secret Government” Controls The World &amp; What They Said - Upside Down Media  \\\n",
       "id                                                      1                                                                                    \n",
       "title                                                   1                                                                                    \n",
       "author                                                  1                                                                                    \n",
       "text                                                    1                                                                                    \n",
       "label                                                   1                                                                                    \n",
       "length                                                  1                                                                                    \n",
       "\n",
       "author  10 Shocking Facts About Society That We Absurdly Accept As Normal – Digital Flow  \\\n",
       "id                                                      1                                  \n",
       "title                                                   1                                  \n",
       "author                                                  1                                  \n",
       "text                                                    1                                  \n",
       "label                                                   1                                  \n",
       "length                                                  1                                  \n",
       "\n",
       "author  11 Things To Let Go Of Before The New Year  \\\n",
       "id                                               1   \n",
       "title                                            1   \n",
       "author                                           1   \n",
       "text                                             1   \n",
       "label                                            1   \n",
       "length                                           1   \n",
       "\n",
       "author  11 Things To Let Go Of Before The New Year – Motivate3.com  ...  \\\n",
       "id                                                      1           ...   \n",
       "title                                                   1           ...   \n",
       "author                                                  1           ...   \n",
       "text                                                    1           ...   \n",
       "label                                                   1           ...   \n",
       "length                                                  1           ...   \n",
       "\n",
       "author  Леонтина Литвинова  Светлана Якн  Тьерри Мейсан  Юлия Громова  \\\n",
       "id                       4             2              2             2   \n",
       "title                    4             2              2             2   \n",
       "author                   1             1              1             1   \n",
       "text                     4             2              2             2   \n",
       "label                    1             1              1             1   \n",
       "length                   4             2              2             2   \n",
       "\n",
       "author  برنامه ریزی ضمیر ناخوداگاه  تييري ميسان  \\\n",
       "id                               1            1   \n",
       "title                            1            1   \n",
       "author                           1            1   \n",
       "text                             1            1   \n",
       "label                            1            1   \n",
       "length                           1            1   \n",
       "\n",
       "author  جنگ ارزی آمریکا علیه ایران / مورد مطالعاتی سال 1390 - کدآمایی  \\\n",
       "id                                                      1               \n",
       "title                                                   1               \n",
       "author                                                  1               \n",
       "text                                                    1               \n",
       "label                                                   1               \n",
       "length                                                  1               \n",
       "\n",
       "author  سعيد هلال الشريفي  \\\n",
       "id                      1   \n",
       "title                   1   \n",
       "author                  1   \n",
       "text                    1   \n",
       "label                   1   \n",
       "length                  1   \n",
       "\n",
       "author  “SHOOT FIRST ASK QUESTIONS LATER” : WHAT HAPPENS TO A UFO WHEN TRACKED ON MILITARY RADAR - Black Barth  \\\n",
       "id                                                      1                                                        \n",
       "title                                                   1                                                        \n",
       "author                                                  1                                                        \n",
       "text                                                    1                                                        \n",
       "label                                                   1                                                        \n",
       "length                                                  1                                                        \n",
       "\n",
       "author  “Shoot First Ask Questions Later” : What Happens To A UFO When Tracked on Military Radar – Mystical Shire  \n",
       "id                                                      1                                                          \n",
       "title                                                   1                                                          \n",
       "author                                                  1                                                          \n",
       "text                                                    1                                                          \n",
       "label                                                   1                                                          \n",
       "length                                                  1                                                          \n",
       "\n",
       "[6 rows x 3838 columns]"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.groupby('author').nunique().T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Text Preprocessing :"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "from nltk.corpus import stopwords\n",
    "import re\n",
    "from nltk.stem.porter import PorterStemmer\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "cor=[]\n",
    "ps=PorterStemmer()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "for i in range(0,len(messages)):\n",
    "    review=re.sub('[^a-zA-Z]',' ',messages['title'][i])\n",
    "    review=messages['title'][i]\n",
    "    review=review.lower()\n",
    "    review=review.split()\n",
    "    \n",
    "    \n",
    "    review=[ps.stem(word) for word in review if not word in stopwords.words('english')]\n",
    "    review=' '.join(review)\n",
    "    cor.append(review)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'15 civilian kill singl us airstrik identifi'"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cor[3]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['hous dem aide: didn’t even see comey’ letter jason chaffetz tweet',\n",
       " 'flynn: hillari clinton, big woman campu - breitbart',\n",
       " 'truth might get fire',\n",
       " '15 civilian kill singl us airstrik identifi',\n",
       " 'iranian woman jail fiction unpublish stori woman stone death adulteri',\n",
       " 'jacki mason: hollywood would love trump bomb north korea lack tran bathroom (exclus video) - breitbart',\n",
       " 'benoît hamon win french socialist party’ presidenti nomin - new york time',\n",
       " 'back-channel plan ukrain russia, courtesi trump associ - new york time',\n",
       " 'obama’ organ action partner soros-link ‘indivisible’ disrupt trump’ agenda',\n",
       " 'bbc comedi sketch \"real housew isis\" caus outrag',\n",
       " 'russian research discov secret nazi militari base ‘treasur hunter’ arctic [photos]',\n",
       " 'us offici see link trump russia',\n",
       " 're: yes, paid govern troll social media, blogs, forum websit',\n",
       " 'major leagu soccer, argentin find home success - new york time',\n",
       " 'well fargo chief abruptli step - new york time',\n",
       " 'anonym donor pay $2.5 million releas everyon arrest dakota access pipelin',\n",
       " 'fbi close hillary!',\n",
       " 'chuck todd: ’buzzfe donald trump polit favor’ - breitbart',\n",
       " 'monica lewinsky, clinton sex scandal set ’american crime story’',\n",
       " 'rob reiner: trump ’mental unstable’ - breitbart',\n",
       " 'abort pill order rise 7 latin american nation zika alert - new york time',\n",
       " 'nuke un: histor treati ban nuclear weapon',\n",
       " 'exclusive: islam state support vow ‘shake’ west follow manchest terrorist massacr - breitbart',\n",
       " 'humili hillari tri hide camera caught 15 min ralli',\n",
       " 'andrea tantaro fox news claim retali sex harass complaint - new york time',\n",
       " 'hillari clinton becam hawk - new york time',\n",
       " 'chuck todd buzzfe eic: ’you publish fake news’ - breitbart',\n",
       " 'won, bori johnson ‘brexit’ leader fumbl - new york time',\n",
       " 'texa oil field rebound price lull, job left behind - new york time',\n",
       " 'bayer deal monsanto follow agribusi trend, rais worri farmer - new york time',\n",
       " 'russia move ban jehovah’ wit ‘extremist’ - new york time',\n",
       " 're: still ‘the danger zone’ januari 20th, 2017',\n",
       " 'open thread (not u.s. election) 2016-39',\n",
       " 'democrat gutierrez blame chicago’ gun violenc nra - breitbart',\n",
       " 'avoid peanut avoid allergi bad strategi - new york time',\n",
       " 'mri show detail imag 20-week unborn babi - breitbart',\n",
       " '4 best kind milk aren’t dairi',\n",
       " 'ryan locht drop speedo usa retail - new york time',\n",
       " 'conserv urg session clean obama’ civil right divis - breitbart',\n",
       " 'intern inquiri seal fate roger ail fox - new york time',\n",
       " 'press tv debate: duff lebanon, hezbollah aoun’ presid (3 videos)',\n",
       " 'samsung, combust galaxi note 7, unveil new smartphon - new york time',\n",
       " 'poland vow referendum migrant quota amidst eu pressure: ’the public’ voic heard’ - breitbart',\n",
       " 'spark inner revolut',\n",
       " 'study: half car crash involv driver distract cell phone - breitbart',\n",
       " 'trump elect spark individu & collect heal',\n",
       " 'ep. 544 fade black jimmi church w/ laura eisenhow : restor balanc [video]',\n",
       " 'cognit true islam - book review',\n",
       " 'donald trump win election, biggest miracl us polit histori',\n",
       " 'mind eat way fight bing - new york time',\n",
       " 'major potenti impact corpor tax overhaul - new york time',\n",
       " 'wonder glp like day election?',\n",
       " '3 maker world’ smallest machin award nobel prize chemistri - new york time',\n",
       " 'massiv anti-trump protests, union squar nyc live stream',\n",
       " 'review: ‘lion’ bring tear lost boy, wipe dri googl - new york time',\n",
       " 'u.s. general: islam state chemic attack ’no impact’ u.s. forc',\n",
       " 'juri find oregon standoff defend guilti feder conspiracy, gun charg',\n",
       " 'clinton campaign stun fbi reportedli reopen probe hillari clinton email',\n",
       " 'penc speak anti-abort ralli - new york time',\n",
       " 'berni sander say media won’t: trump gutless polit coward',\n",
       " 'make briquett daili wast',\n",
       " \"treason! nyt vow 'rededication' reporting!\",\n",
       " 'dress like woman? mean? - new york time',\n",
       " '91, ella brennan still feed (and leads) new orlean - new york time',\n",
       " 'press asia agenda, obama tread lightli human right - new york time',\n",
       " 'democrat 60 percent chanc retak senat - new york time',\n",
       " 'judg spank transgender-obsess obama: lie! | redflag news',\n",
       " '51 u.s. diplomat urg strike assad syria - new york time',\n",
       " 'franken call ’independ investigation’ trump’ ’putin crush’ - breitbart',\n",
       " 'louisiana, simon biles, u.s. presidenti race: tuesday even brief - new york time',\n",
       " 'turkey threaten open migrant ’land passage’ europ row dutch',\n",
       " 'huma’ weiner dog hillari',\n",
       " 'colin kaepernick start black panther-inspir youth camp? wow!',\n",
       " 'trump’ immigr polici explain - new york time',\n",
       " 'mari tyler moor mourn dick van dyke star - new york time',\n",
       " 'poison',\n",
       " 'trump fan ralli across nation support presid - new york time',\n",
       " \"fox biz report can't help bash clinton’ ralli cover trump’ pack event day\",\n",
       " '11 fiction podcast worth listen - new york time',\n",
       " 'mike birbiglia’ 6 tip make small hollywood. anywhere. - new york time',\n",
       " 'invest strategist forecast collaps timeline: ‘the last gasp econom cycl come 2018’',\n",
       " 'venezuela muzzl legislature, move closer one-man rule - new york time',\n",
       " \"whether john mccain, mitt romney donald trump, democrat alway run 'war women' tactic destroy republican candid\",\n",
       " 'breitbart news daily: trump boom - breitbart',\n",
       " 'white hous confirm gitmo transfer obama leav offic',\n",
       " 'poll: voter heard democrat 2020 elect candid - breitbart',\n",
       " 'migrant confront judgment day old deport order - new york time',\n",
       " 'm.i.t., n.y.u. yale su retir plan fee - new york time',\n",
       " 'technocracy: real reason un want control internet',\n",
       " 'american driver regain appetit ga guzzler - new york time',\n",
       " 'hillari clinton build $150 million war chest, doubl donald trump - new york time',\n",
       " 'trump catch sick report snuck interview, priceless respons',\n",
       " '100 senat contact russian govern week',\n",
       " '10 imag perfectli illustr struggl dakota access pipelin',\n",
       " 'washington state take 10 refugees, 0 muslim rest countri take 189 refugees, 151 muslim - breitbart',\n",
       " 'ncaa, big 12 keep watch eye texa bathroom bill - breitbart',\n",
       " 'massiv espn financial, subscrib loss drag disney’ first-quart sale - breitbart',\n",
       " 'megyn kelly, contract set expir next year, prime big show - new york time',\n",
       " 'teacher suspend allow student hit trump pinata cinco de mayo',\n",
       " 'break : trump express concern anthoni weiner’ “illeg access” classifi info 2 month ago – truthfe',\n",
       " 'snap share leap 44% debut investor doubt valu vanish - new york time',\n",
       " 'clinton campaign chair dinner top doj offici one day hillary’ benghazi hear',\n",
       " 'tv seri ’first femal mlb pitcher’ can one, low-rat season - breitbart',\n",
       " 'seek best fit, women’ final four return friday-sunday - new york time',\n",
       " 'propos canadian nation bird ruffl feather - new york time',\n",
       " 'review: beyoncé make ‘lemonade’ marit strife - new york time',\n",
       " 'trump ask sharp increas militari spending, offici say - new york time',\n",
       " 'watergate? smoke gun email discuss “clean up” obama/hillari email',\n",
       " '“chapo trap house”: new left-w podcast flagrant rip-off right stuff',\n",
       " 'taiwan respond china send carrier taiwan strait - new york time',\n",
       " 'mother octob surprises—whi hous card come tumbl',\n",
       " 'explos assange/pilg interview us election: expect riot hillari win',\n",
       " 'telescop ‘ate astronomy’ track surpass hubbl - new york time',\n",
       " 'close afghan-pakistani border becom ‘humanitarian crisis’ - new york time',\n",
       " 'tv anchor arriv white hous lunch donald trump - breitbart',\n",
       " 'pelosi: republican tell trump he’ ’bring dishonor’ presid - breitbart',\n",
       " 'beauti prehistor world: earth wasteland?',\n",
       " 'ignor trump news week. here’ learned. - new york time',\n",
       " 'donald trump unveil plan famili bid women’ vote - new york time',\n",
       " 'montana democrat vote bill ban sharia law, call ’repugnant’ - breitbart',\n",
       " 'monsanto tribun over. go? happen now?',\n",
       " 'it’ official: simon bile world’ best gymnast - new york time',\n",
       " 'liter hurt brain read econom idioci emit trumpkin | libertarian',\n",
       " 'u.n. secretari gener complain ‘mass reject globalism’ favor nation',\n",
       " 'trump bollywood ad meant sway indian american voter hilari fail (video)',\n",
       " 'fbi find previous unseen hillari clinton email weiner’ laptop',\n",
       " '2 year american journalist killed, ‘conspiraci theories’ syria proven fact',\n",
       " 'report: illeg alien forego food stamp stay trump’ radar',\n",
       " 'make netherland great again! hahaha spread worldwide!',\n",
       " 'four killed, 10 injur jerusalem truck-ram terror attack',\n",
       " 'leader salut comrad newt brutal megyn [sic] kelli beatdown: “we don’t play games”',\n",
       " 'student black colleg got beaten mace protest kkk’ david duke',\n",
       " 'despit strict gun control, one ’child youth’ shot everi day ontario',\n",
       " 'rise internet fan bulli - new york time',\n",
       " 'newli vibrant washington fear trump drain cultur - new york time',\n",
       " 'fed hold interest rate steadi plan slower increas - new york time',\n",
       " 'battl unesco',\n",
       " 'latest test white house? pull easter egg roll - new york time',\n",
       " 'burlesqu dancer fired, investig secret servic trump assassin tweet - breitbart',\n",
       " 'clinton haiti',\n",
       " 'cuomo christie, parallel path top, troubl got - new york time',\n",
       " 'top 10 place world allow visit',\n",
       " 'new studi link fluorid consumpt hypothyroidism, weight gain, wors',\n",
       " 'jame matti secretari offens',\n",
       " 'black church burn spray-paint “vote trump”',\n",
       " 'sear agre sell craftsman stanley black &amp decker rais cash - new york time',\n",
       " 'takata chief execut resign financi pressur mount - new york time',\n",
       " 'goodbye, good, black sabbath - new york time',\n",
       " 'teen ’geisha dolls’ gang bust arm robberi - breitbart',\n",
       " 'mohamad khweis: anoth “virginia man” (palestinian-american muslim) charg terror',\n",
       " 'price obamacar replacement: ‘nobodi wors financially’ - breitbart',\n",
       " 'va fail properli examin thousand veteran',\n",
       " 'trump famili alreadi ‘sworn secrecy’ fake moon landings. soon.',\n",
       " 'sport writer: nfl great jim brown’ decad civil right work eras say nice thing donald trump - breitbart',\n",
       " '‘i watch tv’: excus republican skip donald trump convent - new york time',\n",
       " 'open letter trump voter told “like is”',\n",
       " 'comment power corpor lobbi quietli back hillari — nobody’ talk runsinquicksand',\n",
       " 'hijack end peac libyan airlin land malta - new york time',\n",
       " 'don’t like girl ‘girls’? that’ genius. - new york time',\n",
       " 'scientist say canadian bacteria fossil may earth’ oldest - new york time',\n",
       " 'pro-govern forc advanc syria amid talk u.s.-russia cooper - new york time',\n",
       " 'cancer agenc fire withhold ‘carcinogen glyphosate’ document',\n",
       " 'work. walk 5 minutes. work. - new york time',\n",
       " 'steve harvey talk hous president-elect trump - new york time',\n",
       " 'coalition: u.s. troop fight mosul offens ’come fire’',\n",
       " 'uk citizen war hero get cheap pre-fab hous muslim colon get taxpayer-fund luxuri council home',\n",
       " 'vet fight war, fed demand money back… illeg refuge keep money',\n",
       " 'mr. trump’ wild ride - new york time',\n",
       " 'fbi director comey bamboozl doj, congress, clinton',\n",
       " '20 food natur unclog arteri prevent heart attack',\n",
       " 'death ‘two-stat solution’',\n",
       " 'comment parent date asleep car cop arriv kill facespac',\n",
       " 'donald trump’ team show sign post-elect moder - new york time',\n",
       " 'miami beach tri tame raucou street (but fishbowl drink stay) - new york time',\n",
       " 'doctor mysteri found dead summit breakthrough cure cancer',\n",
       " 'donald trump, unsink candid - new york time',\n",
       " 'shock new mock hillari ad campaign warn she’ll take us war: #enlistforher, #fightforher, #dieforh',\n",
       " 'exclus -- famili slain border patrol agent brian terri say eric holder among ’the real criminals’ respons',\n",
       " 'trump tell reporters: ‘wall work - ask israel’ - breitbart',\n",
       " 'america surviv next 4 years?',\n",
       " 'commission start press cleveland indian logo - new york time',\n",
       " 'un plan implant everyon biometr id, drill',\n",
       " 'trump attack senator’ credibl gorsuch’ comment - new york time',\n",
       " 'clinton advisor lose leak email hillary’ illeg activ',\n",
       " 'art laffer: ’paul ryan’ perfect right now’ - breitbart',\n",
       " 'donald trump blame econom crash',\n",
       " 'pokemon go player inadvert stop peopl commit suicid japan',\n",
       " 'california senat race tale divers flail g.o.p. - new york time',\n",
       " 'exclusive: sourc say megyn kelli ‘would welcom back’ fox news',\n",
       " 'break precedent, obama envoy deni extens past inaugur day - new york time',\n",
       " '‘brexit’ vote go? monti python may offer clue - new york time',\n",
       " 'blind mystic predict 9/11 bad news trump',\n",
       " 'total vet fail: left-w snowden fan girl realiti winner get access nsa secret',\n",
       " 'somalia, u.s. escal shadow war - new york time',\n",
       " 'free care ‘blessing’ victim orlando nightclub attack - new york time',\n",
       " 'durabl democrat counti countri could go trump',\n",
       " 'fed’ challenge, rais rates, may existenti - new york time',\n",
       " \"'russia intent attack anyon -thi absurd,' say vladimir putin\",\n",
       " 'f.a.a. investig errant flight involv harrison ford - new york time',\n",
       " 'fed rais key interest rate, cite strengthen economi - new york time',\n",
       " 'la expresión “no, lo siguiente” ya es la má utilizada no, lo siguiente, en el castellano',\n",
       " 'trump berat news media, new strategi need cover - new york time',\n",
       " 'u.s. drone strike target taliban leader - new york time',\n",
       " 'u.s. intelligence: ‘expect al-qaeda attack monday new york, virginia texas’',\n",
       " 'told cannabi great revers alzheimer’s?',\n",
       " 'report: megyn kelli kick nbc show kardashian famili interview',\n",
       " 'local 1-percent may rich think - new york time',\n",
       " 'dr. david duke mark collett uk. collett explain duke & trump victori would chang polit forever!',\n",
       " 'statement senate, well fargo chief ‘deepli sorry’ - new york time',\n",
       " 'cnn statement distanc network buzzfe fake news dossier - breitbart',\n",
       " 'c.e.o. ponder new game, trump’ rule - new york time',\n",
       " 'spicer brady’ stolen jersey: ’anoth bad press’ - breitbart',\n",
       " 'scaredy-cat’ investig peopl enjoy fear - new york time',\n",
       " 'left’ vision',\n",
       " 'showdown loom u.s. question chines deal german chip design - new york time',\n",
       " 'trump administr take harder tack trade china - new york time',\n",
       " 'pew: american trust level feder govern plummet histor low - breitbart',\n",
       " 'islam state support former nation guardsman plead guilti terror charg virginia',\n",
       " 'spicer reporter: ’we’r go rais hand like big boy girls’ - breitbart',\n",
       " 'leader applaud gorsuch confirm ’win pro-lif movement’',\n",
       " 'newstick (974)',\n",
       " 'french vogue’ march cover featur transgend model - new york time',\n",
       " 'trump veer parti line gun control - new york time',\n",
       " 'oligarchi prepar groundwork steal elect',\n",
       " 'ya hay má reencuentro de “operación triunfo” que edicion de “operación triunfo”',\n",
       " 'chatsworth house, tale five centuri - new york time',\n",
       " 'uncomfort love affair donald trump new england patriot - new york time',\n",
       " 'john mccain withdraw support donald trump disclosur record - new york time',\n",
       " 'strange, unend limbo egypt’ hosni mubarak - new york time',\n",
       " 'poverti rose 96% u.s. hous districts, obama’ presid',\n",
       " 'huma abedin seek fbi immun deal',\n",
       " 'singl mom escap friend zone, one non-dat time - new york time',\n",
       " 'boe suit futur spaceflight new spacesuit design - breitbart',\n",
       " 'trump float oliv branch: might keep part health law - new york time',\n",
       " 'wapo tri compar elizabeth warren break senat rule milo shut violent riot - breitbart',\n",
       " 'crumpl school bu leav chattanooga daze - new york time',\n",
       " 'die came back life incred messag human',\n",
       " 'fight nation african-american museum - new york time',\n",
       " 'father manchest suicid bomber arrest libya - breitbart',\n",
       " '4 secret true leader',\n",
       " 'muslim demand local don’t walk dog public – violat sharia “disrespects”',\n",
       " \"hillari campaign bed pac staff donat $500k fbi agent' wife investig\",\n",
       " 'still over: tri “flip elector college” block trump’ win',\n",
       " 'al sharpton dems: point appeal ‘archi bunker’ trump voter - breitbart',\n",
       " 'think mani doom sayer trump get offic ?',\n",
       " 'democrat jump session resign band wagon - breitbart',\n",
       " 'alt-right architect glenn beck open fire alt-right: ‘grave threat republic’ (audio, tweet)',\n",
       " 'politic justic protect hillari',\n",
       " 'north carolina, satur surprised, reel hurrican matthew - new york time',\n",
       " 'live loved: submit memori - new york time',\n",
       " 'achiev mind work, medit cushion requir - new york time',\n",
       " 'world’ first zero-emiss hydrogen-pow passeng train unveil germani',\n",
       " 'confus chip credit cards? get line - new york time',\n",
       " 'brooks: trump ’side foreign leader us president’ israel russia - breitbart',\n",
       " 'there’ toxic air home get rid natur',\n",
       " 'connecticut reader report record voter registration–inspir trump',\n",
       " 'germani react merkel-trump visit: ‘could lot worse’ - new york time',\n",
       " 'justin rose outduel henrik stenson golf gold medal - new york time',\n",
       " 'iceland’ water cure - new york time',\n",
       " 'm.t.a. shorten l train shutdown 15 month - new york time',\n",
       " 'time presid decided? - new york time',\n",
       " 'u.n. relief offici call crisi aleppo ‘apex horror’ - new york time',\n",
       " 'berkeley, treat violent, anti-speech left like kkk',\n",
       " 'statist propaganda: mani syrian us regime-chang killed?',\n",
       " 'self-help guru jame altuch own 15 thing - new york time',\n",
       " 'trump’ religi liberti order give session major leeway - breitbart',\n",
       " '¡demoledor amparo contra salgado, keiko 72 congresista más!',\n",
       " 'era trump, china’ presid champion econom global - new york time',\n",
       " 'sad saga john walker lindh, rebel without clue',\n",
       " 'court disagre michigan vote recount - new york time',\n",
       " 'berni sanders’ feud democrat leadership heat - new york time',\n",
       " \"shortest power explan trump' victori ever seen\",\n",
       " 'russia look popul far east. wimp need apply. - new york time',\n",
       " 'johnson amendment, trump vow ‘destroy,’ explain - new york time',\n",
       " 'donald trump march life: ‘you full support!’',\n",
       " 'polic offici found dead long island, suicid suspect - new york time',\n",
       " 'radic chang store world global markets, ready?',\n",
       " 'it’ like make showbiz best friend - new york time',\n",
       " 'trump nomin neil gorsuch suprem court - new york time',\n",
       " 'bidder cast doubt serious mexican border wall project',\n",
       " 'what’ stake us election?',\n",
       " 'israel approv addit fund settlement west bank - new york time',\n",
       " 'tx gov abbott: sign legisl could put sheriff sanctuari citi jail - breitbart',\n",
       " 'donald trump hold ‘thank you’ ralli cincinnati, announc pick defens secretari - new york time',\n",
       " 'lawmak look bipartisanship health care - new york time',\n",
       " 'insid conserv push state amend constitut - new york time',\n",
       " 'donald trump tell n.r.a. hillari clinton want let violent crimin go free - new york time',\n",
       " 'pope francis, trump, japan: tuesday brief - new york time',\n",
       " '#mayorsstand4al day tout support illeg immigr',\n",
       " 'trump’ campaign celebr',\n",
       " 'democrat drag jeff sessions’ confirm fight - breitbart',\n",
       " 'break news: podesta brother pedo ring: mr. trump, drain swamp!! — v, guerrilla economist',\n",
       " 'la frase má destacada del debat de investidura',\n",
       " 'confus jihad hirabah build peac world',\n",
       " 'lazi liber journalist smear bannon',\n",
       " 'australia close detent center manu island, still won’t accept asylum seeker - new york time',\n",
       " 'politico: hillari clinton run - breitbart',\n",
       " 'giant lynx make ador sound, whenev human rub face',\n",
       " 'minnesota cop found guilti philando castil shoot trial',\n",
       " '115 million american kill 30 minut',\n",
       " 'wayn madsen: cia alway serv interest wall street',\n",
       " 'novemb 10: daili contrarian read',\n",
       " 'flashback - reports: obama’ 2008 campaign rep talk iran, hama',\n",
       " 'lesseroftwoevil',\n",
       " 'aya cash: first time ate veget (i 22) - new york time',\n",
       " 'trump advis say isra settlement ‘not illegal’',\n",
       " 'serena william prevail opener, problem - new york time',\n",
       " '’soul man’ sam moor ’honored’ perform trump inaugur',\n",
       " 'ferrel came back bush destroy trump (video)',\n",
       " 'chines govern concern tough talk trump cabinet - breitbart',\n",
       " 'billionair report seiz hong kong hotel taken china - new york time',\n",
       " 'easi know - link',\n",
       " 'homebodi find ultim home offic - new york time',\n",
       " 'ann coulter unload paul ryan’ ’deepli unpopular’ obamacar 2.0 bill - breitbart',\n",
       " 'transgend bathroom debat turn person vermont high school - new york time',\n",
       " 'obama hillari want libya’ gaddafi toppl kill',\n",
       " 'alert: former soro associ warn pro wrong, gold & silver skyrocket like 1970',\n",
       " 'hillari panick fbi weiner emails?',\n",
       " '77 chaotic minutes, trump defend ‘fine-tun machine’ - new york time',\n",
       " 'one polic shift: patrol anxiou america - new york time',\n",
       " 'fight ghost fascist aid real one',\n",
       " 'monday even briefing: brexit, abortion, ‘game thrones’ - new york time',\n",
       " 'eu increas ‘brexit bill’ demand €100 billion, €60 billion',\n",
       " 'arianna huffington’ sleep revolut start home - new york time',\n",
       " 'iranian missil accident destroy iranian ship aim syria!',\n",
       " 'sonoma counti california vote creat largest gmo free zone america',\n",
       " 'fbi’ comey: wikileak ‘intellig porn,’ journal - breitbart',\n",
       " 'clare waight keller name first femal design givenchi - new york time',\n",
       " 'realiti face black canadian nation shame',\n",
       " 'top nfl draft prospect caleb brantley charg punch woman face - breitbart',\n",
       " 'video pacif crest trail associ lavoy finicim murder',\n",
       " '12 life lesson man who’ seen 12000 death',\n",
       " 'trump g.o.p. work win repeal obama’ health act - new york time',\n",
       " 'atlantic’ goldberg: i’m ‘not confident’ trump handl ‘matter life death’ - breitbart',\n",
       " 'orthodox rabbi support trump',\n",
       " 'nuclear tension us, russia reach ‘dangerous’ point',\n",
       " 'gambia join south africa burundi exodu intern crimin court',\n",
       " 'peyton man golf presid trump sunday',\n",
       " 'obama urg donald trump send ‘signal unity’ minor group women - new york time',\n",
       " '‘it’ like miracle’: woman give birth use ovari frozen sinc childhood - new york time',\n",
       " 'uconn’ recip success run, run run - new york time',\n",
       " 'assang ‘final afford opportunity’ give statement rape accus',\n",
       " 'hillary’ puppet show much hillari care god omiss 2 word',\n",
       " 'stock market gone high, it’ problem - new york time',\n",
       " 'john kerri reject suggest u.s. involv turkey coup - new york time',\n",
       " 'trump aid stephen miller: u.s. ’ha absolut sovereign right determin cannot enter country’ - breitbart',\n",
       " '4-year old russian girl speak 7 languages. this?',\n",
       " 'power corpor lobbi quietli back hillari — nobody’ talk',\n",
       " 'maintain sunni spirit face hardship - new york time',\n",
       " 'rush limbaugh: comey fire ’epic troll’ trump dem - breitbart',\n",
       " 'twitter sue govern block unmask account critic trump - new york time',\n",
       " 'warriors, resili home, cruis cavali - new york time',\n",
       " 'comey letter clinton email subject justic dept. inquiri - new york time',\n",
       " 'spain, malta, u.s./uk pressure, refus allow russian carrier group refuel port',\n",
       " 'review: radiohead’ ‘a moon shape pool,’ patient perfection - new york time',\n",
       " 'man militar polic stand rock work',\n",
       " 'woman arrest properti land stolen dapl',\n",
       " 'pulitz prizes: new york time win 3 daili news propublica share public servic award - new york time',\n",
       " 'vanquish wit takeover: bushes, clinton attend donald trump’ inaugur - breitbart',\n",
       " 'specul possibl obama pardon edward snowden, bow bergdahl chelsea man - breitbart',\n",
       " 'cheesi mash potato soul - new york time',\n",
       " 'unprincipl wapo editor damn comey critic - join',\n",
       " 'nation ‘wrecked’ immigration: civil war brew do-good swede turn muslim migrants’ violence, rape murder',\n",
       " 'man, 73, shot dead offic crucifix, gun, polic say - new york time',\n",
       " 'exclusive—rep. jim jordan trump’ first 100 days: ‘i think we’r great start’ - breitbart',\n",
       " 'haley: attack syria ’one president’ finest hours’ - breitbart',\n",
       " 'justin bieber defec ador irish fan hotel window',\n",
       " 'cancer agenc fire withhold ‘carcinogen glyphosate’ document',\n",
       " 'gianno caldwel claim hillari care black vote, black live',\n",
       " 'isi use ramadan call new terrorist attack - new york time',\n",
       " '’daili show’ mock ’mahatma blondie’ megyn kelly’ nbc debut',\n",
       " 'health care bill’ failure: part ’art deal’ - breitbart',\n",
       " 'lewandowski: comey ’a liar’ - look sign major book deal - breitbart',\n",
       " 'kimberli guilfoyl discuss potenti white hous press secretari job interview',\n",
       " 'clinton’ campaign chairman john podesta invit occult ‘spirit cooking’ dinner marina abramović',\n",
       " 'obama coalit crumbled, leav open trump - new york time',\n",
       " 'pregnanc chang brain way may help mother - new york time',\n",
       " 'fema open loan window red cross tri shut shelter',\n",
       " 'gaiaportal: interweb gaia energet strengthen',\n",
       " 'scarborough: trump poop pants, call ’modern art’ - breitbart',\n",
       " 'cooking, invest time. work. both. - new york time',\n",
       " 'bad news jackson famili woman leak star’ sick $900k sex secret',\n",
       " 'gorsuch, london, republican party: thursday even brief - new york time',\n",
       " 'emma morano, last person born 1800s, die - breitbart',\n",
       " 'loserpalooza: 9 craziest scene anti-trump protest - breitbart',\n",
       " 'trump victori mean africa?',\n",
       " 'vision life mar earth’ depth - new york time',\n",
       " 'obama cancel talk, rodrigo dutert philippin say regret slur - new york time',\n",
       " 'new jersey increas ga tax 23¢, end long polit stalem - new york time',\n",
       " 'abc: manchest attack ’like inflam anti-islam sentiment’ - breitbart',\n",
       " 'hidden plain sight – global depopul agenda',\n",
       " 'job american - new york time',\n",
       " 'sander ask obama interven dakota access pipelin disput',\n",
       " 'googl add job section search engine, includ employ rate - breitbart',\n",
       " 'cri jordan: meme won’t die - new york time',\n",
       " 'dem rep sánchez: trump use ’fear’ muslim immigr promot polici ’undermine’ valu - breitbart',\n",
       " 'announc saker commun german saker blog | vineyard saker',\n",
       " 'shoot victims’ famili watch gun measur stall - new york time',\n",
       " 'imag reveal crash schiaparelli mar lander',\n",
       " 'grassroot coalit share ‘mani question concern betsi devos’ senat',\n",
       " 'octob 28: daili contrarian read',\n",
       " 'trump inaugur balls: ’now work begin ... play games’ - breitbart',\n",
       " 'trump’ choic stephen bannon nod anti-washington base - new york time',\n",
       " 'media outrag white hous ’exclusion’ fake news - breitbart',\n",
       " 'benni morris’ unten denial ethnic cleans palestin',\n",
       " 'obama: hillari clinton pardon could heal divid nation',\n",
       " 'except handl',\n",
       " 'nota conceptu para la presidencia de rusia',\n",
       " 'respons philippin presid fatal blast rais fear - new york time',\n",
       " 'david adjay design museum speak differ languag - new york time',\n",
       " 'bulletin: righteou jew trump!; rule ruin gop establishment; etc.(60 items!)',\n",
       " 'britain reduc terror level one notch ‘severe’ terror cell arrest',\n",
       " 'mute alone, never short kind word friend - new york time',\n",
       " 'iranian militari command claim rogu nation send elit fighter’ infiltr us europ',\n",
       " 'account',\n",
       " 'watch: muslim student claim non-believ kill islam countri - breitbart',\n",
       " 'yemen yet anoth “fals flag” protect saudi us interest middl east | new eastern outlook',\n",
       " 'watch: muslim ‘palestinians’ declar “we follow prophet muhammad, kill christian jews”',\n",
       " 'street dog kerala call upon superdog krypto rescu human',\n",
       " 'israel track ‘anti-government’ journalist facebook',\n",
       " 'new alaska law take first step common core',\n",
       " 'key baylor footbal execut demarko butler fire text scandal - breitbart',\n",
       " 'calgari airport arriv yyc',\n",
       " 'georg michael wrestl fame. frank sinatra advice. - new york time',\n",
       " 'sharon olds, laureat sexuality, scrutin bodi ‘odes’ - new york time',\n",
       " 'blue collar elect shock liber media',\n",
       " '‘they die now’ - new york time',\n",
       " 'polic fire rubber bullet pipelin protest',\n",
       " 'ann coulter hit suppos ’gay icon’ kathi griffin isis-crib antic',\n",
       " \"contamin food china enter u.s. 'organic' label\",\n",
       " 'ten famou peopl read summer - new york time',\n",
       " 'hillari clinton knew 5 year ago anthoni weiner pedophil - wikileak',\n",
       " '$150 million stairway nowher far west side - new york time',\n",
       " 'cyber war \\x97 trifl catastroph : inform',\n",
       " 'presid putin ask us stop provok russia',\n",
       " 'inquiri cloud de blasio’ bid come strong manag ’17 race - new york time',\n",
       " 'us drone strike afghanistan kills, wound sever civilian',\n",
       " 'bobbi hutcherson, vibraphonist colorist rang sound, die 75 - new york time',\n",
       " 'amnesti advoc boycott agenc meet pro-american advoc invit - breitbart',\n",
       " 'project verita 4: robert creamer’ illeg $20,000 foreign wire transfer caught tape',\n",
       " 'ex-flotu michel obama: trump want feed ’crap’ kid',\n",
       " 'south sudan slide closer war gunfir rumbl capit - new york time',\n",
       " '“nation mood” focu group reflect angry, divid america',\n",
       " 'bankrupt puerto rico vote u.s. statehood - breitbart',\n",
       " 'overwhelm ‘brexit’? basic - new york time',\n",
       " 'seattle’ gay mayor accus sexual molest teen 1980 - breitbart',\n",
       " 'gender fluiditi runway - new york time',\n",
       " 'us nato attack putin militari drill russia – world war 3 red alert kopya',\n",
       " 'new clinton email came underag sex pest anthoni weiner',\n",
       " 'montana bear attack, lesson hope, surviv first aid - new york time',\n",
       " '‘what best america’ - new york time',\n",
       " 'pecan step pie plate - new york time',\n",
       " 'barack obama plagiar ’don’t tell word don’t matter’ - breitbart',\n",
       " 'lower back ache? activ wait out, new guidelin say - new york time',\n",
       " '‘if sleep hour, 30 peopl die’ - new york time',\n",
       " '‘veep’ season 5, episod 7: littl danc ... - new york time',\n",
       " '‘dr. oz,’ trump offer placebo transpar - new york time',\n",
       " 'comment gold medalist wrestler get violent polic — 7 cop choos engag deadli forc buck roger',\n",
       " 'one year water orang counti four day - breitbart',\n",
       " 'doctor enemies: afghan forc target m.s.f. hospital? - new york time',\n",
       " '2,700-year-old hebrew mention jerusalem found',\n",
       " 'spirit cooking: disturb podesta email yet? (warning: graphic content)',\n",
       " 'donald trump’ misstep risk put ceil support swing state - new york time',\n",
       " 'green party’ margaret flower challeng us senat debat maryland undemocrat',\n",
       " 'offic rescu drown deer pool quick-think',\n",
       " 'police: suspect punch armi veteran, steal servic dog outsid home bronx - breitbart',\n",
       " 'yikes! megyn kelli receiv rude awakening- remind she’ replaceable!',\n",
       " 'iran send elit irgc warfight europ unit state prepar battl',\n",
       " 'hillari endors donald trump presid accord wikileak',\n",
       " 'woodward: trump dossier ’garbag document’ - intellig chief ’apologize’ trump - breitbart',\n",
       " 'emmi nomin 2016: traci morgan emot return ‘saturday night live’ - new york time',\n",
       " 'trump pick mick mulvaney, south carolina congressman, budget director - new york time',\n",
       " 'donald trump, el primer president naranja de lo estado unido',\n",
       " 're: attorney gener loretta lynch plead fifth?',\n",
       " 'russia: u.s. missil defens ’pose deep risk’ secur asia',\n",
       " 'washington ‘plan b’ syria realli mean?',\n",
       " 'upset brexit, british jew look germani - new york time',\n",
       " 'girl ask 20 boyfriend give iphone, use money buy hous',\n",
       " 'amnesti intern slam obama gov kill 300 civilian syria',\n",
       " 'find flock: rural writer’ book club - new york time',\n",
       " 'venezuela crisi enter danger phase maduro foe go milit',\n",
       " 'emigr super bloc part viii:th quasi-leg coup-hillari clinton inform oper elect 2016',\n",
       " 'could you? 19 question ask love one vote way - new york time',\n",
       " 'bbc ask – realli happen clinton haiti?',\n",
       " 'trump pick thoma bossert top counterterror advis - new york time',\n",
       " 'come unglu',\n",
       " 'trump jr. suspici help arizona woman push stall car, use photo op (video)',\n",
       " 'suicid chicago polic offic skyrocket',\n",
       " 'think suv safe? shock video',\n",
       " '20 peopl tortured, kill sufi muslim shrine pakistan',\n",
       " 'comment architectur clever arrang bricks: man transform heal process architectur clever arrang bricks: man transform heal process - new earth media',\n",
       " 'hybrid war 8. strategi africa – introduct',\n",
       " 'julian assang speak prerecord rt interview (11/5/16)',\n",
       " 'watch: israel love hollywood actor issu major plea america 3 minut that’ll rock elect',\n",
       " '‘s.n.l.,’ donald trump botch ‘independ day’ moment - new york time',\n",
       " 'exclusive: congresswoman marsha blackburn says, ‘elimin net neutral preserv open internet’ - breitbart',\n",
       " 'attach year-round greenhous home',\n",
       " 'sheriff clark obama’ final days: “obama’ like tenant who’ evict property, he’ gonna trash place way door” [video]',\n",
       " '45 weird ban women iran',\n",
       " 'end game close clinton deep state turn',\n",
       " 'trump fight chanc establish | new eastern outlook',\n",
       " 'trade stanc toward china, clinton trump signal chill - new york time',\n",
       " 'review: ‘the secret life pets’ amuses, miss opportun - new york time',\n",
       " 'first case demonetisation-rel hiv man unprotect sex atm machin',\n",
       " '5 thing need know dakota access pipelin protest',\n",
       " 'koch brother battl prevent dark money disclosur south dakota',\n",
       " 'milo berkeley event evacu mask protest light fires, storm venu - breitbart',\n",
       " '\"authoritarianism\": west demon strong, popular leader',\n",
       " 'swedish journo: sweden collaps without illeg migrant',\n",
       " 'promis internet career vine dead? write newsbiscuit cheer',\n",
       " 'iowa, trump voter unfaz controversi - new york time',\n",
       " 'radic american-grown marxist terror group made announc januari 20th | conserv daili post',\n",
       " 'guardian opinion writer: trump, bannon count terrorist ’massacre’',\n",
       " 'putin’ pro-trump onlin troll spill bean samantha bee',\n",
       " 'along mosul’ front line, desper civilian dug-in troop fighter - new york time',\n",
       " 'second avenu subway opens, train delay end (happy) tear - new york time',\n",
       " '71-year-old cher don see-through top nippl pasti billboard award',\n",
       " 'report: stop nine percent illeg alien border crosser would pay trump’ border wall - breitbart',\n",
       " 'ice union issu final warn voter',\n",
       " 'elit new york polic unit rehears terrorist attack - new york time',\n",
       " \"trump' hollywood star vandal out shameless new video, taunt polic seek\",\n",
       " 'california today: view san francisco’ lean tower space - new york time',\n",
       " 'matthews: trump’ speech putin saying, ’america first’ ’hitlerian background’ - breitbart',\n",
       " 'vladimir putin valdai intern discuss club : «shape world tomorrow», vladimir putin',\n",
       " 'chines social media rage unit airlin controversi - breitbart',\n",
       " 'america better without border',\n",
       " '’chaos’: terror tie make venezuela direct threat usa, former un secur council presid say - breitbart',\n",
       " 'rick ross documentari video doubl ad checker - new york time',\n",
       " 'oil spill pacif ocean sinc last month total ignor',\n",
       " 'podesta mills: “we go dump emails”',\n",
       " 'thoughtlessli disbeliev “conspiraci theories” need read',\n",
       " 'dr. david duke dr. slatteri expos hillary’ treason trump & duke win!',\n",
       " 'russian frigat syrian cost blast terrorist hq cruis missil (video)',\n",
       " 'hillari clinton like covert action stay covert, transcript show - new york time',\n",
       " 'us: kurdish troop involv invad isi capit raqqa',\n",
       " 'awaken human await fulli script end controversi elect day near',\n",
       " 'georg soros-back climat march bring celeb nation mall swelter saturday - breitbart',\n",
       " 'edward snowden’ long, strang journey hollywood - new york time',\n",
       " '“black trump” man belong murder cult',\n",
       " 'bill clinton’ lover: call ruthless hillari ‘the warden’',\n",
       " \"russia, cina e arabia saudita domano l'egemonia del dollaro, di ariel noyola rodríguez\",\n",
       " 'third month, india’ cash shortag begin bite - new york time',\n",
       " 'there’ one trump administr posit that’ gain popular it’ go shock - breitbart',\n",
       " 'bill clinton said white middle-class life expect declin obama year',\n",
       " 'furiou eric holder issu dire warn comey’ partisan smear',\n",
       " \"memo trump: 'action day!'\",\n",
       " 'chao desper thousand flee aleppo amid govern advanc - new york time',\n",
       " 'wildfir empti fort mcmurray alberta’ oil sand region - new york time',\n",
       " 'schumer: session investig - ’seem violating’ recus - breitbart',\n",
       " 'amid division, march washington seek bring women togeth - new york time',\n",
       " 'zoe saldana: trump hollywood ’got cocky, becam arrog bullies’',\n",
       " '‘anti-establishment’ trump plan appoint goldman sach georg soro insid',\n",
       " 'cholesterol drug men gonads?',\n",
       " 'trump: flynn treat ’veri unfair’ ’fake media,’ illeg leak - breitbart',\n",
       " 'california today: virtual reality, investig trayvon martin case - new york time',\n",
       " 'nearli 8 decad later, apolog lynch georgia - new york time',\n",
       " 'marcia clark final moment savor emmi - new york time',\n",
       " '‘brexit’ speech, theresa may outlin clean break u.k. - new york time',\n",
       " 'man hate black men found victim care other - new york time',\n",
       " 'michael flynn fail disclos incom russia-link entiti - new york time',\n",
       " 'feder judg throw convict d.c. sniper’ four life sentenc',\n",
       " 'donald trump, obama, thanksgiving: weekend brief - new york time',\n",
       " 'очередная автоколонна мчс с гуманитарной помощью направилась в донбасс',\n",
       " 'vine 2013-2016: celebr life death app 12 clip',\n",
       " 'squatti potti ceo: griffin imag ’so divis disturbing, don’t decision, really’',\n",
       " '11 thing let go new year',\n",
       " 'comment polic union post pic hillari arrest facebook dan',\n",
       " 'koch brother secretli alli w. georg soro hillari clinton',\n",
       " 'trump expand search secretari state - new york time',\n",
       " \"teacher 11 yr old: 'i can't wait trump elected,he' go deport muslims'\",\n",
       " 'cost, choice, top concern health insur custom - new york time',\n",
       " 'shaq announc plan run sheriff 2020 - breitbart',\n",
       " 'illeg immigr cross border vote',\n",
       " 'pirat fail take helm: iceland’ pirat parti gain mileag enough steadi ship alon',\n",
       " 'billionair who’ build davo - new york time',\n",
       " 'run danger alaskan trail - new york time',\n",
       " 'la película de su vida descubr que ha llevado siempr un trozo de lechuga entr lo dient',\n",
       " 'dem win congression basebal game, give trophi republican steve scalis - breitbart',\n",
       " 'franc 2015 present: strict gun control paper tiger - breitbart',\n",
       " 'china, russia, silk road, commodities, nixon massiv bull market gold & silver',\n",
       " 'troubl quarterback johnni manziel appear shop mall sign autograph next super bowl - breitbart',\n",
       " 'bob dylan accus lift part nobel prize speech sparknot',\n",
       " 'blimp crash e. coli contamination, snakebitten u.s. open wit spectat death - breitbart',\n",
       " 'public employe shadow world american carnag',\n",
       " 'espn’ lz granderson: ’justified’ think kaepernick ’blackballed’ nobodi sign - breitbart',\n",
       " 'prescript painkil death drop 25% state legal marijuana',\n",
       " 'we’r low-growth world. get here? - new york time',\n",
       " 'istanbul, donald trump, benjamin netanyahu: morn brief - new york time',\n",
       " 'hitler hillary?',\n",
       " 'dalian wanda’ hollywood event product - new york time',\n",
       " 'comment 2:00pm water cooler 11/2/2016 timmi',\n",
       " 'breakdown clinton money machin',\n",
       " 'california, forefront climat fight, won’t back trump - new york time',\n",
       " 'g.e., 124-year-old softwar start-up - new york time',\n",
       " '$2,700 hillari clinton ‘hamilton’? would enough - new york time',\n",
       " 'brain concuss children adults: know vaccin damag',\n",
       " 'trump great — paul craig robert',\n",
       " 'hillari frantic dirti secret implodes, get wors prison bombshel',\n",
       " 'rent car? know rule road - new york time',\n",
       " 'impeach political. brazil’ someth sinister? - new york time',\n",
       " 'trump, interview, moder view defi convent - new york time',\n",
       " 'review: ‘sweetbitter,’ ‘bright lights, big city’ restaur set - new york time',\n",
       " 'gonzaga beat south carolina final four shot anoth first - new york time',\n",
       " 'gorka: trump ’i interventionist commander-in-chief,’ ’noth changed’ - breitbart',\n",
       " 're: thank fbi: clinton email investig shift poll number significantli trump’ favor',\n",
       " 'race, class, dictat republican futur',\n",
       " 'gorsuch: scalia ’lion law’ - judg look law demands, prefer - breitbart',\n",
       " 'nc state provid student post-elect comfort food, therapi',\n",
       " 'iraqi troop push mosul; 202 kill across iraq',\n",
       " 'pregnant women turn marijuana, perhap harm infant - new york time',\n",
       " 'biggest winner loser 2016 u.s. presidenti elect',\n",
       " 'trump psychic? listen word one year ago, look happened!',\n",
       " 'mccain: trump’ attack press ’how dictat get started’ - breitbart',\n",
       " 'judgment day: one reason everi christian jew america vote donald trump',\n",
       " 'coup stolen elect',\n",
       " 'сми: в россии создадут систему для отслеживания приближающихся со стороны солнца тел',\n",
       " '5 thing need know black dakota access pipelin protest',\n",
       " 'germany: iraqi asylum-seek convict rape chines student',\n",
       " 'teenag boy knock classmat assault femal teacher face- it’ epic!',\n",
       " 'take bring hillari clinton justice?',\n",
       " 'ice round 44 crimin alien texa capit',\n",
       " 'election: hate, grief, new stori',\n",
       " 'hillari question michel obama; help out?',\n",
       " 'keith vaz, british lawmaker, quit senior post amid sex drug scandal - new york time',\n",
       " 'comment sunday devotional: whole univers grain sunday devotional: whole univers grain — fellowship mind | kommonsentsjan',\n",
       " 'donald trump, syria, emperor akihito: morn brief - new york time',\n",
       " 'hell frozen over! michel obama made hillary-destroy move twitter',\n",
       " 'flynn: critic call nuclear scientist miss usa ’dumb’ diss femin call health care ’privilege’ - breitbart',\n",
       " 'hampshir colleg student accus assault basketbal player wear hair braids, claim ’cultur appropriation’ - breitbart',\n",
       " 'obamamometer’ toxic legacy: rule lawless',\n",
       " 'simon manuel, gold rippl beyond pool - new york time',\n",
       " 'vote machin program order steal elect',\n",
       " 'redraw tree life: scientist discov new bacteria groups, stun microbi divers underground',\n",
       " \"trump putin: 'we destroy isi all!'\",\n",
       " 'photo: game camera catch glimps possibl 3-antler buck',\n",
       " 'turkey’ relat europ sink amid quarrel netherland - new york time',\n",
       " 'wikileak document reveal unit nation interest ufo [video]',\n",
       " 'blue state blues: deliber politic intimaci',\n",
       " 'clare hollingworth, report broke news world war ii, die 105 - new york time',\n",
       " 'north miami polic offic shoot man aid patient autism - new york time',\n",
       " \"path total dictatorship: america' shadow govern silent coup\",\n",
       " 'effort curb polic abus mix record, uncertain futur - new york time',\n",
       " 'signal major bottom gold & silver?',\n",
       " 'hey ho, it’ old: england embrac punk rock 40 year later - new york time',\n",
       " 'cano reek genocide, theft white privilege, say canadian professor',\n",
       " 'illeg immigr advoc pledg resist deport trump',\n",
       " 'cdc scientist confirm donald trump right vaccin autism',\n",
       " 'breitbart news daily: drain swamp - breitbart',\n",
       " 'trump: media’ frankenstein monster',\n",
       " 'watch: toni romo say goodby dalla cowboy instagram video - breitbart',\n",
       " 'globalism: far-right conspiraci theori buoy trump - new york time',\n",
       " 'georgia father convict murder toddler’ death hot car - new york time',\n",
       " 'richard boll die 90 wrote ‘what color parachute?’ - new york time',\n",
       " 'stranahan: steve bannon nail media’ fight trump - breitbart',\n",
       " 'texa elector expect massiv corrupt relat elector colleg vote',\n",
       " 'guilty: power nullif counteract govern tyranni',\n",
       " '1/4 trillion new debt 30 day',\n",
       " 'tori councillor say homeless peopl ‘eliminated’',\n",
       " 'review: ‘hillbilli elegy,’ tough love analysi poor back trump - new york time',\n",
       " 'criminal-in-chief?',\n",
       " 'govern lie, movi',\n",
       " 'trump brexit defeat globalism, anyway',\n",
       " 'face congress, sport offici (not all) begin confront sexual abus - new york time',\n",
       " 'airbnb end fight new york citi fine - new york time',\n",
       " 'big pharma’ martin shkreli suspend twitter - breitbart',\n",
       " 'next big tech corridor? seattl vancouver, planner hope - new york time',\n",
       " 'evid robot win race american job - new york time',\n",
       " 'see africa road - new york time',\n",
       " 'happen hip-hop hillari goe dead-broke? brace yourselves.',\n",
       " 'bill maher isn’t high trump: state free speech new era - new york time',\n",
       " 'l.p.g.a. tour donald trump: it’ complic - new york time',\n",
       " 'legend art cashin trump presidency, new world order, gold, brexit, great depress see panic',\n",
       " 'fl sheriff: ’not day goe don’t arrest lot illeg aliens’ ’preying’ peopl - breitbart',\n",
       " 'donald trump threaten cancel berkeley feder fund riot shut milo event',\n",
       " 'концепция записка российского председательства',\n",
       " 'bill herz, last ‘war worlds’ broadcast crew, die 99 - new york time',\n",
       " 'gari johnson equat syria death caus assad west - new york time',\n",
       " 'republican senat bill defund un anti-israel resolut',\n",
       " 'rose evansky, pioneer women’ hairstyling, die 94 - new york time',\n",
       " 'blackstone, saudi arabia announc $40 billion invest u.s. infrastructur - breitbart',\n",
       " 'satur fat heart disease: “the greatest scam histori medicine”',\n",
       " 'dem sen merkley: gorsuch nomin ’court-pack scheme’ - turn nomin - breitbart',\n",
       " 'four common mistak burn wood',\n",
       " 'push internet privaci rule move statehous - new york time',\n",
       " 'madonna gave surpris pop-up concert support clinton. there. - new york time',\n",
       " 'trump support plan anti-trump ralli lack tax reform',\n",
       " 'british healthcar offer glimps futur obamacar',\n",
       " 'trump iranian presid rouhani: ’better careful’ - breitbart',\n",
       " 'breaking: sec defens carter attempt fool american public veterans! caught red-handed!',\n",
       " 'putin’ advis take credit trump victory: ‘mayb help bit wikileaks’',\n",
       " 'warren buffett stake suggest appl grown - new york time',\n",
       " \"re: fbi' clinton email investig shift poll number significantli trump’ favor\",\n",
       " 'hillari horrifi 2 pic surfac overnight didn’t want',\n",
       " 'paul lepage, governor maine, say he’ quit - new york time',\n",
       " 'colorado radio station’ paul martin interview dave hodg elect fraud stand rock',\n",
       " 'bill clinton want call someth complet ridicul hillari elect',\n",
       " 'son’ death, salli mann stage haunt show - new york time',\n",
       " 'trump team’ link russia crisscross washington - new york time',\n",
       " 'north korean arrest kill kim jong-un’ half brother - new york time',\n",
       " 'surgeon admit mammographi outdat harm women',\n",
       " 'war street paris: arm migrant fight run battl french capit',\n",
       " 'oscar voter: meryl streep nomin anti-trump speech',\n",
       " 'texa enact ’anti-sharia’ law',\n",
       " 'chicago polic board chair: windi citi need feder help turn tide crime - breitbart',\n",
       " 'look beyond novemb 8th - song oligarchi doom',\n",
       " 'neil young celebr 71st birthday perform stand rock',\n",
       " 'exclus — amid paul ryan’ obamacar 2.0 push, mississippi’ chri mcdaniel prep potenti 2018 senat run - breitbart',\n",
       " 'boom: short list peopl inspir michel obama',\n",
       " '‘more artist go boycott’: grammi face fallout fraught award - new york time',\n",
       " 'video: idiot destroy trump’ hollywood star, get bad news second later',\n",
       " '“he elit want there, global economi collapse”',\n",
       " '4 best health benefit sweat',\n",
       " 'senat confirm scott pruitt e.p.a. head - new york time',\n",
       " 'crickets, snakes, crabs: mix fact fraud new york’ subway - new york time',\n",
       " 'sessions’ potenti deputi face stern test russia inquiri - new york time',\n",
       " '‘suicid squad’ top box offic second weekend - new york time',\n",
       " 'health insur plan rate hike obamacar exchang - breitbart',\n",
       " 're: look like someon think democrat ohio full manur',\n",
       " 'syrian war report – novemb 14, 2016: govt forc relaunch offens oper insid outsid aleppo',\n",
       " 'mysteri solved! get hillari clinton get movin’ – twitchy.com',\n",
       " 'senat narrowli pass rollback obama-era ‘auto-i.r.a.’ rule - new york time',\n",
       " 'cramp costli bay area, cri build, baby, build - new york time',\n",
       " 'champion optimism, obama hail clinton polit heir - new york time',\n",
       " 'fiona appl releas trump protest chant - new york time',\n",
       " 'susan rice: u.s. must integr lgbt right gov’t foreign polici',\n",
       " 'trump organ move avoid possibl conflict interest - new york time',\n",
       " 'sweden brink? polic forc push break point violenc amid migrant influx',\n",
       " 'comment hemp vs cotton: ultim showdown hemp: readdress cannabi – kuebiko.co',\n",
       " 'jare kushner, trump’ son-in-law, clear serv advis - new york time',\n",
       " 'fisherman face life prison catch $500,000 worth cocain sell - breitbart',\n",
       " 'step ring roll punch - new york time',\n",
       " 'adnan syed, ‘serial’ podcast, get retrial murder case - new york time',\n",
       " \"scientist say weird signal space 'probably' alien\",\n",
       " 'u.s. swimmers’ disput robberi claim fuel tension brazil - new york time',\n",
       " '5 way take self-car vacat - new york time',\n",
       " '370 economist sign letter urg america vote donald trump',\n",
       " 'campaign long, expens chaotic. mayb that’ good thing. - new york time',\n",
       " '‘alien megastructure’ star target $100 million seti search',\n",
       " 'brazen kill myanmar lawyer came spar militari - new york time',\n",
       " 'jane pauley back — - new york time',\n",
       " 'deutsch bank consid altern pay cash bonu',\n",
       " '“danni dyer’ footbal foul ups” dvd 90 second',\n",
       " 'lack oxford comma could cost main compani million overtim disput - new york time',\n",
       " 'european parliament committe consid legal right robot - breitbart',\n",
       " 'rex tillerson, aggress dealmak whose tie russia may prompt scrutini - new york time',\n",
       " 'over: fbi conduct new investig email clinton’ privat illeg server',\n",
       " 'heart & mines: us empire’ cultur industri',\n",
       " 'report: megyn trash trump, newt… murdoch announc replac avail',\n",
       " 'russian scientist track sea lion space',\n",
       " 'seiz definit ‘populism,’ reuter warn us chao come',\n",
       " 'seaworthi readi earli unveil - new york time',\n",
       " 'donald trump add k.t. mcfarland nation secur team - new york time',\n",
       " 'snowstorm bring wintri mix slush gripe - new york time',\n",
       " 'republicans, wilders, tillerson: thursday even brief - new york time',\n",
       " 'review: bryan cranston shine lyndon johnson ‘all way’ - new york time',\n",
       " 'samsung urg consum stop use galaxi note 7s batteri fire - new york time',\n",
       " 'elect result discuss 2016 presidenti elect (open thread)',\n",
       " 'ag lynch told fbi director comey go public new clinton email investig',\n",
       " '“donald trump rise white ident politics”',\n",
       " 'red, blue divided: six view america - new york time',\n",
       " 'franc identifi 2nd man attack church kill priest - new york time',\n",
       " 'dreamer arrest nationwid gang crackdown',\n",
       " 'maxin waters: american public ’get weary’ trump impeach yet - breitbart',\n",
       " 'wwn’ horoscop',\n",
       " 'deport italian mobster caught sneak across u.s.-mexico border',\n",
       " 'leak audio: hillari clinton push “rigging” palestin elect 2006',\n",
       " 'iranian-saudi proxi struggl tore apart middl east - new york time',\n",
       " 'lavrov kerri discuss syrian settlement',\n",
       " \"l'influenc de usa et de l'otan dan le rapport de l’ue avec la chine, manlio dinucci\",\n",
       " 'open border group gird h-1b fight',\n",
       " 'weinerg expos darker dirtier secret imagined?',\n",
       " 'trump’ elect break chain polit correct',\n",
       " 'whitehouse.gov take climat page, put ’america first’ energi plan - breitbart',\n",
       " 'iran warn president-elect trump mess sweetheart nuclear deal obama',\n",
       " 'toni perkins: trump eo re-affirm jefferson’ doctrin separ church state',\n",
       " 'moon fell heaven',\n",
       " '‘mom’ star launch campaign plan parenthood',\n",
       " 'assad’ lesson aleppo: forc works, consequ - new york time',\n",
       " 'pence: bossert bannon weren’t demoted, ’continu play import polici roles’ - breitbart',\n",
       " 'bundi ranch occupi acquit count challeng corrupt bureau land manag',\n",
       " 'report: googl face fine $9 billion eu antitrust case - breitbart',\n",
       " 'don’t ask thom york write cover quot book',\n",
       " 'internet flasher',\n",
       " 'gretchen carlson suit aim retali discrimin - new york time',\n",
       " 'googl launch ai program detect ’hate speech’ - breitbart',\n",
       " 'poll show hillari lead useless mislead [cartoon]',\n",
       " 'last-second lane merger good traffic - new york time',\n",
       " 'macau, skip casinos, embrac past - new york time',\n",
       " 'montreal, ungainli unlov christma tree - new york time',\n",
       " 'photo jupit nasa spacecraft, near far - new york time',\n",
       " 'trump’ labor pick, andrew puzder, critic minimum wage increas - new york time',\n",
       " 'nico rosberg take formula one drivers’ titl despit lewi hamilton’ win abu dhabi - new york time',\n",
       " 'sensori isol tank taught brain - new york time',\n",
       " 'chelsea handler botch tweet attack trump’ grandchild',\n",
       " 'report: trump move tax reform plan without speaker paul ryan - breitbart',\n",
       " 'ag jeff session unveil program acceler deport imprison illeg - breitbart',\n",
       " 'former us attorney dc: new hillari email probe result ‘revolt’ insid fbi',\n",
       " 'keep appear ruin former dalla banker - new york time',\n",
       " 'sesam seed knee osteoarthr',\n",
       " 'white cop interact black real life',\n",
       " 'pennsylvania republican push ban privat gun sale - breitbart',\n",
       " 'review: ‘warcraft,’ orc differ domain, fight heart - new york time',\n",
       " 'good peopl share bad info — here’ need fact check click share',\n",
       " 'all, charit wed registri - new york time',\n",
       " 'it: nypd raid hillary’ property! found ruin life • usa newsflash',\n",
       " 'feinstein: gorsuch’ ’originalist’ doctrin ’realli troubling’ - origin would allow segreg - breitbart',\n",
       " 'confront flare obama’ travel parti reach china - new york time',\n",
       " '3 reason appli job trump administr',\n",
       " 'thought silver market rigged!',\n",
       " 'hear agn martin’ seren john zorn’ frenzi music? - new york time',\n",
       " 'must see! “welcom family.” mani hispanic-american vote donald trump',\n",
       " 'iraqi forc enter western mosul, fierc battl isi - new york time',\n",
       " 'european futur - putin migrant crisi [video]',\n",
       " 'roll stone defam case, magazin report order pay $3 million - new york time',\n",
       " 'hillari sick & tire suffer weiner backup',\n",
       " 'taiwan, italy, joe mcknight: friday even brief - new york time',\n",
       " 'shiit militia say close tal afar, turkey warn limit',\n",
       " 'brother clinton’ campaign chair activ foreign agent saudi arabian payrol',\n",
       " '‘we must fight them’: trump goe conserv freedom caucu - new york time',\n",
       " 'isi kidnaps, kill least 30 civilian afghanistan',\n",
       " 'hold hillari account',\n",
       " 'break : ted cruz call special prosecutor investig hillari – truthfe',\n",
       " 'spare gunman charleston, churchgoer describ night terror - new york time',\n",
       " 'war satur fat harm peopl poor countri shun tradit fat like coconut oil',\n",
       " 'democrats, garland mind, mobil suprem court fight - new york time',\n",
       " 'comment 4 best kind milk aren’t dairi 4 best kind milk aren’t dairi – collect evolut | apg editori',\n",
       " 'harri reid blast comey misconduct, drop bombshell: fbi sit russian-trump info',\n",
       " 'nation review, conservat inc., plan cave even immigration!',\n",
       " '[watch] thug call us marin “pussy” – bare live tell tale',\n",
       " 'next us presid psycho lesbian? (plu 2 break news videos)',\n",
       " 'critic see effort counti town purg minor voter roll - new york time',\n",
       " 'even briefing: hillari clinton, donald trump, cultur revolut - new york time',\n",
       " 'indiana parent lose babi 2 year live jail “abuse” say never happen',\n",
       " 'roll stone paint blue new album - new york time',\n",
       " 'uber extend oliv branch local governments: data - new york time',\n",
       " 'wilders: put dutch first, ’brussels, africa asylum seekers’',\n",
       " 'donald trump: good educ ‘enrich mind soul’',\n",
       " 'watch: brad pitt play afghanistan war gener ’war machine’ teaser - breitbart',\n",
       " 'two power earthquak strike central itali',\n",
       " 'indoor garden made easy: nutritower!',\n",
       " 'elizabeth warren defin sleazi hypocrisi',\n",
       " 'rush limbaugh: o’reilli departur ’natural’ - ’campaign’ - breitbart',\n",
       " 'museum trustee, trump donor, support group deni climat chang - new york time',\n",
       " 'cecil richard credit plan parenthood support stop ahca - breitbart',\n",
       " 'switch chip won’t know anymor',\n",
       " 'u.s. conced $400 million payment iran delay prison ‘leverage’ - new york time',\n",
       " 'australia say foil terrorist plot - new york time',\n",
       " 'orovil dam: state feder govern share blame',\n",
       " 'daili traditionalist: jeff schoep nsm',\n",
       " 'michael moore: joe blow vote trump “ultim f–– elite… human molotov cocktail”',\n",
       " 'jaguar owner shahid khan oppos trump’ immigr ban - new york time',\n",
       " 'anti-trump advert side bu realli visual clever see motion',\n",
       " 'piano man mani faces, stranger stori - new york time',\n",
       " '250,000 ticket releas ‘harri potter curs child’ - new york time',\n",
       " 'fbi visit man home film us postal distribut center',\n",
       " 'hispan crowd boo marco rubio stage',\n",
       " 'fire tv reporter: i’v receiv thousand ’sexual violent’ threat',\n",
       " 'detain illeg alien end 3-day hunger strike',\n",
       " 'break silence, offic testifi kill walter scott - new york time',\n",
       " 'illeg immigr allegedli kill park spot',\n",
       " 'presid trump honor littl sister poor first white hous nat’l day prayer year - breitbart',\n",
       " 'hillari clinton support call recount vote battleground state',\n",
       " 'hbo scrap jon stewart anim comedi seri',\n",
       " 'sentenc murder rare book dealer',\n",
       " 'latest stock market invest book | financi market',\n",
       " 'fashion industri ceo: support plan parenthood ‘civic responsibility’',\n",
       " 'anti-trump protest paid staged, craigslist reveal',\n",
       " 'men, exercis put damper sex life? - new york time',\n",
       " 'bake soda & coconut oil kill cancer: eye-open evid',\n",
       " 'trump, cite evidence, suggest susan rice commit crime - new york time',\n",
       " 'breitbart news daily: gorsuch scotu - breitbart',\n",
       " 'hillari arrested?',\n",
       " 'siri open smart lock let neighbor walk hous',\n",
       " 'donald trump, michael phelps, zika: tuesday even brief - new york time',\n",
       " 'obama furiou fed-up ‘deplorables’ drop 41,000-piec gift',\n",
       " 'l.a. mark 25 year sinc rodney king riot - breitbart',\n",
       " 'de facto us/al qaeda allianc : inform',\n",
       " 'cori booker: ’a paul rever moment’ underway - ’the russian coming’ - breitbart',\n",
       " 'rapper troy ave shot brooklyn - new york time',\n",
       " 'seattl judg ignor jihad convict prior impos refuge reform ban - breitbart',\n",
       " 'texa student skip school protest arrest violent crimin',\n",
       " 'trump aid tri reassur europe, mani wari - new york time',\n",
       " 'china trigger next global recession?',\n",
       " 'bomb kill 140 baghdad - new york time',\n",
       " 'comment black racism martin wright',\n",
       " 'thank fbi: clinton email investig shift poll number significantli trump’ favor',\n",
       " 'u.s. rescu attempt afghanistan miss western hostag hour - new york time',\n",
       " 'rick rule – look 2017 sprott asset manag clients’ money right',\n",
       " \"farm owner arrest protest dakota access pipeline' theft land\",\n",
       " 'trump pois lift ban c.i.a. ‘black site’ prison - new york time',\n",
       " 'tesla’ musk investig solarc congress',\n",
       " '5 ridicul stupid thing men keep women',\n",
       " 'press tv: duff un condemn “moder terrorists”',\n",
       " 'nemesi scourg western world',\n",
       " 'trump budget: ‘a new foundat american greatness’ - breitbart',\n",
       " 'exclus - islam state support vow terror group retak mosul ‘liberators’',\n",
       " 'roll thunder motorcyclist return d.c., honor pow/mia - breitbart',\n",
       " 'interest & fun fact stethoscop',\n",
       " 'china seek bigger role world stage, xi jinp go davo world econom forum - new york time',\n",
       " 'veteran prepar join stand rock protest stop dakota access pipelin',\n",
       " 'photos: latin america condemn venezuela’ ’excess use force’ protest - breitbart',\n",
       " 'sugar doesn’t feed cancer cell may even creat',\n",
       " 'john kerri urg ground militari aircraft ‘key areas’ syria - new york time',\n",
       " 'outsid money favor hillari clinton 2-to-1 rate donald trump - new york time',\n",
       " 'fake news: new york time target breitbart report truth - breitbart',\n",
       " 'blast, new yorker examin psycholog shrapnel - new york time',\n",
       " 'resistance: schwarzenegg call ’grassroot revolution’ u.s. exit pari agreement',\n",
       " 'virginia offici request u.s. inquiri inmat death jail - new york time',\n",
       " 'report voter fraud - crash course.',\n",
       " 'associ press report admit fake news stori hillari clinton.',\n",
       " 'review: garth brook bring rous anthem ballad yanke stadium - new york time',\n",
       " 'sicher trainieren: beim spin gilt ab sofort helmpflicht',\n",
       " 'everi asset class collapse: ‘you need look wealth term mani chicken much ga buy’',\n",
       " 'review: ‘halt catch fire’ time-travel silicon valley’ dawn - new york time',\n",
       " 'obama use religi test favor muslim christian',\n",
       " 'wingsuit flyer vs. tree',\n",
       " 'turkey say airport bomber kyrgyzstan, russia uzbekistan - new york time',\n",
       " 'turmer power 14 artifici drug',\n",
       " 'facebook caught sell target advertis exclud differ race',\n",
       " 'gatlinburg resid return home wildfir destruct - new york time',\n",
       " '10-year-old girl use human bomb nigeria attack',\n",
       " 'shock berkeley poll: california voter want democrat work trump - breitbart',\n",
       " 'famili terror attack victim sue twitter ’provid resourc servic isis’ - breitbart',\n",
       " 'philippin leader vow pardon polic accus mayor’ death - new york time',\n",
       " 'fda found manipul media favor big pharma',\n",
       " 'jay h. lehr: begin end epa',\n",
       " 'imahdi – arriv 28 satan practic leader القادمون',\n",
       " 'ag session dem sen harris: ’i’m abl rush fast - make nervous’ - breitbart',\n",
       " 'u.n. envoy say u.s. still back palestinian state - new york time',\n",
       " 'trump happen',\n",
       " 'japan vote strengthen shinzo abe’ goal chang constitut - new york time',\n",
       " 'in: trump camp caught cam brag “voter suppression” women & black (video)',\n",
       " 'chelsea man ask obama cut sentenc time serv - new york time',\n",
       " 'red sox broadcast jerri remi think foreign player shouldn’t use translat',\n",
       " 'shi’it militia join iraq’ mosul attack',\n",
       " 'escap reign super bowl commercials, polit prove inescap - new york time',\n",
       " 'naval brief 02 novemb 14th, 2016 ledahu',\n",
       " 'scandal video footag anonym expos huma hillari',\n",
       " 'jar new level confront conflict hit washington - new york time',\n",
       " 'clinton transmit classifi info lawyer',\n",
       " 'hillary: russian hack ’guid americans,’ might trump - breitbart',\n",
       " 'gener elect campaign suspend wake manchest suicid bomb',\n",
       " \"'grand slam!' father-son film smash hit famili\",\n",
       " 'venezuela’ econom crisis: mean left failed?',\n",
       " 'herd stamped wild boar kill three islam state jihadist - breitbart',\n",
       " 'venus, mars: believ gender it’ often wrong - new york time',\n",
       " 'obama’ pardon list: hotel magnat own studio 54 - new york time',\n",
       " 'suspect captur ‘ambush-style’ kill two iowa cop',\n",
       " 'megyn [sic] kelly: gowdi triumphantli comment hillari case reopen',\n",
       " 'family-friendli polici that’ friendliest male professor - new york time',\n",
       " 'ringo starr anuncia que deja lo beatl',\n",
       " 'war less immin clinton defeat',\n",
       " 'mi5 chief present russia grow threat british interest',\n",
       " 'washington state upend trump’ travel ban - new york time',\n",
       " 'protect swerve: polic chief caught speeding, get laugh ticket (video)',\n",
       " 'fake news trump hit mexico, explod',\n",
       " 'go wikileaks?',\n",
       " 'former cia director blame millenni wikileak document - breitbart',\n",
       " 'tell stori slavery? - new york time',\n",
       " 'live wire dutch elections: high turnout expected, controversi turkish mosqu poll centr',\n",
       " 'shave mean freedom omar',\n",
       " 'bombshell: leak email expos muslim got obama’ administr',\n",
       " 'nativ american part ten lost tribe jewish people?',\n",
       " 'blm rapper & bill’ alleg son nasti surpris hillari',\n",
       " 'kevin durant join golden state warrior - new york time',\n",
       " 'indian call center becom major center defraud american - breitbart',\n",
       " 'congress: attorney gener lynch ‘plead fifth’ secret iran ‘ransom’ payment',\n",
       " 'lo angel time editori lose trump: ’narcissist,’ ’demagogue’ - breitbart',\n",
       " 'swirl ‘untruths’ ‘falsehoods,’ call lie lie - new york time',\n",
       " 'hillari clinton lead donald trump new hampshir florida, poll show - new york time',\n",
       " 'gene wilder, huma abedin, donald trump: monday even brief - new york time',\n",
       " 'watch: blimp crashes, catch fire us open - breitbart',\n",
       " 'toddler, loos gun car, mother die - new york time',\n",
       " 'asian-american actor fight visibility. ignored. - new york time',\n",
       " 'mexican feel environment?',\n",
       " 'insid donald trump’ last stand: anxiou nomine seek assur - new york time',\n",
       " 'park servic name 24 divers nation landmark - new york time',\n",
       " 'weiner rise white house: alli disgrac ex-congressman hire - breitbart',\n",
       " '“if trump loses, i’m grab musket”: former congressman readi go full revolut',\n",
       " 'decod north korea’ claim success nuclear test - new york time',\n",
       " 'bill belichick wit list testifi aaron hernandez doubl murder case - breitbart',\n",
       " 'l.a. mayor silent city’ rise violent crime - breitbart',\n",
       " 'theresa may, new british prime minister, give bori johnson key post - new york time',\n",
       " 'donald trump, hillari clinton, iphone: wednesday even brief - new york time',\n",
       " \"usa kill 20 million peopl 37 'victim nations' sinc world war ii\",\n",
       " 'polic offic face backlash hillari photo',\n",
       " 'shakespear remain authent bore',\n",
       " 'georgia candid jon ossoff’ film firm financ facebook fact check funder',\n",
       " 'effort defeat isis, u.s. iran imped one anoth - new york time',\n",
       " 'rick ‘put bullet trump’ wilson: potu support see scalis shoot ‘blessing’ - breitbart',\n",
       " 'western intellig agenc run al-qaeda camp north africa',\n",
       " 'trump tell plan parenthood fund stay abort goe - new york time',\n",
       " 'comment hillari clinton’ gun control agenda expos wikileak email braindiseasecalledliber',\n",
       " 'barack obama delay suspend elect hillari forc new fbi email investigation?',\n",
       " 'donald trump incit feuds, g.o.p. candid flee shadow - new york time',\n",
       " 'germany: student forc chant ‘allahu akbar,’ punish refus trip mosqu',\n",
       " 'meteor, space junk, rocket? mysteri flash hit siberia',\n",
       " 'trump nation secur advis call russian envoy day sanction impos - new york time',\n",
       " 'project veritas: implic democrat oper claim credit romney 47% video',\n",
       " 'laid-off americans, requir zip lip way out, grow bolder - new york time',\n",
       " ...]"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cor"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Normal Algorithm Set Up :"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.feature_extraction.text import CountVectorizer,TfidfTransformer\n",
    "from sklearn.naive_bayes import MultinomialNB\n",
    "from sklearn.pipeline import Pipeline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [],
   "source": [
    "cv=CountVectorizer()\n",
    "msg=cv.fit_transform(cor)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<18285x17534 sparse matrix of type '<class 'numpy.int64'>'\n",
       "\twith 161520 stored elements in Compressed Sparse Row format>"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "msg"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "tar=messages['label']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(18285, 17534)"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "msg.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(18285,)"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tar.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [],
   "source": [
    "tfidf=TfidfTransformer()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [],
   "source": [
    "tf=tfidf.fit_transform(msg)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(18285, 17534)"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tf.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Train Test Split "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.model_selection import train_test_split"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [],
   "source": [
    "msg_train,msg_test,tar_train,tar_test=train_test_split(tf,tar,test_size=0.3,random_state=0)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [],
   "source": [
    "classifier_mod=MultinomialNB()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "MultinomialNB(alpha=1.0, class_prior=None, fit_prior=True)"
      ]
     },
     "execution_count": 46,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "classifier_mod.fit(msg_train,tar_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 1, 1, ..., 0, 1, 0], dtype=int64)"
      ]
     },
     "execution_count": 47,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "classifier_mod.predict(msg_test)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {},
   "outputs": [],
   "source": [
    "cm_pred=classifier_mod.predict(msg_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Metrics Evaluation :"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.metrics import confusion_matrix,classification_report,accuracy_score"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "              precision    recall  f1-score   support\n",
      "\n",
      "           0       0.79      0.98      0.88      3084\n",
      "           1       0.96      0.68      0.79      2402\n",
      "\n",
      "    accuracy                           0.84      5486\n",
      "   macro avg       0.87      0.83      0.83      5486\n",
      "weighted avg       0.86      0.84      0.84      5486\n",
      "\n"
     ]
    }
   ],
   "source": [
    "print(classification_report(tar_test,cm_pred))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[3008   76]\n",
      " [ 780 1622]]\n"
     ]
    }
   ],
   "source": [
    "print(confusion_matrix(tar_test,cm_pred))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The Accuracy Score Is :  0.84\n"
     ]
    }
   ],
   "source": [
    "print('The Accuracy Score Is : ',round(accuracy_score(tar_test,cm_pred),2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Pipeline :"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Train Test Split  For Pipeline :"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {},
   "outputs": [],
   "source": [
    "X=messages['title']\n",
    "y=messages['label']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(18285,)"
      ]
     },
     "execution_count": 54,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(18285,)"
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.model_selection import train_test_split"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {},
   "outputs": [],
   "source": [
    " X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(14628,)"
      ]
     },
     "execution_count": 58,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X_train.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(14628,)"
      ]
     },
     "execution_count": 59,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y_train.shape"
   ]
  },
  {
   "cell_type": "raw",
   "metadata": {},
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Pipeline:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.feature_extraction.text import CountVectorizer,TfidfTransformer\n",
    "from sklearn.naive_bayes import MultinomialNB\n",
    "from sklearn.pipeline import Pipeline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 61,
   "metadata": {},
   "outputs": [],
   "source": [
    "pipeline=Pipeline([\n",
    "   ('bow',CountVectorizer()),\n",
    "    ('tfidf',TfidfTransformer()),\n",
    "    ('classifier',MultinomialNB()),\n",
    "])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Pipeline(memory=None,\n",
       "         steps=[('bow',\n",
       "                 CountVectorizer(analyzer='word', binary=False,\n",
       "                                 decode_error='strict',\n",
       "                                 dtype=<class 'numpy.int64'>, encoding='utf-8',\n",
       "                                 input='content', lowercase=True, max_df=1.0,\n",
       "                                 max_features=None, min_df=1,\n",
       "                                 ngram_range=(1, 1), preprocessor=None,\n",
       "                                 stop_words=None, strip_accents=None,\n",
       "                                 token_pattern='(?u)\\\\b\\\\w\\\\w+\\\\b',\n",
       "                                 tokenizer=None, vocabulary=None)),\n",
       "                ('tfidf',\n",
       "                 TfidfTransformer(norm='l2', smooth_idf=True,\n",
       "                                  sublinear_tf=False, use_idf=True)),\n",
       "                ('classifier',\n",
       "                 MultinomialNB(alpha=1.0, class_prior=None, fit_prior=True))],\n",
       "         verbose=False)"
      ]
     },
     "execution_count": 62,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pipeline.fit(X_train,y_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([0, 0, 0, ..., 0, 0, 0], dtype=int64)"
      ]
     },
     "execution_count": 63,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pipeline.predict(X_test)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [],
   "source": [
    "pred=pipeline.predict(X_test)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Actual</th>\n",
       "      <th>Predicted</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>7179</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3971</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13077</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15967</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10882</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5416</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>680</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3313</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12366</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3835</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "       Actual  Predicted\n",
       "7179        0          0\n",
       "3971        0          0\n",
       "13077       1          0\n",
       "15967       0          1\n",
       "10882       0          0\n",
       "5416        1          1\n",
       "680         1          1\n",
       "3313        1          1\n",
       "12366       0          0\n",
       "3835        0          0"
      ]
     },
     "execution_count": 65,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df33=pd.DataFrame({'Actual':y_test,'Predicted':pred})\n",
    "df33.head(10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.metrics import confusion_matrix,classification_report,accuracy_score"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "              precision    recall  f1-score   support\n",
      "\n",
      "           0       0.81      0.98      0.88      2088\n",
      "           1       0.96      0.69      0.80      1569\n",
      "\n",
      "    accuracy                           0.85      3657\n",
      "   macro avg       0.88      0.83      0.84      3657\n",
      "weighted avg       0.87      0.85      0.85      3657\n",
      "\n"
     ]
    }
   ],
   "source": [
    "print(classification_report(y_test,pred))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The Accuracy Score Is : 0.85\n"
     ]
    }
   ],
   "source": [
    "print('The Accuracy Score Is :',round(accuracy_score(y_test,pred),2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## As You can see , pipeline proved with better accuracy score and results.."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}