A blog for computer science passionates.

Sunday, 8 July 2018

Hi Friends,


Welcome again,

Today We are going to learn about Regression. We have already learn a brief about regression. But now, we take deep dive into the regression. It is a very broad thing in ML.

So, let's start with regression.
Regression is a type of supervised learning, so it has input variable as well as output variable like classification, but regression works for statistical analysis on data. or we can say it is a statistical process  to estimate real values, such  as, prices of different cars.

Lets take an example of regression:

import csv
import numpy
import matplotlib.pyplot as plt
from matplotlib import style
style.use("ggplot")
from sklearn import svm
file_name="regression_ex.csv"
raw_data=open(file_name,"rt")
reader=csv.reader(raw_data,delimiter=',',quoting=csv.QUOTE_NONE)
x=list(reader)
data=numpy.array(x)
plt.scatter(data[1:,0],data[1:,1])

Output:
data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAX0AAAD8CAYAAACb4nSYAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAGmVJREFUeJzt3XuUHGWZx/Hv5AJILiBkdiMXBdagJgFDgGTxQoAFFkQSUHwkBiEiYlR0jcCedQVWx4ML7GLQlUUwBy8sIA8oJEdAcBeIihIJhFuCgc2AiCFLQhRCgMBkZv+o6kmn05Ou7q6u6ar39zknJ9PV1f28b8/0M3XpqV9HX18fIiIShiGDPQAREcmOmr6ISEDU9EVEAqKmLyISEDV9EZGAqOmLiARETV9EJCBq+iIiAVHTFxEJyLDBHkAV+hNhEZHGdNRaoR2bPqtWrWr4sWPGjGHt2rUpjqZ96mluqtdutYpeL09z22233RKtp8M7IiIBUdMXEQmImr6ISEDU9EVEAqKmLyISkESf3jGzY4BvAUOB+e5+0QDrnQTcCBzs7kvMbC/gcWBFvMp97j6n6VGLiEhDajZ9MxsKXA4cBTwL3G9mC919ecV6o4AvAIsrnmKlu09Kabwi0iZ616yGBdeybsN6ekeMghmzGNI5drCHJTUk2dKfAvyvu3cDmNmPgRnA8or1vg5cApyT6ghFpO30rllN37wLYM1q3igt7F5B79wuNf42l+SY/u7AH8tuPxsv62dmBwB7uvvPqjx+bzNbamaLzOz9jQ9VRNrGgmthzeotl8Vb/tLekmzpV/uz3v5LJZjZEGAeMLvKes8Bb3X3F8zsQOAWM5vg7i+Vr2RmZwJnArg7Y8aMSTj8rQ0bNqypx7dzPc1N9dql1roN6zdv4ZfX3rCeXVpcu2ivZdb1kjT9Z4E9y27vAZRfJ2EUMBG4x8wAxgILzWy6uy8BNgK4+wNmthLYF1hSXsDdrwKuim/2NfNnz3n6s+l2rpV1vSLPLet6WdTqHTGq6vKeEaNaXrtor2Va9ZJehiFJ078fGGdmewN/Ak4GPla6091fBPp/NZnZPcA58ad3OoF17r7JzPYBxgHdSSchIm1qxizoXrHlIZ7OsdFyaWs1j+m7ew9wFnAH0ccv3d2XmVmXmU2v8fBDgUfM7GHgJmCOu69rdtAiMriGdI6lY24XHVOnMXziZDqmTqNDJ3FzoaOvr+2uZNynq2wOfq2s6xV5blnXK/Lcsq6Xp7nFh3dqXlpZf5ErIhIQNX0RkYCo6YuIBERNX0QkIGr6IiIBUdMXEQmImr6ISEDU9EVEAqKmLyISEDV9EZGAqOmLiASk1Rm5RwEXAdsBrwPnuvtdqYy8gqLbRERqq7mlX5aReywwHphpZuOrrFctI3ctcLy77wecBlyTxqArlaLb+hYv4o3HHqRv8SL65l0Q/SIQEZF+SQ7v9GfkuvvrQCkjt1IpI/e10gJ3X+rupUtmLgN2MLPtmxzz1hTdJiKSSJLDO9UycqeWr1CekWtmAwWjfxhY6u4bK+9oNi5R0W35r1fkuWVdr8hzy7peEefW6ozc0joTgIuBo6vd32xcoqLb8l+vyHPLul6R55Z1vTzNLWlcYpLDO/Vk5D4N/C1RRu5BAGa2B3AzcKq7r0w0qnrNmBVFtZVTdJuIyFZanZG7M3Ar8GV3vzfNgZcb0jmW3rldsOBahm1YT48+vSMiUlXNpu/uPWZWysgdClxdysgFlrj7wm08/Czg7cD5ZnZ+vOxod3++2YFXGtI5Fs44m10y3h0TEckTZeQ2SccX81er6PWKPLes6+VpbsrIFRGRrajpi4gERE1fRCQgavoiIgFR0xcRCYiavohIQNT0RUQCoqYvIhIQNX0RkYCo6YuIBKTVcYm7AjcBBwM/cPez0hm2iIg0ombTL4tLPIroMsv3m9lCd19esV61uMTXgPOJLr08Ma1Bi8jWlBMtSSTZ0u+PSwQws1Jc4vKK9Upxif3JWe6+Afi1mb09neGKSDWlnGjWrN6cIte9gt65XWr8soUkx/SrxSXuXr5CeVxiimMTkaSUEy0JZRKXWEuzGbnliphpORi1sq5X5LllUS+UnOis6xVxbkmafj1xiQBjieISp7v7kiSDaDYjt1yern/dzrWyrlfkuWVRL5Sc6Kzr5WluSTNyWxqXWMd4RaQZM2ZB94otD/EoJ1qqqHlM3917iGIP7wAejxZFcYlmNr3W4+Ow9G8Cs83sWTMb3+SYRaTCkM6xdMztomPqNIZPnEzH1Gl06CSuVKG4xCZpVzN/tYper8hzy7penuamuEQREdmKmr6ISEDU9EVEAqKmLyISEDV9EZGAqOmLiARETV9EJCBq+iIiAVHTFxEJiJq+iEhA1PRFRAKSSkaumc0BPgdsAl4GznT35Wa2F9FF2lbEq97n7nNSGruIiNQprYzc69z9u/H604muqnlMfN9Kd5+U7rCllZS1mh69ltJuUsnIdfeXytYfQVmyluSLslbTo9dS2lGSpl8tI3dq5Upm9jngS8B2wBFld+1tZkuBl4Dz3P1XjQ9XWm5bWatnnD04Y8orvZbShprOyC1x98uBy83sY8B5wGnAc8Bb3f0FMzsQuMXMJlTsGSgjt41qDVbWahG/b3ot81+viHNLIyO30o+BKwDcfSOwMf76ATNbCewLbBGlqIzc9qk1WFmrRfy+6bXMf708zS1pRm6Sj2z2Z+Sa2XZEGbkLy1cws3FlN48DnoyXd8YngjGzfYBxQHeikcngmDErylYtp6zVxui1lDZUc0vf3XvMrJSROxS4upSRCyxx94XAWWZ2JPAG8GeiQzsAhwJdZtZD9HHOOe6+rhUTkXQM6RxL79wuWHAtwzasp0efOGmYXktpR8rIbZJ2NfNXq+j1ijy3rOvlaW7KyBURka2o6YuIBERNX0QkIGr6IiIBUdMXEQmImr6ISEDU9EVEAqKmLyISEDV9EZGAqOmLiARETV9EJCCtzsg9CriIKFjldeBcd78rxfGL1EXxhRK6mlv6ZRm5xwLjgZlmNr5itevcfb84C/cSooxcgLXA8e6+H9GVN69JbeQidSrFF/YtXsQbjz1I3+JF9M27IPpFIBKIJId3+jNy3f11opCUGeUrDJSR6+5L3b10ycxlwA5mtn3zwxZpwLbiC0UCkUVGbsmHgaVxmlblYxWX2Ga1sq5X5PhCKN5rGUq9Is6t1Rm5AJjZBOBi4OhqBRSX2H61sq5X5PhCKN5rGUq9PM0tzbjERjJyTyjdMLM9gJuBU919ZaJRibSC4gtFEm3p92fkAn8iysj9WPkKZjbO3Z+Mb5Zn5O4M3Ap82d3vTW3UIg1QfKFI6zNyzwLeDpxvZufHy4529+fTnohIEkM6x8IZZ7NLxrvtIu1CGblN0vHF/NUqer0izy3renmamzJyRURkK2r6IiIBUdMXEQmImr6ISEDU9EVEAqKmLyISEDV9EZGAqOmLiARETV9EJCBq+iIiAUkrLvFLwBlAD7AGON3d/xDfdzHRRdgAvu7uN6Q0dhERqVNacYlLgYPcfX/gJqLIRMzsOGAyMIkoeOVcMxud3vAHT++a1fTOv5R1559F7/xLFbknIrmQZEu/Py4RwMxKcYnLSyu4+91l698HnBJ/PR5Y5O49QI+ZPQwcA3gKYx80paxV1qzenMTUvYLeuV26TK+ItLUkx/SrxSXuvo31PwncHn/9MHCsme1oZmOAw9kykCWflLUqIjmVWlwigJmdAhwETANw9zvN7GDgN0TH+n9LdNy/8nG5ysgdrKzVIuZ1Dkatotcr8tyyrlfEuSVp+oniEuMQla8A08rDz939QuDCeJ3riFO1yuUtI3ewslbzdG3vdq5V9HpFnlvW9fI0t6QZuWnFJR4AXAkcU56KFZ8E3tndXzCz/YH9gTsTjaydzZgF3Su2PMSjrFURyYG04hL/DRgJ3GhmAM+4+3RgOPCreNlLwCnxSd1cU9aqiOSV4hKbpF3N/NUqer0izy3renmam+ISRURkK2r6IiIBUdMXEQmImr6ISEDU9EVEAqKmLyISEDV9EZGAqOmLiARETV9EJCBq+iIiAVHTFxEJSEszcs3scGBe2arvBE5291vSGLyIiNSnpRm57n63u09y90nAEcArFOHSyiIiKcoyc7vVGbnlTgJud/dXGh+uiEixZJ253eqM3HInA9cnH5qISAAyztxuaUZu2fK3APsRBbFUe1yuMnIHq57mpnrtVqvo9YqYud3yjNzS3cDN7l5tbrnLyB2sepqb6rVbraLXy1Pmdltk5JaZCXw50YhEREKSceZ2zWP6caZtKSP38WhRlJFrZtPj1cozch8ys4Wlx5vZXkR7CovSHryISN4N6RxLx9wuOqZOY/jEyXRMnUZHi07igjJym1a0Xc3BqlfkuWVdr8hzy7penuamjFwREdmKmr6ISEDU9EVEAqKmLyISEDV9EZGAqOmLiARETV9EJCBq+iIiAVHTFxEJiJq+iEhA1PRFRALS6ozcScAVwGhgE3Chu9+Q4vhFRKQOLc3IJcrEPdXdJwDHAJeZ2c5pDV5EpBWyzKzNWkszct39ibJ1VpnZ80An8Jfmhy4ikr6sM2uzlllGrplNAbYDVtYzQBGRTGWcWZu1LDNyrwFOc/feKo9TRm6b1cq6XpHnlnW9Is8ti3pZZ9ZuUSOD17LlGblmNhq4FTjP3e+rVkAZue1XK+t6RZ5b1vWKPLcs6qWVWduIFEJUamppRq6ZbQfcDPzI3W9MNnQRkUGUcWZt1mo2fXfvMbNSRu5Q4OpSRi6wxN0XsmVGLsAz7j4dMOBQYFczmx0/5Wx3fyj9qYiING9I51h653bBgmsZtmE9PSNGwYxZhTiJC8rIbZp22/NXq+j1ijy3rOvlaW7KyBURka2o6YuIBERNX0QkIGr6IiIBUdMXEQmImr6ISEDU9EVEAqKmLyISEDV9EZGAqOmLiARETV9EJCCJMnIH0mh2bjM1pVh643CKdRvWR5e0LdCFrUTaUcNb+k1m54r0x9L1LV7EG489SN/iRfTNu6BQeaQi7aaZwzv92bnu/jpQys7t5+53u/sr8c37iAJYRCIFj6UTaUfNHN6plp07dRvrV83OBcUltmOtLOoVPZZusOoVeW5Z1yvi3Jpp+k1n55YoLrH9amVRL6+xdO1er8hzy7penuaWNC6xmcM79WbnTi/PzhVhxqwohq5cgWLpRNpRM1v6DWfnikDxY+lE2lHDTb/J7FwRIGr8nHE2u2S8Gy0SqqY+p+/utwG3VSy7oOzrI5t5fhERSZf+IldEJCBq+iIiAVHTFxEJiJq+iEhA1PRFRAKipi8iEhA1fRGRgKjpi4gERE1fRCQgavoiIgFJdBmGBLGIhwKXAfsDJ7v7TWX3bQIejW/q2jsiIoOoZtMvi0U8iuhyyveb2UJ3X1622jPAbOCcKk/xqrtPSmGsIhIw5SmnI8mWfn8sIoCZlWIR+5u+uz8d39fbgjGKSOBKecqsWb05ba17Bb1zu9T465TkmH61WMTd66ixg5ktMbP7zOyEukYnIgLKU05Rki39xLGIA3iru68ys32Au8zsUXdfWb6CMnLbr1bW9Yo8t6zrFXFug5WnXMTXMknTTxSLOBB3XxX/321m9wAHACsr1lFGbpvVyrpekeeWdb0izm2w8pTz9FomzchN0vRrxiIOxMzeDLzi7hvNbAzwXuCSRCMTESmZMQu6V2x5iEd5yg2peUzf3XuAUizi49GiKBbRzKYDmNnBZvYs8BHgSjNbFj/8XcASM3sYuBu4qOJTPyIiNQ3pHEvH3C46pk5j+MTJdEydRodO4jako6+vnsPzmehbtSrx0aOt5Gl3rJ1rZV2vyHPLul6R55Z1vTzNLT68U+0c7Bb0F7kiIgFR0xcRCYiavohIQNT0RUQCoqYvIhIQNX0RkYCo6YuIBERNX0QkIGr6IiIBUdMXEQmImr6ISEBampFrZpOAK4DRwCbgQne/Ib3hi4hIPWpu6Zdl5B4LjAdmmtn4itVKGbnXVSx/BTjV3ScAxwCXmdnOzQ46NL1rVtM7/1LWnX8WvfMvjbJCRUQa0NKMXHd/ouzrVWb2PNAJ/KXpkQdC2aAikqYsMnIBMLMpwHZUpGZJDcoGFZEUZZGRi5m9BbgGOM3de6vcr4zcAQxWNigo1zWv9Yo8t6zrFXFuLc/INbPRwK3Aee5+X7V1lJE7sMHKBgWFVeS1XpHnlnW9PM2tXTJytwNuBn7k7jcmGpFsSdmgIpKimk3f3XvMrJSROxS4upSRCyxx94VmdjBRc38zcLyZfS3+xI4BhwK7mtns+Clnu/tDrZhMEQ3pHEvv3C5YcC3DNqynZ8QomDFLJ3FFpCHKyG2SdjXzV6vo9Yo8t6zr5WluysgVEZGtqOmLiARETV9EJCBq+iIiAVHTFxEJSFt+emewByAiklO5/PRORzP/zOyBZp+jXetpbqrXbrWKXi+Hc6upHZu+iIi0iJq+iEhAitj0r6q9Sm7raW6q1261il6vcHNrxxO5IiLSIkXc0hcRkQEkCkZvN2Z2IvBT4F3u/vsi1DKzTcCjwHCgB/ghcFm10JkUa5WcUIq8rLLuYcA57v7BFOq+7O4jm32etOua2T1Ec1zSyjrNMrM+4L/c/ePx7WHAc8DiNL4/7VAzrvdNdz87vn0OMNLdv5p2rbKaexDlgI8n2hD+GXCuu78+wPpfBK5y91caqPUVokvTbwJ6gU+7++JGx96IvG7pzwR+TXRt/8TikPdMajXgVXefFF+S+ijgA8C/tLhW6d/TLaoj6doATDSzN8W3jyLKuEgsbtqZ1qzTRuBDZpZJXJWZdRBt1N3i7uOAfYGRwIXbeNgXgR0bqHUI8EFgsrvvDxzJllG0mcjdlr6ZjQTeCxwOLAS+Gm+NdgEvAO8Afgl81t17zexl4JvA3wNnEzXwZmv1b/ma2XeIcgV+YGYfiGutBR4E9mlka8jdn48jJO83s68S/XK+CDgM2B643N2vjOv/I/Bxoq2G2939n+qtFz/P0IFqAKPN7GYqXtsG64wEFhBlLwwnSlRbYGZ7AbcTfX/eQ9RYZrj7q43UqVL3MAb4vqXx/EnqmNnTRHtwxxPN/SMN7D3eDhwH3ES0QXI98P641hTgMuBNwKvAJ9x9RZxlcRywAzACOCKDmr8CPl/KzjCze4HPuPsjNWr1EJ3MnAt8pfwOM3sbcDXQCawBPgG8CDxM9F7rNbMdgRXx7WpJo5WOAF5z9+8DuPsmM5sLPBW/975G1Dv6gO8RfRZ+N+BuM1vr7ocnqFHyFmCtu2+Ma62N53UgUd8YSdQ7Zrv7c/Ee6EPAFGA0cLq7/66OelXlcUv/BODn7v4EsM7MJsfLpxA19f2AvwE+FC8fATzm7lPdPXHDr1FrK2a2A3AlcKy7v4/oB7Nh7t5N9P35K+CTwIvufjBwMPApM9vbzI6NxzjV3d8NXJLw6d9kZg/F/26Ol1WtEd830GvbiNeAE919MtEv00vjrS2AcUS/bCYAfwE+3ESddrU2nvsVwDkNPP7HwMnxz9v+QPmhgd8Dh7r7AcAFwDfK7juEKKO63obfaM35wGwAM9sX2D5Bwy+5HJhlZjtVLP8OUQrf/sC1wLfdvdT0p8XrHA/ckbDhA0wAHihf4O4vAc8AZwB7AweUarr7t4niYg+vs+ED3AnsaWZPmNl/mtk0MxsO/AdwkrsfSPRLrXwvY4S7vwf4bHxf0/LY9GcS/RAS/z8z/vp37t7t7puItkTeFy/fBPwk5VrVvBPodven4tvXN1izXKkZHg2camYPEb3hdiVqkEcC3y8dW3T3dQmft/zwzok1asDAr22jc/qGmT0C/DewO/DX8X1PlaWqPQDs1USddvXT+P+G5hc3zr2IfhZvq7h7J+BGM3sMmEfU0Ep+UcfPRxo1bwQ+GDe104Ef1FHvJeBHwBcq7joEuC7++ho2/xzeAHw0/vrk+HZSHVS/9EsHUerfd929Jx5XQ69fibu/DBwInEm0p3ID8GlgIvCL+L13HlEOecn18WN/SbTHvXMzY4CcHd4xs12Jdscmxid8hhJ9w25j629c6fZrcbNKq9ZCtvxluUP8f6I/ga6j/j5Ev7Cej5/78+5+R8U6x5DetYoGqnFYlRrN1JxFtBd0oLu/ER/yKL2GG8vW20R0yCAtPVT/vqWtVp3SHDfR+PtvIfDvRIfidi1b/nXgbnc/MT5cdk/ZfRsarNVQTXd/xcx+Acwgik09qM56lxEdIv3+NtYp/RwuBP7VzHYhaqp31VFnGRV7lGY2GtgT6Cbla4HFvege4B4zexT4HLDM3Q8Z4CFpvveA/G3pn0S0e/c2d9/L3fcEniL6jT8lPuQxhOi3fr2HcpLWAhhvZtvHu59/Fy/7PbBP/IMPm7c86mZmncB3ge+4ex9RPvFn4q0mzGxfMxtBtLt4enwck/iHvlED1YB0X9udgOfjhn848LYmnqsef6D69y2Pda4Gutz90YrlO7H5JOvsNqg5H/g2cH+9W8nx+k502LHkN2z+QMUs4p/DeAv6d8C3gJ/VuZH3P8COZnYq9J/bupRoz+ROYE7p5HfZ+2s9MKqe+cSPf4eZjStbNAl4HOiMT/JiZsPNrHwP7aPx8vcRHX59sd66lfLW9GcSBbCX+wnRR6B+S3Qi8jGi5ly5Xpq1HHiE6LjiUoD4hONngZ+b2a+B/yM6yZRU6Tj7MqLDHncSnUSC6M2zHHgw3o2+Ehjm7j8n2spZEu8aNnKMuKRqjfi+qq+tmc03s0RbcPEbZyPRa3aQmS0heuPWPJFpZnPMbE5909myrrv/kSrft7RkVQfA3Z91929VuesSoi3ee4n2TLc13oe2dX8aNd39AeAltr21vi2XAuWf4vkC8In40ODHgX8ou+8G4BTqO7RDvFF1IvARM3sSeILovNM/E70nngEeMbOHid77EJ1ovt3M7q5zPiOBH5rZ8ngO44nOg5wEXBzXeIjogwwlfzaz3xBtBH6y8gkbUYi/yK38xMQgjmOku78cn5i8HHjS3ecN5pjahZm9G/ieu08pYt3Bml87M7PdiA5lvLPRT3uFzFL6+5FKedvSb3efireglhHt9l5ZY/0gxFvp1xOdpCpc3cGaXzuLD5csBr6iht9eCrGlLyIiyWhLX0QkIGr6IiIBUdMXEQmImr6ISEDU9EVEAqKmLyISkP8HtkOF8rWBZjMAAAAASUVORK5CYII=
Figure: Regression of Month wise Heatwave


So, This is a simple example of regression. in next article, we will learn different types of regression.