{"id":7077,"date":"2016-04-01T06:29:10","date_gmt":"2016-04-01T06:29:10","guid":{"rendered":"http:\/\/www.esds.co.in\/blog\/?p=7077"},"modified":"2018-05-12T07:16:30","modified_gmt":"2018-05-12T07:16:30","slug":"big-data","status":"publish","type":"post","link":"https:\/\/www.esds.co.in\/blog\/big-data\/","title":{"rendered":"Misconceptions About The BIG DATA Concept"},"content":{"rendered":"<h2 style=\"text-align: justify;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone\" src=\"https:\/\/www.esds.co.in\/blog\/wp-content\/uploads\/2016\/04\/Big-Data.png\" alt=\"\" width=\"674\" height=\"385\" \/><\/h2>\n<h2 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"What_is_BIG_DATA%E2%80%A6\"><\/span>What is <strong>BIG DATA<\/strong>\u2026???<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p style=\"text-align: justify;\"><strong>Big data is the collection of humongous Data &#8211; structured or unstructured.\u00a0 This raw data can have various implementations in an organization such as analyzing insights and assist in initiating better decisions &amp; strategic business moves in future. But that is not it; big data is going to change the world and everything and everyone is going to get affected by it. I will try and clear out all the doubts and misconceptions about the BIG DATA concept with the help of this article.<\/strong><\/p><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_76 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.esds.co.in\/blog\/big-data\/#What_is_BIG_DATA%E2%80%A6\" >What is BIG DATA\u2026???<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.esds.co.in\/blog\/big-data\/#Volume\" >Volume<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.esds.co.in\/blog\/big-data\/#Velocity\" >Velocity<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.esds.co.in\/blog\/big-data\/#Variety\" >Variety<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.esds.co.in\/blog\/big-data\/#Veracity\" >Veracity<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n\n<p style=\"text-align: justify;\">The world is engaged in gathering &amp; analyzing huge data. The technology to harness this massive amount of data has enabled us (humans) to understand everything about the world and within it. Analyzing this huge data can help us in different sectors such as predict human behavior &amp; patterns, decode the human DNA in minutes, prevent terror attacks, find cures \u00a0for deseases, innovations &amp; inventions etc.<\/p>\n<p style=\"text-align: justify;\"><em>For e.g. a retail company can analyze your past buying patterns, analyze your social media accounts for needs and preferences, check their stock list, tracks your cell phone locations and examine the external weather all this can be done within seconds. And send you a voucher for your preference when you are within the radius of the retail store.<\/em> Sounds spooky right..!!! But yes all this is possible with datafication. Datafication is caused by a number of things such as digitalization of music, videos and books and this is possible due to rise in internet usage.<\/p>\n<p style=\"text-align: justify;\">In the initial days, we use to buy hard copies of books and novels to read but nowadays devices like <strong>kindle<\/strong> enable us to have any book or novels in azw or documented formats. These devices analyze individual profiles for their preferences and needs and provide or suggest books and novels according to their reading preferences. Same is the case with music, movies, clothes etc. have you ever wondered while using the internet we receive suggestions similar to what we were searching for its due to the same reason as the devices are recording our needs and preferences and fetching similar data and suggesting it back. Now, imagine all these with billions of searches performed daily, 500+ million tweets on twitter per day &amp; almost 75 hours of video uploaded on YouTube every minute.<\/p>\n<p style=\"text-align: justify;\">According to Eric Schmidt, Google\u2019s executive chairman \u201csince the dawn of the civilization humankind have generated five Exabyte of data till the end of 2003.\u201d But as per the computer giant IBM 2.5, Exabyte of data is generated every day in 2012 and the pace is accelerating.<\/p>\n<p style=\"text-align: justify;\">This data is in different formats such as text, video, web search logs, sensor data, financial transactions and credit card payments etc. All this data is segregated in four V\u2019s of Big Data.<\/p>\n<h3 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Volume\"><\/span><strong>Volume<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p style=\"text-align: justify;\">It refers to the massive amount of data generated every second. According to a survey by IBM, it is estimated that 2.5 quintillion bytes of data is generated each day &amp; 40 zettabytes of data will be generated by the end of 2020.<\/p>\n<h3 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Velocity\"><\/span><strong>Velocity<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p style=\"text-align: justify;\">It refers to the speed at which the new data is generated and rolled out. NYSE captures 1 TB of trade information during each trade session. A very good <em>e.g. of this is the credit card fraud detection where millions of transactions are analyzed for unusual patterns in real time.<\/em><\/p>\n<h3 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Variety\"><\/span><strong>Variety<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p style=\"text-align: justify;\">It refers to different forms of data recorded it can be in any form videos, docs, social media updates, financial data, sensor data etc. Almost 80% of the data collected in the world is in unstructured form. Almost 30 billion pieces of content is shared solely on Facebook every month &amp; 500 million tweets per day.<\/p>\n<h3 style=\"text-align: justify;\"><span class=\"ez-toc-section\" id=\"Veracity\"><\/span><strong>Veracity<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p style=\"text-align: justify;\">It refers to the uncertainty of data. The huge volumes often lack the quality or accuracy. 33% of companies don\u2019t believe the data to be completely reliable. Poor data quality costs the US economy 1.3$ trillion every year. According to a survey by IBM, almost 30% of respondent don\u2019t know whether their data is accurate or not.<\/p>\n<p style=\"text-align: justify;\">Now the question is how it is going to change the world\u2026???<\/p>\n<p style=\"text-align: justify;\">Initially, we had traditional tools which couldn\u2019t deal with fast moving &amp; unstructured data. But now the scenario is completely different as we have software\u2019s like Hadoop which enables us to analyze and format the huge amount of structured and unstructured data. All this is done by an automated system which segregates the task between many different computers or VM\u2019s.\u00a0 Due to this companies can gather all this accessible and inaccessible data together and deduce the actual gist from it to generate impressive results or outputs.<\/p>\n<p style=\"text-align: justify;\">Let\u2019s take a look at few big data implementations today<\/p>\n<p style=\"text-align: justify;\">Politicians today are using social media analytics to plan and execute their promotion campaigns, select a target audience and finalize where they should run their campaigns.<\/p>\n<p style=\"text-align: justify;\">Facebook analyzes your pictures, locations; friends list &amp; compare with others to determine your potential friends and your interests &amp; preferences on the basis of your likes and posts you share.<\/p>\n<p style=\"text-align: justify;\">Investigation agencies analyze data\u2019s from social media, CCTV cameras, texts, phone calls etc. to track criminal activities and also to predict terror attacks.<\/p>\n<p style=\"text-align: justify;\">Video analytics and sensor data are being used to analyze the games and sports activities and how to improve them <em>for e.g. you can now buy a cricket bat which has more than 200 sensors which analyze you\u2019re playing pattern and provides suggestions on how to improve your game.<\/em><\/p>\n<p style=\"text-align: justify;\">Have you ever wondered how apple iTunes or YouTube provides you with the similar genre of songs you are listening to they do it by analyzing individual preferences and provides suggestions accordingly all this is done with the help of datafication.<\/p>\n<p style=\"text-align: justify;\">Self-driving car by Google analyzes and collect a massive amount of data in real time in order to stay on the road. Safely<\/p>\n<p style=\"text-align: justify;\">Companies in order to predict sales volumes and brand equity are using a new concept called sentiment analysis from Facebook and twitter posts. They are also analyzing buying patterns of people for <em>e.g. if a lady has changed her buying pattern they get to know that she is pregnant and accordingly they promote baby products and pregnancy related goods to that specific client.<\/em><\/p>\n<p style=\"text-align: justify;\">Even in medical sector symptoms of a specific disease which is yet to happen to the patient can be detected based on the heartbeat and the physical symptoms recorded of previous patients and take precautions before the situation exaggerate.<\/p>\n<p style=\"text-align: justify;\">All this and it\u2019s just the beginning of a new era. The era of \u201cBig Data\u201d or \u201cDatafication\u201d all we can see now is just the horizon but the oceans water runs deeper and we don\u2019t know what lies in the depths of it.<\/p>\n<p style=\"text-align: justify;\">\n","protected":false},"excerpt":{"rendered":"<p>What is BIG DATA\u2026??? Big data is the collection of humongous Data &#8211; structured or unstructured.\u00a0 This raw data can have various implementations in an organization such as analyzing insights and assist in initiating better decisions &amp; strategic business moves in future. But that is not it; big data is going to change the world&#8230; <\/p>\n<div class=\"clear\"><\/div>\n<p><a href=\"https:\/\/www.esds.co.in\/blog\/big-data\/\" class=\"gdlr-button small excerpt-read-more\">Read More<\/a><\/p>\n","protected":false},"author":81,"featured_media":7080,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[744],"tags":[745,1345,1453],"class_list":["post-7077","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data","tag-big-data-2","tag-cloud-computing","tag-latest-technology"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/posts\/7077","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/users\/81"}],"replies":[{"embeddable":true,"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/comments?post=7077"}],"version-history":[{"count":6,"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/posts\/7077\/revisions"}],"predecessor-version":[{"id":8340,"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/posts\/7077\/revisions\/8340"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/media\/7080"}],"wp:attachment":[{"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/media?parent=7077"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/categories?post=7077"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.esds.co.in\/blog\/wp-json\/wp\/v2\/tags?post=7077"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}