{"id":2194,"date":"2012-10-22T08:59:53","date_gmt":"2012-10-22T13:59:53","guid":{"rendered":"http:\/\/steinvox.com\/blog\/?p=2194"},"modified":"2012-10-25T21:04:56","modified_gmt":"2012-10-26T02:04:56","slug":"big-data-and-analytics-drivers-evolving-big-data","status":"publish","type":"post","link":"https:\/\/steinvox.com\/blog\/big-data-and-analytics-drivers-evolving-big-data\/","title":{"rendered":"Big Data And Analytics, The Evolution Of Big Data – Part 2"},"content":{"rendered":"

\"Big<\/a><\/p>\n

In part 1 of this series, we disambiguated the terms Big Data<\/em> and\u00a0Analytics<\/em>. This post focuses on the forces driving Big Data in the evolution of Big Data and Analytics.<\/p>\n[Part 1<\/a>] [Part 2<\/a>] [Part 3<\/a>] [Part 4<\/a>]\n

Big Data and Analytics has quietly crept up on many of us. Only a few decades ago, texts held in the United States Library of Congress \u00a0and the AT&T global telephone number index was our reference point for big data.<\/p>\n

Big Data today is a much more complex combination of dynamic streaming data with large static data sets. Big Data is now text, audio, images, video and richly tagged and indexed amalgamations of \u00a0content stored in many analog and digital formats. Big Data presents a rich opportunity to create value created by social, political, economic and industry drivers.<\/p>\n

Democratization Of Computing Power And Infrastructure<\/h3>\n

Formerly, an expensive class of computing called High Performance Computing <\/em>(HPC) was only available to academia and large institutions.\u00a0Today, globally distributed multi-blade servers with multi-core 64-bit CPU architectures are common. Disk storage is a low-cost commodity below $75 per terabyte. Open source operating systems (OS) like Linux make these resources available \u00a0\u2013 at a reasonable cost.<\/p>\n

Consumers use cloud and client computing <\/em>on billions of smartphones and tablets. Developers deliver consumer, commercial and industrial applications on these mobile devices. The shift to mobile platforms has changed our perception of software, and its maintenance. Infrastructure-centric changes are driving rapid entrepreneurial innovation in a race to satisfy consumers.\u00a0A new class of easy-to-use applications that capture and create data at alarming rates all contribute to the explosion of Big Data.<\/p>\n

Big Data And Analytics \u2013 From Active Creation To Passive Capture<\/h3>\n

Only a few years ago, data had to be\u00a0actively created <\/em>and\u00a0was in the hands of the few. Consumer data was captured on clipboards by survey-takers. Expensive software applications on desktop computers required training. Data was hoarded in isolated silos. Most of all, it required time to create.<\/p>\n

Today, data is increasingly passively captured<\/em> and is in the hands of the many. IDC reported in the\u00a0Digital Universe Study of September 2011<\/a>\u00a0that \u201c70% of information is created by individuals.\u201d Largely due to the proliferation of smart phones and mobile devices. GPS tracking applications and social media tools such as Facebook, Twitter, Foursquare, and Google+ have flipped the ratio of actively created data in favor of passively captured data. Our mobile phones produce a constant streaming record of our personal activity including text messages, email, voicemail, call records, use of our camera.<\/p>\n

Constant Real-time Data<\/h3>\n

In addition to smart phones generating passively captured consumer data, an entire new category of data-generating sensors has been deployed. These sensors are generating massive amounts of Big Data in real-time.<\/p>\n

Sensors track almost everything today, like FedEx packages from origin to destination. Our automobiles recording maintenance events in embedded sensors and have GPS systems both constantly interfacing with Big Data as we drive. Sensors track efficiency of goods through the supply chain for manufacturers and retail giants like Amazon. These devices generate a stream of location-centric time-stamped <\/em>data forming interesting real-time fact records<\/em>.<\/p>\n

Pervasive Proliferation of Photos, Audio And Video<\/h3>\n

Historically, we had not fully grasped the potential of digitally recorded photos, audio and video as data sources \u2013 they lived in a data silo. Images, audio and video were (and to some degree still are) stifled by commercial production industries through varying degrees of digital rights management.<\/p>\n

Two things have put the lion\u2019s share of image, audio and video creation in the hands of the consumer. Integration of cameras, audio and video recording technology in smartphones has given us the tools. Social media and the proliferation of sharing and re-sharing content<\/em> has changed our behavior. Social applications like Instagram, YouTube, Vimeo, Facebook and Twitter have catalyzed this shift accelerating the evolution of Big Data and Analytics.<\/p>\n

Looking Ahead<\/h3>\n

Each of these drivers have social, political, economic, and industry \u2013centric elements that have created a perfect convergence of transformative large-scale digital, social and cultural change. This kind of change is transformational, and irreversible.<\/p>\n

The biggest change may be the volume ratio between past and present data <\/em>our mobile apps analytically consider. This in turn will drive individual decisions for personal, business political and economic issues. Governments and institutions will be revolutionized by this ratio flip. Rearward-looking analysis will become less interesting and increasingly less relevant to the present and future. An entire set of value-metrics will \u00a0enable us to leverage future technical and social evolution in Big Data, and the resulting Analytic value we extract from it.<\/p>\n

Image credits: IDC from the EMC2<\/sup> sponsored 2011 Digital Universe Study<\/a>,
\nFeatured Image: metaroll<\/a> via photopin<\/a> cc<\/a>
\n<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

<\/a><\/p>\n

In part 1 of this series, we disambiguated the terms Big Data and\u00a0Analytics. This post focuses on the forces driving Big Data in the evolution of Big Data and Analytics.<\/p>\n

[Part 1<\/a>] [Part 2<\/a>] […]<\/p>\n","protected":false},"author":1,"featured_media":2206,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[11,59,104,39,8,41],"tags":[93,12,58,20],"class_list":["post-2194","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-decision-making","category-definitions","category-economics","category-social-media","category-strategy","category-technology","tag-complexity-into-simplicity","tag-design-thinking","tag-disambiguation","tag-results-outcomes"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/steinvox.com\/blog\/wp-content\/uploads\/2012\/10\/BigDatalarge__6637427465FeaturedImage.jpg?fit=150%2C150&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p25ukk-zo","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/posts\/2194","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/comments?post=2194"}],"version-history":[{"count":0,"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/posts\/2194\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/media\/2206"}],"wp:attachment":[{"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/media?parent=2194"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/categories?post=2194"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/steinvox.com\/blog\/wp-json\/wp\/v2\/tags?post=2194"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}