{"id":2457,"date":"2012-08-11T22:45:58","date_gmt":"2012-08-12T05:45:58","guid":{"rendered":"http:\/\/ivyproschool.com\/blog\/?p=2457"},"modified":"2024-11-13T16:51:33","modified_gmt":"2024-11-13T11:21:33","slug":"2457","status":"publish","type":"post","link":"https:\/\/ivyproschool.com\/blog\/2457\/","title":{"rendered":"Dig Data for Gold – Data Mining is a hot new job!"},"content":{"rendered":"

\"\"<\/a>Dig for gold<\/strong>
\nData mining is a hot new job, and it\u2019s making number crunching sexy. Prasun Chaudhuri looks at what it takes to become a data whizkid<\/p>\n

Mousum Datta is a miner who digs out precious resources. But his form of mining doesn\u2019t involve drilling machines or gigantic trucks \u2014 just smart software, immense patience and some intellect. His work is all about crunching numbers and finding patterns \u2014 mining for data in an ocean of information.<\/p>\n

\u201cWe try to trace patterns from a database, which help companies take business decisions,\u201d says Dutta, 34, a senior software specialist at SAS, a leading data analysis firm in Pune. \u201cFor instance, retail majors ask us to analyse their billing database to gain an insight into consumers\u2019 purchasing behaviour \u2014 such as how often they shop or what they buy,\u201d he explains. The information helps the retailer choose stocks or organise the store to boost sales.<\/p>\n

The retail business is just one of the sectors he looks at. Industries such as banking, insurance and even movie production are competing on the back of predictive models of consumer behaviour built through mined data. Big data is big business.<\/p>\n

\u201c’It\u2019s a virtual goldmine, the biggest industry that people have started talking about,\u201d’ says C.A. Murthy of the Indian Statistical Institute (ISI), Calcutta.<\/p>\n

As a seasoned data miner, he\u2019s been involved in several mammoth central government projects such as the decennial census and the Five Year Plans, but storing the data collected had been a problem until recently. Now supercomputers and connected networks have made storage easier. \u201cYesterday\u2019s storage problem is today\u2019s strategic asset,\u201d he says.<\/p>\n

Rajeeva Karandikar, director of the Chennai Mathematical Institute and a top data scientist, stresses that data mining is the \u201cnew name for age-old\u201d analytics or statistical analysis. \u201cYou need basic mathematical skills and should be able to handle software programs to get into this field.\u201d<\/p>\n

People with experience of statistical modelling have an advantage, but they are not the only ones who can delve into the data mine. \u201cA solid background in soft computing or a penchant for working with huge data sets is an advantage,\u201d says Bhamidipati Narayan, a data miner working with Yahoo Labs, Bangalore. A PhD from ISI, Calcutta, he analyses the consumer behaviour of those who surf the Internet using Yahoo. \u201cBy mining terabytes of data culled out of zillion \u2018search\u2019 terms, we try to track probable consumers of a particular product so that the company can reach out to them with pinpoint precision,\u201d says Narayan. In other words, the approach maximises the impact of advertisements, pushes up sale figures and spares viewers or readers from getting bombarded with irrelevant ads.<\/p>\n

Thanks to the Internet and new mobile devices, the world has become a swelling ocean of data. Social media networks are also throwing up personal information that is up for grabs. \u201cCleaning up raw data \u2014 like looking for a needle in a digital haystack \u2014 is not an easy task,\u201d says Narayan.<\/p>\n

Indeed, this part of the job is tedious. According to Dutta, basic mining (extraction, transformation and loading or ETL) is 70 per cent of the task. \u201cIt\u2019s like harvesting ore from a mine. A good software programmer with a graduate degree in engineering, technology or computer applications can do this.\u201d<\/p>\n

But finding patterns (akin to cutting a raw diamond) needs a higher degree in statistics, mathematics, physics, economics, computer science or bioinformatics. The final task is to present the data (this can be likened to displaying the diamond in a showroom) by analysing bits and pieces of information, accomplished by user interface programmers with impeccable communication skills.<\/p>\n

Even though data mining is finding diverse applications (ranging from the prevention of disease to gauging gambler satisfaction in casinos) there are not enough qualified people. \u201cThere\u2019s a huge dearth of big data skills in the country. A report by [consultancy firm] McKinsey suggests that with organisations increasingly depending on data crunching, the demand will shoot up,\u201d says a professional turned entrepreneur, who\u2019s been running an analytic training institute in Bangalore since 2007.<\/p>\n

According to another analytic expert, many youngsters are launching such startups. \u201cIt needs a little investment (around Rs 10-15 lakh) and a few good professionals. I have seen hundreds of such firms grow in India in the last five years. Most of these clean up basic data sets (ETL phase) for foreign firms,\u201d he says. Another professional points out that the next outsourcing boom is happening in this field. \u201cTop Indian IT firms are now in a rush to recruit data analysts.\u201d<\/p>\n

Data mining is still in its infancy, but it\u2019s going to change the way we do business \u2014 just like IT transformed the face of global industry a decade ago.<\/p>\n

So are you ready to dig for gold?<\/p>\n

WHERE THE JOBS ARE<\/strong><\/p>\n

MARKETING
\n<\/strong>Applied to identify potential customers of a product or service, the size of the market, the profitability of the market<\/p>\n

FINANCE
\n<\/strong>Designed to help banks in their operational activities like customer acquisition, operations and minimising default risks<\/p>\n

HUMAN RESOURCE MANAGEMENT
\n<\/strong>To predict the effectiveness of hiring, the performance of employees and attrition decisions<\/p>\n

MANUFACTURING INDUSTRY
\n<\/strong>For continuous process improvement, quick detection of defects and identifying customer trends early<\/p>\n

PHARMACEUTICAL INDUSTRY
\n<\/strong>Measurement of the effectiveness of strategies, picking up of customer trends immediately, cutting the down time of clinical trials<\/p>\n

Source: http:\/\/www.telegraphindia.com<\/a>\/ (CareerGraph)<\/p>\n","protected":false},"excerpt":{"rendered":"

Dig for gold Data mining is a hot new job, and it\u2019s making number crunching sexy. Prasun Chaudhuri looks at what it takes to become a data whizkid Mousum Datta is a miner who digs out precious resources. But his form of mining doesn\u2019t involve drilling machines or gigantic trucks \u2014 just smart software, immense patience and some intellect. His work is all about crunching numbers and finding patterns \u2014 mining for data in an ocean of information. \u201cWe try to trace patterns from a database, which help companies take business decisions,\u201d says Dutta, 34, a senior software specialist at SAS, a leading data analysis firm in Pune. \u201cFor instance, retail majors ask us to analyse their billing database to gain an insight into consumers\u2019 purchasing behaviour \u2014 such as how often they shop or what they buy,\u201d he explains. The information helps the retailer choose stocks or organise the store to boost sales. The retail business is just one of the sectors he looks at. Industries such as banking, insurance and even movie production are competing on the back of predictive models of consumer behaviour built through mined data. Big data is big business. \u201c’It\u2019s a virtual goldmine, the […]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[22,16,23],"class_list":["post-2457","post","type-post","status-publish","format-standard","hentry","category-data-analytics","tag-analytics","tag-analytics-career","tag-analytics-skills"],"yoast_head":"\nDig Data for Gold \u2013 Data Mining as the New Job Frontier<\/title>\n<meta name=\"description\" content=\"Explore the booming field of data mining, where crunching numbers uncovers valuable insights to boost business success. Learn what it takes to become a data expert in this fast-growing sector.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ivyproschool.com\/blog\/2457\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Dig Data for Gold \u2013 Data Mining as the New Job Frontier\" \/>\n<meta property=\"og:description\" content=\"Explore the booming field of data mining, where crunching numbers uncovers valuable insights to boost business success. Learn what it takes to become a data expert in this fast-growing sector.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ivyproschool.com\/blog\/2457\/\" \/>\n<meta property=\"og:site_name\" content=\"R vs Python: Which Analytics Tool Should You Choose for Data Science?\" \/>\n<meta property=\"article:published_time\" content=\"2012-08-12T05:45:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-11-13T11:21:33+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/ivyproschool.com\/blog\/wp-content\/uploads\/2012\/08\/Dig-For-Gold-Data-Mining-201x300.jpg\" \/>\n<meta name=\"author\" content=\"puja\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"puja\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/\"},\"author\":{\"name\":\"puja\",\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/#\\\/schema\\\/person\\\/1a7cb5a55a6acaab2b33dbb3739e680c\"},\"headline\":\"Dig Data for Gold – Data Mining is a hot new job!\",\"datePublished\":\"2012-08-12T05:45:58+00:00\",\"dateModified\":\"2024-11-13T11:21:33+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/\"},\"wordCount\":913,\"commentCount\":1,\"image\":{\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/wp-content\\\/uploads\\\/2012\\\/08\\\/Dig-For-Gold-Data-Mining-201x300.jpg\",\"keywords\":[\"Analytics\",\"Analytics Career\",\"Analytics Skills\"],\"articleSection\":[\"Data Analytics\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/\",\"url\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/\",\"name\":\"Dig Data for Gold \u2013 Data Mining as the New Job Frontier\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/wp-content\\\/uploads\\\/2012\\\/08\\\/Dig-For-Gold-Data-Mining-201x300.jpg\",\"datePublished\":\"2012-08-12T05:45:58+00:00\",\"dateModified\":\"2024-11-13T11:21:33+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/#\\\/schema\\\/person\\\/1a7cb5a55a6acaab2b33dbb3739e680c\"},\"description\":\"Explore the booming field of data mining, where crunching numbers uncovers valuable insights to boost business success. Learn what it takes to become a data expert in this fast-growing sector.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/#primaryimage\",\"url\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/wp-content\\\/uploads\\\/2012\\\/08\\\/Dig-For-Gold-Data-Mining.jpg\",\"contentUrl\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/wp-content\\\/uploads\\\/2012\\\/08\\\/Dig-For-Gold-Data-Mining.jpg\",\"width\":\"490\",\"height\":\"728\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/2457\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Dig Data for Gold – Data Mining is a hot new job!\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/\",\"name\":\"Ivy Professional School | Official Blog\",\"description\":\"Confused between R and Python for your data science journey? Discover the key differences in data visualization, handling capabilities, speed, and ease of learning.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/#\\\/schema\\\/person\\\/1a7cb5a55a6acaab2b33dbb3739e680c\",\"name\":\"puja\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/de912f2133e74586cca328a8b80e9337a3eade3e229fa6edab8a2131769ab7e9?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/de912f2133e74586cca328a8b80e9337a3eade3e229fa6edab8a2131769ab7e9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/de912f2133e74586cca328a8b80e9337a3eade3e229fa6edab8a2131769ab7e9?s=96&d=mm&r=g\",\"caption\":\"puja\"},\"url\":\"https:\\\/\\\/ivyproschool.com\\\/blog\\\/author\\\/puja\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Dig Data for Gold \u2013 Data Mining as the New Job Frontier","description":"Explore the booming field of data mining, where crunching numbers uncovers valuable insights to boost business success. Learn what it takes to become a data expert in this fast-growing sector.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ivyproschool.com\/blog\/2457\/","og_locale":"en_US","og_type":"article","og_title":"Dig Data for Gold \u2013 Data Mining as the New Job Frontier","og_description":"Explore the booming field of data mining, where crunching numbers uncovers valuable insights to boost business success. Learn what it takes to become a data expert in this fast-growing sector.","og_url":"https:\/\/ivyproschool.com\/blog\/2457\/","og_site_name":"R vs Python: Which Analytics Tool Should You Choose for Data Science?","article_published_time":"2012-08-12T05:45:58+00:00","article_modified_time":"2024-11-13T11:21:33+00:00","og_image":[{"url":"https:\/\/ivyproschool.com\/blog\/wp-content\/uploads\/2012\/08\/Dig-For-Gold-Data-Mining-201x300.jpg","type":"","width":"","height":""}],"author":"puja","twitter_card":"summary_large_image","twitter_misc":{"Written by":"puja","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ivyproschool.com\/blog\/2457\/#article","isPartOf":{"@id":"https:\/\/ivyproschool.com\/blog\/2457\/"},"author":{"name":"puja","@id":"https:\/\/ivyproschool.com\/blog\/#\/schema\/person\/1a7cb5a55a6acaab2b33dbb3739e680c"},"headline":"Dig Data for Gold – Data Mining is a hot new job!","datePublished":"2012-08-12T05:45:58+00:00","dateModified":"2024-11-13T11:21:33+00:00","mainEntityOfPage":{"@id":"https:\/\/ivyproschool.com\/blog\/2457\/"},"wordCount":913,"commentCount":1,"image":{"@id":"https:\/\/ivyproschool.com\/blog\/2457\/#primaryimage"},"thumbnailUrl":"https:\/\/ivyproschool.com\/blog\/wp-content\/uploads\/2012\/08\/Dig-For-Gold-Data-Mining-201x300.jpg","keywords":["Analytics","Analytics Career","Analytics Skills"],"articleSection":["Data Analytics"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/ivyproschool.com\/blog\/2457\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/ivyproschool.com\/blog\/2457\/","url":"https:\/\/ivyproschool.com\/blog\/2457\/","name":"Dig Data for Gold \u2013 Data Mining as the New Job Frontier","isPartOf":{"@id":"https:\/\/ivyproschool.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/ivyproschool.com\/blog\/2457\/#primaryimage"},"image":{"@id":"https:\/\/ivyproschool.com\/blog\/2457\/#primaryimage"},"thumbnailUrl":"https:\/\/ivyproschool.com\/blog\/wp-content\/uploads\/2012\/08\/Dig-For-Gold-Data-Mining-201x300.jpg","datePublished":"2012-08-12T05:45:58+00:00","dateModified":"2024-11-13T11:21:33+00:00","author":{"@id":"https:\/\/ivyproschool.com\/blog\/#\/schema\/person\/1a7cb5a55a6acaab2b33dbb3739e680c"},"description":"Explore the booming field of data mining, where crunching numbers uncovers valuable insights to boost business success. Learn what it takes to become a data expert in this fast-growing sector.","breadcrumb":{"@id":"https:\/\/ivyproschool.com\/blog\/2457\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ivyproschool.com\/blog\/2457\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/ivyproschool.com\/blog\/2457\/#primaryimage","url":"https:\/\/ivyproschool.com\/blog\/wp-content\/uploads\/2012\/08\/Dig-For-Gold-Data-Mining.jpg","contentUrl":"https:\/\/ivyproschool.com\/blog\/wp-content\/uploads\/2012\/08\/Dig-For-Gold-Data-Mining.jpg","width":"490","height":"728"},{"@type":"BreadcrumbList","@id":"https:\/\/ivyproschool.com\/blog\/2457\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ivyproschool.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Dig Data for Gold – Data Mining is a hot new job!"}]},{"@type":"WebSite","@id":"https:\/\/ivyproschool.com\/blog\/#website","url":"https:\/\/ivyproschool.com\/blog\/","name":"Ivy Professional School | Official Blog","description":"Confused between R and Python for your data science journey? Discover the key differences in data visualization, handling capabilities, speed, and ease of learning.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ivyproschool.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/ivyproschool.com\/blog\/#\/schema\/person\/1a7cb5a55a6acaab2b33dbb3739e680c","name":"puja","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/de912f2133e74586cca328a8b80e9337a3eade3e229fa6edab8a2131769ab7e9?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/de912f2133e74586cca328a8b80e9337a3eade3e229fa6edab8a2131769ab7e9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/de912f2133e74586cca328a8b80e9337a3eade3e229fa6edab8a2131769ab7e9?s=96&d=mm&r=g","caption":"puja"},"url":"https:\/\/ivyproschool.com\/blog\/author\/puja\/"}]}},"_links":{"self":[{"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/posts\/2457","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/comments?post=2457"}],"version-history":[{"count":1,"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/posts\/2457\/revisions"}],"predecessor-version":[{"id":9162,"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/posts\/2457\/revisions\/9162"}],"wp:attachment":[{"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/media?parent=2457"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/categories?post=2457"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ivyproschool.com\/blog\/wp-json\/wp\/v2\/tags?post=2457"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}