{"id":33,"date":"2025-03-09T04:14:38","date_gmt":"2025-03-09T04:14:38","guid":{"rendered":"https:\/\/ma568.mavachgiare.com\/?p=33"},"modified":"2025-03-09T04:14:38","modified_gmt":"2025-03-09T04:14:38","slug":"harnessing-the-power-of-diverse-data-with-fern-halper","status":"publish","type":"post","link":"https:\/\/ma568.mavachgiare.com\/?p=33","title":{"rendered":"Harnessing the Power of Diverse Data with Fern Halper"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-34 aligncenter\" src=\"http:\/\/ma568.mavachgiare.com\/wp-content\/uploads\/2025\/03\/12-300x123.jpg\" alt=\"\" width=\"300\" height=\"123\" srcset=\"https:\/\/ma568.mavachgiare.com\/wp-content\/uploads\/2025\/03\/12-300x123.jpg 300w, https:\/\/ma568.mavachgiare.com\/wp-content\/uploads\/2025\/03\/12-768x315.jpg 768w, https:\/\/ma568.mavachgiare.com\/wp-content\/uploads\/2025\/03\/12.jpg 976w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>In this \u201cSpeaking of Data\u201d podcast, TDWI\u2019s Fern Halper explores the findings from her latest TDWI Best Practices Report on harnessing the power of diverse data for business growth. Halper is vice president and senior research director for advanced analytics at TDWI. [Editor\u2019s note: Speaker quotations have been edited for length and clarity.<\/p>\n<p>Halper began with a quick overview of what constitutes diverse data.<\/p>\n<p>\u201cDiverse data is pretty much just what it sounds like data in formats other than structured data,\u201d she said. \u201cThis includes unstructured and semistructured data (for example, XML and JSON) and data from different sources (such as social media and IoT devices).\u201d<\/p>\n<p>She explained that this diverse data is becoming more important as companies seek any way to compete better in their markets. \u201cFor example, a company can use the unstructured or semistructured data from their call center interactions to better predict when a customer might churn.\u201d This diverse data can also be used to uncover hidden insights, make better predictions, and otherwise better respond to what\u2019s happening on the ground, she added.<\/p>\n<p>\u201cThis reflects what we saw in the survey, which was that the primary driver for using diverse data, cited by 53% of respondents, was to better understand customers. This was followed by use cases related to operational efficiency, which were cited by 43%.\u201d<\/p>\n<p>The conversation then turned to the subject of how organizations were managing all this data.<\/p>\n<p>\u201cIn our survey, no one approach stood out as the leader,\u201d Halper said. \u201cAbout 20% of respondents said they were managing their diverse data in a combination of cloud data warehouses and data lakes the structured data in the warehouse and the other types in the data lake. An additional 20% said their platforms were a hybrid of cloud and on premises.\u201d Lakehouses, data fabrics, data virtualization, and semantic layers were also mentioned as solutions respondents were using, she added.<\/p>\n<p>Survey respondents were also fairly evenly divided on their assessments of how well they were managing their data, Halper said, explaining that about half of respondents reported they were doing either at least a relatively good job and the rest reporting that they could do a much better job.<\/p>\n<p>The reason for this, as Halper sees it, is that managing diverse data is a relatively new mission for most organizations. For example, about 40% of survey respondents said they had either no skills or only limited skills to analyze the data, she said. This raises concerns around data quality and governance, as well as a lack of tools to help resolve them.<\/p>\n<p>She went on to say that there is an expectation that innovations such as generative AI can provide assistance with certain aspects of using this diverse data. \u201cFor example, with the example of the call center notes, you can train an LLM to do sentiment analysis to assist in customer retention.\u201d<\/p>\n<p>\u201cWhen it comes to the key takeaways,\u201d Halper said, \u201cin addition to the fact that making use of diverse data is really important for your success, I think the other is that the market is not nearly as far along as one would hope.\u201d She noted, though, that she had seen evidence that organizations are at least starting to collect this data, even if they haven\u2019t yet begun to use it.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this \u201cSpeaking of Data\u201d podcast, TDWI\u2019s Fern Halper explores the findings from her latest TDWI Best Practices Report on harnessing the power of diverse data for business growth. Halper is vice president and senior research director for advanced analytics&#8230; <\/p>\n","protected":false},"author":1,"featured_media":34,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-33","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=\/wp\/v2\/posts\/33","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=33"}],"version-history":[{"count":1,"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=\/wp\/v2\/posts\/33\/revisions"}],"predecessor-version":[{"id":35,"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=\/wp\/v2\/posts\/33\/revisions\/35"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=\/wp\/v2\/media\/34"}],"wp:attachment":[{"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=33"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=33"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ma568.mavachgiare.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=33"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}