{"id":1967,"date":"2019-09-23T02:55:41","date_gmt":"2019-09-23T02:55:41","guid":{"rendered":"http:\/\/kusuaks7\/?p=1572"},"modified":"2024-04-01T14:36:54","modified_gmt":"2024-04-01T14:36:54","slug":"are-we-on-the-cusp-of-an-artifical-intelligence-golden-age","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/ai-ml\/are-we-on-the-cusp-of-an-artifical-intelligence-golden-age\/","title":{"rendered":"Are we on the cusp of an Artifical Intelligence Golden Age?"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tPeriodically my colleagues and I raise the topic of machine learning and artificial intelligence in the everyday application of data management and data quality and every day it seems I read something that suggests that if you are not using or considering AI or ML you may be missing out.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tIt is often stated in the press and articles on data management and data science that the biggest drag on insights and innovation is around getting data into a fit state to be used for any meaningful use.\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tBy a fit state, I am of course referring to not just the reshaping of data but also the application of basic rules and conditions to the data. You would do this to ensure that inappropriate outliers and glaringly wrong data is eliminated so as to ensure that the data that one use for insights and analysis, is as good as it can possibly be.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\nThere is a pragmatism that needs to be applied to this of course and that I guess, is where my thoughts dwell, when thinking about how software can be taught to accelerate the data cleansing and data hygiene function. It is not the consideration of AI or ML as a knee jerk response to a fear of missing out so much as a concern that in the absence of application \u201csmarts\u201d, users are wasting a lot of resources on fixing data when it could be fixed proactively.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tA year or two back, Gartner\u00a0predicted<\/a>\u00a0that by next year, almost every new piece of software on the market will leverage AI technology in some form or fashion. So it\u2019s interesting to note that the recent acquisitions by both Google (of Looker) and Salesforce (of Tableau) both focused on products that offer data prep, data wrangling, data cleansing, data visualization, data presentation, and data action as capabilities in their technology stacks.\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tGoogle seems to have so many existing capabilities that it is easy to think that its acquisition could be relegated to the Google graveyard of\u00a0killedbygoogle<\/a>\u00a0but there are some interesting AI and ML pieces even in there and one wonders if this was part of the acquisition decision.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tA lot of these capabilities are squarely aimed at what Looker\u00a0referred<\/a>\u00a0to as \u201cprofessional and citizen data scientists<\/em>\u201d.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tThe Salesforce acquisition of Tableau seems perhaps even more deliberate in this regard \u2013 it is argued that the Tableau purchase lands Salesforce, the leading analytics platform in the market. An important position given that small or large business using Tableau (86,000+ organizations) now open up to Salesforce pitching more offerings. Tableau too, has AI and ML components to ease the manipulation and usefulness of data.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Smart Analytics<\/h2><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tMid 2018, Tableau acquired Empirical Systems an AI startup specializing in automated statistics.\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tStarting out as the\u00a0MIT Probabilistic Computing Project<\/em>, they had developed a unique analytics engine applying statistical techniques to automatically uncover insights hidden inside all kinds of data.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tTypically, this kind of approach to data requires a trained statistician with familiarity with the data and programming techniques to analyze and review all the data at their disposal and then work out what data is worth investigating further and which data is, in fact, relevant to the ultimate goal and intent of the analysis.\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\n\u201cEmpirical\u201d supposedly automated the analysis and data modelling and easily identified correlations, outliers, and patterns in the data. What Tableau would go onto describing later as \u201csmart analytics\u201d.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tSo, with that as a bit of a background, I thought I would think a little more on where AI and ML might be specifically applied in this area as it relates to data quality and data improvement.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

SMURF, SMURF, SMURFETY, SMURF!<\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tOne area where we know that it is pretty obvious to consider AI and ML, is in the area of fraudulent or non-compliant transaction identification. It\u2019s obvious because it is either associated with revenue leakage, the unbridling of cost management and the risk of penalties and fines.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tMost of us would have experienced this with our banks when we use a bank or credit card abroad or on a foreign website. Transactions get flagged, possibly blocked, and we get contacted in near real-time by email, phone call, in-app notification or SMS. Banks use a variety of techniques to manage this, a lot of it wrapped up in where they think the transaction is happening relative to where you spend most of your time shopping and transacting.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tWhen the\u00a0horse has bolted<\/em>\u00a0so to speak, it is still often useful to evaluate transactions and master data in batches, on a schedule perhaps, to identify anomalous events. Sometimes this is handled by audit and exception reporting, but often those audit and exception reports have very specific thresholds against which the transactions are assessed.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tContinuous training of an AI monitor on transactional data, could, for example, recognize explicit behaviour where a user or operator is running or putting through transactions that are outliers from the normal distribution of transactions. Manual training of exceptions or periodic batches improves the analysis algorithms.\u00a0Smurfing<\/a>, is the practice of ensuring that you make deposits into bank accounts that avoid triggering compliance reporting to the regulators, by the banks.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tWhile banks likely use a number of explicit methods to identify this and related kinds of behaviour, it is a great candidate for AI in environments where you simply want to know where some activity contains weird outliers or anomalies. These same practices can also be applied to stock trades and in ERP and CRM, stock pricing, inventory and SKU pricing, materials cost assessment and inventory handling.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Reducing inventory complexity and costs<\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tI had occasion recently to look at a list of inventory items being purchased by a large healthcare organization and of particular interest to me, was the likelihood of there being duplicates items in the inventory.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tNow arguably, the items did need to be listed more than once, because in all likelihood, the application search that the users might engage in, would focus on just the area that they are interested in, but this is another area where applying AI could quickly identify the presence of duplicate records and alternative approaches could be considered in order to minimize the likelihood of duplicate or redundant records and in fact save the institution on poorly negotiated procurement agreements. Cash strapped healthcare organizations, particularly in public health would always want to leverage the lowest costing items whenever possible and duplicate entries introduce value dilution and could cause confusion and decision delay.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tThis deduplication process needed, in fact, spans much more than inventory, it affords the opportunity to consolidate orphaned patient records elsewhere in health care and the unification of customer and vendor accounts in order to have a more holistic view of the business partner.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Filling in the blanks<\/h2><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tUsing AI to auto-fill missing data seems a straightforward thing to have done, as long as it can be done without introducing unnecessarily negative results or vulnerabilities.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tMany applications are still fraught with the risk of incomplete data entry due to poor capture screens, a lack of validation and insufficient data entry rules.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tIn such circumstances, AI could potentially prepopulate and include data without the need for explicit entry or manual intervention, this could include the appending of supplementary data which could enrich or accentuate the data further for additional downstream activities like marketing segmentation.\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tUsing a combination of matching algorithms and machine learning a captured data set can go from routine master or transactional data to a rich source for more advanced analytics and decision making.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Salesforce Einstein and SAP Leonardo<\/h2><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tIncidentally,\u00a0Salesforce<\/a>\u00a0uses an AI-powered duplicate management system for automatically checking that data is \u201caccurate and devoid of duplicate entries\u201d and this feature is automatically activated in the platform \u2013 it has some limitations though and does not work well with high levels of duplicative data. Salesforce also offers the\u00a0Einstein Prediction Builder<\/a>\u00a0which is a customizable AI for Salesforce admins.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tSAP hasn\u2019t made much that I have seen, in terms of using Leonardo in the same ways as Salesforce has Einstein, it has focused on \u201cConversational AI\u201d and metadata-based (read that as structured rules) bots for what has been described as \u201cIntelligent Robotic Process Automation<\/a>\u201d services. SAP views these as being ways to accelerate and improve interactions across a broad swathe of CRM, ERP, HCM and Supply Chain applications.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tIn principle, you could have AI scrutinize sales opportunities and work out whether sales reps are either naively over-confident or withholding their opportunities and only entering them when they are very confident that they will secure a deal or when sales incentives are introduced, particularly with the intent of accelerating deal closes at quarter-end or period-close.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tI have also mentioned Microsoft Dynamics 365 in the past, and Cognitive Services. Dynamics 365 also comes with a host of built-in AI. These are largely out of the box including Relationship Insights, Lead Scoring, Cortana based Product Recommendations that push the right items to online shoppers, rather than waiting until they check out to make suggestions and Predictive Sales & Inventory Forecasting.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tIn this case, AI could smooth the pipeline and rationalize the expectations about the future of deals and forecasting.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\nResolving data issues has to be considered with a bi-modal approach in mind even if one considers AI and ML as part of the solution mix. On the one hand, one considers how to avoid real-time data entry issues through intelligent searching and matching accompanied by auto-filling and enrichment. At rest, the data suffer similar challenges. The data becomes stale, out of date or becomes contaminated or compromised as a result of a great many possible factors.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tA batched or scheduled approach needs to be considered as complementary and this too can incorporate AI and ML in how decisions are made and actions are taken. The technology has the power to execute for most use cases today, perhaps not at massive scale and perhaps in very specific and possibly narrow or as \u2018weak AI\u2019\u00a0propositions but these may just be the starting point for what Amazon’s Jeff Bezos\u00a0considers<\/a>\u00a0the AI Golden Age.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

Periodically my colleagues and I raise the topic of machine learning and artificial intelligence in the everyday application of data management and data quality and every day it seems I read something that suggests that if you are not using or considering AI or ML you may be missing out.It is often stated in the<\/p>\n","protected":false},"author":539,"featured_media":4019,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[183],"tags":[97],"ppma_author":[3199],"class_list":["post-1967","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-ml","tag-artificial-intelligence"],"authors":[{"term_id":3199,"user_id":539,"is_guest":0,"slug":"clinton-jones","display_name":"Clinton Jones","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","author_category":"","user_url":"","last_name":"Jones","first_name":"Clinton","job_title":"","description":"Clinton Jones, Group Product Manager at Experian and Principal at JonesAssociates, is internationally experienced digital and physical product manager with full stack experience."}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1967","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/539"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=1967"}],"version-history":[{"count":0,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1967\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/4019"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=1967"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=1967"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=1967"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=1967"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}