{"id":22592,"date":"2021-01-29T10:11:26","date_gmt":"2021-01-29T10:11:26","guid":{"rendered":"https:\/\/www.experfy.com\/blog\/evolution-enterprise-knowledge-graphs-cns\/"},"modified":"2023-09-05T12:10:22","modified_gmt":"2023-09-05T12:10:22","slug":"evolution-enterprise-knowledge-graphs-cns","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/ai-ml\/evolution-enterprise-knowledge-graphs-cns\/","title":{"rendered":"The Evolution of Enterprise Knowledge Graphs and the CNS"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

This blog will speculate on how enterprise knowledge graphs (EKGs) will evolve to contain specialized functions and specialized subgraphs. We will use metaphors from the evolution of centralized nervous systems (CNS) in primitive life forms to make some key points about architectural trade-off analysis.<\/p>\n\n

If EKGs are really going to become the centralized \u201cBrain\u201d of organizations, they will need to evolve from where they are today to take on new roles. We also need to understand the challenges of depending on central control of organizations.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

EKG and CNS Metaphor: Sponges, Octopuses, and the Human Brain<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

We will be using the metaphor of the CNS in organisms to discuss how EKGs are evolving. This requires us to look at the spectrum of different ways that organisms have evolved different types of nervous systems and how important these are at adapting to new environments.<\/p>\n\n

Let\u2019s begin with the sponge<\/strong>. It has no real central nervous system. There is no cell-type specialization<\/strong> of neurons in sponges that exchange information using electrochemical signals. Sponges have homogeneous<\/strong> cells that communicate using chemical signals, but they are slow and evenly distributed throughout the sponge’s body.<\/p>\n\n

This decentralized design has some advantages. You can cut a sponge in half, and both parts can survive. Simple designs are easier to maintain and have fewer single points of failure.<\/p>\n\n

When we think of the \u201csponge information architecture,\u201d we can imagine many small departmental subgraphs, databases, and spreadsheets that are disconnected. They are all small islands of \u201ccells\u201d of information in an enterprise, and they don\u2019t communicate in real-time. However, you can often do a reorganization of your company by and sell business units, and it will continue to function without impacting the individual team performance.<\/p>\n\n

Next, consider the\u00a0octopuses<\/strong>. Although octopuses have neurons and a centralized brain, over half the neurons are also\u00a0distributed in each of the\u00a0<\/a>octopus’ limbs. Octopuses do general planning for movement in their central brain, but they allow the details of complex limb motion to be done within the neurons of each limb itself.<\/p>\n\n

An \u201coctopus information architecture\u201d has some centralized role for an EKG, but it does not perform the detailed predictive business planning within each business unit. Technically we call this a semi-centralized<\/strong> EKG architecture. The EKG will still have specialized subgraphs, but they need to be designed to send abstract concepts to departmental graphs where the execution details are done.<\/p>\n\n

Finally, consider the human brain. Our brains have highly centralized nervous systems, and both large-scale body movement planning and fine motion control are all performed within the skull. Our eyes process images and send the data to our visual cortex, and separate brain areas coordinate predictive motion with our limbs. However, we don\u2019t delegate motion planning into neurons within our limbs. We do have many highly specialized regions of our brain for doing different functions.<\/p>\n\n

Human brains display both low-level homogeneous cell types (Neurons) but high-level diversity of the connection patterns within the brain’s thousands of subregions.<\/p>\n\n

I believe that different organizations will also evolve different styles of EKGs based on their environments. And just like the ways that different types of CNS have evolved, in the same way, different types of EKGs will also evolve to meet the needs of different types of organizations. EKG will also follow similar evolutionary paths as CNS evolution. They will start simple and slowly evolve more complex and specialized structures. I also believe that large organizations with centralized EKGs will come to dominate companies just like humans have come to dominate life on planet Earth.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

Complexity Has a Cost<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Complexity always comes with some cost. Many examples of plants and animals in the living world today have kept their organization simple. Because of this simplicity, they thrived. Datastores like key-value stores are good examples of keeping the data stores and their interfaces simple to become easier to scale-out. Unfortunately, this simplicity also prevents us from efficiently doing complex queries on key-value stores.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

Evolutionary Progress in Non-Linear<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\"The\t\t\t\t\t\t\t\t\t\t\t
Evolution does not usually occur along a straight line. It comes in waves that are triggered by key alignments of features. What are the key features that are causing EKGs to expand in diversity quickly? Artwork by the author.<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Most people know about the concept of the\u00a0Cambrian Explosion<\/a>. The Cambrian Explosion occurred around 541 million years ago when ocean lifeforms were primitive \u2014 much like sponges. Before the Cambrian Explosion life forms were relatively simple and didn\u2019t change quickly over time. After the Cambrian Explosion, we had both rapid evolution and huge growth in the diversity of animals.<\/p>\n\n

The Cambrian Explosion is an example of a\u00a0non-linear<\/a>\u00a0evolutionary system. If we plotted the number of different types of animals over time, it would not fit a straight line. So do most systems that evolve behave like\u00a0Complex Systems<\/a>. EKGs will also follow many of the complex systems’ rules and show nonlinear growth patterns triggered by key events such as the GQL standard and the arrival of graph hardware.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

Early Life Forms and the Evolution of the Central Nervous System<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

But how did the\u00a0Central Nervous System<\/a>\u00a0evolve? Why is the growth non-linear?<\/p>\n\n

Unlike plants that wait for food to come to them, some early life forms were more mobile. They moved to where the food was, and later, they also needed to learn to catch prey and move away from predators. So to catch its prey or to evade its predators, they needed muscles.<\/p>\n\n

Unlike sponges that were stationary, jellyfish move around. Jellyfish animals have distributed\u00a0Nerve Net<\/a>s throughout their body. They don\u2019t show any signs of centralized nervous systems yet. The key evolutionary step in the evolution of centralized nervous systems was the\u00a0Cephalization<\/a>\u00a0of the body plan. This process organized body parts around a bilateral body plan.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\"The\t\t\t\t\t\t\t\t\t\t\t
The idealized bilateral body plan is a cylinder with circular and longitudinal muscles arranged around a central gut. Sense organs were placed at the head end near the mouth of the gut. Source: Wikipedia Commons.<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Once the basic body plan around a gut evolved, specialized tissues that expanded and contracted became muscles. Sense organs appeared around the mouth of the gut. And now the question arose \u2014 how do we coordinate senses with muscles? Should this coordination be distributed or centralized?<\/p>\n\n

Jellyfish took the decentralized route. They kept their body plans simple and put sense organs at the tips or edges of their body plans, and they never evolved a gut and bilateral symmetry.<\/p>\n\n

But\u00a0Bilateria<\/a>\u00a0took a different route. They took a specific body architecture and found that a centralized nervous system could coordinate senses and muscles.<\/p>\n\n

Today it seems evident that the distributed native labeled property graph is the equivalent of the bilateral body plan. It has all the key architectural features we need to build a scalable and sustainable EKG. There will still be niche environments for other graph database architectures. But we now have an architecture that will trigger a \u201cCambrian Explosion\u201d in graph databases that will power future EKGs.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

The Evolution of Best Practices<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\"The\t\t\t\t\t\t\t\t\t\t\t
Once the basic body plan has evolved, a set of best practices can be built on that body plan. Here is an example of the\u00a0coelomate<\/a>\u00a0body plan that has more complex structures around the central gut. Source: Wikipedia commons.<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Diverse Environments Accelerate Evolution<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Imagine that the entire planet earth was a uniform shallow ocean. There was no variation in the depth of the ocean and no landmasses. If this were the case, we would not see the same diversity of life forms today. Because the earth provides non-uniform ecological landscapes, we get much more diversity of life forms.<\/p>\n\n

The same will be true of the evolution of EKGs. Organizations are not homogeneous. They serve different industries and different types of customers with a wide variety of products and services. Because of this diversity, we should expect to see EKGs diversify in some of their architectures.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

Software Homogeneity Allows for Hardware Optimization<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Now here is an oppositional thought to the diversity observation. If there are thousands of different databases, no vendor would sink a billion dollars into optimizing silicon hardware for one architecture. But the evolution of distributed native labeled property graphs (DNLPGs) has put a sharp focus on one single architecture \u2014 the use of pointer hoping to traverse relationships. Since almost all modern enterprise knowledge graphs use NLPGs we are starting to see hardware optimized for these databases.<\/p>\n\n

That means that any other database that does not leverage DNLPGs will see a 1,000x disadvantage in performance. That means that evolutionary forces will force these non-DNLPG systems to focus on other areas than performance. If they don\u2019t the laws of survival of the fittest will eliminate them from the database marketplace.<\/p>\n\n

Yes, these rules are somewhat contradictory. But we need to keep them both in our minds as we try to visualize how EKGs will evolve.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

Specialized Brain Regions<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

One of the most incredible things in the universe is how brains have taken a single structure, the neuron, and have used that same structure to build an incredible variety of more complex structures within brains. Human brains have\u00a0thousands of different regions<\/a>\u00a0that have developed specialization over more than 500 million years of evolution. We can expect EKGs to develop highly specialized regions but still use a common structure: vertices and edges with attributes. Here are just a few specialized subgraphs that might develop:<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
  1. Geolocation<\/strong> \u2014 information about places such as addresses, cities, states, and regions.<\/li>
  2. Access Control <\/strong>(security) \u2014 associates a user with their roles and permissions.<\/li>
  3. Customer Knowledge<\/strong> \u2014 all customer touchpoints including web visits, e-mails, purchases, returns, and product reviews.<\/li>
  4. Product Knowledge<\/strong> \u2014 detailed knowledge about products, specifications, warranties, product taxonomies, similar products, and competitor products.<\/li>
  5. General Language Knowledge<\/strong> \u2014 structures that describe words, word meanings, synonyms, acronyms, abbreviations, related words, and definitions.<\/li>
  6. Business Terminology<\/strong> \u2014 Terms that are specific to your organization and industry. May contain specialized definitions for common words within your field.<\/li>
  7. Data Conversion Knowledge<\/strong> \u2014 How raw data is converted into connected knowledge. Include rules for schema matching, schema mapping, data format conversion, and data quality checks.<\/li>
  8. Data Linage Knowledge<\/strong>-How did data arrive in the EKG? Where did it come from and how was it transformed. How recent and how relevant is the data to a specific task?<\/li>
  9. Business Rule Knowledg<\/strong>e \u2014 How are deterministic business rules stored and executed in the EKG? How do people view and update the rules? What are the downstream consequences of a high-level rule is changed?<\/li>
  10. Reporting Knowledge<\/strong>-How are reports created. Where did the data come from? How often are the reports run and by what agents? What is the cost of running the reports? Who created and maintains the reports? What are the most similar reports to any given report?<\/li>
  11. Causality Knowledge<\/strong> \u2014 What is the cause of various business events? Can we explain the root causes of problems with our customer experience? Can see simulate choices to predict future costs?<\/li><\/ol>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
    \n\t\t\t\t
    \n\t\t\t\t\t

    Brains and Skulls: Protecting Your EKG<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
    \n\t\t\t\t
    \n\t\t\t\t\t\t\t\t\t

    As centralized nervous systems became more complex they started to become a single point of failure for animals. A blow to an unprotected brain could quickly render an animal unconscious and vulnerable to predators.<\/p>\n\n

    If an octopus loses part of its decentralized brain in one of its limbs it can still survive and even grown a new limb. Similarly, a departmental data mart can crash and not impact your customer experience.<\/p>\n\n

    So how to protect a central resource where our customer experience depends on it being available 7×24? How do we build a \u201cskull\u201d around our EKG to make sure it has high availability? Using a distributed graph database that has a high level of replication is one solution. But protecting your EKG from rough queries is also critical.<\/p>\n\n

    Several years ago, a friend of mine was involved in a project to make it easier to query low-level data in a Data Lake using a new open-source query program. The problem was that the software did not have any ability to limit resources such as CPU time, memory, or IO for any query. As a result, a small error in a query would make the entire Data Lake unusable until the query finished or every node in the cluster was rebooted. Needless to say, the project was halted even after considerable investment. The core attributes of fine-grain enterprise-class control of resources had not yet evolved.<\/p>\n\n

    In summary, EKGs need not just fine-grain access controls, but they also need internal controls to protect real-time services from disruption.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

    \n\t\t\t\t
    \n\t\t\t\t\t

    Conclusion: Let the EKG Explosion Begin<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
    \n\t\t\t\t
    \n\t\t\t\t\t\t\t\t\t

    We are now at the stage that several powerful forces are at work to create an explosion in different types of EKGs:<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

    \n\t\t\t\t
    \n\t\t\t\t\t\t\t\t\t
    1. A standardized data model <\/strong>\u2014 the Labeled Property Graph (LPG)<\/li>
    2. A scale-out architecture<\/strong> \u2014 Distributed Native LPGs<\/li>
    3. A standard query language<\/strong> -Graph Query Language (GQL)<\/li>
    4. Hardware<\/strong> optimized for the pointer hopping and random access patterns of distributed native LPGs<\/li>
    5. Software<\/strong> that supports enterprise concerns (HA, Security, etc.)<\/li>
    6. Integration of graph-machine learning<\/strong> software to automatically predict future events and make recommendations<\/li><\/ol>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
      \n\t\t\t\t
      \n\t\t\t\t\t\t\t\t\t

      As a result, I expect that in a few years, we will see EKGs that are as diverse as the animal types at the end of the Cambrian Explosion. We will also see a decline in older more primitive relational architectures as EKGs evolve more sophisticated features.<\/p>\n\n

      Note that relational databases and spreadsheets will not go away. We still have sponges in the world because their simple designs have benefits. But sponges don\u2019t dominate our planet. Organizations that embrace EKGs’ diversity and complexity are destined to control far more resources than those that stick with simple designs.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

      This blog will speculate on how enterprise knowledge graphs (EKGs) will evolve to contain specialized functions and specialized subgraphs.<\/p>\n","protected":false},"author":993,"featured_media":18575,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[183],"tags":[1297,1298,1223,92],"ppma_author":[3677],"class_list":["post-22592","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-ml","tag-ekg","tag-evolution","tag-knowledge-graphs","tag-machine-learning"],"authors":[{"term_id":3677,"user_id":993,"is_guest":0,"slug":"dan-mccreary","display_name":"Dan McCreary","avatar_url":"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/Dan-McCreary.jpeg","user_url":"https:\/\/www.optum.com\/","last_name":"McCreary","first_name":"Dan","job_title":"","description":"Dan McCreary is a distinguished Engineer in AI and Graph at Optum, a health services and innovation company. He is the co-author of the highly rated book \"Making Sense of NoSQL\" and co-founder of the \"NoSQL Now!\" conference."}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/22592","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/993"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=22592"}],"version-history":[{"count":4,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/22592\/revisions"}],"predecessor-version":[{"id":32352,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/22592\/revisions\/32352"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/18575"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=22592"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=22592"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=22592"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=22592"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}