{"id":2079,"date":"2019-11-19T02:46:57","date_gmt":"2019-11-19T02:46:57","guid":{"rendered":"http:\/\/kusuaks7\/?p=1684"},"modified":"2024-02-23T13:42:31","modified_gmt":"2024-02-23T13:42:31","slug":"ai-hardware-and-the-battle-for-more-computational-power","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/ai-ml\/ai-hardware-and-the-battle-for-more-computational-power\/","title":{"rendered":"AI Hardware and the Battle for More Computational Power"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
\n

We write a lot about Artificial Intelligence and its algorithms, approaches and techniques. As a software developing company, we have a keen interest in such innovations that we can immediately put to practice in our projects. However, Artificial Intelligence is not only a smart program that works miracles; in many cases in depends on a physical device that incorporates this program. Like a robot without its body, AI software, to be productive, often needs a shell. In this post, we\u2019ll explore what AI hardware really means.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

As AI systems become more sophisticated, they demand more computation power from hardware. To address their needs, new hardware, specifically designed for AI, is supposed to accelerate training and performance of neural networks and reduce the power consumption. The traditional solution is to reduce the size of logic gates to fit more transistors, but shrinking logic gates below about 5nm can cause the chip to malfunction due to quantum tunnelling, so the challenge now is to find another way.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

What is AI hardware?<\/strong><\/h1>\n<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

First of all, what is actually AI hardware and how it differs from the general hardware we are used to. Essentially, when we talk about AI hardware, we refer to some type of AI accelerators \u2014 a class of microprocessors, or microchips, designed to enable faster processing of AI applications, especially in machine learning, neural networks and computer vision. They are usually designed as manycore and focus on low-precision arithmetic, novel dataflow architectures or in-memory computing capability.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

The idea behind AI accelerators is that a large part of AI tasks can be massively parallel. With a general purpose GPU (GPGPU<\/a>), for example, a graphics card can be used in massively parallel computing implementations, where they deliver up to 10 times the performance of CPUs.<\/p>\n

The second pillar of AI accelerators design is focused on\u00a0multicore<\/a>\u00a0implementation. Think of a GPU that can accelerate such tasks using many simple cores that are normally used to deliver pixels to a screen. These cores are designed for simpler arithmetic functions common to AI, where the number of simple functions grows so high that traditional computing approaches fail. With purpose-designed application-specific integrated circuits (ASICs<\/a>), efficiency can be even greater than that achieved with GPGPU, which can benefit edge AI tasks.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Generally speaking, a purpose-made accelerator delivers greater performance, more features and greater power efficiency to facilitate a given task.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

What are the most important new capabilities of AI hardware?<\/strong><\/h1><\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

As the need for computational resources to process the newest software soars exponentially, the industry is waiting for a new generation of AI chips that would have new capabilities:<\/p>\n

More computational power and cost-efficiency<\/em><\/strong>: next-generation AI hardware solutions will need to be both more powerful and more cost efficient\u00a0<\/strong>to meet the needs of the sophisticated training models;<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Cloud and Edge computing<\/em><\/strong>:<\/em>\u00a0new silicon architectures have to be adapted to support deep learning, neural networks and computer vision algorithms with training models in the Cloud and delivering ubiquitous AI at the Edge;<\/p>\n

Faster insights:\u00a0<\/em><\/strong>to be useful for businesses, AI solutions \u2014 both software and hardware \u2014 should provide much faster insights into customers\u2019 behavior and preferences, which can improve sales and customer satisfaction, upgrade manufacturing processes and uptime and reduce costs;<\/p>\n

New materials<\/em><\/strong>: new research is made to move from traditional silicon to do\u00a0optical computing chip<\/em>s developing optical systems that are much faster than traditional CPUs or GPUs.<\/p>\n

New architectures<\/em><\/strong>: there\u2019s also new types of architectures like neuromorphic chips \u2014 the architecture that tries to mimic brain cells. This architecture of interconnected \u201cneurons\u201d replaces von-Neumann\u2019s back-and-forth bottleneck with low-powered signals that go directly between neurons for more efficient computation. If you\u2019re trying to train neural networks at the edge or in the cloud, such architectures will have a huge advantage.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

How to choose your AI hardware provider<\/strong><\/h1><\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Before making purchases on AI hardware, businesses should, of course, understand how different types of hardware suit different needs. Nowadays with the shift towards purpose-make chips you don\u2019t want to spend a ton of money on specialized hardware that you don\u2019t need.<\/p>\n

The first step to choosing AI hardware is to map out how improvements in interaction with customers or suppliers could affect business processes. Afterwards, it is possible to look for software solutions that can support these changes and the corresponding hardware.<\/p>\n

Deciding on a general-purpose chips like GPUs, more specialized solutions, like TPU or VPUs or looking for more innovative designs offered by promising startups depends on the AI tasks a business needs.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

Top 5 AI hardware solutions<\/strong><\/h1>\n<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tunits (GPUs) are the dominant AI hardware architecture, that is far from the truth. Over the past several years, startups and established chip vendors have introduced an impressive new generation of hardware architectures optimized for AI workloads.<\/p>\n

The most popular current hardware solutions for AI acceleration include the following:<\/p>\n

Tensor Processing Unit<\/a>\u00a0is an AI accelerator application-specific integrated circuit (ASIC) developed by\u00a0Google<\/strong>\u00a0specifically for neural network machine learning which features a\u00a0cloud solution<\/a>.<\/p>\n

Nervana\u00a0<\/a>Neural Network Processor-I 1000 is a discrete accelerator produced by\u00a0Intel<\/strong>\u00a0that is designed specifically for the growing complexity and scale of inference application.<\/p>\n

EyeQ<\/a>\u00a0is of a family of system-on-chip (SoC) devices that are designed by\u00a0Mobileye<\/strong>\u00a0to support complex and computationally intense vision processing, maintaining low power consumption even while located on the windshield.<\/p>\n

Epiphany V<\/a>\u00a0is a 1,024-core processor chip by\u00a0Adapteva<\/strong>\u00a0aimed at real-time image processing, autonomous driving, and machine learning.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Myriad 2<\/a>\u00a0is a vision processor unit (VPU) system-on-a-chip (SoC) by\u00a0Movidus<\/strong>\u00a0comprises a set of programmable processors and a set of dedicated and configurable image and vision accelerators to power computational cameras.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

More Promising Startups<\/strong><\/h1>\n<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Besides from established semiconductor companies, there are a number of well-funded startups that work on purpose-specific chips or try to develop new architectures to build a supercomputer:<\/p>\n

Graphcore<\/strong><\/a>\u00a0is a semiconductor company that develops Intelligent Processing Units (IPUs) that holds the complete machine learning model inside the processor. The IPU is designed to work on the complex high-dimensional models, as it emphasizes massively parallel, low-precision floating-point compute and provides high compute density.<\/p>\n

Wave Computing<\/strong><\/a>\u00a0<\/strong>is developing the Wave Dataflow Processing Unit (DPU), employing a disruptive, massively parallel dataflow architecture. When introduced, Wave\u2019s DPU-based solution is claimed to be the world\u2019s fastest and most energy efficient deep learning computer family.<\/p>\n

Luminous Computing<\/strong><\/a>\u00a0<\/strong>is developing a supercomputer for AI on a single chip that will replace 3000 TPU boards. The company\u2019s idea is to use photonics to solve all of the major bottlenecks traditional processors have to overcome.<\/p>\n

Mythic<\/strong><\/a>\u00a0<\/strong>develops its version of IPUs going beyond conventional digital architectures, memory, and calculation elements \u2014 rethinking everything: transistors and physics, circuits and systems, and software and AI algorithms.<\/p>\n

Prophesee<\/strong><\/a>\u00a0<\/strong>stands a bit apart of chip producers as it focuses on innovative computer vision sensors and systems for applications in all fields of artificial vision. The sensor technology is inspired by biological eyes, acquiring and processing the visual information in a performing and efficient way.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
\n

Despite the rapidly evolving market of AI hardware, of the three key parts of hardware infrastructure \u2014 computing, storage, and networking \u2014 it is computing that has been the focus and has made significant progress in the last couple of years. The industry is going with the fastest available option and promoting that as a solution for deep learning. The other two areas, storage and networking, are still to be seen in the near future.<\/p>\n\n<\/section>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

Despite the rapidly evolving market of AI hardware, of the three key parts of hardware infrastructure – computing, storage, and networking –  it is computing that has been the focus and has made significant progress in the last couple of years. The industry is going with the fastest available option and promoting that as a solution for deep learning. The other two areas, storage and networking, are still to be seen in the near future.<\/p>\n","protected":false},"author":570,"featured_media":2789,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[183],"tags":[97],"ppma_author":[3261],"class_list":["post-2079","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-ml","tag-artificial-intelligence"],"authors":[{"term_id":3261,"user_id":570,"is_guest":0,"slug":"max-ved","display_name":"Max Ved","avatar_url":"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/04\/medium_cbaf23d5-a78a-4ceb-8f6e-343134811364-150x150.jpg","user_url":"https:\/\/sciforce.solutions\/","last_name":"Ved","first_name":"Max","job_title":"","description":"Max Ved, a Scientist Entrepreneur, is Co-Founder & CTO at SciForce, an IT company specialized in the development of software solutions.\u00a0"}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/2079","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/570"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=2079"}],"version-history":[{"count":5,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/2079\/revisions"}],"predecessor-version":[{"id":36125,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/2079\/revisions\/36125"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/2789"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=2079"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=2079"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=2079"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=2079"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}