{"id":469,"date":"2015-08-28T07:28:43","date_gmt":"2015-08-28T04:28:43","guid":{"rendered":"http:\/\/kusuaks7\/?p=74"},"modified":"2025-02-27T12:28:52","modified_gmt":"2025-02-27T12:28:52","slug":"hps-data-lake-meets-hadoop","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/bigdata-cloud\/hps-data-lake-meets-hadoop\/","title":{"rendered":"HP’s Data Lake Meets Hadoop"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tLarge enterprises usually have fragmented data deposits in department-centric silos or customer service systems. When cross-functional data are required for advanced analytics or for concurrent storage, the enterprise big data systems fail to deliver as they are not well integrated. A solution to that problem has been addressed by recent Apache Hadoop technology, where silo stored data are continuously moved to a central Hadoop system with a multi-server scenario for storing terabytes or petabytes of business data. Additionally, any MapR distribution with Hadoop can greatly enhance the data processing power of a wide variety of data types at high speed. In other words, Hadoop with MapR implementation truly characterizes the big data environment of volume, velocity, variety, and veracity.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

For some years now, HP has been facing steep competition from hardware vendors, and while contemplating more efficient methods for big data analytics across their six data centers, or for enhanced customers experiences, they visualized the concept of a data lake to integrate all the data funnels from different silos into a single repository for advanced analytics. HP’s basic mission behind redesigning their enterprise data management included providing integrated big data analytics across the enterprise network, and enhancing the consumer engagement experience for increasing sales.<\/span> HP’s choice of a suitable Hadoop vendor was narrowed down to MapR because they found this was the only Hadoop distribution that offered scalability, low downtime, high maintenance, and knowledgeable customer support. Keith Dornbusch, Manager of HP’s Big Data Services points out<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

The MapR technology was top-notch, particularly their performance and high availability features. Plus, our working relationship with the vendor was excellent. MapR’s responsiveness, service, and support, were second to none. And MapR addresses our long-term needs by being a reli\u00adable Hadoop distribution geared towards the enterprise.<\/p><\/blockquote>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

\u00a0<\/strong>\n

Hadoop with MapR implementation at HP<\/strong><\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

The enterprise data management architecture has been built around the concept of a data lake, which is nothing but a single, centralized platform to store data derived from different customer touch points or internal departments. Paul Westerman, Senior Director of IT Big Data Solutions at HP, says, The real value is break\u00ading down silos and bringing the data together. With Hadoop, you can drop files in and the data is there. It’s a different type of development environment. The HP Hadoop clusters are distributed over 320 servers with Dual Intel processors. The servers are capable of storing about 20 terabytes of data, while the processors provide 128 gigabytes of SD RM making the environment ideal for big data storage and processing.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

\u00a0<\/strong>\n

The benefits of HP's Hadoop environment <\/strong><\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tFlexible file formats<\/strong> MapR ensures data of any type can be moved from silos to Hadoop for quick processing.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Scalability<\/strong><\/h4><\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tWith data growing at the rate of 50% every year, HP is well positioned to scale up their data storage due to Hadoop.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Zero downtime\u00a0<\/strong><\/h4><\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tBuilt-in disaster recovery thresholds and fail-over between clusters ensure high up time.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Cost benefits\u00a0<\/strong><\/h4><\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tHadoop provides massive data storage at low cost; and MapR ensures quick processing, which again saves cost.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Monitoring customer activity through telemetry data<\/strong><\/h4><\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tThis machine-generated data can monitor customer experience with products and send back feedback to HP.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

Large enterprises usually have fragmented data deposits in department-centric silos or customer service systems. When cross-functional data are required<\/p>\n","protected":false},"author":11,"featured_media":2669,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[187],"tags":[143,144],"ppma_author":[1606],"class_list":["post-469","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-bigdata-cloud","tag-hadoop","tag-nosql-amp-newsql"],"authors":[{"term_id":1606,"user_id":11,"is_guest":0,"slug":"cameron-turner","display_name":"Cameron Turner","avatar_url":{"url":"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2024\/09\/cameron.jpeg","url2x":"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2024\/09\/cameron.jpeg"},"user_url":"","last_name":"Turner","first_name":"Cameron","job_title":"","description":""}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/469","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=469"}],"version-history":[{"count":5,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/469\/revisions"}],"predecessor-version":[{"id":37343,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/469\/revisions\/37343"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/2669"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=469"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=469"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=469"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=469"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}