{"id":1641,"date":"2019-04-18T02:13:58","date_gmt":"2019-04-18T02:13:58","guid":{"rendered":"http:\/\/kusuaks7\/?p=1246"},"modified":"2023-07-10T13:22:25","modified_gmt":"2023-07-10T13:22:25","slug":"four-continuous-testing-challenges-organizations-must-address","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/bigdata-cloud\/four-continuous-testing-challenges-organizations-must-address\/","title":{"rendered":"Four continuous testing challenges organizations must address"},"content":{"rendered":"<h3 style=\"color: #aaa; font-style: italic;\">As devops teams embrace continuous testing to assure quality, they encounter new challenges on their road to success<\/h3>\n<p>How much time do you spend on your cell phone in a single day? According to one set of research, it\u2019s more than five hours. From making calls to using things like banking and health care\u00a0apps, today there is an app for just about everything. In today\u2019s world, our lives very much revolve around digital technologies.<\/p>\n<p>But what would happen if the apps that help run our lives and keep our businesses on track suddenly stopped working? Think of it this way: You wouldn\u2019t have easy access to things that affect your daily life, like your checking account or health-monitoring systems.\u00a0From a business perspective, processes would be delayed, and tasks would take longer to complete.<\/p>\n<p>That\u2019s why it is more important now than ever before for developers to assure continuous quality throughout the entire software development life cycle (SDLC). And it all starts with testing.<\/p>\n<p>Once considered a bottleneck holding up different activities throughout the devops process, continuous testing (CT) is becoming a staple of the SDLC. Organizations can use these techniques in a variety of ways such as identifying, reacting and responding to bugs in real-time. Automation is helping to drive these implementations but not all tests are automated. In fact, according to a 2017 report from Sogeti, only 16 percent of test activities are automated.<\/p>\n<p>While automation is a key factor to\u00a0making continuous testing a reality, there are hurdles that dev teams need to overcome. Let\u2019s look at the top four challenges organizations must address and how you can tackle them to assure rapid release turnarounds that are glitch-free.<\/p>\n<h3><strong>1. Moving both faster and smarter<\/strong><\/h3>\n<p>In today\u2019s digital age, app developers are expected to move both faster and smarter. A good example is the iOS 11 release back in September 2017. Within its first few months of general availability, iOS 11 underwent multiple iterations and updates. With every new release, app developers had to ensure their apps would still work. This proved to be challenging as app developers often find it difficult to automate new tests within existing cycles. As a result, they are held back from continued maintenance and continued innovation.<\/p>\n<p>As consumers\u2019 expectations continue to rise, more platforms will be introduced and new technologies like internet of things (IoT) devices and wearables will take center stage. Release cycles will also only continue to accelerate. To help overcome these obstacles, app developers should look to adopt acceptance test-driven development (ATDD) and behavior-driven development (BDD) practices, which drives the test automation code prior to the code itself.\u00a0In addition, adopting faster test execution frameworks like Espresso and XCUITest for mobile, or headless browsers frameworks like Puppeteer and PhantomJS for web, accelerate setup time, and test execution speed.<\/p>\n<h3><strong>2. Devops teams aren\u2019t on the same page when it comes to test automation<\/strong><\/h3>\n<p>Across devops teams, there unfortunately is a stigma of \u201cit\u2019s not my problem\u201d when it comes to test data. Explained further, most believe that it\u2019s the test data team\u2019s job to provide all the data and insight. However, as\u00a0devops continues to evolve\u00a0within agile organizations, these silos are starting to disappear.<\/p>\n<p>To implement a testing automation team that keeps the engine running, strong discipline is needed throughout the SDLC.<\/p>\n<p>The first step is ensuring all teams agree when it comes to the process you choose, whether it\u2019s BDD, ATDD, or agile. In addition, perhaps most important, leave shadow continuous integration (CI) processes in the past to ensure teams have access to a single view of the quality per code commit. Finally, keep in mind that each department has a different persona and set of needs. Because of this, it is important to provide them with the tools that best match their skill set, while still integrating with the overall CI and continuous development (CD) stack.<\/p>\n<h3><strong>3. There is too much data to act on<\/strong><\/h3>\n<p>The good news is that today, we find that tests are primarily doing what they\u2019re meant to\u2014generating new data and insights. However, the influx of information is making it nearly impossible for teams to act upon the new data and insights that are being generated. Lack of intelligence is partly to blame here however we do find that most organizations struggling to determine the best way to\u00a0<a href=\"https:\/\/appdevelopermagazine.com\/5654\/2017\/11\/10\/let-the-machines-do-the-work\/\" rel=\"noopener\">implement machine learning<\/a>\u00a0and artificial intelligence throughout the entire devops life cycle.<\/p>\n<p>To start, focus on test analytics, leveraging current in-house tools to determine test suite efficiency and platform usage.\u00a0This provides insights such as which tests are detecting the most bugs and which tests are constantly failing. It can also stabilize overall CT activities and reduce the overhead associated with \u201ccleaning the noise\u201d per each cycle. From a platform usage perspective,\u00a0organizations that use such data should look to optimize their test labs for maximum platform utilization by revealing shortage in platforms per cycle, or unused platforms per cycle. In addition, matching platform usage throughout the testing cycle to test data that shows pass\/fail results can point teams to focus their testing efforts on the most error-prone platforms. Prioritizing platforms saves time and stabilizes product quality.<\/p>\n<h3><strong>4. Lack of clarity makes open source a time suck<\/strong><\/h3>\n<p>Although open source tools are still a relatively new concept throughout the industry, they are becoming an important element of the dev team\u2019s stack. Most organizations are however struggling to maximize productivity with them mainly because they are limited in their abilities. For example, they are unable to\u00a0support\u00a0advanced features. They also produce detailed reports and optimize intelligently, making it difficult to enhance debugging capabilities or\u00a0scale test automation itself.\u00a0What\u2019s more, in the case of mobile specifically, open source frameworks just can\u2019t keep up.<\/p>\n<p>Instead of using open source tools individually, teams should look to start combining them with commercial tools. Using the right open source test automation framework in conjunction with an enterprise commercial tool provider makes it easier to execute automation at scale &#8211; especially in the cloud.<\/p>\n<p>At the end of the day, no organization wants their application to fail, and ultimately, let customers down. To achieve continuous quality and keep customers coming back for more, implementing CT throughout the entire SDLC will not only achieve continuous quality and keep customers coming back for more, it will also ensure teams catch all bugs in real time. This enables teams to speed up the process in which they can patch holes and return to business as usual.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What would happen if the apps that help run our lives and keep our businesses on track suddenly stopped working? You wouldn&rsquo;t have easy access to things that affect your daily life, like your checking account or health-monitoring systems.&nbsp;From a business perspective, processes would delay, and tasks would take longer to complete. That&rsquo;s why it is more important now than ever before for developers to assure continuous quality throughout the entire software development life cycle (SDLC). And it all starts with testing.<\/p>\n","protected":false},"author":494,"featured_media":2507,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[187],"tags":[95],"ppma_author":[3126],"class_list":["post-1641","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-bigdata-cloud","tag-big-data-amp-technology"],"authors":[{"term_id":3126,"user_id":494,"is_guest":0,"slug":"eran-kinsbruner","display_name":"Eran Kinsbruner","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","user_url":"","last_name":"Kinsbruner","first_name":"Eran","job_title":"","description":"Eran Kinsbruner&nbsp;is the lead&nbsp;Technical Evangelist at&nbsp;<a href=\"https:\/\/www.perfectomobile.com\/\" target=\"_blank\" title=\"Perfecto\" rel=\"noopener\">Perfecto<\/a>, the leading cloud-based web, and mobile quality lab. A monthly columnist at&nbsp;<a href=\"https:\/\/www.infoworld.com\/author\/Eran-Kinsbruner\/\">InfoWorld.Com<\/a>, he is the author of the&nbsp;<a href=\"https:\/\/www.amazon.com\/dp\/0692885994\/ref=sr_1_1?ie=UTF8&amp;qid=1493727687&amp;sr=8-1&amp;keywords=eran+kinsbruner\">Digital Quality Handbook<\/a>, and Continuous Testing for DevOps Professionals and the creator and author of the quarterly Digital Test Coverage&nbsp;<a href=\"https:\/\/info.perfectomobile.com\/factors-magazine.html\">factors<\/a>&nbsp;magazine, and co-inventor of the&nbsp;<a href=\"https:\/\/www.google.com\/patents\/US6980916\">test exclusion automated mechanism<\/a>&nbsp;for mobile J2ME testing at Sun Microsystems. He is also a public speaker, researcher, and blogger."}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1641","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/494"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=1641"}],"version-history":[{"count":2,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1641\/revisions"}],"predecessor-version":[{"id":29101,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1641\/revisions\/29101"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/2507"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=1641"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=1641"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=1641"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=1641"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}