Using Agile Processes to Develop AI-Based Solutions

Irving Wladawsky-Berger Irving Wladawsky-Berger
September 6, 2019 AI & Machine Learning
In the waterfall development model, a project is broken down into a set of sequential phases, – e.g., conception, analysis, design, construction, testing, deployment, maintenance, – each dependent on the completion of the previous phase.  Such a model is most appropriate for complex engineering projects, like bridges, airplanes, and computer hardware.  It’s also quite applicable for mission critical software and infrastructure projects where security, availability, scalability and other ilities are paramount.
But, a serial, orderly approach isn’t appropriate for projects where time-to-market, usability, and flexibility are the highest priorities.  For such projects, an agile development approach is much more suitable.  Key to the agile approach is the involvement of the product’s target end-users early in the process to make sure that the product under development is responsive to their requirements.
Agile development is evolutionary in nature, based on the early availability of experimental prototypes, user feedback, continuous improvements, and rapid responses to technology, market, and user requirements.  It’s not surprising that agile software development took off in the 1990s, when the explosive rise of the Internet brought millions and millions of users online, lots of new user-oriented applications, and short time-to-market cycles in response to fierce competition.
Our increasingly sophisticated smart machines bring with them a whole new set of development challenges.  These AI-based systems are generally software-intensive, user-centric, and data-driven.  Their complexity goes way up the smarter we want the systems to be.  The behavior of an AI system based on machine learning depends on the information we use to train its algorithms rather than on the precise set of software instructions that tell the computer what to do.
AI systems are designed to sense, respond and adapt to a changing environment.  Their development feels sort of like bringing up and sending a teen-ager into the world.  Given that we want them to be able to handle unanticipated situations, they must have a fair degree of flexibility and autonomy.  But, it’s hard to be sure that the system (or the teen-ager) will always behave the way we’d like them to.
In June, Adobe announced Technology Previews, an agile development approach for building AI-powered solutions.  According to Adobe, agile development is particularly well suited to AI-based products and systems, where it’s important to involve users early in the development cycle to help test, refine and improve the AI features in the product by sharing their real-time feedback with the development teams.
In June, Adobe announced Technology Previews, an agile development approach for building AI-powered solutions.  According to Adobe, agile development is particularly well suited to AI-based products and systems, where it’s important to involve users early in the development cycle to help test, refine and improve the AI features in the product by sharing their real-time feedback with the development teams.
By engaging directly with users, Technology Previews lets Adobe researchers quickly validate the quality and value of a new idea before committing development investments.  First, the researchers create a test-bed prototype of the new AI features in Adobe’s cloud.  Each user participating in the evaluation then logs into the prototype, agrees to a Non-Disclosure Agreement and is shown a tutorial of the product and it new features.  Once ready, the users start interacting with the prototype.
The AI-based prototype works with and is trained by each user’s own production data,  so each user may well have a different experience.  Once done interacting with the prototype, the users provide specific feedback on feature value and ease of use, answering questions such as: did the prototype meet your expectations?; was it easy to understand and use?; and, would you like this feature incorporate in a future version of the product?  Based on the overall users’ feedback, Adobe’s development teams are better able to decide whether the new feature should be incorporated into the product’s roadmap, and if so, what priority it should be given relative to other features in the development queue.
“In legacy applications, testing is focused on logic and feature operation, both of which are quite finite,” noted John Bates, Adobe’s Director of Product Management.  “However, with AI-powered applications, the testing process must fundamentally change.  Optimizing algorithms requires that they be tested by many users to ensure they work across many different scenarios… The development process for next-generation AI- or machine learning-enhanced software had to evolve to include the ability to test and gather input in a manner that would consistently deliver outstanding solutions.  We have moved from the waterfall process into agile processes.  With Technology Previews, we can now use agile processes for AI-powered solutions.”

Initially, Technology Previews will be used to <a href=”https://news.adobe.com/press-release/experience-cloud/adobe-unveils-ai-powered-technology-previews-adobe-experience-cloud”>evaluate solutions</a> based on three kinds of AI features: helping brands understand how their customers interact with their product as they move across screens by surfacing insights that may not be clear with the naked eye; identifying the ideal audience for a company’s product by leveraging machine learning to automatically cluster customers into groups based upon expected preferences and behaviors; and accelerating a brand’s ability to predict a customer’s future needs and wants using deep learning capabilities.

Technology Previews is a win-win, said Bates.  Customers get early access to the latest technologies while Adobe benefits from their feedback. “We help our users have more influence and become a virtual product manager.  We can see where are we going to further innovate and further invest for future solutions. It all depends on the feedback of our users.”
  • Experfy Insights

    Top articles, research, podcasts, webinars and more delivered to you monthly.

  • Irving Wladawsky-Berger

    Tags
    Artificial Intelligence
    © 2021, Experfy Inc. All rights reserved.
    Leave a Comment
    Next Post
    Design for DevOps – Best Practices

    Design for DevOps – Best Practices

    Leave a Reply Cancel reply

    Your email address will not be published. Required fields are marked *

    More in AI & Machine Learning
    AI & Machine Learning,Future of Work
    AI’s Role in the Future of Work

    Artificial intelligence is shaping the future of work around the world in virtually every field. The role AI will play in employment in the years ahead is dynamic and collaborative. Rather than eliminating jobs altogether, AI will augment the capabilities and resources of employees and businesses, allowing them to do more with less. In more

    5 MINUTES READ Continue Reading »
    AI & Machine Learning
    How Can AI Help Improve Legal Services Delivery?

    Everybody is discussing Artificial Intelligence (AI) and machine learning, and some legal professionals are already leveraging these technological capabilities.  AI is not the future expectation; it is the present reality.  Aside from law, AI is widely used in various fields such as transportation and manufacturing, education, employment, defense, health care, business intelligence, robotics, and so

    5 MINUTES READ Continue Reading »
    AI & Machine Learning
    5 AI Applications Changing the Energy Industry

    The energy industry faces some significant challenges, but AI applications could help. Increasing demand, population expansion, and climate change necessitate creative solutions that could fundamentally alter how businesses generate and utilize electricity. Industry researchers looking for ways to solve these problems have turned to data and new data-processing technology. Artificial intelligence, in particular — and

    3 MINUTES READ Continue Reading »

    About Us

    Incubated in Harvard Innovation Lab, Experfy specializes in pipelining and deploying the world's best AI and engineering talent at breakneck speed, with exceptional focus on quality and compliance. Enterprises and governments also leverage our award-winning SaaS platform to build their own customized future of work solutions such as talent clouds.

    Join Us At

    Contact Us

    1700 West Park Drive, Suite 190
    Westborough, MA 01581

    Email: [email protected]

    Toll Free: (844) EXPERFY or
    (844) 397-3739

    © 2025, Experfy Inc. All rights reserved.