The Wiley and SAS Business Series presents books that help senior level managers with their critical management decisions.
Titles in the Wiley and SAS Business Series include:
For more information on any of the above titles, please visit www.wiley.com.
Copyright © 2021 by SAS Institute Inc. All rights reserved.
Published by John Wiley & Sons, Inc., Hoboken, New Jersey.
Published simultaneously in Canada.
No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 750-4470, or on the web at www.copyright.com. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748-6011, fax (201) 748-6008, or online at http://www.wiley.com/go/permission.
Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose. No warranty may be created or extended by sales representatives or written sales materials. The advice and strategies contained herein may not be suitable for your situation. You should consult with a professional where appropriate. Neither the publisher nor author shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages.
For general information on our other products and services or for technical support, please contact our Customer Care Department within the United States at (800) 762-2974, outside the United States at (317) 572-3993 or fax (317) 572-4002.
Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may not be available in electronic formats. For more information about Wiley products, visit our web site at www.wiley.com.
Library of Congress Cataloging-in-Publication Data
Names: Chase, Charles, author. | John Wiley & Sons, publisher.
Title: Consumption-based forecasting and planning : predicting changing demand patterns in the new digital economy / Charles W. Chase. Other titles: Wiley and SAS business series
Description: Hoboken, New Jersey : John Wiley & Sons, Inc., [2021] | Series: Wiley and SAS business series | Includes index.
Identifiers: LCCN 2021020635 (print) | LCCN 2021020636 (ebook) | ISBN 9781119809869 (cloth) | ISBN 9781119809883 (adobe pdf) | ISBN 9781119809876 (epub)
Subjects: LCSH: Business forecasting. | Business logistics. | Demand (Economic theory).
Classification: LCC HD30.27 .C473 2021 (print) | LCC HD30.27 (ebook) | DDC 658.4/0355—dc23
LC record available at https://lccn.loc.gov/2021020635
LC ebook record available at https://lccn.loc.gov/2021020636
Cover image: © Radoslav Zilinsky/Getty Images
Cover design: Wiley
I have the honor of writing the foreword to Charles Chase's new book Consumption-Based Forecasting and Planning: Predicting Shifting Demand Patterns in the New Digital Economy. I have known Mr. Chase (“Charlie”) for roughly 35 years. Charlie and I have common interests in business forecasting and market analytics. In addition, Charlie and I are close friends, and he and his wife Cheryl are adopted members of my immediate family.
The purpose of a foreword is to confer credibility to the author(s) and to provide context and background of the book in question. Let's start with credibility. Charles Chase is unquestionably a leader in forecasting/modeling and advanced marketing analytics. Currently employed at SAS Institute, Inc., he is the author of Next Generation Demand Management: People, Process, Analytics, and Technology; Demand-Driven Forecasting: A Structured Approach to Forecasting; and coauthor of Bricks Matter: The Role of Supply Chains in Building Market-Driven Differentiation. Each of these books is required reading in my Business Forecasting PhD-level class at Texas A&M University. Moreover, Charlie has served as president of the International Association of Business Forecasting and currently writes a quarterly column in the Journal of Business Forecasting entitled “Innovations in Business Forecasting.”
Concerning the context of his new pithy tome, the book is divided into seven chapters: (1) The Digital Economy and Unexpected Disruptions; (2) A Wake-up Call for Demand Management; (3) Why Data and Analytics Are Important; (4) Consumption-Based Forecasting and Planning; (5) AI/Machine Learning Is Disrupting Demand Forecasting; (6) Intelligent Automation Is Disrupting Demand Planning; and (7) The Future Is Cloud Analytics and Analytics at the Edge. Targeting principally business executives, the main objective is to describe how the new digital economy and the disruption attributed to COVID-19 have changed the way companies deploy demand forecasting. As such, this book is very timely. Further, Chase argues for repositioning demand planning downstream in the supply chain closer to customers (ultimately consumers) to maximize sales. While not necessarily a novel concept, the emphasis on this repositioning is important operationally to firms, especially those engaged in the consumer-packaged goods industry. Additionally, the case is made for applying predictive analytics and machine learning to available data sources to ameliorate modeling efforts associated with customer demand patterns. Improvements in the ability to model demand lead to efficiencies, the reduction of costs and hence advances in the bottom line. Finally, a unique contribution of the book is the introduction of cloud analytic solutions and edge analytics, what Chase calls the future of demand forecasting and planning. On all fronts, Chase provides information on various key topics not presently evident in the extant literature.
Data are the lifeblood of the digital economy providing business insights and supporting real-time delivery of critical information to enable decision making. Massive amounts of data are routinely collected from sensors and devices operating in real-time from remote locations operating globally. As supply chain executives face the new digital economy, Chase argues that the appropriate vision for data and analytics is to harness relevant information not only to make better decisions but also to react faster to disruptions like the unprecedented COVID-19 pandemic. Chase states that “Intelligent automation supported by machine learning is changing the game, particularly for demand forecasting and planning.” Chase makes clear that “when shaping business plans and strategy, consumption-based forecasting and planning can serve as a great counterweight to gut feelings and biases.”
Given that demand forecasting and planning generally have been designated as the areas that likely will deliver the most benefits from predictive analytics, it is not unreasonable to assume that cloud computing would also be the preferred technology platform. As this technology continues to grow, Chase points out that there will be incessant debate surrounding the best approaches to utilizing cloud computing due to the demand for advanced analytics skills. Analytics at the edge is a technology-based approach to data collection and analysis where automated-analytical calculations are performed using sensors, network switches, or other devices instead of utilizing centralized data repositories.
In agreement with Chase, the virtual flood of data is changing the way businesses handle data storage, processing, and analytics. The traditional computing paradigm built on centralized data warehouses with conventional Internet connectivity is not well suited for dealing with huge volumes of data. Bandwidth limitations and unpredictable system disruptions all contribute to network bottlenecks. Chase notes that companies are responding to these data challenges related to the new digital economy by deploying edge computing applications. Chase opines that the cloud is a key component for a successful digital transformation. Further, he observes that open-source cloud solutions now allow companies to monitor consumer demand on a daily and/or weekly basis providing real-time updates regarding ever-changing consumer demand patterns based on current market conditions.
Not surprisingly, Chase astutely provides a concise and cogent blueprint for how business executives should deal with the digital economy and unexpected disruptions. Indeed, his contribution provides a wake-up call for demand management. Without question, Chase illustrates why data and analytics are important, challenging business operations to embrace consumption-based forecasting and planning. Additionally, Chase notes that artificial intelligence, machine learning, and automation are vital capabilities in the digital economy. This pronouncement is not only important to the business community but also to the academic community as well. Finally, Chase accurately surmises that applications of cloud analytics and analytics at the edge will grow in the future as businesses continue to grapple in a time-sensitive manner with the ever-present challenges of demand forecasting and planning. Simply put, business executives who read carefully and take copious notes of the concepts set forth in this book will have a decided advantage in coping with the full potential of the digital economy.
Dr. Oral “Jug” Capps, Jr.
Executive Professor and Regents Professor
Co-Director of the Agribusiness, Food, and Consumer Economics Research Center
Department of Agricultural Economics
Texas A&M University
Also Managing Partner and Co-Founder, Forecasting and Business Analytics, LLC
College Station, Texas
March 30, 2021
Retail and consumer goods executives know that when shaping business plans forecasts serve to temper and balance gut feelings and judgmental bias. Yet, most will admit that their forecasts are still disgracefully inaccurate. There are signs, however, based on early adoption of applying intelligent automation supported by machine learning and traditional predictive analytics that are changing the playing field, particularly for demand forecasting and planning. For example, a large global consumer goods company reduced its global days of finished goods inventory by 1.2 days after improving their overall forecast accuracy from 70% to 81% on average across their product portfolio. That corresponded to a 50 basis points improvement in overall customer service levels. So, you don't need to move the needle that much to gain significant improvements in overall supply chain performance.
The past year of the pandemic has highlighted that companies don't respond quickly to shifting consumer demand patterns, as well as other market disruptions. Companies were already facing many new challenges because of the new digital economy. The unforeseen disruption of COVID-19 worsened the economic uncertainty and market volatility. This perfect supply chain storm has become even more important for commercial teams to explore predictive analytics and automation. Those teams will need new systems to turbocharge their demand forecasting and planning capabilities to capture those shifting consumer demand patterns that are taking place as consumers move through the four phases of the pandemic—preliminary, outbreak, stabilization, and recovery. They will need efficient ways to generate and disseminate real-time consumer demand forecasts that reflect rapidly shifting market conditions. Likewise, it will be imperative for analysts and demand planning teams to embrace automated digital applications and dashboards to allow data to be refreshed frequently and incorporate multiple scenarios.
We all know that not all forecasts will be 100% accurate, 100% of the time. That's also reflective of best-made plans and strategic initiatives. No statistical formula can predict the surge, outcome, or exact length of a black swan event like COVID-19—or can it? There's no data available for an unforeseen disruption—or is there? Nor will analytics generate optimal forecasts every time, maybe not when using traditional time series methods. In the wake of COVID-19, for example, retailers and consumer goods companies had to reset their traditional algorithms and data sets in an attempt to understand the effects of multiple phases of self-isolation, lockdowns, and reopenings over the past 10 months in an attempt to understand shifting consumption patterns.
The COVID-19 pandemic has disrupted the usual demand forecasting and planning processes. Consumer demand patterns for different products and services have shifted from the norm, given the uneven spread of the virus, and continuing economic and health uncertainties. Traditional statistical models that rely heavily only on shipments (supply) historical data alone were unable to capture the effects of the crisis for both current demand and into the next normal. However, some early adopter demand planning teams were using predictive analytics and were able to stress-test their demand forecasts and create “What If” scenarios. The technology allowed them to drill down on the impact of the crisis across specific product categories using different parameters. For instance, one consumer goods company used a combination of precrisis data, postcrisis assumptions across specific business drivers, and consumer-behavior research to model the shifting consumer demand patterns for their products across categories under various scenarios. One early finding showed that the next 1–8 weeks compound annual growth rate in the “pasta goods” category changed from a single-digit growth percent in a business-as-usual setting to a double-digit percent increase based on the scenarios. The behavior was linked to POS (point-of-sale), Google trends, epidemiological, stringency index, and regional economic data. By contrast, non-essential products were not influenced as much by the current situation, as demand remained unchanged across all scenarios and assumptions.
Once opportunities have been identified and benefits targeted, organizations implementing predictive analytics and machine learning on a large-scale basis must invest in the following core requirements:
At investor days or in quarterly earnings reports, C-suite leaders tend to talk about analytics programs in broad terms. For instance, how they will change the industry, how the company will work with customers differently, or how digitization will affect the financials. In doing so, they can help fulfill the repeated request, from both senior management and the board, that they serve not only as traditional transaction managers but also as key strategy partners and as value managers. Of course, CAOs cannot lead digital transformations all alone; they should serve as global collaborators, encouraging everyone, including leaders in IT, sales, and marketing, to own the process. CAOs on the cutting edge of advanced analytics are positioning themselves not just as forward-thinking analytics leaders but also as valued business partners to other leaders in their companies. Those who aren't will need to think about how analytics programs could change the way they work, and then lead by example.
Without a doubt, consumer behavior has changed several dimensions across product categories, channel selection, shopper trip frequency, brand preferences, and omnichannel consumption. These shifts, combined with projections for virus containment and economic recovery, are critical for retail and consumer goods strategies. Leading retail and consumer goods companies are using traditional predictive analytics and machine learning algorithms with multiple sources of insights including point-of-sale data, primary consumer research, social media, and online search trends to understand how consumer demand could evolve during and after the crisis at a granular level (SKU/Ship-to-location).
Leading executives are planning to rapidly adapt their sales and marketing plans to reflect changing consumption patterns as well as consumer sentiment. The overall consumer outlook seems to vary depending on the stage of the pandemic response, causing executives to adjust the intensity of their marketing, including ad copy and calls to action, and to stay in sync with the evolving situation. Changing consumer demand patterns for essential purchases and non-essentials is leading retail and consumer goods companies to consider shifting marketing spending in channels such as digital and social media. All these actions are beneficial due to real-time testing and measurement. Just because the crisis is unprecedented does not mean rapid analytic testing should be abandoned. Many companies are using it surgically to gather data regarding the effectiveness of ongoing marketing efforts and adjust promotional campaigns accordingly given the resulting insights.
Consumer goods companies can maximize the impact of their new demand plans by collaborating with key customers (retailers) to refine, deploy, and revamp commercial plans. Flexibility and compassion have been found to be important elements in this collaboration. The pandemic has changed the retail landscape, especially for smaller retail outlets that have been hit the hardest. Making daily calls and adjusting payment terms as needed are setting the right tone. Changes in sales techniques are being considered to adapt, as well. Companies are considering providing additional support and technologies to their sales force to improve virtual-selling techniques. Similarly, companies are reallocating field sales and brokerage resources to the channels, key customers, and geographies that are experiencing the highest demand. Retail and consumer goods companies who successfully execute these strategies will have a clear view of how the market will unfold and positioned to come out of the COVID-19 crisis ahead of their competitors. By contrast, those companies who wait until after the crisis to act on these opportunities will find themselves lagging their counterparts.
To be successful in the rapidly changing digital economy, companies need to properly tackle digital transformation. This is not possible if it's not part of their business agenda. The speed of digitalization will only continue to increase as consumers of demand forecasts throughout the business ecosystem mandate answers in real time. As more and more companies reinvent the way they do business, the efficiency of the digital economy will see its full potential.
This book describes the organizational, operational, and leadership requirements necessary to use predictive analytics and AI/machine learning technologies to generate more accurate consumption-based forecasts and demand plans. Some leading-edge companies are already well on their way in the digital journey, providing several case studies. Their stories and approaches will be a testament to the effectiveness of predictive analytics and machine learning providing a path forward for others.
Over the course of my career, I have had many chance meetings with others, several of whom have had a significant impact on my life, career, and this book. More than a few of those chance meetings lead to personal friendships that have spanned several decades.
First and foremost, I want to thank Dr. Oral Capps, executive professor and Regents Professor, department of Agricultural Economics at Texas A&M University, who has been a mentor and a best friend—not to mention being one of the smartest people that I have ever known. Dr. Chaman Jain, founder of the Institute of Business Forecasting (IBF), and chief editor of the Journal of Business Forecasting (JBF), who has given me a platform to write, speak, and share my experiences with others—to pay it forward.
A special thank-you to Albert Guffanti, VP/Group Publisher of Retail Information Systems (RIS News) and Consumer Goods Technology (CGT) at Ensemble IQ for allowing me to share several analytics research studies and reports that his team has created over the past six years. Also, I thank him for his support in providing another social media platform for me to publish and share my experiences and knowledge, to continue paying it forward.
For the past 18 years I have had the privilege of working at SAS Institute Inc., where I have been humbled by the sheer number of extremely smart people. Without their curiosity, passion, and innovative spirit, this book would not have been written. They have provided a steady flow of groundbreaking work in the field of statistical forecasting and machine learning that is reflected in this book. They include Roger Baldridge, James Ochiai-Brown, Brittany Bullard, Jessica Curtis, Sherrine Eid, Michael Gilliland, Sudeshna Guhaneogi, Pasi Helenius, Adam Hillman, Matteo Landrò, Valentina Larina, Kedar Prabhudesai, Varunraj Valsaraj, Dan Woo, and many others for their amazing work.
Most of all, I want to thank the best chance meeting of my life, my wife and best friend, Cheryl, for keeping the faith all these years and supporting my career. Without her support and encouragement, I would not have been able to write this book.
Charles Chase
Executive Industry Consultant and Trusted Advisor
Global Retail/Consumer Goods Practice
SAS Institute, Inc.
Charles Chase is Executive Industry Consultant with SAS Global Retail/Consumer Goods Industry Practice. As executive industry consultant, Charles Chase is a thought leader and trusted adviser for delivering analytics-driven solutions to improve SAS customers supply chain efficiencies. Chase has more than 20 years of experience in the consumer goods industry, and is an expert in demand forecasting and planning, market response modeling, econometrics, and supply chain management.
Prior to working as executive industry consultant, Chase led the strategic marketing activities in support of the launch of SAS® Forecast Server, which won the Trend-Setting Product of the Year award for 2005 by KM World magazine. Chase launched SAS Demand-Driven Planning and Optimization Solution in 2008, which is used by over 100 large corporations globally. He has also been involved in the re-engineering, design, and implementation of three forecasting/marketing intelligence process/systems. His employment history includes the MENNEN Company, Johnson & Johnson, Consumer Products, Reckitt & Benckiser, the Polaroid Corporation, Coca Cola, Wyeth-Ayerst Pharmaceuticals, and Heineken USA.
Chase's authority in the area of forecasting/modeling and advanced marketing analytics is further exemplified by his prior posts as president of the International Association of Business Forecasting, associate editor of the Journal of Business Forecasting, and chairperson of the Institute of Business Forecasting (IBF) Best Practices Conferences. He currently writes a quarterly column in the Journal of Business Forecasting. He also served as a member of the Practitioner Advisory Board for Foresight: The International Journal of Applied Forecasting.
He has been an invited guest lecturer at several well-known universities including the Fuqua School of Business, Duke University; the Sloan School of Management, MIT; North Carolina State University; Northeastern University; Agricultural School of Economics, Texas A&M; Institute of Retail Management, Templeton College, University of Oxford; William & Mary University; Wake Forest University; and Virginia Commonwealth University.