Is your enterprise suffering from too much data?

Good policy is critical to creating operational effectiveness at a time when the amount of data being collected is growing exponentially

Subscriber: Log Out

Editor’s Note: Norman Katz, president of supply chain consultancy Katzscan Inc., writes a monthly column for Supply Chain Management Review. Katz’s column appears on the third Monday of each month.

Not only is there too much information running through my brain (thanks to the rock band The Police for that line, taken from their song “Too Much Information” from their 1981 album Ghost In The Machine—I mostly blame social media and the internet for this these days), but apparently there’s also too much information running through most companies too. 

According to a CIO Dive article titled Enterprise data overload triggers cost overruns, spending spikes from September 25, 2023, data overload causes cost overruns and increases in spending.  After all, it does cost to collect and store all of this data.

In a survey of 500 total professionals by Wakefield Research, excessive spending due to excessive data collection was something that nearly everyone on the survey acknowledged.  Similarly, 4 out of 5 survey respondents admitted to limiting log ingestions, and approximately one-third admitted to randomly discarding data.

All of this is at a time when IOT—internet of things—initiatives are being pressed forward which only involves the collection of more data as more data collection points are added.  Advances in data collection methodology, e.g., shifting to radio frequency identification (RFID) instead of barcode label scanning for automatic identification, realistically means that more data is collected via the RFID tag than the traditional barcode scan. Even the move to 2D (two-dimensional) barcodes from 1D (one-dimensional) barcodes means that more data will be acquired per scan.

More data collection points collecting more data per collection point. Whew. What is practical to collect and how often to give you the necessary insights into your supply chain’s activities?   

To balance the costs of data collection and retention with the value of the insights that the information can provide, the right retention policy needs to be formulated for all of the different data collected. How long does the data need to be retained? (Are there regulatory or tax requirements for data retention?) Does the data need to be retained in its original state, or can it be aggregated and only the summary data retained with the detailed data eventually deleted? Is there a single source of the data, or is the data being replicated unnecessarily, e.g., for analysis purposes, across multiple software systems?

Is there so very much data in your organization that your people just don’t know what to do with it all?  If there is, then you’ve likely reached the point of diminishing returns to a factor: the more data you have, the less value it has.

Closing transactional gaps in supply chains, increasing operational effectiveness, and enhancing your competitiveness with data collection is helpful.  But doing so without a good data policy is costly, and probably confusing too.

SC
MR

Closing transactional gaps in supply chains, increasing operational effectiveness, and enhancing your competitiveness with data collection is helpful. But doing so without a good data policy is costly, and probably confusing too.
(Photo: Getty Images)
Closing transactional gaps in supply chains, increasing operational effectiveness, and enhancing your competitiveness with data collection is helpful. But doing so without a good data policy is costly, and probably confusing too.
What's Related in Data Management Practices
Maximizing Efficiency and Productivity of Warehouse Operations
Download our white paper to discover practical insights for building an intelligent warehouse.
Download

About the Author

Norman Katz, President of Katzscan
Norman Katz's Bio Photo

Norman Katz is president of Katzscan Inc. a supply chain technology and operations consultancy that specializes in vendor compliance, ERP, EDI, and barcode applications.  Norman is the author of “Detecting and Reducing Supply Chain Fraud” (Gower/Routledge, 2012), “Successful Supply Chain Vendor Compliance” (Gower/Routledge, 2016), and “Attack, Parry, Riposte: A Fencer’s Guide To Better Business Execution” (Austin Macauley, 2020). Norman is a U.S. national and international speaker and article writer, and a foil and saber fencer and fencing instructor.

View Norman's author profile.

Subscribe

Supply Chain Management Review delivers the best industry content.
Subscribe today and get full access to all of Supply Chain Management Review’s exclusive content, email newsletters, premium resources and in-depth, comprehensive feature articles written by the industry's top experts on the subjects that matter most to supply chain professionals.
×

Search

Search

Sourcing & Procurement

Inventory Management Risk Management Global Trade Ports & Shipping

Business Management

Supply Chain TMS WMS 3PL Government & Regulation Sustainability Finance

Software & Technology

Artificial Intelligence Automation Cloud IoT Robotics Software

The Academy

Executive Education Associations Institutions Universities & Colleges

Resources

Podcasts Webcasts Companies Visionaries White Papers Special Reports Premiums Magazine Archive

Subscribe

SCMR Magazine Newsletters Magazine Archives Customer Service

Press Releases

Press Releases Submit Press Release