UNITED WAY STL ACADEMY
  • Courses
  • Log In
  • Join Free
  • Home
  • Courses
  • Scrum Essentials

Scrum for Business Agility

Curriculum

  • 5 Sections
  • 29 Lessons
  • Lifetime
Expand all sectionsCollapse all sections
  • IT Management and Operations
    8
    • 1.1
      Big Data and Large-Scale Migration
      10 mins
    • 1.2
      Commercial-Off-the-Shelf (COTS) Implementations
      10 mins
    • 1.3
      Oracle Primavera Unifier
      10 mins
    • 1.4
      ServiceNow
      10 mins
    • 1.5
      Broadcom’s Clarity
      10 mins
    • 1.6
      DevOps and Beyond
      10 mins
    • 1.7
      Profit-and-Loss Potential
      10 mins
    • 1.8
      Innovation versus Stability
      10 mins
  • Portfolio Management
    8
    • 2.1
      Portfolio Management Challenges
      10 mins
    • 2.2
      De-scaling Scrum for Large Portfolios
      10 mins
    • 2.3
      A Vertical Slicing Overview
      10 mins
    • 2.4
      Scrum of Scrums
      10 mins
    • 2.5
      Large-Scale Scrum (LeSS)
      10 mins
    • 2.6
      Scrum@Scale
      10 mins
    • 2.7
      Nexus
      10 mins
    • 2.8
      Scaled Agile Framework (SAFe)
      10 mins
  • Human Resources and Finance
    3
    • 3.1
      Human Resources and Scrum
      10 mins
    • 3.2
      Creating the Right Culture
      10 mins
    • 3.3
      Finance
      10 mins
  • Business Development
    7
    • 4.1
      Marketing Evolution
      10 mins
    • 4.2
      Scrum for Marketing
      10 mins
    • 4.3
      Marketing Tools
      10 mins
    • 4.4
      Scrum in Action (Marketing)
      10 mins
    • 4.5
      The Gap Between Marketing and Sales
      10 mins
    • 4.6
      Scrum for Sales
      10 mins
    • 4.7
      Determining Roadmap to Value (Sales)
      10 mins
  • Customer Service
    3
    • 5.1
      Customers: The Most Crucial Stakeholders
      10 mins
    • 5.2
      Scrum and Customer Service
      10 mins
    • 5.3
      Scrum in Action in Customer Service
      10 mins

Big Data and Large-Scale Migration

Scrum for Business Agility

Big Data and Large-Scale Migration

🕐 12 min read
2.5 PB
of data in Walmart’s databases—every hour
95M
photos and videos shared daily on Instagram
80%
of business data is unstructured
7.7 EB
daily global Internet traffic (2021)

The sheer scale of data generated and managed in modern organizations is both astonishing and daunting. Imagine trying to visualize the size of the universe—Big Data stretches the limits of what we can comprehend, and it’s growing every second.

Pause for a moment: When you think of “Big Data,” what real-world examples come to mind—and how do they impact your daily life?

  • Walmart conducts 1 million transactions per hour, feeding databases of more than 2.5 petabytes (about 167 times the size of all the books in the Library of Congress).
  • Instagram houses over 40 billion photographs, with 95 million photos and videos shared every day.
  • eBay adds 50 terabytes of information daily, processing 100 petabytes.
  • Decoding the human genome requires analyzing 3 billion base pairs—what once took ten years now takes just three to seven days.
  • Cisco estimated global Internet traffic at 7.7 exabytes per day in 2021—a threefold increase from 2016.
💡 Did You Know?

Unstructured data—like emails, social media, and videos—makes up 80% of all business data and is growing even faster than structured data.

Big Data isn’t just about size. Much of it is highly personal and sensitive, influencing lives and bottom lines. The challenge is to gather, manage, and interpret this data quickly, effectively, and securely—transforming raw information into useful intelligence.

Big Data

Enormous, complex sets of information—often measured in petabytes or exabytes—that require advanced methods to process, analyze, and utilize.

Another challenge: most data is unstructured. Think emails, blogs, spreadsheets, images, video, voice, and search logs—a vast, growing, and often messy data universe.

Want to go deeper? Understanding Data Sizes from Bytes to Yottabytes

A yottabyte is a trillion gigabytes, or 1024 bytes! Here’s the scale:

  • 1 byte: a single text character (like “a”)
  • 1 KB (kilobyte): ~1,000 bytes
  • 1 MB (megabyte): 1 million bytes
  • 1 GB (gigabyte): 1 billion bytes
  • 1 TB (terabyte): 1 trillion bytes
  • 1 PB (petabyte): 1 quadrillion bytes
  • 1 EB (exabyte): 1 quintillion bytes
  • 1 ZB (zettabyte): 1 sextillion bytes
  • 1 YB (yottabyte): 1 septillion bytes

Data at enterprise scale is measured in these gigantic units—and the growth is exponential.

Why do you think unstructured data is growing so much faster than structured data in today’s digital world?

With so much data, organizations need clear strategies for managing, securing, and interpreting it—especially as much of it is sensitive or business-critical. Traditional data management isn’t enough. Speed, flexibility, and instant feedback are essential.

Practitioners note: Many organizations are migrating to the cloud—sometimes building in-house virtualized environments to handle the flood of data, transforming both IT and business processes.

Data Warehouse

A centralized repository that stores integrated data from multiple sources, enabling strategic and tactical decision-making through analytics and reporting.

Data Warehouse Management

Data warehouses are traditionally seen as difficult to manage. Unlike typical projects with clear beginnings and ends, a data warehouse is never “done”—it keeps growing and evolving.

Remember
REMEMBER

A data warehouse isn’t a barbed-wire-fenced building on the edge of town—it’s a process or framework for handling data and supporting decision-making across the organization.

Mergers, acquisitions, and constant change create new integration challenges: new assets, groups, and legacy systems that may not play nicely together. Sometimes, maintaining incompatible legacy applications costs more than modernizing with a conversion project.

One multinational pharmaceutical company used a Scrum team to pilot a new enterprise data strategy. Leaders handpicked team members with data, governance, and communications skills, set a product goal, built a roadmap, and iterated through sprints—engaging the entire organization and embedding the strategy into company culture.

+50 XP

What percentage of business data is estimated to be unstructured, such as emails and videos?

Review the unstructured data section above to find the answer.

Think about your own organization or a company you know: What are some challenges they might face when integrating new data sources after a merger or acquisition?

⏱ 5 minutes
Activity: Map the Data Journey

Visualize how data moves in an organization. Where is it created, where does it go, and how is it used?

  1. Pick a process (e.g., sales, customer service, or production) in a real or hypothetical company.
  2. Sketch or list how data is generated, collected, stored, and finally used for decision-making.
  3. Identify one point where unstructured data might enter, and how it could be managed better.
❌ Common Misconception

Data warehouses are static, finished projects that only need minor maintenance once built.

✅ The Reality

Data warehouses are dynamic, continually evolving systems that require ongoing integration, adaptation, and management as data and organizational structures change.

The challenge is to gather, manage, and interpret data quickly, effectively, and correctly.

  • Big Data is vast, ever-growing, and often unstructured.
  • Data warehouses are living systems, not static projects.
  • Modern organizations need agile, iterative strategies for data management and migration.
Flashcard

What percentage of organizational data is estimated to be unstructured?

Tap to reveal
Answer

Approximately 80% of data is unstructured.

Flashcard

Define “data warehouse.”

Tap to reveal
Answer

A centralized repository that stores integrated data from multiple sources for analysis and reporting.

Flashcard

Why are agile practices valuable in data strategy projects?

Tap to reveal
Answer

Agile practices help organizations adapt quickly, iterate solutions, and engage stakeholders in complex, evolving data environments.

Imagine you are leading a data migration project in an organization undergoing rapid growth or a merger. What steps would you take to ensure data integrity, security, and usability for all stakeholders?

0 words Take your time — depth matters more than length
Key Takeaway

Big Data is not only massive and rapidly growing, but also increasingly unstructured—demanding agile, secure, and adaptive strategies for effective enterprise management and value creation.

Key Takeaway

Data warehouses and large-scale migrations are never “set and forget” efforts; they require ongoing evolution, stakeholder engagement, and iterative approaches to succeed.

What are the biggest risks organizations face if they don’t adapt their data management processes to handle Big Data and large-scale migration?

0 words
SHIFT

The Shift

  • Big Data is not only vast but mostly unstructured, demanding new strategies for management and analysis.
  • Data warehouses and data migration projects are ongoing, adaptive processes, not one-time builds.
  • Agile, cross-functional teams and iterative approaches are key to successful enterprise data strategies.
End of lesson Ready for the next lesson?
Continue to next lesson  →

Leave a Reply Cancel reply

Commercial-Off-the-Shelf (COTS) Implementations
Next

© 2026 United Way STL Academy | Powered by Sejal Learning Systems.

Modal title

Main Content