Article 4: How Bungie Became a Data-Informed Creative Studio
The analytics system behind Destiny 2’s live-service evolution — and why data should sharpen creativity, not replace it.
If the “Trust → Retention → Revenue” framework gave Bungie the strategy to save Destiny 2, then becoming a data-informed studio gave them the tools to sustain it.
In a live-service game, instinct isn’t enough. Player feedback isn’t enough. Even good design isn’t enough.
To build a world that evolves every week — and do it across multiple seasons, expansions, and platforms — you need something more rigorous:
A feedback loop where creativity generates ideas and data validates decisions.
Not data-driven. Not decision-by-spreadsheet. But data-informed — a model where data reveals insights, highlights surprises, and corrects assumptions, while creativity leads the way. This article breaks down how Bungie built that system.
The Myth of “Cold Data vs Creativity”
There’s a persistent myth in game development that data and creativity are enemies. But in reality:
- Creativity is how you generate possibilities.
- Data is how you measure which possibilities work.
- And live-service development needs both in constant conversation.
When Destiny 2 crashed in early 2018, Bungie realized many of their assumptions about players were wrong:
- What players value?
- How long they engage?
- What they find rewarding?
- What they ignore?
- What frustrates them?
- And most importantly why?
The only way to fix that was to build a studio-wide system where every designer had access to real, granular player behavior. Not to constrain vision. But to confirm or contradict intuition. That contradiction is where the learning happens.
The KPI Report Card: Measuring What Matters
To evaluate each release, Bungie built a “KPI Report Card” used across the entire studio. It standardized how success was defined, measured, and communicated.
The core KPIs included:
1. Trust Metrics
- Vocal sentiment (social spaces, influencer reactions)
- Weekly “Rate your last week” surveys sent directly to players
This gave Bungie both:
- What players say
- What players feel
And those two are not always aligned.
2. Engagement Metrics
Engagement — the lifeblood of any live service — was broken down into:
- DAU (Daily Active Users)
- New players
- Return rate (players who were active last week)
- Win-backs (players who returned after lapsing)
Instead of seeing engagement as one number, Bungie viewed it as a series of interconnected funnels.
This allowed them to answer questions like:
- Are we attracting new players?
- Are existing players sticking around?
- Are lapsed players returning?
- Which activities increase each behavior?
This level of granularity allows design teams to target specific problems, not general symptoms.
3. Revenue Metrics
Revenue was tracked, of course — but it was not optimized blindly. If revenue rose while trust or retention dropped, that was a red flag, not a success. This is what it means to be data-informed rather than revenue-driven.
Daily Dashboards: Radical Transparency Across the Studio
Bungie made a bold cultural decision:
All core KPIs were made visible to every employee, every day.
This includes:
- Sentiment
- DAU
- Revenue
- Win-backs
- Content performance
These dashboards lived in:
- Studio kitchens
- Common areas
- Internal web portals
Why does this matter? Because designers, artists, writers, and producers weren’t relying on secondhand interpretations. They were looking at the raw pulse of the game directly.
Get Pat Genest’s stories in your inbox
Join Medium for free to get updates from this writer.
This democratization of data:
- Eliminated guesswork
- Reduced silos
- Empowered teams
- Kept everyone aligned
- Made the “health of the game” a shared responsibility
Transparency builds accountability. Accountability builds better decisions.
Biweekly LiveOps Reviews: Learning in Real Time
Every two weeks, Bungie held LiveOps reviews — studio-wide meetings to dissect:
- What happened recently?
- What players engaged with?
- What surprised the team?
- What succeeded?
- What failed?
- And what should change next?
These weren’t just producer or analyst meetings. Design directors and creative leads were expected to attend. Because iteration is only meaningful if decision-makers understand the data behind the iteration.
A key benefit of LiveOps reviews:
- New features can be evaluated within days or weeks of launch.
- Designers can test creative risks and measure results immediately.
This transformed Bungie into a fast-learning organization, not a slow-responding one.
Season Postmortems: Deep Learning Through Long Form Analysis
At the end of each season, Bungie hosted large-scale 2-hour retrospectives:
- Lecture-style deep dives
- Comprehensive analysis of every feature
- Recorded and archived for all employees
These weren’t just reports — they were internal college courses on Destiny’s business.
New hires were even encouraged to watch past postmortems to understand:
- Why certain decisions were made
- How the community reacted
- What patterns emerged
- Which assumptions proved wrong
This institutionalized learning is something few studios do well and it gave Bungie a massive advantage.
Designers as Scientists, Not Guessers
Perhaps the most transformative cultural shift Bungie made was this:
Designers now make hypotheses then test them against live data.
This moves design from, “I think players will love this” to “Let’s predict what players will do and compare that to what actually happens.”
This approach:
- Reduces ego
- Increases curiosity
- Generates surprise insights
- Leads to better iteration
- Strengthens creative confidence
One famous example Bungie shared:
- The Legendary Campaign for The Witch Queen was expected to be niche.
- Instead, engagement numbers were far higher than anyone predicted.
Without data, assumptions would have been wrong. With data, priorities shifted.
Why Data-Informed Beats Data-Driven
A data-driven studio lets spreadsheets dictate design.
A data-informed studio uses data to:
- Challenge assumptions
- Validate creative risks
- Expose player motivations
- Reveal blind spots
- Improve decision-making
This is the philosophy Bungie adopted. Vision sets the direction. Data confirms the path.
Up Next: Building a Train Station, Not a Train
If data gave Bungie clarity, the next mindset shift gave them sustainability.
In Article 5, we’ll explore:
- Why live-service studios must think like train stations
- How Bungie manages 5–6 parallel releases
- Why crunch becomes permanent in live-service pipelines
- How over-delivery can sabotage future releases
- The importance of sustainable, repeatable blueprints
This is the operational backbone of long-term live-service success.
If you want to know more about me, feel free to connect with me on LinkedIn or subscribe.
