From Lengthy Delays to Lightning-Fast NPI Launches: How a team at Databricks Drove a 24-Week Process Down to 2 Hours

tldr;

Efficiency Gains Are Within Reach: With the right approach, processes that appear inherently slow can be streamlined significantly.
Data-Driven Insights: Analyzing where errors occur and standardizing submissions can cut rework and reduce confusion.
Clear Metrics Matter: Setting and tracking specific goals, such as a 63% standardization rate and a 67% automation rate, keeps improvements on target.
Empower People Through Automation & AI: Reducing the number of people involved from 10 to 3 not only saves resources but also redirects human effort toward tasks that require creativity and judgment.
Innovation is Iterative: Incremental steps—like refining intake forms first—can lead to transformational outcomes, from major time savings to bolstered accuracy.

——————————————————————————————————————————-

Six months to launch a new product offering is six months too long. Yet that was precisely the challenge our commercial team at Databricks faced—a cumbersome SKU creation process that had become a critical bottleneck to our growth and market responsiveness.

In today’s market—and especially in the realm of AI—introducing new products quickly can make or break a business. Stock Keeping Units (SKUs), which identify products for billing and invoicing, are crucial in commerce operations. Yet, in my personal experience working at many large companies, creating and launching SKUs is bogged down by red tape and manual processes.

At Databricks the commercial cross-functional team set out to change this dynamic, drastically reducing SKU launch time from a staggering 24 weeks to just 2 hours. Throughout this journey, we also boosted key metrics such as standardization and automation rates, while dramatically reducing the number of people needed to introduce a SKU. Here’s how we did it.

1. Diagnose the Delay

Data Analysis and Standardization

Initially, the team discovered that SKU requests varied widely in their format and quality. This inconsistency caused errors and significant rework.
By analyzing past submissions, they found a clear need to standardize both data and processes. After six months of concerted efforts, a 63% standardization rate was achieved across all SKU requests, drastically reducing confusion and errors.

“Despite these process improvements, human errors remained a challenge. The need for greater automation became impossible to ignore.”

2. Define the “North Star”

Early on, our team established key principles—“North Star” metrics—to ensure the new process would be both efficient and reliable:

Error Reduction : Achieve near-perfect (99.9999%) accuracy in data entry to avoid costly billing and operational mistakes.
Minimal Manual Intervention : Keep only critical checks—like financial validations and compliance reviews—in human hands. Take # of humans involved in submitting SKUs from 10 to just 3.
Innovation and Flexibility : Develop creative solutions that are not limited by current system constraints and can scale with Databricks’ revenue growth
Scalability and Resilience : Build modular, robust processes capable of handling thousands of SKU requests simultaneously.

These guiding metrics kept the team focused on delivering a solution that was fast, accurate, and scalable.

3. Build the MVP (Minimum Viable Product)

Moving swiftly to design a prototype, the team introduced several automated capabilities:

Automated SKU Intake and Validation: A user-friendly submission portal with built-in checks to spot errors before they cause delays.
Scalable SKU Releases: The ability to approve and launch thousands of SKUs simultaneously, ensuring that scaling up wouldn’t introduce bottlenecks.
Robust Observability, Reporting and SOX Compliance : Real-time dashboards for tracking changes, flagging incidents, and reporting errors with strict SLAs.
System Integrations: APIs that connect each step of the process end-to-end eliminating all manual data entry.

Within the first few months of operation, the automation rate reached 67%, surpassing early projections and dramatically cutting down on manual tasks. Keeping the scope limited was a key challenge but the team persevered to deliver features that mattered more to the business while avoiding noise.

4. Achieving Results

As the new process matured, the benefits became clear:

From 24 Weeks to 2 Hours: By automating and standardizing key steps, the typical time to launch a new SKU plunged from nearly half a year to just a couple of hours.
Fewer Hands on Deck: With automation in place, the number of people required to introduce a SKU fell from 10 to 3, freeing teams to focus on higher-level tasks.
Sustained Accuracy: Automated checks and validations helped maintain accuracy, preventing billing and compliance errors before they occurred.

This combination of speed and reliability has transformed the organization’s go-to-market capabilities, ensuring swift responses to emerging market demands without sacrificing data quality or compliance.

Looking Ahead

This transformation goes beyond introducing SKUs faster—it reflects a deeper commitment to automation, standardization, and self-service. By setting clear goals, identifying pain points through data analysis, and rigorously automating wherever possible, the organization demonstrates that tenacity and innovation can turn a merely good process into a truly great one.

Moving forward, ongoing refinement of these systems and metrics will continue to drive agility, accuracy, and scalability. The success of this initiative stands as a testament to how businesses can remain nimble and competitive in an ever-evolving market by embracing well-structured processes and relentless improvement.