Oncology Software / Hardware Design

Challenge

Remove hardware and software boundaries for Pathologists so they may diagnose cancer patients ASAP!

Business Needs

    1. Increase Pathology sign-out completion rates
    2. Retire high maintenance, legacy applications
    3. Expand the reach of Memoral Sloan Kettering (MSK)

User Concerns

    1. Need to be on-site to complete urgent diagnoses
    2. Switching between apps causes context fatigue
    3. Cannot maintain an optimal environment across terminals
Attending clinicians need disparate 5 apps to complete a sign-out Easy to read dashboard and work space eliminates context switching and need for multiple logins

Solution

Retire desktop programs, improve the UI and merge functionality into a web app for a true Digital Pathology!

Story Line

Introduction

Design Example

Double Diamond

Post Mortem

Introduction

The journey of a cancer patient often begins with a diagnosis, traditionally conducted by pathologists examining tissue samples embedded in glass slides under a microscope. This project aimed to transform that process by building a digital infrastructure that enables diagnosis using scanned images of glass slides.

I remember the day I was assigned to the Research Platform. John Philip, a 30-year veteran of MSK, research scientist, and software developer, onboarded me into Digital Pathology. He ended his introduction with a simple yet audacious statement: “Basically, we need to retire the microscope.

 

 

 

One of MSK’s Histology Labs
(click images for closer views 😉

Design Example

Hundreds of design decisions were made throughout the process. Since, the Double Diamond flow below can’t capture these micro-details, I’ve extracted a simple one that covers how these are derived.

The takeaway from the example below is: Often design decisions that make a difference are not simple graphical elements; but, understanding human intentions and behaviors that will lead you to unexpected, and robust solutions.

 

In user interviews while reviewing CoPath, the existing application we were to replace, I noticed that the users would keep the window size of the app consistent.

The researchers spent alot of time arrange multiple application across several monitors.

When asked about the size, I was shown that the applictions, built in the early “aughts”, wasn’t what we would call responsive. And while you could expand the window infinitely, the primary touch points were static – locked in a specific place and dimension.

In all of my design review sketches, I could see that the app real estate was restrictive.  My design sketches are peppered with comments  about better use of space.

Reviewing the research, I could see how frustrated all the researchers were in not only logging into applications – but arranging them in the perfect way.

This dynamic was exacerbated when a clinician had to work at a remote terminal. I witnessed a senior pathologist take 20 mins to find a login link to an application she used daily from an email sent three years prior on her phone.

Ultimately, I made the bold decision to extend our designs to not just replace CoPath, but to integrate the 5 disparate applications as well.

After reviewing the APIs with the dev team, we found that this was easier than expected – and would elimninate dozens for pain points.

My designs were to make the application less form like and more native – resulting in tool bars, contextual panels, and integrated work states.

When shown the first rounds of designs, the pathologists loved it – and sighed with relief that everything they needed was at their fingertips.

The Double Diamond

Discover

The UX team played a crucial role in shaping the final solution. As the UX lead, I conducted over 20 interviews with pathologists and support staff to gather insights and ensure the system met their needs. Over time, I built a team of talented researchers and designers who worked closely with stakeholders.

From there, we scheduled contextual observations with attending physicians and fellows, uncovering dynamic insights throughout the process. The attending clinicians domain knowledge was remarkable, while the fellows work demonstrated exceptional precision correctly diagnosing cases – 98% acccuracy.

During binary ”signouts”, I observed a distinct mental model shift, as discussions seamlessly oscillated between case identification and training.

  • ZListening

    The Five Whys is a problem-solving technique that involves repeatedly asking “why” to identify the root cause of an issue. Developed by Toyota in the 1930s, it’s a cornerstone of Lean management and continuous improvement practices.

  • ZUser Research

    Surveys for broad quantitative captures; Interviews for deeper qualitative exploration

  • ZHeuristic Evaluation

    A usability inspection method where experts review a product’s interface against established usability principles (heuristics) to identify potential issues – Concepts | Freeform

  • ZContextual Inquiry

    Engaging with users in their environment to understand how they use a product and the context of its use – On-Site |iPhone | iPad

  • ZLo-Fi Wireframes

    Sketching is the fastest, most direct way to get a vision out of your head. Non-visual people sketch in text, as well – sketching | drawing

Define

As we gathered research, we simultaneously explored ideas and potential directions. Creativity is rarely a linear process: insights can be fleeting while inspiration unpredictable. To capture ideas before they faded, I encouraged my team to sketch freely and without hesitation, knowing that quick sketches often serve as the foundation for innovative solutions.

In parallel, we refined user journeys and mapped out an optimal “happy path”, ensuring a seamless experience. These artifacts were then shared with stakeholders for review and approval, guiding the next steps of development.

  • ZUser Research Analysis

    Dovetail is an essential service to analyze while Excel is the workhorse of corporate America

  • ZJourney Mapping

    Mapping out a user’s experience step-by-step to identify touchpoints, frustrations, and opportunities for improvement – Miro | Lucid | Omnigraffle

  • ZPersonas | Identity Models

    Personas channel a users voice from within a stakeholders opinion. Identity Models focus on interactions that traverse roles.

  • ZLo-Fi Wireframes

    Sketching is the fastest, most direct way to get a vision out of your head. Non-visual people sketch in text, as well – sketching | drawing

Design

  • ZLo-Fi Wireframes

    Sketching is the fastest, most direct way to get a vision out of your head. Non-visual people sketch in text, as well – sketching | drawing

  • ZMi-Fi Wireframes

    Designed to put the focus on information design, model tools, that can host a Design system, are the best of both worlds as they can render a beautiful idea almost effortlessly – Sketch/Figma | Omnigraffle

  • ZComposites

    “Comps” is the short version of “Composites” : the actual designs that envision the project – Sketch/Figma | Photoshop

  • ZLo-Fi - Prototyping

    Hand-drawn prototyping is an immersive design process where sketching ideas on paper in real-time fosters rapid exploration. Sitting across from a user and visually mapping out potential directions can quickly uncover key concerns, making it a powerful tool for early-stage feedback and iteration – pencil/paper

  • ZMi-Fi Prototyping

    Modern wire framing / design tools often have a prototyping component to take designs, add interactions, and host user sessions – Sketch/Figma | Omnigraffle |Axure

  • ZHi-Fi Prototyping

    When users anticipate engaging with dense data, subtle animations, or native features like geo-location, building a prototype in a more robust environment can often be faster and more efficient than using a traditional design tool – html/js/css | native iOS

Holly Nava

UX Designer II

An exceptionally talented designer whom I had the privilege of working with. Using my notes and sketches, Holly skillfully crafted the first rounds of Figma designs and prototypes.

As a contractor, she eventually moved on—but for an incredible reason: she went on to design housing for actual missions to Mars!

Deliver

We conducted several rounds of prototype testing, which led to some bold and unconventional ideas. One of the most radical concepts I proposed was eliminating the need for multiple monitors entirely and leveraging AR with iPhones. Since all the pathologists and fellows used iPhones—none were on Android—we saw an opportunity to replace fragmented, uncalibrated monitor setups with a seamless, infinite digital workspace.

To test the concept, we prototyped it on an iPad. The breakthrough moment came when a senior pathologist—who had been highly skeptical of digital tools—began actively engaging with the prototype. Seeing them not only use it but also enjoy the experience validated our approach. In fact, that same scientist later admitted, “This is actually better than what we currently have.”

Although we ultimately put the AR concept on hold due to funding constraints, we took the best elements from our prototypes and focused on developing a web-based, scalable SaaS application.

  • ZListening

    The Five Whys is a problem-solving technique that involves repeatedly asking “why” to identify the root cause of an issue. Developed by Toyota in the 1930s, it’s a cornerstone of Lean management and continuous improvement practices.

  • ZUser Research Analysis

    Dovetail is an essential service to analyze while Excel is the workhorse of corporate America

  • ZFeedback Loops

    Give your users an effortless way to give you valuable feedback.

  • ZLo-Fi Wireframes

    Sketching is the fastest, most direct way to get a vision out of your head. Non-visual people sketch in text, as well – sketching | drawing

  • ZMi-Fi Wireframes

    Designed to put the focus on information design, model tools, that can host a Design system, are the best of both worlds as they can render a beautiful idea almost effortlessly – Sketch/Figma | Omnigraffle

  • ZLo-Fi - Prototyping

    Hand-drawn prototyping is an immersive design process where sketching ideas on paper in real-time fosters rapid exploration. Sitting across from a user and visually mapping out potential directions can quickly uncover key concerns, making it a powerful tool for early-stage feedback and iteration – pencil/paper

  • ZHi-Fi Prototyping

    When users anticipate engaging with dense data, subtle animations, or native features like geo-location, building a prototype in a more robust environment can often be faster and more efficient than using a traditional design tool – html/js/css | native iOS

Deploy

The software is on track for full adoption by the end of 2025, with over 100 pathologists expected to integrate it into their workflow. This implementation will drastically reduce MSK’s reliance on physical microscopes, allowing pathologists to work remotely and conduct diagnoses directly from a computer screen. By spearheading this transition to large-scale digital pathology, MSK has positioned itself as an industry leader, setting a precedent that other hospitals are now beginning to follow.

  • ZAnalytics

    Planning and embedding a mechanism for continuous feedback remains an essential part of future-proofing a product – Adobe Analytics | Google Analytics | HEAP | HotJar | Mouseflow | Pendo | CrazyEgg | Optimizely | Matomo | Amplitude

  • ZAgile

    A flexible, iterative approach to project management and software development that prioritizes collaboration, adaptability, and continuous improvement – Capability | Features | User Story

  • ZSilver Platter

    A term I use to describe when UX deliverables are delivered to a team inclusive to discovery, testing, and design – completed, without a need for further consultation – .pdf

The Double Diamond

1
1

Discover

The UX team played a crucial role in shaping the final solution. As the UX lead, I conducted over 20 interviews with pathologists and support staff to gather insights and ensure the system met their needs. Over time, I built a team of talented researchers and designers who worked closely with stakeholders.

From there, we scheduled contextual observations with attending physicians and fellows, uncovering dynamic insights throughout the process. The attending clinicians domain knowledge was remarkable, while the fellows work demonstrated exceptional precision correctly diagnosing cases – 98% acccuracy.

During binary ”signouts”, I observed a distinct mental model shift, as discussions seamlessly oscillated between case identification and training.

  • ZListening

    The Five Whys is a problem-solving technique that involves repeatedly asking "why" to identify the root cause of an issue. Developed by Toyota in the 1930s, it's a cornerstone of Lean management and continuous improvement practices.

  • ZUser Research

    Surveys for broad quantitative captures; Interviews for deeper qualitative exploration

  • ZHeuristic Evaluation

    A usability inspection method where experts review a product’s interface against established usability principles (heuristics) to identify potential issues - Concepts | Freeform

  • ZContextual Inquiry

    Engaging with users in their environment to understand how they use a product and the context of its use - On-Site |iPhone | iPad

  • ZLo-Fi Wireframes

    Sketching is the fastest, most direct way to get a vision out of your head. Non-visual people sketch in text, as well - sketching | drawing

2
2

Define

As we gathered research, we simultaneously explored ideas and potential directions. Creativity is rarely a linear process: insights can be fleeting while inspiration unpredictable. To capture ideas before they faded, I encouraged my team to sketch freely and without hesitation, knowing that quick sketches often serve as the foundation for innovative solutions.

In parallel, we refined user journeys and mapped out an optimal “happy path”, ensuring a seamless experience. These artifacts were then shared with stakeholders for review and approval, guiding the next steps of development.

  • ZUser Research Analysis

    Dovetail is an essential service to analyze while Excel is the workhorse of corporate America

  • ZJourney Mapping

    Mapping out a user’s experience step-by-step to identify touchpoints, frustrations, and opportunities for improvement - Miro | Lucid | Omnigraffle

  • ZPersonas | Identity Models

    Personas channel a users voice from within a stakeholders opinion. Identity Models focus on interactions that traverse roles.

  • ZLo-Fi Wireframes

    Sketching is the fastest, most direct way to get a vision out of your head. Non-visual people sketch in text, as well - sketching | drawing

3
3

Design

Once we had a clear understanding of the work pathologists were doing, we shifted our focus to the work they wanted to do—and, more importantly, how they wanted to do it. This presented a challenge, as previous teams had introduced various technologies, yet none had truly resonated with the pathologists. To bridge this gap, we developed clear, clickable prototypes that allowed us to rapidly test and refine the interface based on their feedback.

Working in Figma enabled us to leverage the robust design system another UX team was building, allowing us to design quickly without worrying about pixel perfection—it was already built in. e designed several round of the application.

User testing revealed that microscopes were a like a physical extension of the pathologists. Completely in tune with their devices, their gestures were memorized and fascinating. Because of this, I pushed to have the prototypes make for tablet devices - the finger and hand gestures might not be the same - but there could be a transference of experience.

  • ZLo-Fi Wireframes

    Sketching is the fastest, most direct way to get a vision out of your head. Non-visual people sketch in text, as well - sketching | drawing

  • ZMi-Fi Wireframes

    Designed to put the focus on information design, model tools, that can host a Design system, are the best of both worlds as they can render a beautiful idea almost effortlessly - Sketch/Figma | Omnigraffle

  • ZComposites

    "Comps" is the short version of "Composites" : the actual designs that envision the project - Sketch/Figma | Photoshop

  • ZLo-Fi - Prototyping

    Hand-drawn prototyping is an immersive design process where sketching ideas on paper in real-time fosters rapid exploration. Sitting across from a user and visually mapping out potential directions can quickly uncover key concerns, making it a powerful tool for early-stage feedback and iteration - pencil/paper

  • ZMi-Fi Prototyping

    Modern wire framing / design tools often have a prototyping component to take designs, add interactions, and host user sessions - Sketch/Figma | Omnigraffle |Axure

  • ZHi-Fi Prototyping

    When users anticipate engaging with dense data, subtle animations, or native features like geo-location, building a prototype in a more robust environment can often be faster and more efficient than using a traditional design tool - html/js/css | native iOS

Holly Nava

UX Designer II

An exceptionally talented designer whom I had the privilege of working with. Using my notes and sketches, Holly skillfully crafted the first rounds of Figma designs and prototypes.

As a contractor, she eventually moved on—but for an incredible reason: she went on to design housing for actual missions to Mars!

4
4

Deliver

We conducted several rounds of prototype testing, which led to some bold and unconventional ideas. One of the most radical, I proposed eliminating the need for multiple monitors entirely and leveraging AR with iPhones. Since all the pathologists and fellows used iPhones—none were on Android—we saw an opportunity to replace fragmented, uncalibrated monitor setups with a seamless, infinite digital workspace.

To test the concept, we prototyped it on an iPad. The breakthrough moment came when a senior pathologist—who had been highly skeptical of digital tools—began actively engaging with the prototype. Seeing them not only use it but also enjoy the experience validated our approach. In fact, that same scientist later admitted, “This is actually better than what we currently have.”

Although we ultimately put the AR concept on hold due to funding constraints, we took the best elements from our prototypes and focused on developing a web-based, scalable SaaS application.

  • ZListening

    The Five Whys is a problem-solving technique that involves repeatedly asking "why" to identify the root cause of an issue. Developed by Toyota in the 1930s, it's a cornerstone of Lean management and continuous improvement practices.

  • ZUser Research Analysis

    Dovetail is an essential service to analyze while Excel is the workhorse of corporate America

  • ZFeedback Loops

    Give your users an effortless way to give you valuable feedback.

  • ZLo-Fi Wireframes

    Sketching is the fastest, most direct way to get a vision out of your head. Non-visual people sketch in text, as well - sketching | drawing

  • ZMi-Fi Wireframes

    Designed to put the focus on information design, model tools, that can host a Design system, are the best of both worlds as they can render a beautiful idea almost effortlessly - Sketch/Figma | Omnigraffle

  • ZLo-Fi - Prototyping

    Hand-drawn prototyping is an immersive design process where sketching ideas on paper in real-time fosters rapid exploration. Sitting across from a user and visually mapping out potential directions can quickly uncover key concerns, making it a powerful tool for early-stage feedback and iteration - pencil/paper

  • ZHi-Fi Prototyping

    When users anticipate engaging with dense data, subtle animations, or native features like geo-location, building a prototype in a more robust environment can often be faster and more efficient than using a traditional design tool - html/js/css | native iOS

5
5

Deploy

Results

The software is on track for full adoption by the end of 2025, with over 100 pathologists expected to integrate it into their workflow.

This implementation will drastically reduce MSK’s reliance on physical microscopes, allowing pathologists to work remotely and conduct diagnoses directly from a computer screen.

By spearheading this transition to large-scale digital pathology, MSK has positioned itself as an industry leader, setting a precedent that other hospitals are now beginning to follow.

  • ZAnalytics

    Planning and embedding a mechanism for continuous feedback remains an essential part of future-proofing a product - Adobe Analytics | Google Analytics | HEAP | HotJar | Mouseflow | Pendo | CrazyEgg | Optimizely | Matomo | Amplitude

  • ZAgile

    A flexible, iterative approach to project management and software development that prioritizes collaboration, adaptability, and continuous improvement - Capability | Features | User Story

  • ZSilver Platter

    A term I use to describe when UX deliverables are delivered to a team inclusive to discovery, testing, and design - completed, without a need for further consultation - .pdf

My Role in Product Strategy

Much of the above discusses the details of a moment in a product - but it doesn't speak to how we got there;  the strategy behind it; the countless meetings to discuss a platform / product direction.

As a Principle Product Designer,  I would

  • rally for the User in business planning discussions
  • alter the vector of the project vision
  • provide roadmaps for annual and quarterly workshops

It would be remiss not to mention this - less you might think I was a passive reactor to the development of these products.

Key Insights from Pathologists

  1. A Deep Love for Microscopes: Most pathologists own high-end microscopes, with many keeping one at home—a seamless extension of their professional selves.
  2. Open to AI (with Conditions): Surprisingly, they were more receptive to AI analysis than expected but insisted on human verification for all results.
  3. Frustration with Logging In: They hate logging into multiple systems. If not at their personal terminal, it can take up to 20 minutes just to get set up.
  4. Blindfolded Gestures: For years, MSK researchers were forcing mice into the hands of Pathologists – when they really wanted to retain the learned body memory from years at the microscope
  5. Delegation of Accession Planning: Fellows handle accession planning, but attendings insist on reviewing all cases themselves.
  6. Reluctance to Let Fellows Use AI: Attendings strictly prohibit fellows from using AI tools, preferring to oversee and verify their work.
  7. Rapid Oscillation Between Roles: When reviewing cases initially diagnosed by fellows, attendings seamlessly shift between analysis and teaching, training their mental models in real-time.
  8.  Technical Lag Times Are the Real Enemy: The curmudgeons weren’t opposed to digital implementations; they despised the technical lag. DICOM and other medical images, often 3GB in size, exacerbate this frustration.
  9. Apple Loyalty: Every pathologist I spoke to owned iPhones and Apple products—none used Android.

While these insights are just the surface, they provided critical direction for my designs and prototypes. Some of the most remarkable findings are proprietary and can’t be shared here, but they served as the driving force behind my approach.

 

Observing a signout with a leader in cancer research

Given the variety of the projects, John showed the ability to pick up new ideas and with inspiration, drive the projects with creativity. In many ways, some of his approaches were way ahead ofthe times.

John’s 2021 vision for digital pathology was to have touch screens or VR headsets to view and interact with the images, mimicking the pinch/zoom capabilities of the iPhone. Due to budget limitations, we were unable to buy screens for all the pathologists.

But at a recent digital pathology conference, I saw that this touch navigation is becoming the default interaction. There was even a demo with the Apple Vision Pro.

It’s a testament to John’s creativity and vision that he was able to  imagine this a few years ago.

John Philip

Senior Director of Clinical and Translational Informatics in Digits, Memorial Sloan Kettering Cancer Center