Visuals on Fly — UX Case Study by Sahil
Amazon

Bringing visuals to Gen-AI talent planningfor 350k+ employees

How I designed the patterns that let the Amazon AI answer
with org charts and metrics, not walls of text.

Visuals on Fly case study cover image
Role
Lead UX Designer
Team
Senior Leader Experiences (SLX), A to Z AI, Blueprint
Timeline
~6 weeks,
concept to pilot
Status
Shipped to pilot,
30–40 HRBPs
The short version

When you ask your fav Gen-AI for the weather, you get a weather card. It's like loading visuals on the fly.

Weather card example showing a rich visual answer in chat

Aza, Amazon's Gen-AI chatbot, couldn't do that yet. It answered talent planning questions in text, even when the question was inherently visual ("show me promotion-ready L7s in Julia's org"). Meanwhile, Blueprint had a rich library of org charts, employee cards, and readiness indicators, but they lived in a separate product.

Visuals on Fly (VOF) brought Blueprint's visual language into Aza conversations. As the lead designer, I owned the curation, rendering, and transition patterns that defined how this new kind of response should work.

01 — The problem

Talent planning is visual work, trapped in a text box

  • HRBPs think in org charts, candidate lists, and reporting lines, not paragraphs.
  • Aza could only respond in text, so complex answers turned into wall of words.
  • Anything structural required leaving Aza for Blueprint, breaking the conversational thread every time.
Problem walkthrough video
02 — My role

Sole designer, owning three challenges

I partnered with PMs from the Blueprint team and got design review from designers on the Aza team. I owned the design end to end:

  • Curation — which Blueprint visuals belong inside a conversation.
  • Rendering — how those visuals should look and behave in a chat surface instead of a dashboard.
  • Transitions — when to answer inline vs. hand off to Blueprint.
03 — The flow I designed

Talent planning was a multi-step workflow spread across tools.

An HRBP could get an insight in Aza, then had to jump to Blueprint and rebuild context to act on it. So I redesigned the journey to keep each answer in the conversation, with every response setting up the next decision.

Customer journey diagram for the Visuals on Fly flow

In the product, that journey became three connected turns. Each answer narrows the problem and hands the user a stronger next step, instead of sending them back to start over somewhere else.

TURN 01
"Who's ready?"
Candidate cards grouped by readiness, each showing role, location, and management ratio, plus a funnel summary.
Candidate cards
TURN 02
"What org change creates the scope?"
A recommended structure change with a metrics comparison table, measured against L8 thresholds.
Comparison table
TURN 03
"What's the impact on the team?"
An Org Impact Overview with annotated changes and a team-health breakdown of headcount and job-level mix.
Impact overview
The improved journey in product. Candidates → structure → impact.
04 — Key decisions

Four calls that shaped UX

1. How I decided which Blueprint visuals translate to AZA?

  • Blueprint has dozens of components built for a full dashboard, and most don't survive translation to AZA. I made tradeoffs decisions to these components mentioned in the below table.
Blueprint Decision Why
Employee Cards
Level, photo, role
Employee card visual example
Translated
  • Atomic unit for org analysis
  • All essential employee info in one component
  • Contains customizable chips to fit chat context
Org chart tree
Metric tiles, level mix, ratios
Org chart tree visual example
Translated
  • Lifted from side panel to inline response
  • Each chart answers one question at a time
  • Preserves chat tempo
Job level mix
Level distribution, composition
Job level mix visual example
Translated
  • Summarizes team composition at a glance
  • Keeps level distribution inline with the answer
  • Supports quick tradeoff discussion in chat
Multi-tab nav
View org, Scenario, Dashboard
Multi-tab navigation visual example
Rejected
  • Chat handles routing
  • Tabs would compete with conversation
Scenario entry
Person picker + action button
Scenario entry visual example
Rejected
  • Org Modeling hands off to Blueprint
Zoom toolbar
Floating view + zoom controls
Zoom toolbar visual example
Rejected
  • No persistent canvas in chat to anchor it
  • Controls anchor to the response, not the page

These components were translated by keeping the core Blueprint signal intact, then reshaping it for chat. The image below shows one example of how an employee card was adapted into a compact, inline answer.

Design decisions example showing how the employee card component was translated
2

2. Designing visuals to carry states, not just static data

  • Most useful pattern was visuals that show what changed, not just what is.
  • Org Impact Overview tags nodes with their state directly on the chart: a "new position" banner, a "manager change" banner, and an inline warning when a promotion falls outside the org's region.
  • HRBP read the consequence of a decision without parsing a table.
4

3. I tested split-screen integration but complex org modeling requires handoff to Blueprint

  • Modeling a multi-step reorg or running deep scenario analysis needs Blueprint's native features and its full canvas, therefore these actions require redirect to Blueprint .
Customer journey diagram for the Visuals on Fly flow
5

4. Defining guardrails for AI to prevent irreversible decisions

During my first week at Amazon I learned about "one-way door decisions" i.e. choices that can't be undone once made. Even though our goal was to empower HRBPs with faster talent planning, we had to be careful about how much we let Aza execute on a user's behalf. So I designed guardrails around approval flows that keep Aza out of any one-way door decisions, no matter how confident the AI sounds.

AZA Non-executable actions Explanation
Marking employee ready or not ready for promotion
Affects the org review and create bias towards certain candidates.
Submitting a promotion request
Since it's in the approval queue, the candidate, manager, and committee all see it
Notifying employees about promotion decisions
Early phases of promotion planning restricts employee involvement or notification
05 — Feedback & iteration

How collaboration and feedback from AZA team refined designs

From 0->1 to 1->N, working with the AZA team helped me refine the experience around AZA's conversational model, constraints, and expectations.

Feedback theme

Visuals to help not overwhelm

Visuals on Fly should compliment the existing conversational flow but not overwhelm it.

Feedback theme

Tighter information density

Combine multiple visual components into one, improving load performance.

Feedback theme

Follow-up prompts

For non-deterministic workflows, guide next user action using contextual follow-up prompts.

Iterating through feedback video
06 — Solution

Talent planning becomes simpler with visuals on fly

HRBPs now ask Aza a talent planning question in plain language and get a visual response inline. Live org charts, candidate cards, and readiness indicators render directly in the chat thread, composed from Blueprint and ETM data behind the scenes.

Final solution walkthrough
07 — Learnings & Challenges

With great AI comes great responsibility

I experimented, failed sometimes and eventually learnt how to define guardrails around AI for talent planning which preserved the user's trust in AZA and onboard more teams to use it.

The biggest challenge was choosing the right visuals for the chat because Blueprint had a big component library built for a full dashboard, and it was tempting to bring everything across. The harder discipline was curating carefully meaning keeping only the components that carried their meaning inside the chat, and rejecting patterns that were not relevant to AZA.

08 — Outcome

Shipped, and reusable

The pilot's real value wasn't the feature. It was proving that an agentic chat could compose visual responses from a separate product's component library and chain them across a real decision

Prod
Shipped & deployed to production and approved for broader rollout
30–40
HRBPs onboarded to the pilot in the first week of launch
78%
Pilot users completed task without support
Home

AMAZON

Building dynamic
HR 
agentic chat
experience

How I designed the patterns that let the Amazon AI answer
with org charts and metrics, not walls of text.

Autodesk Construction Cloud (ACC) is a enterprise SaaS product that allows construction project management and is used by over 1m+ customers. The Member Administration module which I worked on allows Account Admins to view and manage all the members in ACC.

I led the design of View Projects of Account Members which improved the projects visibility by providing a centralized view of a member's projects to account admins along with relevant details like access levels, roles, and assigned products.

The short version

TL;DR

Autodesk Construction Cloud (ACC) is a enterprise SaaS product that allows construction project management and is used by over 1m+ customers. The Member Administration module which I worked on allows Account Admins to view and manage all the members in ACC.

  • When you ask ChatGPT or Gemini for the weather, you get a weather card. Ask it about a stock, you get a chart. The visuals are integrated inside the responses.
  • Aza, Amazon's internal HR chatbot, couldn't do that yet. It answered talent planning questions in text, even when the question was inherently visual. Meanwhile, Blueprint had a rich library of org charts, employee cards, and readiness indicators, but they lived in a separate product.
  • Visuals on Fly (VOF) was the design effort to bring Blueprint's visual language into Aza conversations. I contributed to the curation, rendering, and transition patterns that defined how this new kind of response should work.

I led the design of View Projects of Account Members which improved the projects visibility by providing a centralized view of a member's projects to account admins along with relevant details like access levels, roles, and assigned products.

InFO

Role

UX Designer lead

Duration

6 weeks (Dec'26 - Jan'26)

Team

SLX - Senior leader experiences + AZA product management & design

Status

Shipped to pilot; 30–40 pilot users enabled

Problem overview

Managers & HRs love using Aza AI to ask questions about org data, but deeper visual exploration lived in Blueprint.
  • Talent planning is visual work: HRBPs think in org charts, candidate lists, and reporting lines, not paragraphs.
  • Aza could only respond in text, so complex answers turned into walls of bullet points. Anything structural required leaving Aza for Blueprint, breaking the conversational thread every time.
  • The opportunity: do for HR what weather cards did for ChatGPT, letting the agent compose visual responses inline using a component library Blueprint had already built.
Our team was asked to design a use case that would demonstrate the SLX agentic vision: one conversation, multiple data sources, decisions made without leaving the chat.

Key Design Decisions

1. Reframed the customer journey as a single decision

HRBPs used to bounce between Blueprint, ETM (Executive Talent Management), and workforce planning to answer a single promotion question racking up multiple context switches before they could even make a decision.

We made tool-switching itself the design constraint: Aza pulls from all three sources behind the scenes and composes one visual response, so readiness, structure, and headcount appear in a single unit instead of three separate lookups.

Key Design Decisions

2. Inline visuals, not canvas mode

Early concepts focusing on the new customer journey explored split-screen "canvas mode" where Blueprint would open alongside the chat for complex org interactions.

Key Design Decisions

3. Client-side filtering to preserve conversational tempo

When result sets got large, the question was whether to add traditional filter controls or keep the interaction conversational. We landed on client-side filtering: Aza sends the full data set once and filters locally, so follow-up refinements happen instantly without new API calls. This let users narrow results through conversation ("just the ones in Seattle") rather than wrestling with a sidebar of filter checkboxes.

Process Overview

Interaction Design IDeation

Crafting the optimized dashboard for Visual Clarity

Club cards display the basic information to identify the club before clicking to view more. They play a dominant role in shaping the visual experience. Therefore, this singular piece went through the most iterations by far.

The Solution

Core Experiences
Shipped

To discover and define the problems, our team used double diamond process. This approach enabled me to dive into the intricacies of the data experience within Autodesk.

Integrated Dashboard shoy for a Holistic View

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla,

Integrated Dashboard shoy for a Holistic View

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla,

Integrated Dashboard shoy for a Holistic View

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla,

Let's step back to see how did I reach here...

Adding a server

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.

Adding a camera

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.

Configuring cameras

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.

Precision

Tortor interdum condimentum nunc molestie quam lectus euismod

Prioritization

Tortor interdum condimentum nunc molestie quam lectus euismod

Efficiency

Tortor interdum condimentum nunc molstie quam lectus euismod

DURATION

9 Months

responsibilities

Product thinking, Interaction design, Visual design

Category

SaaS, Security System, B2B, Capstone

ROLE

UX/Product Designer

TEAM

2 UX Researchers, 2 Product designer

TOOLS

Figma, Miro, Balsamiq