This page is in lite mode.
View full version ↗
This page is
in lite mode.
View full version
This page is in lite mode.
View full version
NASA
NASA SUITS
Sep 2023 - May 2024
An AR program that assists NASA astronauts to navigate the Martian surface with ease during spacewalk. Placed Finalist.
Topic
UI/UX
AR
Role
Team Lead
UI/UX Designer
Team
RISD x Brown University (28 members)
NASA
NASA SUITS
Sep 2023 - May 2024
An AR program that assists NASA astronauts to navigate the Martian surface with ease during spacewalk. Placed Finalist.
Topic
UI/UX
AR
Role
Team Lead
UI/UX Designer
Team
RISD x Brown University (28 members)
NASA
NASA SUITS
Sep 2023 - May 2024
An AR program that assists NASA astronauts to navigate the Martian surface with ease during spacewalk. Placed Finalist.
Topic
UI/UX
AR
Role
Team Lead
UI/UX Designer
Team
RISD x Brown University (28 members)
NASA
NASA SUITS
Sep 2023 - May 2024
An AR program that assists NASA astronauts to navigate the Martian surface with ease during spacewalk. Placed Finalist.
Topic
UI/UX
AR
Role
Team Lead
UI/UX Designer
Team
RISD x Brown University (28 members)
OVERVIEW
OVERVIEW
OVERVIEW
OVERVIEW
The Challenge
The Challenge
The Challenge
The Challenge
NASA’s Artemis missions aim to establish a sustained human presence on the Moon and Mars. Extravehicular activities (EVA), or "spacewalks", play a vital role in these missions and the pursuit of deeper space exploration.
In 2024, the NASA SUITS challenge invited us to reimagine the spacewalk experience to meet the demands of the harsh Martian environment.
I served as the NAV Design Team Lead, initially guiding a team of four. As the project progressed, I expanded my role to oversee the overall AR UI/UX design, ensuring a cohesive and user-centered experience.
NASA’s Artemis missions aim to establish a sustained human presence on the Moon and Mars. Extravehicular activities (EVA), or "spacewalks", play a vital role in these missions and the pursuit of deeper space exploration.
In 2024, the NASA SUITS challenge invited us to reimagine the spacewalk experience to meet the demands of the harsh Martian environment.
I served as the NAV Design Team Lead, initially guiding a team of four. As the project progressed, I expanded my role to oversee the overall AR UI/UX design, ensuring a cohesive and user-centered experience.
Our Solution
Our Solution
Our Solution
Augmented Reality (AR) navigation and task management tools that reduce cognitive load and a localized control center to streamline mission operations.
Our Impact
Our Impact
Our Impact
Our Impact
We were honored to be selected as finalists and to showcase our work through on-site testing at NASA's Johnson Space Center in May 2024.
Our on-site testing with NASA design evaluators and astronauts showcased high task accuracy, with feedback highlighting the intuitive and effective communication of our design.
We were honored to be selected as finalists and to showcase our work through on-site testing at NASA's Johnson Space Center in May 2024.
Our on-site testing with NASA design evaluators and astronauts showcased high task accuracy, with feedback highlighting the intuitive and effective communication of our design.
FINAL DESIGN
This page is in lite mode. View full version ↗
FINAL DESIGN
This page is in lite mode. View full version
FINAL DESIGN
This page is in lite mode. View full version ↗
FINAL DESIGN
FEATURE 01
FEATURE 01
FEATURE 01
Shortcuts and automations to
combat limited mobility.
Shortcuts and automations to
combat limited mobility.
Shortcuts and automations to combat limited mobility.
Palm Menu
Palm Menu
Palm Menu
Palm Menu
Palm Menu
Flip your hand to access shortcuts to key features, designed for spacesuit mobility limits.
Flip your hand to access shortcuts to key features, designed for spacesuit mobility limits.
Task List
Task List
Task List
Task List
Streamline your mission with an auto-advancing task list, guiding you effortlessly to the next site.
Streamline your mission with an auto-advancing task list, guiding you effortlessly to the next site.
Task List
FEATURE 02
FEATURE 02
FEATURE 02
Intuitive map and unobtrusive navigation.
Intuitive map and unobtrusive navigation.
Intuitive map and
unobtrusive navigation.
Map
Map
Map
Map
View important site landmarks at a glance with a simple, intuitive map.
View important site landmarks at a glance with a simple, intuitive map.
Active Nav Mode
Active Nav Mode
Active Nav Mode
Active Nav Mode
Active Nav Mode
Navigate hands-free — UI appears only when you look, keeping your view clear.
Navigate hands-free — UI appears only when you look, keeping your view clear.
FEATURE 03
FEATURE 03
FEATURE 03
Complex procedures made simple.
Complex procedures made simple.
Complex procedures
made simple.
Geo Sampling
Geo Sampling
Geo Sampling
Geo Sampling
Geo Sampling
Capture geologic data, image notes, and voice notes all at once for a seamless sampling workflow.
Capture geologic data, image notes, and voice notes all at once for a seamless sampling workflow.
Egress
Egress
Egress
Egress
Egress
Straightforward step-by-step guides for complex procedures like egress, ingress, and equipment repair.
Straightforward step-by-step guides for complex procedures like egress, ingress, and equipment repair.
FEATURE 04
FEATURE 04
FEATURE 04
Seamless spacewalk support.
Seamless spacewalk support.
Seamless spacewalk support.
Stay mission-ready with the Local Mission Control Console (LMCC) — a dual-display setup optimized for real-time sync with astronauts, navigation path drawing, rover control, sample monitoring, and task management.
Stay mission-ready with the Local Mission Control Console (LMCC) — a dual-display setup optimized for real-time sync with astronauts, navigation path drawing, rover control, sample monitoring, and task management.
Palm Menu
Map > View Station
Map > Add Point of Interest (POI)
Map > Add Obstacle
Map > POI > Add image note
Geo Sampling
Geo Sampling > Voice Note
Egress
Repair
RESEARCH
RESEARCH
RESEARCH
RESEARCH
Understanding the Objectives
Understanding the Objectives
Understanding the Objectives
Understanding the Objectives
What do astronauts exactly do on spacewalks? We broke down the key objectives of spacewalk tasks to gain insight into our users' goals and priorities.
What do astronauts exactly do on spacewalks? We broke down the key objectives of spacewalk tasks to gain insight into our users' goals and priorities.
Egress
Egress
Egress
Ensure a safe transition in and out of the airlock.
Ensure a safe transition in and out of the airlock.
Navigation
Navigation
Navigation
Enable safe and efficient navigation between stations, with room for flexibility in destination changes.
Enable safe and efficient navigation between stations, with room for flexibility in destination changes.
Sampling + Repair
Sampling + Repair
Sampling + Repair
Document geologic samples and perform system repairs following a designated spacewalk task list.
Document geologic samples and perform system repairs following a designated spacewalk task list.
Rover Control
Rover Control
Rover Control
(Control center) Transmit GPS pins of rover locations to guide astronauts in collecting scientific assets.
(Control center) Transmit GPS pins of rover locations to guide astronauts in collecting scientific assets.
Understanding the Flow
Understanding the Flow
Understanding the Flow
Understanding the Flow
Next, we analyzed these tasks in detail, mapping user flows for each and pinpointing areas where critical information needs to be displayed.
Next, we analyzed these tasks in detail, mapping user flows for each and pinpointing areas where critical information needs to be displayed.
Understanding the User
Understanding the User
Understanding the User
Understanding the User
What better way to uncover the challenges of spacewalks than by seeing through the eyes of those who’ve lived it? Through user interviews with 8 former astronauts and experts conducted in 2022, we identified two key pain points in the spacewalk experience:
What better way to uncover the challenges of spacewalks than by seeing through the eyes of those who’ve lived it? Through user interviews with 8 former astronauts and experts conducted in 2022, we identified two key pain points in the spacewalk experience:
1
1
1
Cognitive Overload
Cognitive Overload
Cognitive Overload
Juggling intricate tasks, tight timelines, and constant hazards — all while working in zero gravity puts astronauts at risk of cognitive overload.
Juggling intricate tasks, tight timelines, and constant hazards — all while working in zero gravity puts astronauts at risk of cognitive overload.
"A checklist relies on memorization and the current one looks like a poorly designed book"
— James H. Newman, former NASA astronaut
"A checklist relies on memorization and the current one looks like a poorly designed book"
— James H. Newman, former NASA astronaut
"A checklist relies on memorization and the current one looks like a poorly designed book"
— James H. Newman, former NASA astronaut
"A checklist relies on memorization and the current one looks like a poorly designed book"
— James H. Newman, former NASA astronaut
2
2
2
Limited Mobility
Limited Mobility
Limited Mobility
With heavy pressurized suits and stiff gloves, even simple movements like gripping and gesturing become monumental challenges.
With heavy pressurized suits and stiff gloves, even simple movements like gripping and gesturing become monumental challenges.
"With bulky gloves, there's no tactile feedback"
— Steve Swanson, former NASA astronaut
"With bulky gloves, there's no tactile feedback"
— Steve Swanson, former NASA astronaut
"With bulky gloves, there's no tactile feedback"
— Steve Swanson, former NASA astronaut
"With bulky gloves, there's no tactile feedback"
— Steve Swanson, former NASA astronaut
TLDR —
TLDR —
TLDR —
TLDR —
As an astronaut conducting spacewalk on Mars,
I need simple and clear directions for navigating between destinations
so I can focus on completing my tasks safely.
SOLUTION:
SOLUTION:
SOLUTION:
AR navigation and task management tools
As control center crew assisting spacewalk,
I need to stay in sync with astronaut status and task progress
so I can ensure mission success and a safe return.
SOLUTION:
SOLUTION:
SOLUTION:
Local mission control console (LMCC) interface
IDEATION
IDEATION
IDEATION
IDEATION
Design Goals
Design Goals
Design Goals
Design Goals
Using the objectives, user flows, and pain points of spacewalks as a foundation, we established key design goals for our project:
Using the objectives, user flows, and pain points of spacewalks as a foundation, we established key design goals for our project:
1
1
1
Unobtrusive Design
Unobtrusive Design
Unobtrusive Design
Lower cognitive load with subtle, unobtrusive UI elements. Keep field of view clear.
Lower cognitive load with subtle, unobtrusive UI elements. Keep field of view clear.
2
2
2
Minimal Gestures
Minimal Gestures
Minimal Gestures
Avoid complex gestures to account for limited mobility.
Avoid complex gestures to account for limited mobility.
3
3
3
Clear Visual Hierarchy
Clear Visual Hierarchy
Clear Visual Hierarchy
Use a clear visual hierarchy to emphasize key UI elements.
Use a clear visual hierarchy to emphasize key UI elements.
4
4
4
Consistent Design Patterns
Consistent Design Patterns
Consistent Design Patterns
Ensure consistent design across AR and LMCC for seamless communication.
Ensure consistent design across AR and LMCC for seamless communication.
Iterative Design Process
Iterative Design Process
Iterative Design Process
Iterative Design Process
From lo-fi to hi-fi, we went through countless rounds of iterations and conducted rapid concept testing in close collaboration with the dev team. This approach helped us identify and address false assumptions early.
From lo-fi to hi-fi, we went through countless rounds of iterations and conducted rapid concept testing in close collaboration with the dev team. This approach helped us identify and address false assumptions early.
Sketches
Sketches
Sketches
Sketches
Lo-fi iterations
Lo-fi iterations
Lo-fi iterations
Lo-fi iterations
Implementation + testing
Implementation + testing
Implementation + testing
Implementation + testing
Hi-fi mocks ready for dev
Hi-fi mocks ready for dev
Hi-fi mocks ready for dev
Hi-fi mocks ready for dev
UI Library
UI Library
UI Library
UI Library
100+ Custom-made Components
100+ Custom-made Components
100+ Custom-made Components
Following the given style guide, I created and maintained the AR UI component library to ensure consistent visual design across all features.
Following the given style guide, I created and maintained the AR UI component library to ensure consistent visual design across all features.
TESTING
TESTING
TESTING
TESTING
User Testing
User Testing
User Testing
User Testing
Prior to on-site testing, we tested both Figma and AR prototypes with 20 participants, aged 18-50. This gave us an opportunity to fine-tune the user experience before heading to Houston.
Prior to on-site testing, we tested both Figma and AR prototypes with 20 participants, aged 18-50. This gave us an opportunity to fine-tune the user experience before heading to Houston.
User testing participant Kaline Yoo testing the Figma prototype.
User testing participant Kaline Yoo testing the Figma prototype.
User testing participant Kaline Yoo testing the Figma prototype.
User testing participant Kaline Yoo testing the Figma prototype.
LMCC lead Linlin Yu testing the AR interface in outdoor conditions.
LMCC lead Linlin Yu testing the AR interface in outdoor conditions.
LMCC lead Linlin Yu testing the AR interface in outdoor conditions.
LMCC lead Linlin Yu testing the AR interface in outdoor conditions.
"The wrist menu clashes with hand visualizations on the headset. Difficult to press."
"The wrist menu clashes with hand visualizations on the headset. Difficult to press."
→ Changed menu to open up when the left hand palm is showing, further reducing gestures.
→ Changed menu to open up when the left hand palm is showing, further reducing gestures.
"Hazard and Point of Interest pin icons look too similar - it's hard to distinguish them, especially on the headset."
"Hazard and Point of Interest pin icons look too similar - it's hard to distinguish them, especially on the headset."
→ Changed the design of the pins to be more distinctive.
→ Changed the design of the pins to be more distinctive.
"(LMCC) Telemetrics data is an important feature - it needs to be more visible."
"(LMCC) Telemetrics data is an important feature - it needs to be more visible."
→ Re-organized hierarchy of console panels.
→ Re-organized hierarchy of console panels.
On-site Testing
On-site Testing
On-site Testing
On-site Testing
May 19-23 2024, we embarked on a journey to the Johnson Space Center to conduct on-site testing and present our project to NASA professionals.
May 19-23 2024, we embarked on a journey to the Johnson Space Center to conduct on-site testing and present our project to NASA professionals.
NASA design evaluator testing Comm Tower cable repair scenario
NASA astronaut Anil Menon evaluating our LMCC station
NASA astronaut Anil Menon evaluating our LMCC station
NASA astronaut Anil Menon evaluating our LMCC station
NASA astronaut Anil Menon evaluating our LMCC station
Findings
Findings
Findings
Clarify Acronyms
Acronyms like "POI" are efficient in saving visual real estate, but need tooltips for clarification.
Acronyms like "POI" are efficient in saving visual real estate, but need tooltips for clarification.
Color Accessibility
Orange proved to be an inaccessible color to indicate obstacles.
Orange proved to be an inaccessible color to indicate obstacles.
Map Toggle On/Off
The map also needs a toggle on/off shortcut for easy access.
The map also needs a toggle on/off shortcut for easy access.
Technical Difficulties
Technical Difficulties
Technical Difficulties
This was the first year the SUITS challenge tested during the day — a factor we hadn’t accounted for. Many devices, including our Magic Leap 2, experienced overheating as most commercially available AR headsets are not yet built for outdoor usage.
This was the first year the SUITS challenge tested during the day — a factor we hadn’t accounted for. Many devices, including our Magic Leap 2, experienced overheating as most commercially available AR headsets are not yet built for outdoor usage.
TAKEAWAYS
TAKEAWAYS
TAKEAWAYS
TAKEAWAYS
1
1
1
Fail Fast
Fail Fast
Fail Fast
Rapid prototyping and testing directly on the device helped us uncover false assumptions early, like discovering a palm menu is far more accessible than a wrist menu. This reinforced the value of failing fast to iterate and optimize designs.
Rapid prototyping and testing directly on the device helped us uncover false assumptions early, like discovering a palm menu is far more accessible than a wrist menu. This reinforced the value of failing fast to iterate and optimize designs.
2
2
2
Optimize Figma to AR workflow
Optimize Figma to AR workflow
Optimize Figma to AR workflow
Bringing AR designs to life was a major challenge, with mismatched dimensions in Figma and Unity slowing progress. This inspired me to reimagine XR design tools, leading to my independent project: Figma XR Mode.
Bringing AR designs to life was a major challenge, with mismatched dimensions in Figma and Unity slowing progress. This inspired me to reimagine XR design tools, leading to my independent project: Figma XR Mode.
3
3
3
Anticipate Technical Limitations
Anticipate Technical Limitations
Anticipate Technical Limitations
Technical limitations of the Magic Leap 2 created unexpected challenges during on-site testing, such as overheating under Houston rockyard conditions. This taught me the importance of anticipating hardware constraints when designing for XR.
Technical limitations of the Magic Leap 2 created unexpected challenges during on-site testing, such as overheating under Houston rockyard conditions. This taught me the importance of anticipating hardware constraints when designing for XR.
The RISD x Brown team will continue building and enhancing AR tools for space exploration in upcoming NASA SUITS challenges!
The RISD x Brown team will continue building and enhancing AR tools for space exploration in upcoming NASA SUITS challenges!
Special thanks to:
RISD x Brown SUITS team members
RISD Advisor Michael Lye
NASA Advisor Skye Ray
Special thanks to:
RISD x Brown SUITS team members
RISD Advisor Michael Lye
NASA Advisor Skye Ray
Check out more projects!
Check out more projects!
© Sunjoo Park 2024
© Sunjoo Park 2024
© Sunjoo Park 2024
© Sunjoo Park 2024