Contact me
side menu icon
Tech Fleet: UX Skills Study
Photo by David Travis on Unsplash

Project Overview

who
Tech Fleet is a volunteer-based organization that offers pro bono UX research and design services for nonprofits. The volunteers are early-career UX designers and researchers, for whom Tech Fleet is a stepping stone to gain experience.
what
Exploring which direction the organization should take to serve its volunteer members best, Tech Fleet’s Lead has tasked a group of researchers (incl. myself) to answer some critical questions about the UX job market.

Problem Statement

Understand how Tech Fleet can better serve its volunteers in terms of equipping them for the job market. With that, we set out to learn about Tech Fleet’s volunteers’ needs, expectations, and career goals and compare their answers to the market needs.

HIGH-LEVEL GOALS
  • Validate the value proposition of Tech Fleet for its volunteers, given the current market needs.
  • Understand the differences between in-house and agency-type UX roles.*
  • Identify any gaps between what UX candidates think they need vs. what the industry professionals are looking for.
  • Based on the research findings, provide recommendations to Tech Fleet on how it might better serve its volunteers.

*The goal was revised during the process. See below.

Target Audience
video interview

Recruiters and Hiring Managers

Participants eligibility criteria:

  • Experience recruiting or hiring entry-level UX candidates.
  • Work for a consultancy, staffing agency, or in-house.

Entry-Level UX Research and Design Candidates

Participants eligibility criteria:

  • No employment history in UX-related job.
  • Familiarity with the UX job market.
video interview

My Contribution

  • Conducted preliminary research of the UX job market and created UX skills datasets to support subsequent stages of the research;
  • Developed surveys and card sort studies.
  • Wrote interview scripts, moderated interviews, and led qualitative data analysis.
  • Developed and presented a portion of the final presentation.

Research Limitations

  • The small sample size for hiring managers and recruiters made a quantitative comparison between the two target groups inapplicable.
  • The data we gathered was limited in organization types prompting us to pivot away from the initial idea to distinguish between agencies and in-house UX roles.

Process

Step 1: Understand the job market.

We collected job descriptions on LinkedIn and compiled our data into two categories – UX Researcher and UX Designer. Each team member collected job postings specific to their location to capture the range of the existing variations across the US.

Go
to open the table in a new tab.
Step 2: Identify what skills appear most frequently.
Next, I ran a Word Frequency Analysis using the software program MAXQDA to learn which words and word combinations are most frequently used in job postings.

One fun way to visualize the data is with a word cloud
word cloud
Image by Masha Buschujewa produced with MAXQDA
Word Frequency Analysis Results

Step 3: Compare the skills that candidates and professionals perceive as essential for landing a job in UX.

Card Sort

To compare how UX candidates and UX professionals rate specific skills, we created a Card Sort study. Using the Word Frequency Analysis results, we asked the participants to sort the skills (32 cards) into four categories in order of importance. Meaning: the higher the skill was placed within a category, the more important the skill was.

cards
cards for the card sort as displayed in the research software
categories
Category: must-have experienceCategory: must be familiar withCategory: nice to haveCategory: unnecessary
Go
to open the cards in a new tab.

Survey

Additionally to the card sort, participants filled out a Survey. While the card sorts were identical, survey questions were group-specific and designed to screen and segment the participants according to the target audience parameters.

Further, we used post-study questions as a recruiting tool for the follow-up interview.

QUESTIONS EXAMPLES

Have you ever applied for a UX position?  (UX candidates screener)

  • Yes [go to study]
  • No, but I've looked at UX job listings [go to study]
  • No, I've never applied or even looked at UX job listings [rejects the participant]

Do you have experience interviewing or hiring for junior UX positions? (UX professionals screener)

  • Yes [go to study]
  • No [rejects the participant]
Go
to view the survey questions.
Card Sort Data Analysis
Sample
UX candidates by desired role
Pie chart
UX candidates sample
The total number of participants is 39

41% of participants are applying for both – UX design and
research roles
25.6% apply for UX Design roles, and 25.6% apply for
UX Research roles
7.7% are not yet sure which role within UX they’ll pursue
UX professionals by role and organization type
Bar chart
UX professionals sample
The total number of participants is 10

Break down by role:
5 hiring managers
4 professionals on a hiring committee
1 recruiter

Break down by organization type:
1 professional working for a design agency
9 professionals working for an in-house based UX team
UX professionals by the role they hire for
Bubble chart
UX professionals sample
The total number of participants is 10

Break down by the roles they hire for
5 of the participants are hiring for UX Design roles
3 are hiring for hybrid-type roles
2 are hiring for UX research roles
Analysis Method

We compared* the results of both groups side-by-side in terms of:

  • Results for all UX professionals.
  • Results for all UX candidates.
  • UX research candidates compared to the UX research-centered professionals.
  • UX design candidates compared to the UX design-centered professionals.
  • UX professionals, hiring for research roles vs. design roles.

*We omitted the comparison by the organization type due to the small sample size.

Findings

We concluded from the card sort results that UX candidates and UX professionals involved in the hiring process have a relatively homogeneous view of the required skills for the entry-level UX candidates.

Selected findings:

  • Soft skills, such as problem-solving, communication, and collaboration, were the highest rated in the must-have category list by both groups.
  • Regarding hard skills, 70% of hiring managers ranked 'Understanding the Differences of UX Deliverables' as a must-have skill, followed by wireframing (60%), design thinking (60%), and qualitative research methods (50%).
  • 51% of UX Candidates placed 'Personas' and 'Usability Evaluation' in the must-have category. At the same time, most hiring managers and recruiters ranked those as must be familiar with or nice to have skills.
  • Both groups ranked skills like coding, knowledge of Adobe creative suite, and a degree in HCI or human factors as nice to have or unnecessary skill.

Step 4: Understand participants’ pain points, needs, and wants.

Interviews

what

We conducted a total of 14 in-depth interviews.

Goals:

  • Learn about the participants' problems when searching for a job or a candidate to fill a position.
  • Understand their search process;
  • Recognize their motivations and frustrations.
who

9 UX candidates

5 UX professionals

how

Online Interviews of approx. 30 min.
Tools: Zoom  + Otter (as our transcription tool).

QUESTIONS EXAMPLES
  • What has been most helpful in your job search so far?
  • How do you decide whether you are going or not to apply for a particular position?
  • Besides work experience in the field, what are some of the critical skills and qualities you look for in a UX candidate?
  • Could you tell me a little about the last few people you hired and the recruitment process you went through?
Go
to view the complete script.

Qualitative Data Analysis

We analyzed interview data, first looking at the UX candidates and UX professionals as two separate groups and then comparing them to each other. Tool: Reframer by OptimalWorkshop.

  • We looked for patterns, common themes, and individual narratives.
  • The qualitative coding and grouping of the data ensured we followed a systematic approach and curbed arbitrariness.
  • To help us capture the emotional level, we focused on how something was said, the tone, and the emphasis.

Findings

UX Candidates

We discovered three common themes:

  1. Role level + years of experience.
  2. Role title + skills required.
  3. Portfolio requirements.

Together these points are a source of frustration contributing to the imposter syndrome that many candidates reported.

seniority level and years of experience
There is a contradiction between the role level and the years of experience required – junior-level roles often require 5+ years of experience.
“Sometimes I get discouraged for applying to roles that require more than a year of experience. But unfortunately, those are the only roles that are out there right now.”
(A. – interview participant)
Role title + skills required
There is a discrepancy between the role title and the skills desired for that role – e.g., a UX job will sometimes require knowledge of design software and coding skills.
“The coding part, I mean, I am learning coding, but there are just some languages that I'm surprised to see. Included, like, heavy emphasis on JavaScript or more emphasis on the back-end.”
(G. – interview participant)
Portfolio requirements
Candidates report confusion about the portfolio requirements – what types of projects, "real" projects vs. projects conducted during their education process.
“Most undergrad programs aren't really associated with any kind of UX research methodology. [...] You're not going to really have UX research experience to put in a portfolio so it seems odd to [...] have that as an expectation for entry-level positions.”
(S. – interview participant)

How do the candidates address these frustrations?

  • They connect with peers on various platforms and channels.
  • Seek advice and help from the networks that they are actively building.
  • They volunteer, create self-initiated projects, participate in hackathons, and design challenges to get experience.

Check out this Miro board for an interactive experience with the data.

UX Professionals

In the interviews with UX professionals, we addressed the pain points of the UX candidates. Our findings suggest that

Experience
A candidate's experience is not evaluated by the number of years on the job but rather by the expertise in solving User Experience related problems.
"I think I rely a little bit heavier on the portfolio, the case study that they present then necessarily the experience."
(Interview participant)
Skills
Job descriptions are not designed to contain all the details but serve as a generalized screener. So to find a perfect fit for a particular role, hiring managers tap into their networks and rely on recommendations.
"I've definitely had people reach out to me on LinkedIn, and I'll grab like half-hour coffee or something like that and just get to know them a little bit, and if I feel like they're a good fit […], I'm happy to put them into our system as well [...]."  
(Interview participant)
Portfolio
A portfolio is critical for assessing the experience. In a portfolio, hiring managers look for the overall understanding of UX principles, problem-solving skills, and the ability to communicate and convince.
"What's important to understand is what thinking led to how those elements ended up on the screen."
(Interview participant)

To summarize:

  • Job descriptions are a general guide and are used by recruiters for creating a repository of potential candidates.
  • Networking and referrals play an important role in finding the right candidate.
  • A portfolio is instrumental for assessing the candidate’s competence and potential.

Key Takeaways & Recommendations

This research began with a question:

How relevant is Tech Fleet's value proposition for its volunteers, and what can the organization do better to serve its base of aspiring UX designers and researchers?

The results show that entry-level UX candidates must have a portfolio of projects to showcase their experience. Hence, they need a place to gain experience. In this regard, a platform such as Tech Fleet serves an essential function on the market, providing a space for aspiring UX professionals to obtain experience beyond education (university degree, boot camp, or self-learning methods).

Recommendations

EXPLORE UX ROLES & FUNCTIONS

Tech Fleet could further explore the area between UX education and industry employment. For example, by establishing a "greenhouse" where volunteers can experiment with various roles and responsibilities –

  • with no risk of losing their job,
  • have the opportunity to get mentorship.

This way, the future candidates could better learn about the strengths and functions they are best suited for.

LEARN ABOUT THE VARIABILITY OF UX RESPONSIBILITIES

Because responsibilities within UX roles can vary depending on the organization's size, Tech Fleet could be a place for candidates to learn which type of working environment they are looking for in their next career opportunity.

ACTIVATE NETWORK

Tech Fleet is a community that can function as a network for UX candidates to share opportunities, get references, and a place to help one another to get "their foot into the door" of the UX industry.

Outcomes

Because of the efforts tied directly to this research to gain more exposure within the UX community, Tech Fleet has been dramatically expanding its members' and clients' base.

Additionally, Tech Fleet has sought to build partnerships with some boot camp programs leveraging the potential for growth within the niche space between UX education and industry employment for entry-level UX professionals.

You can find the final result of the presentation deck here.

To watch the presentation, go here.

Thank you for reading!
Have questions or want to say hello?
contact
arrow up