SA
Angel Studios
SEARCH FEATURE IMRPOVEMENTS
THE PROBLEM
Search on web was not useful as it was built. We are missing out on a powerful tool for engagement
Hypothosis:
I believed that a full page search that mimmicks the TV experience will allow us to .
SEARCH BEFORE
Hypothosis:
I believed that a full page search that mimmicks the TV experience will allow us to .
Original search before the change
THE PROBLEM
What are we hoping to achieve with this test
Hypothosis:
The new search
The new search - mobile experience
Imrpoved membership plans
Search Engagement is Way Up:
- Higher click through rate - Users found something interesting.
- Search abandonment is down.
- Search per user is down = Users found it quicker.
Imrpoved membership plans
Watch Time Is Down During Test
THE PROBLEM
Analyzing Results For Future Testing
Hypothosis:
I believed that a full page search that mimmicks the TV experience will allow us to .
SUGGESTIONS FROM AI
Hypothosis:
I believed that a full page search that mimmicks the TV experience will allow us to .
I believed that a full page search that mimmicks the TV experience will allow us to .
Suggestions From Claude
Suggestions From Claude
View other projects
A little line about what’s being said and who’s saying it.
Angel Studios
SEARCH FEATURE IMRPOVEMENTS
THE PROBLEM
Search on web was not useful as it was built. We are missing out on a powerful tool for engagement
Hypothosis:
I believed that a full page search that mimmicks the TV experience will allow us to .
SEARCH BEFORE
Hypothosis:
I believed that a full page search that mimmicks the TV experience will allow us to .
Original search before the change
THE PROBLEM
What are we hoping to achieve with this test
Hypothosis:
The new search
The new search - mobile experience
Imrpoved membership plans
Search Engagement is Way Up:
- Higher click through rate - Users found something interesting.
- Search abandonment is down.
- Search per user is down = Users found it quicker.
Imrpoved membership plans
Watch Time Is Down During Test
- Higher click through rate - Users found something interesting.
- Search abandonment is down.
- Search per user is down = Users found it quicker.
THE PROBLEM
Analyzing Results For Future Testing
Hypothosis:
I believed that a full page search that mimmicks the TV experience will allow us to .
SUGGESTIONS FROM AI
Hypothosis:
I believed that a full page search that mimmicks the TV experience will allow us to .
I believed that a full page search that mimmicks the TV experience will allow us to .
Suggestions From Claude
Suggestions From Claude
View other projects
A little line about what’s being said and who’s saying it.
Scott Adams
Angel Studios
SEARCH FEATURE IMRPOVEMENTS
THE PROBLEM
Search on web was not useful as it was built. We are missing out on a powerful tool for engagement
Hypothesis: A more robust search will result in higher engagement.
I believed that a full page search that mimics a more traditional streaming service and will get more user engagement. Regardless of where users are on the site, they will be able to quickly find the content they are looking for and watch more.
SEARCH BEFORE
Limited results, no filtering or assisted guidance
The old search was built as a temporary placeholder that did not get revisited for quite some time. The old search was just not functional. Many users who stream content often use search for the quickest way to get to something they know they want to watch.
Original search before the change
THE PROBLEM
What are we hoping to achieve with this test
Higher click through rates. Increase watch time.
The new search
The new search full takeover for the V1 addresses search results based on what users type, and makes recommendations based on user intent or trending or popular content if search results are not available.
The new search - mobile experience
The new search full takeover for the V1 addresses search results based on what users type, and makes recommendations based on user intent or trending or popular content if search results are not available.
Results
Search Engagement is Way Up:
- Higher click through rate - Users found something interesting.
- Search abandonment is down.
- Search per user is down = Users found it quicker.
Improved membership plans that convert to premium
Watch Time Is Down During Test
Content watching slightly negative but not statistically significant to raise alarms. This led me to believe that the users either:A: Need better ways to preview a film before going to the brand pageB: the Brand pages need to revisited to look for opportunities to improve watch time.C: Both.D: Something else.
THE PROBLEM
Analyzing Results For Future Testing
Workflow standard using AI to review data and help recommend next iterations.
Part of my regular workflow is to have AI make recommendations on what the next phase is. Since AI is reviewing what is winning, it uses that as the new baseline to suggest options with reasoning.
SUGGESTIONS FROM AI
AI suggested we test users watching from the search results and bypass the brand pages if at al possible.
This suggestion from Claude was actually a brilliant shift that aligned with a belief that have had, but not had time to pursue. The search results are often mixed with things users have seen, haven’t seen, or not available yet. The wireframe suggestions from Claude opened up some great examples that included actions a user can take such as resume a film, buy tickets (a perk we have for our own theatrical releases), and join to watch, which addresses content not available to our legacy free users. Other options suggested were results with no content returned, this suggested some things like giving the user the opportunity to make recommendations for our library.
This suggestion from Claude was actually a brilliant shift that aligned with a belief that have had, but not had time to pursue. The search results are often mixed with things users have seen, haven’t seen, or not available yet. The wireframe suggestions from Claude opened up some great examples that included actions a user can take such as resume a film, buy tickets (a perk we have for our own theatrical releases), and join to watch, which addresses content not available to our legacy free users. Other options suggested were results with no content returned, this suggested some things like giving the user the opportunity to make recommendations for our library.
Suggestions From Claude
Suggestions From Claude
View other projects
A little line about what’s being said and who’s saying it.