The Problem With Visual Search In Fashion… And How To Fix It

November 13, 2019
InSearch
Vivek Bharadwaj, Director of Product Development

How often has this happened to you?

You love browsing shopping apps and are always on the lookout for interesting clothing that others are wearing. You’ve heard all about “visual search” that retailers now offer in their apps, so you open the camera and upload a picture to find similar matches.

You’re disappointed with the suggestions though…

Successful fashion retailers are really starting to adopt innovative technology for their customers, and this increasingly relies on AI. To retain their edge in an extremely competitive space most retailers are exploring “visual search” as a starting point. It’s easy to understand why -

  1. Pinterest (whose users overlap significantly with fashion retailers) reported 600 million visual searches in 2018 on its platform with fashion being the most popular category. (https://newsroom.pinterest.com/en/post/celebrating-one-year-of-pinterest-lens)
  2. Gartner predicted in 2017 that visual and voice search would increase eCommerce revenue by over 30% by 2021.

While there are many successful case studies presented for visual search, most retailers suggest adoption levels are much lower than expected. Hence, the success stories we see are based on a small set of users and because of this visual search is not even close to contributing to eCommerce revenue the way Gartner predicted.

We at Streamoid have been working hard to understand why this is and address it. So what did we find? How can visual search be perfected to ensure that you have a great experience next time you use it?

Why are users frequently disappointed with the results?

  1. Sometimes, the results are not from the category that the user is looking for.
  2. The results are not visually similar at all
  3. The results (although relevant) don’t have the aspect the user was looking for, like a pattern

Why does this happen?

  1. Not every retailer has a large enough catalog to find an exact or even close match to what the user has uploaded
  2. Not all users like the same features of a garment, some may be searching for the pattern, while others the cut.

To fix this, Streamoid has adapted visual search, by giving retailers a framework that allows them to make changes to the matching criteria. This means that certain features of a suggested item are taken into account more.

How have we done this?

  1. By creating a Universal Fashion Ontology that spans 50+ attributes and contains 2000+ visual features, Streamoid is able to capture detailed information about a garment just from the image.
  2. A retailer’s catalog goes through our auto-tagging system (Autoscribe) which tags garment information at a far more granular level than any retailer could hope to do manually.
  3. Retailers then have the flexibility to decide the visual matching criteria for every category. We recommend fewer criteria for retailers with smaller catalogs so there’s a higher chance of showing results.
  4. Our Superintelligent platform already understands the fashion world and curates default recommendations for attributes that should be matched in each category.
few recommendations
Retailers can decide the matching criteria
matching criteria
Users can decide matching criteria

Retailers can take this experience even further by giving users the choice to decide which aspects they love, keeping the user engaged even if the initial results weren’t exactly what they wanted.

The same user can now get a meaningful visual search experience across different retailers regardless of catalog size.

Small Catalog, only print is matched

On a smaller catalog, the users can search for example just for matching prints.

On a larger catalog, the users can find an exact match for the product they’re looking for.

Exact matching product


Tags
No items found.

Top Five eCommerce Technology Trends To Watch In 2022

As physical retail stores continue to close, Streamoid takes a look at what fashion retailers should be considering in eCommerce technical development to drive revenue and build brand loyalty in 2022.

What is Fashion optimized search and how does it impact your revenues?

Since text search is critical to the bottom line, why do 31% of all search queries not return any relevant products on most websites? Streamoid investigates search in fashion eCommerce.

Transform performance across your value chain

Explore InSearch

Lead customers from inspiration to sale with image based search
Learn More

Explore InSearch

Outfit generator to complete the look and inspire styling
Learn More
© 2024 Streamoid Technologies. All right reserved.