UI designs are a particularly interesting domain to apply concept lenses to. Depending on what they’re working on, a designer looking for inspiration might want different kinds of similarity: layout, color palette, visual style, or even just screen type.
This is actually the task I was working on when I originally discovered this, but I could never find a solid product use case.
Show more
Taking a short break from LLM research to go back to my roots.
Introducing... Concept Lenses! A training-free way to do similarity search along whatever concept you care about.
Typically, embedding-based similarity search is constrained by whatever notion of similarity the model learned in training. This means that if the model is primed for semantic similarity, but you actually care more about visual appearance, you'd need to switch models.
Under a Concept Lens projection, though, distance between embeddings means distance only along the concept you care about.
Blog post:
Demo:
Show more
