|
🛠️ Open-source Libraries |
![]() |
MaskInversion
A library for generating localized embeddings of CLIP-like models via optimization of explainability maps. pip install maskinversion_torch
GitHub / PyPI |
|
LeGrad
An explainability method for Vision Transformers that, given a text prompt, generates a heatmap localizing the part of the image that is important for the model to recognize the text prompt. pip install legrad_torch
GitHub / PyPI |
![]() |
GEM (Grounding Everything Method)
A library for exploring emerging localization properties in Vision-Language Transformers. pip install gem_torch
GitHub / PyPI |
|
Data Stream
A Python tool for streaming data from remote servers to local compute resources, particularly useful for training models on large datasets stored remotely without requiring local storage (developed for internal use). pip install data-streaming
GitHub / PyPI |
📰 Media Coverage |
|
Talk at Cohere For AI - Community Talks
Presented our latest work on LeGrad, discussing novel approaches to explainability in Vision Transformers. Watch Talk / LeGrad Project |
|
Computer Vision News Magazine Interview
Featured interview discussing our paper "Grounding Everything" and its implications for Vision-Language models. Read Interview / GEM Project |
|
Design and source code borrowed from Jon Barron's website. |