Support open_clip

[escorciav]

Hi gents,

I wanna support your SynthClip as part of open_clip. Similar to what we did in #6 .

Could you please take a look at this on your end?
I'm struggling again 😖 . The output of the synthclip_openclip.py is:

Compose(
    Resize(size=224, interpolation=bilinear, max_size=None, antialias=True)
    CenterCrop(size=(224, 224))
    Lambda()
    ToTensor()
    Normalize(mean=[0.485, 0.456, 0.406], std=[0.229, 0.224, 0.225])
)=
Model setup 🎉
Load & preprocess image...
Fwd-pass model...
Label probs: tensor([[0.0755, 0.3281, 0.5965]], device='cuda:0')

while the expected output should be Label probs: tensor([[0.0048, 0.0878, 0.9075]], device='cuda:0')

cc @HaniItani

[escorciav]

I'd advise to install open_clip via

cd open_clip
# open_clip setup steps
pip install -e .
# copy the misc stuff in the gist :wink: