openai/CLIP
View on GitHub ↗ ★ 34,557 Jupyter Notebook
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
18 mentions on Hacker News by 18 people: 1 story, 17 comments · first 2021-02-12 · latest 2026-06-09
20082026
-
>which describes images in natural language, See CLIP https://github.com/openai/CLIP
comment by krackers · 2026-06-09 · in Playing with Vision Embeddings -
Do you think https://github.com/openai/CLIP can be ran on it? LLM makes me think of chatbots but I suppose because it's inference-based it would work. Somewhat unclear on what's the difference between LLMs and inference, I think inference…
comment by anttiharju · 2025-05-20 · in LLM-D: Kubernetes-Native Distributed Inference -
…from the llama vision models - a feature request with several upvotes has been opened [1].) [0] https://github.com/openai/CLIP [1] https://github.com/ollama/ollama/issues/5304
comment by ResearchAtPlay · 2025-01-14 · in How we used GPT-4o for image detection with 350 similar illustrations -
…browsing through hundreds or thousands of photos. There are trained neural networks out there like https://github.com/openai/CLIP which are quite good.
comment by adrr · 2024-03-22 · in Show HN: Memories – FOSS Google Photos alternative built for high performance -
…photos of red algae I could just search for that. OpenAI open sourced CLIP a couple of years ago: https://github.com/openai/CLIP and I was planning to write something myself to index my vast photo library but got too lazy and gave up.
comment by porphyra · 2024-03-21 · in Show HN: Memories – FOSS Google Photos alternative built for high performance -
the first thing that comes to mind is CLIP: https://github.com/openai/CLIP maybe combining it with some sort of knowledge graph is what you're looking for
comment by srijansriv · 2024-02-21 · in NLP Algorithms for Clustering AI Content Search Keywords -
…text (which it would be very bad at), so they're working on that (or other use-case problems). [0] https://github.com/openai/CLIP
comment by RC_ITR · 2023-07-06 · in GPT-4 API General Availability -
…against very long words (like 10k character long words :) ). In previous tokenizer like CLIP ( https://github.com/openai/CLIP/blob/main/clip/simple_tokeniz... ) , they used additional preprocessing steps like html escaping and various…
comment by GistNoesis · 2023-04-05 · in OpenAI Tokenizer -
…without directly optimizing for the task, similarly to the zero-shot capabilities of GPT-2 and 3." https://github.com/openai/CLIP Folks who've been playing with Dall-E and getting coherent images seem to be adept at prompting GPT-3 and…
comment by Terretta · 2022-12-03 · in I made ChatGPT take an SAT Test -
…alternatives. For example Stable Diffusion uses it. They also release Whisper model and code[2] [1] https://github.com/openai/CLIP [2] https://github.com/openai/whisper
comment by nl · 2022-10-05 · in 3D Novel View Synthesis with Diffusion Models -
OpenAI announced and released CLIP on GitHub on January 5, 2021: https://github.com/openai/CLIP You need CLIP to have CLIP guided diffusion. So the current situation seems to trace back to OpenAI and the MIT-licensed code they released the…
comment by GrantS · 2022-09-19 · in AI Seamless Texture Generator Built-In to Blender -
Thanks. The next step would be combining it with text-image foundation models such as clip https://github.com/openai/CLIP so that the model no longer depends on a limited set of predefined labels (coco…), right? Also occlusion inference…
comment by singularity2001 · 2022-06-29 · in YOLOv6: Redefine state-of-the-art for object detection -
This uses OpenAI’s CLIP model which is open source: https://github.com/openai/clip
comment by ShannonLimiter · 2022-05-01 · in DALL-E 2 open source implementation -
…models[1] to run it well. Disclose: I have built a vector search engine to proof this idea[2] [1]: https://github.com/openai/CLIP [2]: https://unisearch.cc/search?q=how+to+reset+mac+ssd
comment by blackcat201 · 2021-12-15 · in Find anything fast with Google's vector search technology -
Not sure if this is the same thing? https://github.com/openai/CLIP
comment by sharemywin · 2021-09-30 · in VideoCLIP: Contrastive Pre-Training for Zero-Shot Video-Text Understanding -
https://github.com/openai/CLIP The results are quite interesting: https://www.reddit.com/r/Art/comments/p866wv/deep_dive_meai_...
comment by sillysaurusx · 2021-08-25 · in Do vision transformers see like convolutional neural networks? -
▲ 2
Clip – a neural network trained on a variety of (image, text) pairsstory by prakhargurunani · 2021-03-07 · 0 comments
-
…problem is you really need 1.7.1, because 1.7.0 leads to some strange issues and broken results: https://github.com/openai/CLIP/issues/13#issuecomment-771143...
comment by vladoh · 2021-02-12 · in Show HN: Search inside YouTube videos using natural language queries