marqo-ai/marqo on Hacker News

Marqo.ai ( https://github.com/marqo-ai/marqo ) is doing some interesting stuff and is oss. We handle embedding generation as well as retrieval (full disclosure, I work for Marqo.ai)

comment by bumberg · 2024-01-24 · in Qdrant, the Vector Search Database, raised $28M in a Series A round

Take a look here https://github.com/marqo-ai/local-image-search-demo . It is based on https://github.com/marqo-ai/marqo . We do a lot of image search applications. Feel free to reach out if you have other questions (email in profile).

comment by jn2clark · 2024-01-17 · in Ask HN: Is there any good semantic search GUI for images or documents?

…than it should. I am not sure on your exact use-case but I would encourage you to check out Marqo ( https://github.com/marqo-ai/marqo - disclaimer, I am a co-founder). All inference and orchestration is included (no api calls) and many…

comment by jn2clark · 2024-01-02 · in 90x Faster Than Pgvector – Lantern's HNSW Index Creation Time

Try this https://github.com/marqo-ai/marqo which handles all the chunking for you (and is configurable). Also handles chunking of images in an analogous way. This enables highlighting in longer docs and also for images in a single…

comment by jn2clark · 2023-10-25 · in Embeddings: What they are and why they matter

…models. Currently this is left as an exercise to the reader - and a very large one at that. We ( https://github.com/marqo-ai/marqo , I am a co-founder) are investing heavily into making the ML production worthy and continuous learning from…

comment by jn2clark · 2023-10-04 · in Choosing vector database: a side-by-side comparison

…generation and retrieval on lucene indexes: https://www.marqo.ai/ It's also available opensource: https://github.com/marqo-ai/marqo

comment by tomhamer · 2023-09-04 · in Vector Search with OpenAI Embeddings: Lucene Is All You Need

Marqo is an end-to-end vector search engine that handles both embedding creation and retrieval: https://github.com/marqo-ai/marqo

comment by tomhamer · 2023-08-21 · in Vector databases: analyzing the trade-offs

…have additional preprocessing to accommodate this though. Feel free to add a feature request here https://github.com/marqo-ai/marqo/issues . The other consideration is that you would want the distribution of the content and queries to…

comment by jn2clark · 2023-08-17 · in Show HN: Marqo – Vectorless Vector Search

Just adding here that if you want a vector DB that handles inference for you too, you can try Marqo https://github.com/marqo-ai/marqo

comment by tomhamer · 2023-07-21 · in The fully bootstrapped and vector search engine

Marqo will generate embeddings for you as well as run on a mac/in the cloud. https://github.com/marqo-ai/marqo

comment by tomhamer · 2023-07-17 · in Ask HN: Seeking advice on open source end user distributed vector database

…from a heap of open-source models or bring your own fine-tuned ones. It all runs locally in docker https://github.com/marqo-ai/marqo

comment by owen-elliott · 2023-07-12 · in Introduction to vector similarity search (2022)

…or choose from a wide range of opensource models. I think e5-large would be a good one to try. https://github.com/marqo-ai/marqo

comment by tomhamer · 2023-07-07 · in AI for AWS Documentation

Have you tried Marqo? check the repo : https://github.com/marqo-ai/marqo

comment by Chachadef · 2023-06-29 · in Ask HN: Which Vector Database do you recommend for LLM applications?

Have you seen github.com/marqo-ai/marqo? It does all this wrapping, and you don't even need to pay for OpenAI or pinecone

comment by jeadie · 2023-06-09 · in Show HN: Yes, another vector embeddings API

Disclaimer - someone from Marqo here. Marqo supports E5 models: https://github.com/marqo-ai/marqo

comment by tomhamer · 2023-05-20 · in Ask HN: Can someone ELI5 transformers and the “Attention is all we need” paper?

…vector search DB that handles vector search and transformation you should check out marqo. https://github.com/marqo-ai/marqo

comment by tomhamer · 2023-05-20 · in Kdb.ai Vector Database

If anyone is looking for a vector search engine, see here https://github.com/marqo-ai/marqo . Has additional functionality to make vector search much easier.

comment by jn2clark · 2023-05-05 · in What is a Vector Database? (2021)

…also has some other methods for hallucination and reference checking by using cross-encoders https://github.com/marqo-ai/marqo/blob/mainline/examples/GPT... . It is not perfect but can be easily modified to make it more robust.

comment by jn2clark · 2023-05-05 · in Fixing Hallucination with Knowledge Bases

…one, but if you are after a vector search engine (not just a database) then I can recommend this https://github.com/marqo-ai/marqo . Includes inference, transformations, schema's, multi-modal search, multi-modal queries, multi-modal…

comment by jn2clark · 2023-05-05 · in Fixing Hallucination with Knowledge Bases

See here https://github.com/marqo-ai/marqo/blob/mainline/examples/GPT... and https://github.com/marqo-ai/marqo/blob/mainline/examples/Spe... . Multiple examples for answering questions from documents/manuals, text, or transcripts.

comment by jn2clark · 2023-05-03 · in How to feed content to ChatGPT and make it answer questions about it?

You should check out https://github.com/marqo-ai/marqo for an end-to-end vector search database with batteries included. Disclaimer, I'm from the Marqo team.

comment by tomhamer · 2023-04-20 · in Ask HN: Seeking a Vector Database for ClickHouse Users – Suggestions Appreciated

…your interest/use case but something that is designed for "documents in" -> "documents out" is here https://github.com/marqo-ai/marqo . It does retrieval using embeddings and combines all the text splitting and inference operations and can…

comment by jn2clark · 2023-04-20 · in Autonomous Agents and Agent Simulations

Plenty of good open-source options https://github.com/marqo-ai/marqo/blob/mainline/examples/GPT... . LLM choice is a bit harder but the composability of it all lets you easily choose alternatives.

comment by jn2clark · 2023-04-19 · in ChatPDF – Chat with Any PDF

Barely grasping but something to do with https://github.com/marqo-ai/marqo , which has come heavily recommended in some other threads. > marqo: tensor search for humans

comment by rektide · 2023-04-18 · in Context is all you need

Hadn't heard of the thing they were putting their data into, Marqo, a "tensor search for humans" , https://github.com/marqo-ai/marqo

comment by rektide · 2023-04-15 · in After All Is Said and Indexed – Unlocking Information in Recorded Speech

…search experiences. We are willing to help the right candidate relocate. Check out our repo here: https://github.com/marqo-ai/marqo Send your resume to pandu@marqo.ai

comment by panduk · 2023-04-05 · in Ask HN: Who is hiring? (April 2023)

You can get pretty far with this https://github.com/marqo-ai/marqo . Choose your LLM of choice to pair with it. Examples https://github.com/marqo-ai/marqo/blob/mainline/examples/GPT...

comment by jn2clark · 2023-04-02 · in Show HN: SiteGPT – Create ChatGPT-like chatbots trained on your website content

…to do it yourself. There are some platforms and open source tools that handle it end to end. https://github.com/marqo-ai/marqo is one, for example that is both open source and has a cloud offering.

comment by jeadie · 2023-03-31 · in Faiss: A library for efficient similarity search

You could try https://github.com/marqo-ai/marqo

comment by jeadie · 2023-03-30 · in You probably shouldn't use OpenAI's embeddings

Looks really interesting! Are you looking for more vector search integrations? we have one here https://github.com/marqo-ai/marqo which includes a lot of the transformation logic (including inference). If so, we can do a PR

comment by jn2clark · 2023-03-30 · in Show HN: Open-source ETL framework to sync data from SaaS tools to vector stores

if you want some more options (chunking, models, +more) check here https://github.com/marqo-ai/marqo and an example for RAG using context aware trimming of text for fitting into context windows https://github.com/marqo-ai/marqo/blob/mainlin…

comment by jn2clark · 2023-03-29 · in Launch HN: Metal (YC W23) – Embeddings as a Service

Didn't even realise Milvus was so lacking. https://github.com/marqo-ai/marqo also has a hybrid approach. It's just a more complete/end-to-end platform than pinecone, so it really just depends on what you're building

comment by jeadie · 2023-03-26 · in Vector database built for scalable similarity search

…document representations) which are absent from vector db's. It also takes care of inference https://github.com/marqo-ai/marqo

comment by jn2clark · 2023-03-26 · in Vector database built for scalable similarity search

…OpenAI on every search query and to add each new document, you could look at some open source tools, Marqo (github.com/marqo-ai/marqo) would work for this, and is entirely free and end-to-end

comment by jeadie · 2023-03-24 · in We built semantic search for ArXiv

…search experiences. We are willing to help the right candidate relocate. Check out our repo here: https://github.com/marqo-ai/marqo Send your resume to pandu@marqo.ai

comment by panduk · 2023-03-01 · in Ask HN: Who is hiring? (March 2023)

If you're wanting an end to end solution for something like this, you should check out https://github.com/marqo-ai/marqo . It handles all of this and it's entirely open-source too

comment by jeadie · 2023-02-23 · in Show HN: GPTflix: a simple framework for the OpenAI and Pinecone stack

As did we! It works very well. Article: https://github.com/marqo-ai/marqo/blob/mainline/examples/GPT... and code: https://github.com/marqo-ai/marqo/tree/mainline/examples/GPT...

comment by jn2clark · 2023-02-22 · in Show HN: AskHN

You forgot to mention https://github.com/marqo-ai/marqo . It's a tensor search platform and has had traditional search features since Day 1.

comment by jeadie · 2023-02-20 · in Vector Search for the Uninitiated

…you process your documents to create embedding(s). The open-source tensor search project [marqo]( https://github.com/marqo-ai/marqo ) does a great job of dealing with these type of fixed attention window problems.

comment by jeadie · 2023-02-17 · in Ask HN: How to build a cost effective MVP for niche web search?

code: https://github.com/marqo-ai/marqo/tree/mainline/examples/GPT...

comment by jn2clark · 2023-02-08 · in From “iron manual” to “Iron Man” – augmenting GPT with a fast editable memory

I'd take a look at the open source project https://github.com/marqo-ai/marqo instead. It does 1 and 2 out of the box. You can use CLIP or any model you want really.

comment by jeadie · 2023-02-02 · in Ask HN: How to build an image search service?

You should try https://github.com/marqo-ai/marqo instead. Does all this and more and still very active development.

comment by jeadie · 2023-02-01 · in Same.energy: Image Search by Similarity

…sounds like something that you could benefit from, or you are interested, check out the docs here: https://github.com/marqo-ai/marqo/blob/mainline/README.md

comment by 0x9874 · 2022-11-07