← Back to Feed

Post from 1 October 2026

I used to think SQL could only match keywords. This week I learned it can filter by meaning: Quail, an open-source “AI-SQL” engine, lets a query ask an LLM a yes/no question about each row.

Here’s the difference. To find every movie review that talks about the ending, I’d write:

WHERE text LIKE '%ending%' OR text LIKE '%climax%'

But then I could miss the following review: “I couldn’t believe who the killer was in the final ten minutes.”

Quail (QUery Aware Inference Layer) is an open-source engine for “AI-SQL” - queries that can call an LLM inside the WHERE clause. Instead of matching words, you ask the model a question about each row, roughly:

-- pseudocode, not real syntax
WHERE ask_model('Does this review discuss the ending?', review_text)

The model reads each review and returns true or false.

So as you can see, SQL can filter by meaning now (semantic filtering), not just match strings.

But the catch here is cost. That one query makes one model call per row, so a million reviews means a million LLM calls. Quail is built to make that faster.

On one large multi-join query in their benchmark, a standard vLLM setup took 6.84 hours and Quail took only 29 minutes. Across all 29 benchmark queries, the average speedup was 1.84x. Either way, it’s still a batch job, not a single lookup.

Also on Bluesky · Mastodon

Loading comments…