Don't Use NOT IN Operator

Evan Hicks

—July 12, 2022

The Problem

The NOT IN operator in Postgres seems like a useful opposite to the IN operator, but it is actually recommended by Postgres to not use this operator in your queries. In fact, they recommend you don’t use any combination of NOT with IN operators because the NOT IN operator behaves strangely with NULL values., e.g. NOT (x IN (SELECT...)).

Click to Copy

SELECT * FROM foo WHERE col NOT IN (1, NULL);

This query will never return any rows, no matter what values are in the col column. This happens because of the way NULL is evaluated with an IN condition. col IN (1, NULL) returns either TRUE if col is 1, or NULL. If you then apply a NOT to that, NOT(NULL) is still NULL. Since NULL is not TRUE, this query will never have any TRUE values and so no rows will be returned.

Click to Copy

SELECT * FROM foo WHERE col NOT IN (SELECT other_col FROM bar);

This query will not return any rows if any value from bar.other_col is NULL. Even if other_col is never NULL, this query can also suffer from extreme performance issues once the dataset gets above a certain size. That means that the performance might be okay in small tests, but once your queries get above a certain size you will likely see performance degrade by orders of magnitude.

The Solution

The NOT IN operator is fine to use for comparing against static lists.

Click to Copy

SELECT * FROM foo WHERE col NOT IN (1, 2, 3);

As long as you are comparing to small lists of constant values, it might even be advisable to use.

Platform

Languages & Frameworks

Why Sentry?

Features

Don't Use NOT IN Operator

The Problem

The Solution

Further Reading

Don't Use NOT IN Operator

The Solution

Further Reading

A peek at your privacy

Who we collect PII from

PII we may collect about you

How we use your PII

Third parties who receive your PII

We use cookies (but not for advertising)

Know your rights