It turned out the sample I was using did not have the correct values for schemas and extra_search_path inside config.toml. They should look like:

schemas = ["public", "graphql_public"]
extra_search_path = ["public", "extensions"]