As I tested on sqlx 0.8.3

One can connect with

let db = SqlitePool::connect_with(
    SqliteConnectOptions::new()
        .filename(format!("{}/data.db", context.output_dir.display()))
        .create_if_missing(true),
)
.await
.unwrap();

Just remove sqlit:// prefix of the filename!