It was issue with pooling on EF Core, so just disabling it in my connection strings helped me

var connection = new SqliteConnection($"Filename{databasePath};Mode=ReadWriteCreate;Pooling=False");