The issue was the the CSV file contained Commas in the number values. So while the column was set to an integer SQLite was reading it as a number until the comma, then it was dropping the rest.

Opened the CSV in Excel, removed the commas, recreated the table and its summing correctly now.