Removing iPad from Supported Destinations should suffice.
But there are some considerations. I believe that if you already have your app released on the App Store and it supports iPad, it may mean you should create a different iPhone only app instead. This behaviour described here in apple docs, please read for more information on what you can do next