To add (after spending hours debugging) If you are using serverless-appsync-simulator as well, you still need to include appSync under custom.
custom:
appSync: ${self:appSync}
appsync-simulator:
apiKey: ${env:APPSYNC_SIMULATOR_API_KEY}
location: '.webpack/service'