you can try to filter the data with blank Delivery date like following:
Avg Days = CALCULATE( AVERAGEX( 'Table', DATEDIFF('Table'[ETA], 'Table'[Delivery], DAY), FILTER('Table', ISBLANK ([Delivery]) = FALSE) ) )