Set the Y pivot to 1, you will see that the panel will start growing to the bottom instead of both sizes simultaneously