Have you considered using Selenium package. It's the most useful I've found for extracting data from dynamic websites