To optimize your Power Query design for managing live streaming data, separate the queries for present and historic data. Create individual queries for each year's historic data (e.g., data22_historic
, data23_historic
), and set these to refresh only on demand. For the current year's data, maintain a dedicated query (data_present
) that includes both basic and historic information, ensuring it updates regularly. Instead of appending all data into a single query (allData
) that triggers full updates, create a consolidated query referencing only the present data dynamically and historic data as needed. This approach prevents excessive updates, supports efficient management, and ensures scalability for live streaming and static datasets alike.