This is limitation of using expo-notifications or via react native alarm handling. To precisely fire the event, you will have to take bare bone approach using java and xml.
I am working on a similar design, let me know if you want to connect.