When generating inventory, all the inventory files are in one output folder called "data". In order to find out which inventory files are for a specific day, we have to look at the provided manifest file for that day. How would you suggest I create an Athena table with the data for only one day? Do I have to manually separate the inventory files to a different folder (based on the manifest) and then point Athena to that folder? Or is there a more direct approach supported by S3/Athena where I can say "here's the inventory folder but just use the inventory files from 2024-07-17"?
Thank you ! It was really helpful!
You're welcome! We're glad to hear that it was helpful. 🙌
When generating inventory, all the inventory files are in one output folder called "data". In order to find out which inventory files are for a specific day, we have to look at the provided manifest file for that day.
How would you suggest I create an Athena table with the data for only one day? Do I have to manually separate the inventory files to a different folder (based on the manifest) and then point Athena to that folder? Or is there a more direct approach supported by S3/Athena where I can say "here's the inventory folder but just use the inventory files from 2024-07-17"?
Did you manage to fix this issue?
SHoulw we setup a crawler for this??