CloudGuild · Blog · Cheat sheets · Lessons · Certifications
AWS Certified Data Engineer - Associate (DEA-C01) Exam Question Walkthrough
Master AWS Data Lake compliance with our detailed walkthrough of a DEA-C01 exam question on data lifecycle policies.
Building a data lake on AWS is a common task. However, many candidates stumble when it comes to implementing data lifecycle policies for compliance. Knowing which service to use is critical.
The question
Your team is developing a data lake on AWS using Amazon S3 and AWS Glue. To ensure compliance with regulatory requirements, you need to implement data lifecycle policies that automatically delete data after a certain period. Which service or feature will allow you to achieve this?
A. Amazon S3 Lifecycle policies
B. AWS Glue Data Catalog expiration settings
C. Amazon Athena partitioning strategy
D. AWS Lambda scheduled events
Think before you scroll
Before you choose an option, consider the specific requirement: automatic deletion of data after a set period. Each option serves different purposes within the AWS ecosystem.
The answer
The correct option is A. Amazon S3 Lifecycle policies. These policies allow you to manage your S3 objects based on their age, including automatic deletion after a defined time frame. This directly addresses the compliance requirement.
Why the other options lose
B. AWS Glue Data Catalog expiration settings: This option pertains to metadata management rather than direct object lifecycle management in S3. While it helps manage metadata, it does not delete actual data from S3.
C. Amazon Athena partitioning strategy: While Athena allows querying over partitioned data, it does not include functionality for automatic data deletion. This option does not meet the requirement of deleting data based on age.
D. AWS Lambda scheduled events: Although Lambda can run scheduled events, it requires additional configuration to delete S3 objects. This option is not a built-in solution for automatic lifecycle management like S3 Lifecycle policies.
The concept behind it
Understanding how S3 Lifecycle policies work is essential. These policies are designed to automatically transition or delete data based on its age. Knowing this principle can help you apply similar logic to other AWS services when considering data management and compliance.
Exam trap to remember
Always remember: when asked about automatic data deletion in S3, think Amazon S3 Lifecycle policies. They are the go-to solution for managing object lifecycles efficiently.