CloudGuild · Blog · Cheat sheets · Lessons · Certifications
Exam Question Walkthrough: AWS Certified Data Engineer - Associate (DEA-C01)
Understand the nuances of AWS data ingestion services with our detailed breakdown of a real DEA-C01 exam question.
A data engineering team is tasked with ingesting large volumes of streaming data from multiple sources into an AWS environment for real-time processing. Which AWS service is best suited for this purpose?
A. AWS Glue
B. Amazon Kinesis Data Streams
C. Amazon S3
D. AWS Data Pipeline
Think before you scroll
When assessing which AWS service to choose for real-time streaming data ingestion, consider the specific functionalities of each option. Focus on the service's intended use case and its ability to handle streaming data.
The answer
B. Amazon Kinesis Data Streams is the correct option. This service is specifically designed for real-time ingestion of streaming data, making it the best choice for processing large volumes of data from multiple sources.
Why the other options lose
- A. AWS Glue: This service is primarily an ETL (Extract, Transform, Load) tool. It’s designed for batch processing and data preparation, not for real-time streaming ingestion.
- C. Amazon S3: While S3 is an excellent storage solution, it does not provide real-time data processing capabilities. It is designed for storing data rather than ingesting or processing streaming data.
- D. AWS Data Pipeline: This service is useful for batch processing and scheduling data workflows. It is not optimized for real-time streaming data ingestion, which is required in this scenario.
The concept behind it
The key principle here is understanding the difference between real-time data ingestion services and batch processing tools. Services like Amazon Kinesis Data Streams are built for immediate data processing, while others like AWS Glue and AWS Data Pipeline focus on managing data workflows in a batch-oriented manner.
Exam trap to remember
Remember the focus: Kinesis is for real-time streaming, while Glue and Data Pipeline are for batch processing. This distinction is crucial for success on the exam.