AWS Certified Data Engineer - Associate (DEA-C01) Dumps July 2026
PDF + Test Engine
$139 $97
Test Engine
$119 $83
PDF
$99 $69
Here are Amazon Data-Engineer-Associate PDF available features:
302 questions with answers
Updation Date : 16 Jul, 2026
1 day study required to pass exam
100% Passing Assurance
100% Money Back Guarantee
Free 3 Months Updates
Amazon Data-Engineer-Associate Sample Questions
Question # 71
A data engineer runs Amazon Athena
queries on data that is in an Amazon S3 bucket. The Athena queries use
AWS Glue Data Catalog as a metadata table.The data engineer
notices that the Athena query plans are experiencing a performance
bottleneck. The data engineer determines that the cause of the
performance bottleneck is the large number of partitions that are in the
S3 bucket. The data engineer must resolve the performance bottleneck
and reduce Athena query planning time.Which solutions will meet these requirements? (Choose two.)
A. Create an AWS Glue partition index. Enable partition filtering.
B. Bucketthe data based on a column thatthe data have in common in a WHERE clause of the user query C. Use Athena partition projection based on the S3 bucket prefix. D. Transform the data that is in the S3 bucket to Apache Parquet format. E. Use the Amazon EMR S3DistCP utility to combine smaller objects in the S3 bucket into larger objects.
Answer: A,C Explanation:
Improve query performance using AWS Glue partition indexes
Partition projection with Amazon Athena
Bucketing vs Partitioning
Columnar Storage Formats
S3DistCp
AWS Certified Data Engineer - Associate DEA-C01 Complete Study Guide
Explanation: The
best solutions to resolve the performance bottleneck and reduce Athena
query planning time are to create an AWS Glue partition index and enable
partition filtering, and to use Athena partition projection based on
the S3 bucket prefix.AWS Glue partition indexes are a feature
that allows you to speed up query processing of highly partitioned
tables cataloged in AWS Glue Data Catalog. Partition indexes are
available for queries in Amazon EMR, Amazon Redshift Spectrum, and AWS
Glue ETL jobs. Partition indexes are sublists of partition keys defined
in the table. When you create a partition index, you specify a list of
partition keys that already exist on a given table. AWS Glue then
creates an index for the specified keys and stores it in the Data
Catalog. When you run a query that filters on the partition keys, AWS
Glue uses the partition index to quickly identify the relevant
partitions without scanning the entiretable metadata. This reduces the
query planning time and improves the query performance1.Athena
partition projection is a feature that allows you to speed up query
processing of highly partitioned tables and automate partition
management. In partition projection, Athena calculates partition values
and locations using the table properties that you configure directly on
your table in AWS Glue. The table properties allow Athena to ‘project’,
or determine, the necessary partition information instead of having to
do a more time-consuming metadata lookup in the AWS Glue Data Catalog.
Because in-memory operations are often faster than remote operations,
partition projection can reduce the runtime of queries against highly
partitioned tables. Partition projection also automates partition
management because it removes the need to manually create partitions in
Athena, AWS Glue, or your external Hive metastore2.Option B is
not the best solution, as bucketing the data based on a column that the
data have in common in a WHERE clause of the user query would not reduce
the query planning time. Bucketing is a technique that divides data
into buckets based on a hash function applied to a column. Bucketing can
improve the performance of join queries by reducing the amount of data
that needs to be shuffled between nodes. However, bucketing does not
affect the partition metadata retrieval, which is the main cause of the
performance bottleneck in this scenario3.Option D is not the best
solution, as transforming the data that is in the S3 bucket to Apache
Parquet format would not reduce the query planning time. Apache Parquet
is a columnar storage format that can improve the performance of
analytical queries by reducing the amount of data that needs to be
scanned and providing efficient compression and encoding
schemes. However, Parquet does not affect the partition metadata
retrieval, which is the main cause of the performance bottleneck in this
scenario4.Option E is not the best solution, as using the Amazon
EMR S3DistCP utility to combine smaller objects in the S3 bucket into
larger objects would not reduce the query planning time. S3DistCP is a
tool that can copy large amounts of data between Amazon S3 buckets or
from HDFS to Amazon S3. S3DistCP can also aggregate smaller files into
larger files to improve the performance of sequential access. However,
S3DistCP does not affect the partition metadata retrieval, which is the
main cause of the performance bottleneck in this scenario5. References:
Question # 72
A company stores datasets in JSON
format and .csv format in an Amazon S3 bucket. The company has Amazon
RDS for Microsoft SQL Server databases, Amazon DynamoDB tables that are
in provisionedcapacity mode, and an Amazon Redshift cluster. A data
engineering team must develop a solution that will give data scientists
the ability to query all data sources by using syntax similar to SQL.Which solution will meet these requirements with the LEAST operational overhead?
A. Use AWS Glue to crawl the data sources. Store
metadata in the AWS Glue Data Catalog. Use Amazon Athena to query the
data. Use SQL for structured data sources. Use PartiQL for data that is
stored in JSON format.
B. Use AWS Glue to crawl the data sources. Store metadata in the AWS Glue Data Catalog. Use Redshift Spectrum to query the data. Use SQL for structured data sources. Use PartiQL for data that is stored in JSON format. C. Use AWS Glue to crawl the data sources. Store metadata in the AWS Glue Data Catalog. Use AWS Glue jobs to transform data that is in JSON format to Apache Parquet or .csv format. Store the transformed data in an S3 bucket. Use Amazon Athena to query the original and transformed data from the S3 bucket. D. Use AWS Lake Formation to create a data lake. Use Lake Formation jobs to transform the data from all data sources to Apache Parquet format. Store the transformed data in an S3 bucket. Use Amazon Athena or Redshift Spectrum to query the data.
Answer: A Explanation:
What is Amazon Athena?
Data Catalog and crawlers in AWS Glue
AWS Glue Data Catalog
Columnar Storage Formats
AWS Certified Data Engineer - Associate DEA-C01 Complete Study Guide
AWS Glue Schema Registry
What is AWS Glue?
Amazon Redshift Serverless
Amazon Redshift provisioned clusters
[Querying external data using Amazon Redshift Spectrum]
[Using stored procedures in Amazon Redshift]
[What is AWS Lambda?]
[PartiQL for Amazon Athena]
[Federated queries in Amazon Athena]
[Amazon Athena pricing]
[Top 10 performance tuning tips for Amazon Athena]
[AWS Glue ETL jobs]
[AWS Lake Formation jobs]
Explanation: The
best solution to meet the requirements of giving data scientists the
ability to query all data sources by using syntax similar to SQL with
the least operational overhead is to use AWS Glue to crawl the data
sources, store metadata in the AWS Glue Data Catalog, use Amazon Athena
to query the data, use SQL for structured data sources, and use PartiQL
for data that is stored in JSON format.AWS Glue is a serverless
data integration service that makes it easy to prepare, clean, enrich,
and move data between data stores1. AWS Glue crawlers are processes that
connect to a data store, progress through a prioritized list of
classifiers to determine the schema for your data, and then create
metadata tables in the Data Catalog2. The Data Catalog is a persistent
metadata store that contains table definitions, job definitions, and
other control information to help you manage your AWS Glue components3.
You can use AWS Glue to crawl the data sources, such as Amazon S3,
Amazon RDS for Microsoft SQL Server, and Amazon DynamoDB, and store the
metadata in the Data Catalog.Amazon Athena is a serverless,
interactive query service that makes it easy to analyze data directly in
Amazon S3 using standard SQL or Python4. Amazon Athena also supports
PartiQL, a SQL-compatible query language that lets you query, insert,
update, and delete data from semi-structured and nested data, such as
JSON. You can use Amazon Athena to query the data from the Data Catalog
using SQL for structured data sources, such as .csv files and relational
databases, and PartiQL for data that is stored in JSON format. You can
also use Athena to query data from other data sources, such as Amazon
Redshift, using federated queries.Using AWS Glue and Amazon
Athena to query all data sources by using syntax similar to SQL is the
least operational overhead solution, as you do not need to provision,
manage, or scale any infrastructure, and you pay only for the resources
you use. AWS Glue charges you based on the compute time and the data
processed by your crawlers and ETL jobs1. Amazon Athena charges you
based on the amount of data scanned by your queries. You can also reduce
the cost and improve the performance of your queries by using
compression, partitioning, and columnar formats for your data in Amazon
S3.Option B is not the best solution, as using AWS Glue to crawl
the data sources, store metadata in the AWS Glue Data Catalog, and use
Redshift Spectrum to query the data, would incur more costs and
complexity than using Amazon Athena. Redshift Spectrum is a feature of
Amazon Redshift, a fully managed data warehouse service, that allows you
to query and join data across your data warehouse and your data lake
using standard SQL. While Redshift Spectrum is powerful and useful for
many data warehousing scenarios, it is not necessary or cost-effective
for querying all data sources by using syntax similar to SQL. Redshift
Spectrum charges you based on the amount of data scanned by your
queries, which is similar to Amazon Athena, but it also requires you to
have an Amazon Redshift cluster, which charges you based on the node
type, the number of nodes, and the duration of the cluster5. These costs
can add up quickly, especially if you have large volumes of data and
complex queries. Moreover, using Redshift Spectrum would introduce
additional latency and complexity, as you would have to provision and
manage the cluster, and create an external schema and database for the
data in the Data Catalog, instead of querying it directly from Amazon
Athena.Option C is not the best solution, as using AWS Glue to
crawl the data sources, store metadata in the AWS Glue Data Catalog, use
AWS Glue jobs to transform data that is in JSON format to Apache
Parquet or .csv format, store the transformed data in an S3 bucket, and
use Amazon Athena to query the original and transformed data from the S3
bucket, would incur more costs and complexity than using Amazon Athena
with PartiQL. AWS Glue jobs are ETL scripts that you can write in Python
or Scala to transform your data and load it to your target data
store. Apache Parquet is a columnar storage format that can improve the
performance of analytical queries by reducing the amount of data that
needs to be scanned and providing efficient compression and encoding
schemes6. While using AWS Glue jobs and Parquet can improve the
performance and reduce the cost of your queries, they would also
increase the complexity and the operational overhead of the data
pipeline, as you would have to write, run, and monitor the ETL jobs, and
store the transformed data in a separate location in Amazon S3.
Moreover, using AWS Glue jobs and Parquet would introduce additional
latency, as you would have to wait for the ETL jobs to finish before
querying the transformed data.Option D is not the best solution,
as using AWS Lake Formation to create a data lake, use Lake Formation
jobs to transform the data from all data sources to Apache Parquet
format, store the transformed data in an S3 bucket, and use Amazon
Athena or RedshiftSpectrum to query the data, would incur more costs and
complexity than using Amazon Athena with PartiQL. AWS Lake Formation is
a service that helps you centrally govern, secure, and globally share
data for analytics and machine learning7. Lake Formation jobs are ETL
jobs that you can create and run using the Lake Formation console or
API. While using Lake Formation and Parquet can improve the performance
and reduce the cost of your queries, they would also increase the
complexity and the operational overhead of the data pipeline, as you
would have to create, run, and monitor the Lake Formation jobs, and
store the transformed data in a separate location in Amazon S3.
Moreover, using Lake Formation and Parquet would introduce additional
latency, as you would have to wait for the Lake Formation jobs to finish
before querying the transformed data. Furthermore, using Redshift
Spectrum to query the data would also incur the same costs and
complexity as mentioned in option B. References:
Question # 73
A company currently stores all of its data in Amazon S3 by using the S3 Standard storage class.A
data engineer examined data access patterns to identify trends. During
the first 6 months, most data files are accessed several times each day.
Between 6 months and 2 years, most data files are accessed once or
twice each month. After 2 years, data files are accessed only once or
twice each year.The data engineer needs to use an S3 Lifecycle
policy to develop new data storage rules. The new storage solution must
continue to provide high availability.Which solution will meet these requirements in the MOST cost-effective way?
A. Transition objects to S3 One Zone-Infrequent
Access (S3 One Zone-IA) after 6 months. Transfer objects to S3 Glacier
Flexible Retrieval after 2 years.
B. Transition objects to S3 Standard-Infrequent Access (S3 Standard-IA) after 6 months. Transfer objects to S3 Glacier Flexible Retrieval after 2 years. C. Transition objects to S3 Standard-Infrequent Access (S3 Standard-IA) after 6 months. Transfer objects to S3 Glacier Deep Archive after 2 years. D. Transition objects to S3 One Zone-Infrequent Access (S3 One Zone-IA) after 6 months. Transfer objects to S3 Glacier Deep Archive after 2 years.
Answer: C Explanation:
Transition objects to S3
Standard-Infrequent Access (S3 Standard-IA) after 6 months. S3
Standard-IA is designed for data that is accessed less frequently, but
requires rapid access when needed. It offers the same high durability,
throughput, and low latency as S3 Standard, but with a lower storage
cost and a retrieval fee2. Therefore, it is suitablefor data files that
are accessed once or twice each month. S3 Standard-IA also provides high
availability, as it stores data redundantly across multiple
Availability Zones1.
Transfer objects to S3 Glacier Deep Archive
after 2 years. S3 Glacier Deep Archive is the lowest-cost storage class
that offers secure and durable storage for data that is rarely accessed
and can tolerate a 12-hour retrieval time. It is ideal for long-term
archiving and digital preservation3. Therefore, it is suitable for data
files that are accessed only once or twice each year. S3 Glacier Deep
Archive also provides high availability, as it stores data across at
least three geographically dispersed Availability Zones1.
Delete
objects when they are no longer needed. The data engineer can specify
an expiration action in the S3 Lifecycle policy to delete objects after a
certain period of time. This will reduce the storage cost and comply
with any data retention policies.
Option C is the only solution that includes all these steps. Therefore, option C is the correct answer.Option
A is incorrect because it transitions objects to S3 One Zone-Infrequent
Access (S3 One Zone-IA) after 6 months. S3 One Zone-IA is similar to S3
Standard-IA, but it stores data in a single Availability Zone. This
means it has a lower availability and durability than S3 Standard-IA,
and it is not resilient to the loss of data in a single Availability
Zone1. Therefore, it does not provide high availability as required.Option
B is incorrect because it transfers objects to S3 Glacier Flexible
Retrieval after 2 years. S3 Glacier Flexible Retrieval is a storage
class that offers secure and durable storage for data that is accessed
infrequently and can tolerate a retrieval time of minutes to hours. It
is more expensive than S3 Glacier Deep Archive, and it is not suitable
for data that is accessed only once or twice each year3. Therefore, it
is not the most cost-effective option.Option D is incorrect
because it combines the errors of option A and B. It transitions objects
to S3 One Zone-IA after 6 months, which does not provide high
availability, and it transfers objects to S3 Glacier Flexible Retrieval
after 2 years, which is not the most cost-effective option.References:
1: Amazon S3 storage classes - Amazon Simple Storage Service
3: Amazon S3 Glacier and S3 Glacier Deep Archive - Amazon Simple Storage Service
[4]: Expiring objects - Amazon Simple Storage Service
[5]: Managing your storage lifecycle - Amazon Simple Storage Service
[6]: Examples of S3 Lifecycle configuration - Amazon Simple Storage Service
[7]: Amazon S3 Lifecycle further optimizes storage cost savings with new features - What’s New with AWS
Explanation: To
achieve the most cost-effective storage solution, the data engineer
needs to use an S3 Lifecycle policy that transitions objects to
lower-cost storage classes based on their access patterns, and deletes
them when they are no longer needed. The storage classes should also
provide high availability, which means they should be resilient to the
loss of data in a single Availability Zone1. Therefore, the solution
must include the following steps:
Question # 74
A data engineer needs to join data
from multiple sources to perform a one-time analysis job. The data is
stored in Amazon DynamoDB, Amazon RDS, Amazon Redshift, and Amazon S3.Which solution will meet this requirement MOST cost-effectively?
A. Use an Amazon EMR provisioned cluster to read from all sources. Use Apache Spark to join the data and perform the analysis.
B. Copy the data from DynamoDB, Amazon RDS, and Amazon Redshift into Amazon S3. Run Amazon Athena queries directly on the S3 files. C. Use Amazon Athena Federated Query to join the data from all data sources. D. Use Redshift Spectrum to query data from DynamoDB, Amazon RDS, and Amazon S3 directly from Redshift.
Answer: C Explanation:
Amazon Athena Federated Query
Redshift Spectrum vs Federated Query
Explanation: Amazon
Athena Federated Query is a feature that allows you to query data from
multiple sources using standard SQL. You can use Athena Federated Query
to join data from Amazon DynamoDB, Amazon RDS, Amazon Redshift, and
Amazon S3, as well as other data sources such as MongoDB, Apache HBase,
and Apache Kafka1. Athena Federated Query is a serverless and
interactive service, meaning you do not need to provision or manage any
infrastructure, and you only pay for the amount of data scanned by your
queries. Athena Federated Query is the most cost-effective solution for
performing a one-time analysis job on data from multiple sources, as it
eliminates the need to copy or move data, and allows you to query data
directly from the source.The other options are not as
cost-effective as Athena Federated Query, as they involve additional
steps or costs. Option A requires you to provision and pay for an Amazon
EMR cluster, which can be expensive and time-consuming for a one-time
job. Option B requires you to copy or move data from DynamoDB, RDS, and
Redshift to S3, which can incur additional costs for data transfer and
storage, and also introduce latency and complexity. Option D requires
you to have an existing Redshift cluster, which can be costly and may
not be necessary for a one-time job. Option D also does not
supportquerying data from RDS directly, so you would need to use
Redshift Federated Query to access RDS data, which adds another layer of
complexity2. References:
Question # 75
A data engineer is building a data
pipeline on AWS by using AWS Glue extract, transform, and load (ETL)
jobs. The data engineer needs to process data from Amazon RDS and
MongoDB, perform transformations, and load the transformed data into
Amazon Redshift for analytics. The data updates must occur every hour.Which combination of tasks will meet these requirements with the LEAST operational overhead? (Choose two.)
A. Configure AWS Glue triggers to run the ETL jobs even/ hour.
B. Use AWS Glue DataBrewto clean and prepare the data for analytics. C. Use AWS Lambda functions to schedule and run the ETL jobs even/ hour. D. Use AWS Glue connections to establish connectivity between the data sources and Amazon Redshift. E. Use the Redshift Data API to load transformed data into Amazon Redshift.
Answer: A,D Explanation:
AWS Glue triggers
AWS Glue connections
AWS Glue DataBrew
[AWS Lambda functions]
[Redshift Data API]
Explanation: The
correct answer is to configure AWS Glue triggers to run the ETL jobs
every hour and use AWS Glue connections to establish connectivity
between the data sources and Amazon Redshift. AWS Glue triggers are a
way to schedule and orchestrate ETL jobs with the least operational
overhead. AWS Glue connections are a way to securely connect to data
sources and targets using JDBC or MongoDB drivers. AWS Glue DataBrew is a
visual data preparation tool that does not support MongoDB as a data
source. AWS Lambda functions are a serverless option to schedule and run
ETL jobs, but they have a limit of 15 minutes for execution time, which
may not be enough for complex transformations. The Redshift Data API is
a way to run SQL commands on Amazon Redshift clusters without needing a
persistent connection, but it does not support loading data from AWS
Glue ETL jobs. References:
Question # 76
A data engineer needs to use an
Amazon QuickSight dashboard that is based on Amazon Athena queries on
data that is stored in an Amazon S3 bucket. When the data engineer
connects to the QuickSight dashboard, the data engineer receives an
error message that indicates insufficient permissions.Which factors could cause to the permissions-related errors? (Choose two.)
A. There is no connection between QuickSgqht and Athena.
B. The Athena tables are not cataloged. C. QuickSiqht does not have access to the S3 bucket. D. QuickSight does not have access to decrypt S3 data. E. There is no 1AM role assigned to QuickSiqht.
Answer: C,D Explanation:
Using Amazon Athena as a Data Source
Granting Amazon QuickSight Access to AWS Resources
Encrypting Data at Rest in Amazon S3
Explanation: QuickSight
does not have access to the S3 bucket and QuickSight does not have
access to decrypt S3 data are two possible factors that could cause the
permissions-related errors. Amazon QuickSight is a business intelligence
service that allows you to create and share interactive dashboards
based on various data sources, including Amazon Athena. Amazon Athena is
a serverless query service that allows you to analyze data stored in
Amazon S3 using standard SQL. To use an Amazon QuickSight dashboard that
is based on Amazon Athena queries on data that is stored in an Amazon
S3 bucket, you need to grant QuickSight access to both Athena and S3, as
well as any encryption keys that are used to encrypt the S3 data. If
QuickSight does not have access to the S3 bucket or the encryption keys,
it will not be able to read the data from Athena and display it on the
dashboard, resulting in an error message that indicates insufficient
permissions.The other options are not factors that could cause
the permissions-related errors. Option A, there is no connection between
QuickSight and Athena, is not a factor, as QuickSight supports Athena
as a native data source, and you can easily create a connection between
them using the QuickSight console or the API. Option B, the Athena
tables are not cataloged, is not a factor, as QuickSight can
automatically discover the Athena tables that are cataloged in the AWS
Glue Data Catalog, and you can also manually specify the Athena tables
that are not cataloged. Option E, there is no IAM role assigned to
QuickSight, is not a factor, as QuickSight requires an IAM role to
access any AWS data sources, including Athena and S3, and you can create
and assign an IAM role to QuickSight using the QuickSight console or
the API. References:
Question # 77
A data engineer needs to use AWS
Step Functions to design an orchestration workflow. The workflow must
parallel process a large collection of data files and apply a specific
transformation to each file.Which Step Functions state should the data engineer use to meet these requirements?
A. Parallel state
B. Choice state C. Map state D. Wait state
Answer: C Explanation:
AWS
Certified Data Engineer - Associate DEA-C01 Complete Study Guide,
Chapter 5: Data Orchestration, Section 5.3: AWS Step Functions, Pages
131-132
Building Batch Data Analytics Solutions on AWS, Module 5: Data Orchestration, Lesson 5.2: AWS Step Functions, Pages 9-10
Explanation: Option
C is the correct answer because the Map state is designed to process a
collection of data in parallel by applying the same transformation to
each element. The Map state can invoke a nested workflow for each
element, which can be another state machine ora Lambda function. The Map
state will wait until all the parallel executions are completed before
moving to the next state.Option A is incorrect because the
Parallel state is used to execute multiple branches of logic
concurrently, not to process a collection of data. The Parallel state
can have different branches with different logic and states, whereas the
Map state has only one branch that is applied to each element of the
collection.Option B is incorrect because the Choice state is used
to make decisions based on a comparison of a value to a set of rules.
The Choice state does not process any data or invoke any nested
workflows.Option D is incorrect because the Wait state is used to
delay the state machine from continuing for a specified time. The Wait
state does not process any data or invoke any nested workflows.References:
Question # 78
A company uses an Amazon
QuickSight dashboard to monitor usage of one of the company's
applications. The company uses AWS Glue jobs to process data for the
dashboard. The company stores the data in a single Amazon S3 bucket. The
company adds new data every day.A data engineer discovers that
dashboard queries are becoming slower over time. The data engineer
determines that the root cause of the slowing queries is long-running
AWS Glue jobs.Which actions should the data engineer take to improve the performance of the AWS Glue jobs? (Choose two.)
A. Partition the data that is in the S3 bucket. Organize the data by year, month, and day.
atures. B. Increase the AWS Glue instance size by scaling up the worker type. C. Convert the AWS Glue schema to the DynamicFrame schema class. D. Adjust AWS Glue job scheduling frequency so the jobs run half as many times each day.
Answer: A, B
Explanation:
Explanation: Partitioning
the data in the S3 bucket can improve the performance of AWS Glue jobs
by reducing the amount of data that needs to be scanned and processed.
By organizingthe data by year, month, and day, the AWS Glue job can use
partition pruning to filter out irrelevant data and only read the data
that matches the query criteria. This can speed up the data processing
and reduce the cost of running the AWS Glue job. Increasing the AWS Glue
instance size by scaling up the worker type can also improve the
performance of AWS Glue jobs by providing more memory and CPU resources
for the Spark execution engine. This can help the AWS Glue job handle
larger data sets and complex transformations more efficiently. The other
options are either incorrect or irrelevant, as they do not affect the
performance of the AWS Glue jobs. Converting the AWS Glue schema to the
DynamicFrame schema class does not improve the performance, but rather
provides additional functionality and flexibility for data manipulation.
Adjusting the AWS Glue job scheduling frequency does not improve the
performance, but rather reduces the frequency of data updates. Modifying
the IAM role that grants access to AWS Glue does not improve the
performance, but rather affects the security and permissions of the AWS
Glue service. References:
Optimising Glue Scripts for Efficient Data Processing: Part 1 (Section: Partitioning Data in S3)
Best practices to optimize cost and performance for AWS Glue streaming ETL jobs (Section: Development tools)
Monitoring with AWS Glue job run insights (Section: Requirements)
AWS Certified Data Engineer - Associate DEA-C01 Complete Study Guide (Chapter 5, page 133)
Question # 79
A company uses Amazon RDS for
MySQL as the database for a critical application. The database workload
is mostly writes, with a small number of reads.A data engineer
notices that the CPU utilization of the DB instance is very high. The
high CPU utilization is slowing down the application. The data engineer
must reduce the CPU utilization of the DB Instance.Which actions should the data engineer take to meet this requirement? (Choose two.)
A. Use the Performance Insights feature of
Amazon RDS to identify queries that have high CPU utilization. Optimize
the problematic queries.
B. Modify the database schema to include additional tables and indexes. C. Reboot the RDS DB instance once each week. D. Upgrade to a larger instance size. E. Implement caching to reduce the database query load.
Answer: A, E Explanation:
Explanation: Amazon
RDS is a fully managed service that provides relational databases in
the cloud. Amazon RDS for MySQL is one of the supported database engines
that you can use to run your applications. Amazon RDS provides various
features and tools to monitor and optimize the performance of your DB
instances, such as Performance Insights, Enhanced Monitoring, CloudWatch
metrics and alarms, etc.Using the Performance Insights feature
of Amazon RDS to identify queries that have high CPU utilization and
optimizing the problematic queries will help reduce the CPU utilization
of the DB instance. Performance Insights is a feature that allows you to
analyze the load on your DB instance and determine what is causing
performance issues. Performance Insights collects, analyzes, and
displays database performance data using an interactive dashboard. You
can use Performance Insights to identify the top SQL statements, hosts,
users, or processes that are consuming the most CPU resources. You can
also drill down into the details of each query and see the execution
plan, wait events, locks, etc. By using Performance Insights, you can
pinpoint the root cause of the high CPU utilization and optimize the
queries accordingly. For example, you can rewrite the queries to make
them more efficient, add or remove indexes, use prepared statements,
etc.Implementing caching to reduce the database query load will
also help reduce the CPU utilization of the DB instance. Caching is a
technique that allows you to store frequently accessed data in a fast
and scalable storage layer, such as Amazon ElastiCache. By using
caching, you can reduce the number of requests that hit your database,
which in turn reduces the CPU load on your DB instance. Caching also
improves the performance and availability of your application, as it
reduces the latency and increases the throughput of your data access.
You can use caching for various scenarios, such as storing session data,
user preferences, application configuration, etc. You can also use
caching for read-heavy workloads, such as displaying product details,
recommendations, reviews, etc.The other options are not as
effective as using Performance Insights and caching. Modifying the
database schema to include additional tables and indexes may or may not
improve the CPU utilization, depending on the nature of the workload and
the queries. Adding more tables and indexes may increase the complexity
and overhead of the database, which may negatively affect the
performance. Rebooting the RDS DB instance once each week will not
reduce the CPU utilization, as it will not address the underlying cause
of the high CPU load. Rebooting may also cause downtime and disruption
to your application. Upgrading to a larger instance size may reduce the
CPUutilization, but it will also increase the cost and complexity of
your solution. Upgrading may also not be necessary if you can optimize
the queries and reduce the database load by using caching. References:
Amazon RDS
Performance Insights
Amazon ElastiCache
[AWS Certified Data Engineer - Associate DEA-C01 Complete Study Guide], Chapter 3: Data Storage and Management, Section 3.1: Amazon RDS
Question # 80
A data engineer needs to securely
transfer 5 TB of data from an on-premises data center to an Amazon S3
bucket. Approximately 5% of the data changes every day. Updates to the
data need to be regularlyproliferated to the S3 bucket. The data
includes files that are in multiple formats. The data engineer needs to
automate the transfer process and must schedule the process to run
periodically.Which AWS service should the data engineer use to transfer the data in the MOST operationally efficient way?
A. AWS DataSync
B. AWS Glue C. AWS Direct Connect D. Amazon S3 Transfer Acceleration
Answer: A Explanation: Explanation: AWS
DataSync is an online data movement and discovery service that
simplifies and accelerates data migrations to AWS as well as moving data
to and from on-premises storage, edge locations, other cloud providers,
and AWS Storage services1. AWS DataSync can copy data to and from
various sources and targets, including Amazon S3, and handle files in
multiple formats. AWS DataSync also supports incremental transfers,
meaning it can detect and copy only the changes to the data, reducing
the amount of data transferred and improving the performance. AWS
DataSync can automate and schedule the transfer process using triggers,
and monitor the progress and status of the transfers using CloudWatch
metrics and events1.AWS DataSync is the most operationally
efficient way to transfer the data in this scenario, as it meets all the
requirements and offers a serverless and scalable solution. AWS Glue,
AWS Direct Connect, and Amazon S3 Transfer Acceleration are not the best
options for this scenario, as they have some limitations or drawbacks
compared to AWS DataSync. AWS Glue is a serverless ETL service that can
extract, transform, and load data from various sources to various
targets, including Amazon S32. However, AWS Glue is not designed for
large-scale data transfers, as it has some quotas and limits on the
number and size of files it can process3. AWS Glue also does not support
incremental transfers, meaning it would have to copy the entire data
set every time, which would be inefficient and costly.AWS Direct
Connect is a service that establishes a dedicated network connection
between your on-premises data center and AWS, bypassing the public
internet and improving the bandwidth and performance of the data
transfer. However, AWS Direct Connect is not a data transfer service by
itself, as it requires additional services or tools to copy the data,
such as AWS DataSync, AWS Storage Gateway, or AWS CLI. AWS Direct
Connect also has some hardware and location requirements, and charges
you for the port hours and data transfer out of AWS.Amazon S3
Transfer Acceleration is a feature that enables faster data transfers to
Amazon S3 over long distances, using the AWS edge locations and
optimized network paths. However, Amazon S3 Transfer Acceleration is not
a data transfer service by itself, as it requires additional services
or tools to copy the data, such as AWS CLI, AWS SDK, or third-party
software. Amazon S3 Transfer Acceleration also charges you for the data
transferred over the accelerated endpoints, and does not guarantee a
performance improvement for every transfer, as it depends on various
factors such as the network conditions, the distance, and the object
size. References: