CLF-C02 ยท AI, machine learning and analytics
Querying and processing data
Amazon Athena for SQL on S3, AWS Glue for ETL and the data catalog, Amazon EMR for big data frameworks and Amazon Redshift for data warehousing.
Key points
- Amazon Athena: serverless, interactive SQL directly on data in Amazon S3; you pay for the queries you run.
- AWS Glue: serverless ETL jobs and a central Data Catalog that crawlers fill with table schemas.
- Amazon EMR: managed clusters for open-source frameworks such as Apache Spark and Hadoop.
- Amazon Redshift: managed data warehouse for fast analytic SQL on large structured datasets.
Source: https://docs.aws.amazon.com/athena/latest/ug/what-is.html
Practice questions
Which AWS service lets you run standard SQL queries directly on files stored in Amazon S3 without setting up any servers?
- Amazon Redshift
- Amazon EMR
- AWS Glue
- Amazon Athena
Show answer
Answer: D. Amazon Athena
Amazon Athena is serverless and queries data in place in S3. Redshift and EMR involve provisioned clusters or loading data, and Glue prepares and catalogs data rather than serving as the query engine.
Which statements describe AWS Glue?
- It is serverless, so there is no infrastructure to manage
- It runs ETL jobs that transform and move data
- It is a provisioned cluster used as the data warehouse
- Its Data Catalog holds table schemas that Athena can query
- It publishes interactive dashboards to business users
Show answer
Answer: A. It is serverless, so there is no infrastructure to manage, B. It runs ETL jobs that transform and move data, D. Its Data Catalog holds table schemas that Athena can query
Glue is serverless, runs ETL jobs to extract, transform and load data, and keeps a central Data Catalog that Athena, EMR and Redshift Spectrum can query. A provisioned warehouse cluster is Redshift, and business dashboards come from Quick Sight.
Before Amazon Athena can query log files in S3, the data must first be loaded into a database cluster that you provision.
Show answer
Answer: False
False. Athena queries the data where it sits in S3 and is serverless, so there is no cluster to provision or load. Loading into a warehouse cluster is how Amazon Redshift is typically used, which is the source of the confusion.
Practice 8 questions on this topic in Bitzu
Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.
