{"question":{"id":38361,"htmlId":"question38361","kind":"SingleChoice","specVersion":null,"questionHtml":"

A company stores hourly CSV files from partners in the incoming-data S3 bucket. Each time a file is uploaded, a Glue crawler must update the Data Catalog and, on crawler success, a Glue ETL job must run. The solution must be fully serverless, event-driven, and require minimal maintenance. How should you configure EventBridge?

","descriptionHtml":"

Enable EventBridge on the S3 bucket so that each Object Created event is delivered to the account's default event bus. Create an EventBridge rule that matches Object Created events for the incoming-data bucket and set a single target that starts an AWS Glue workflow. Inside the workflow, configure the crawler as the first action and the ETL job as an action that depends on the crawler's SUCCEEDED state. This guarantees correct ordering without using CloudTrail, Lambda, or additional services, and it remains entirely serverless.

","answers":[{"id":2563248,"html":"

Enable CloudTrail data events for the bucket and create an EventBridge rule that starts the Glue crawler, plus another rule that starts the Glue job when the crawler succeeds.

","isCorrect":false},{"id":2563246,"html":"

Create a rule on the default event bus that matches Object Created events and add the Glue crawler and Glue job as two separate targets so the job runs after the crawler.

","isCorrect":false},{"id":2563247,"html":"

Configure an S3 Event Notification to publish to an SNS topic and subscribe a Lambda function that sequentially starts the Glue crawler and then the ETL job.

","isCorrect":false},{"id":2563245,"html":"

Enable EventBridge for the bucket and create a rule on the default event bus that matches Object Created events for incoming-data. Set the rule's single target to start a Glue workflow whose first action runs the crawler and whose dependent action starts the ETL job.

","isCorrect":true}],"textInput":null,"matching":null,"objectiveId":1919,"objectiveTitle":"Data Ingestion and Transformation","nextQuestionUrl":"/study/questions/dea-c01/a-data-engineer-is-developing-a-production-ml-workflow-that-uses-amazon/39121?HideScore=false&ObjectiveMode=RoundRobbinObjectives","questionUrl":"/study/questions/dea-c01/a-company-stores-hourly-csv-files-from-partners-in-the-incoming-data-s3/38361","followUpPrompts":[{"id":278397,"prompt":"What is EventBridge used for in AWS?","response":"EventBridge is a serverless event bus service in AWS that helps applications respond to changes in your environment by routing events from different sources to targets. It is suitable for building event-driven architectures. In this setup, EventBridge captures events (like `Object Created` from the S3 bucket) and triggers an AWS Glue workflow based on predefined rules, ensuring automated task execution without extra maintenance."},{"id":278398,"prompt":"What is the purpose of an AWS Glue workflow?","response":"An AWS Glue workflow allows you to define, orchestrate, and monitor complex data processing pipelines. It provides step-by-step execution of various tasks, such as running crawlers to update the Data Catalog and executing ETL jobs for data transformation. In this scenario, the workflow ensures the Glue crawler finishes successfully before triggering the ETL job, maintaining proper task order."},{"id":278399,"prompt":"Why is an event-driven architecture recommended for this solution?","response":"An event-driven architecture allows systems to react dynamically to specific events, minimizing manual intervention and operational overhead. In this use case, it ensures that when a file is uploaded to the S3 bucket, an automated workflow starts immediately. By leveraging EventBridge to connect the S3 bucket event with the Glue workflow, the solution remains fully serverless and highly scalable."}],"presentationMode":false,"hideFeedbackForm":false,"hideResponseBadges":false,"setId":null,"skipSaveResponse":false},"canVote":false,"streak":{"value":null,"title":null,"launchConfetti":false,"isRecord":false},"id":"crucial-react-7060aa1ebe1c4ac6bb40e44e24f9d91f"}

AWS Certified Data Engineer Associate DEA-C01 Practice Question

Report Issue