Setting up automated data quality workflows and alerts using AWS Glue DataBrew and AWS Lambda

By Amazon Web Services - 2020-12-18

Description

Proper data management is critical to successful, data-driven decision-making. An increasingly large number of customers are adopting data lakes to realize deeper insights from big data. As part of th ...

Summary

  • Proper data management is critical to successful, data-driven decision-making.
  • You can download the sample dataset (us-east-1 Region) and follow the instructions for this solution, or use your own data that gets dumped into your data lake on a recurring basis.
  • The topic provides us with a central communication channel that we can broadcast to when the job completes, and the subscription is then used to receive the messages published to our topic.
  • For Topic ARN, choose the topic that you created in the previous step.

 

Topics

  1. Backend (0.42)
  2. Database (0.16)
  3. Security (0.09)

Similar Articles

14 Data Science projects to improve your skills

By KDnuggets - 2020-12-01

There's a lot of data out there and so many data science techniques to master or review. Check out these great project ideas from easy to advanced difficulty levels to develop new skills and strengthe ...