New Skills

New Training: Aggregate Log files in Amazon S3

by Team Nuggets
New Training: Getting Started with Amazon S3 picture: A
Published on February 19, 2021

In this 9-video skill, CBT Nuggets trainer Bart Castle teaches you how to design and implement S3-based centralized logging solutions. Gain an understanding of CloudWatch Logs groups and permissions and the CloudWatch Agent. Watch this new AWS training.

Learn AWS with one of these courses:

This training includes:

  • 9 videos

  • 52 minutes of training

You’ll learn these topics in this skill:

  • Centralizing Log Aggregation to S3

  • Logging to S3 from Elastic Beanstalk

  • Logging Directly to S3 and Configuring Permissions

  • S3 Copy and Sync from an EC2 Instance

  • S3 Sync from a Remote Azure Instance

  • CloudWatch Logs Group and Permissions

  • Installing the CloudWatch Agent

  • Configuring the CloudWatch Agent

  • Using Lambda to Ship Log Group Events to S3

What is AWS Centralized Logging?

The AWS Centralized Logging Solution that lets you aggregate, analyze and view logs from Amazon CloudWatch within a single Kibana dashboard. When you use services from AWS, they generate logs for numerous events, such as for access, configuration changes and billing. Also, web servers, applications and operating systems generate their own logs. Collecting, managing and acting upon all this data can be challenging, and this is where Centralized Logging comes into play.

The solution uses the Amazon Elasticsearch Service in combination with an analytics and visualization platform called Kibana to collect log events from CloudWatch and present them to you within a unified view.

There are three components to Centralized Logging: log ingestion, log indexing and visualization. During log ingestion, the solution gathers data. During log indexing, the solution indexes data for fast retrieval of information. Finally, during visualization, the solution displays data to you in a useful way.

Recommended Articles