Administer > Configure Streaming of Logs

Configure Streaming of Logs

OMi MP for AWS enables data collection from the Cloud Watch log file. The log data is structured in a specific format to provide information about account ID, region, group, stream, timestamp, and message. The structured data is further processed by Operations Agent and forwarded to required targets.

OMi MP for AWS provides AWS CloudWatch Log aspect and AWS Log Collection aspect. The aspects and related policies are available as OMi MP for AWS Log Streaming AddOn 01.00.000 package.

Log streaming is supported on Operations Manager i 10.61 (or later) and Operations Agent 12.04 (or later) versions.

The AWS CloudWatch Log Aspect creates AWSCloudWatchLog.log log file at /var/opt/OV/log/AWS/ location. The AWS CloudWatch Log aspect collects logs at 5-minute frequency.

Note Make sure the following:

  • Deploy the AWS CloudWatch Log aspect before you deploy the AWS Log Collection aspect.
  • To collect logs, set the same frequency(polling  interval) for both AWS CloudWatch Log aspect and AWS Log Streaming policy.

The AWS Log Collection aspect enables the streaming of structured logs for cloud watch logs. AWS Log Collection aspect contains Log Streaming and Data Forwarding policies that must be configured before deploying the aspect. Data from the log file is converted to structured data based on the mapping and conditions defined in the Log Streaming policy. Operations Agent processes the data and then forwards it to the target specified in the Data forwarding policy.

Deploy Aspect and Policies for AWS Log Streaming

You must deploy the aspects and policies in the following order for AWS log Streaming:

  1. Deploy AWS CloudWatch Log aspect. AWS CloudWatch Log aspect creates the /var/opt/OV/log/AWS/AWSCloudWatchLog.log file. Log data is collected from the log file.
  2. To load historic data, configure the AWS_LogStreaming policy. Else, go to step 3.

    For more information about configuring the log streaming policy, see Configure Log Streaming Policy.

  3. To specify the target and filter conditions, configure the AWS_DataForwarding policy.

    For more information about configuring the data forwarding policy, see Configure Data Forwarding policy.

  4. Edit the AWS Log Collection Aspect to include the latest version of AWS_LogStreaming and AWS_DataForwarding policies and click Save.
  5. Deploy the latest version of AWS Log Collection aspect.