Alibaba LoongCollector - Fast and Lightweight Observability Data Collector | 中文用户手册（GitBook | 可观测中文社区）

LoongCollector was born for observable scenarios and has many production-level features such as lightweight, high performance, and automated configuration, which are widely used internally by Alibaba Group and tens of thousands of external Alibaba Cloud customers. You can deploy it in physical machines, Kubernetes and other environments to collect telemetry data, such as logs, traces and metrics.

Abstract

The core advantages of LoongCollector:

• Support a variety of Logs, Traces, Metrics data collection, and friendly to container and Kubernetes environment support.
• The resource cost of data collection is quite low, 5-20 times better than similar telemetry data collection Agent performance.
• High stability, used in the production of Alibaba and tens of thousands of Alibaba Cloud customers, and collecting dozens of petabytes of observable data every day with nearly tens of millions deployments.
• Support plugin expansion, such as collection, processing, aggregation, and sending modules.
• Support configuration remote management and provide a variety of ways, such as SLS console, SDK, K8s Operator, etc.
• Supports multiple advanced features such as self-monitoring, flow control, resource control, alarms, and statistics collection.

LoongCollector supports the collection of a variety of telemetry data and transmission to a variety of different backends, such as SLS observable platform. The data supported for collection are mainly as follows:

• Logs
  • Collect static log files
  • Dynamic collect the files when running with containerized environment
  • Dynamic collect Stdout when running with containerized environment
• Traces
  • OpenTelemetry protocol
  • Skywalking V2 protocol
  • Skywalking V3 protocol
  • ...
• Metrics
  • Node metrics
  • Process metrics
  • Gpu metrics
  • Nginx metrics
  • Support fetch prometheus metrics
  • Support transfer telegraf metrics
  • ...

Quick Start

For the complexity of C++ dependencies, the compilation of LoongCollector requires you have docker and golang installed. If you aim to build LoongCollector from sources, you can go ahead and start with the following commands.

make
cp -r example_config/quick_start/* output
cd output
./loongcollector
# Now, LoongCollector is collecting data from output/simple.log,
# and outputing the result to stdout.

Documentation

Our official User Manual is located here:

Homepage

Download

Installation

Configuration

All Plugins

Getting Started

Developer Guide

Benchmark

Contribution

There are many ways to contribute:

• Fix and report bugs
• Improve Documentation
• Review code and feature proposals
• Contribute plugins

Contact Us

You can report bugs, make suggestions or participate in discussions through Github Issues and Github Discussions, or contact us with the following ways:

• Bilibili：阿里云SLS
• Zhihu：LoongCollector社区
• DingTalk/WeChat：LoongCollector社区

Our Users

Tens of thousands of companies use LoongCollector in Alibaba Cloud, IDC, or other clouds. More details please see here.

Licence

Apache 2.0 License