Mirror Maker 2

Introduction

Kafka MirrorMaker 2 (MM2) is a tool for replicating topics between Kafka clusters, primarily used for disaster recovery, multi-cluster deployments, and data migration. It is built on Kafka Connect and supports automatic topic synchronization, consumer group synchronization, and offset translation.

Kubernetes 2.0 ConfigMap

Users should update or append the existing ConfigMap named opsramp-workload-metric-user-config by adding application-specific fields. These fields may include authentication credentials, collection frequency, and other relevant configurations. To run OpenTelemetry Redis Receiver with Kubernetes, we need to create a ConfigMap and deploy it.

apiVersion: v1
kind: ConfigMap
metadata:
  name: opsramp-workload-metric-user-config
  namespace: opsramp-agent
data:
  workloads: |
    mirrormaker2:
    - name: mirrormaker2-1
      collectionFrequency: 10s
      port: 9404
      targetPodSelector:
        matchLabels:
          - key: app.kubernetes.io/instance
            operator: ==
            value:
              - mirror-maker-2

Supported Metrics

Supported metrics for this workload as provided by the Kubernetes 2.0 Agent.

Metric	Description
kafka_connect_mirror_mirrorsourceconnector_record_rate	Rate of records mirrored by the MirrorSourceConnector in Kafka Connect
kafka_connect_worker_task_count	Number of tasks currently running in the Kafka Connect worker
rate(kafka_consumer_outgoing_byte_total)	Rate of outgoing bytes processed by Kafka consumers
kafka_connect_mirror_mirrorsourceconnector_replication_latency_ms_avg	Average replication latency (in milliseconds) for the MirrorSourceConnector
kafka_connect_mirror_mirrorsourceconnector_record_age_ms_avg	Average age (in milliseconds) of records mirrored by the MirrorSourceConnector
kafka_connect_worker_connector_count	Number of connectors currently running in the Kafka Connect worker
kafka_connect_mirror_mirrorsourceconnector_byte_rate	Rate of bytes mirrored by the MirrorSourceConnector in Kafka Connect
kafka_consumer_incoming_byte_total	Total number of incoming bytes processed by Kafka consumers