kafka commands

20 commands, each with a one-line explanation. Click a command to copy it, or its title for details.

Commands 20 shown

  • List topics
    kafka-topics.sh --bootstrap-server kafka:9092 --list

    List all Kafka topics in the cluster

  • Create topic
    kafka-topics.sh --bootstrap-server kafka:9092 --create --topic <name> --partitions 3 --replication-factor 2

    Create topic with specific partition and replication settings

  • Describe topic
    kafka-topics.sh --bootstrap-server kafka:9092 --describe --topic <name>

    Show partition count, replication, leaders and ISR

  • Delete topic
    kafka-topics.sh --bootstrap-server kafka:9092 --delete --topic <name>

    Permanently delete a Kafka topic

  • Consume from beginning
    kafka-console-consumer.sh --bootstrap-server kafka:9092 --topic <name> --from-beginning

    Read all messages from a topic starting from offset 0

    debug

  • Produce messages
    kafka-console-producer.sh --bootstrap-server kafka:9092 --topic <name>

    Send messages to a topic interactively from stdin

    debug

  • List consumer groups
    kafka-consumer-groups.sh --bootstrap-server kafka:9092 --list

    Show all consumer groups

  • Consumer group lag
    kafka-consumer-groups.sh --bootstrap-server kafka:9092 --describe --group <group>

    Show lag per partition for a consumer group

    monitoring · debug

  • Reset consumer group offset
    kafka-consumer-groups.sh --bootstrap-server kafka:9092 --group <group> --topic <topic> --reset-offsets --to-earliest --execute

    Reset a consumer group to the beginning of the topic

  • Alter topic partitions
    kafka-topics.sh --bootstrap-server kafka:9092 --alter --topic <name> --partitions 6

    Increase (only) the number of partitions for a topic

  • Get topic offsets
    kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list kafka:9092 --topic <name>

    Show earliest and latest offsets per partition

    debug

  • Create a topic
    kafka-topics.sh --bootstrap-server kafka:9092 --create --topic my-topic --partitions 6 --replication-factor 3

    Create a new Kafka topic with 6 partitions and RF=3

  • List consumer group lag
    kafka-consumer-groups.sh --bootstrap-server kafka:9092 --describe --group my-group

    Show per-partition lag for a consumer group

    monitoring

  • Reset consumer group offset
    kafka-consumer-groups.sh --bootstrap-server kafka:9092 --group my-group --reset-offsets --to-earliest --topic my-topic --execute

    Reset consumer offsets to earliest

  • Produce messages from stdin
    kafka-console-producer.sh --bootstrap-server kafka:9092 --topic my-topic --property 'key.separator=:' --property 'parse.key=true'

    Produce key:value messages interactively

  • Consume from beginning
    kafka-console-consumer.sh --bootstrap-server kafka:9092 --topic my-topic --from-beginning --max-messages 10

    Read first 10 messages from a topic

  • Alter topic partitions
    kafka-topics.sh --bootstrap-server kafka:9092 --alter --topic my-topic --partitions 12

    Increase partition count (cannot decrease)

  • Describe topic config
    kafka-configs.sh --bootstrap-server kafka:9092 --describe --entity-type topics --entity-name my-topic

    Show all overridden config values for a topic

  • Set topic retention
    kafka-configs.sh --bootstrap-server kafka:9092 --alter --entity-type topics --entity-name my-topic --add-config retention.ms=604800000

    Set 7-day retention on a topic

  • Check broker metadata
    kafka-broker-api-versions.sh --bootstrap-server kafka:9092

    List all API versions supported by the broker

    debug