kafka.partitioner package¶

Submodules¶

kafka.partitioner.base module¶

class kafka.partitioner.base.Partitioner(partitions)[source]¶

Bases: object

Base class for a partitioner

partition(key, partitions=None)[source]¶

Takes a string key and num_partitions as argument and returns a partition to be used for the message

Arguments:

key: the key to use for partitioning partitions: (optional) a list of partitions.

kafka.partitioner.hashed module¶

kafka.partitioner.hashed.HashedPartitioner¶

alias of LegacyPartitioner

class kafka.partitioner.hashed.LegacyPartitioner(partitions)[source]¶

Bases: kafka.partitioner.base.Partitioner

DEPRECATED – See Issue 374

Implements a partitioner which selects the target partition based on the hash of the key

partition(key, partitions=None)[source]¶

class kafka.partitioner.hashed.Murmur2Partitioner(partitions)[source]¶

Bases: kafka.partitioner.base.Partitioner

Implements a partitioner which selects the target partition based on the hash of the key. Attempts to apply the same hashing function as mainline java client.

partition(key, partitions=None)[source]¶

kafka.partitioner.hashed.murmur2(key)[source]¶

Pure-python Murmur2 implementation.

Based on java client, see org.apache.kafka.common.utils.Utils.murmur2

Args:

key: if not a bytes type, encoded using default encoding

Returns: MurmurHash2 of key bytearray

kafka.partitioner.roundrobin module¶

class kafka.partitioner.roundrobin.RoundRobinPartitioner(partitions)[source]¶

Bases: kafka.partitioner.base.Partitioner

Implements a round robin partitioner which sends data to partitions in a round robin fashion

partition(key, partitions=None)[source]¶

Module contents¶

class kafka.partitioner.RoundRobinPartitioner(partitions)[source]¶

Bases: kafka.partitioner.base.Partitioner

Implements a round robin partitioner which sends data to partitions in a round robin fashion

partition(key, partitions=None)[source]¶

kafka.partitioner.HashedPartitioner¶

alias of LegacyPartitioner

class kafka.partitioner.Murmur2Partitioner(partitions)[source]¶

Bases: kafka.partitioner.base.Partitioner

Implements a partitioner which selects the target partition based on the hash of the key. Attempts to apply the same hashing function as mainline java client.

partition(key, partitions=None)[source]¶

class kafka.partitioner.LegacyPartitioner(partitions)[source]¶

Bases: kafka.partitioner.base.Partitioner

DEPRECATED – See Issue 374

Implements a partitioner which selects the target partition based on the hash of the key

partition(key, partitions=None)[source]¶