kafka.partitioner package

Submodules

kafka.partitioner.base module

class kafka.partitioner.base.Partitioner(partitions)

Bases: object

Base class for a partitioner

partition(key, partitions)

Takes a string key and num_partitions as argument and returns a partition to be used for the message

Parameters:partitions – The list of partitions is passed in every call. This may look like an overhead, but it will be useful (in future) when we handle cases like rebalancing

kafka.partitioner.hashed module

class kafka.partitioner.hashed.HashedPartitioner(partitions)

Bases: kafka.partitioner.base.Partitioner

Implements a partitioner which selects the target partition based on the hash of the key

partition(key, partitions)

kafka.partitioner.roundrobin module

class kafka.partitioner.roundrobin.RoundRobinPartitioner(partitions)

Bases: kafka.partitioner.base.Partitioner

Implements a round robin partitioner which sends data to partitions in a round robin fashion

partition(key, partitions)

Module contents

class kafka.partitioner.RoundRobinPartitioner(partitions)

Bases: kafka.partitioner.base.Partitioner

Implements a round robin partitioner which sends data to partitions in a round robin fashion

partition(key, partitions)

class kafka.partitioner.HashedPartitioner(partitions)

Bases: kafka.partitioner.base.Partitioner

Implements a partitioner which selects the target partition based on the hash of the key

partition(key, partitions)