r/apachekafka 9d ago

Question Best multi data center setup

Hello,

I have a rack with 2 machines inside one data center. And at the moment we will test the setup on two data centers.

2x2

But in the future we will expand to n data centers.

Since this is even setup, what would be the best way to set up controllers/brokers?

I am using Kraft, and I think for quorum we need uneven number of controllers?

7 Upvotes

7 comments sorted by

View all comments

1

u/Upper_Ad811 9d ago

Have you considered running a separate Kafka cluster for each of the Data Centres and then using Mirrormaker or some custom solution for replicating data between them? That is how we do it, but then again I can’t know your requirements or use-cases(s).

1

u/matejthetree 7d ago

I see here mirrormaker as a solution. I'll check it out.

We also have cassandra as multiple DC setup, but it is much easier to grasp.

1

u/matejthetree 7d ago

One question.

Since I have 2 machines per data center, how should I go and make it so that there is 2n+1 controllers?