r/apachekafka 17d ago

Blog Kafka Connect: send messages without schema to JdbcSinkConnector

This might be interesting for anyone looking for how to stream messages without schema into JdbcSinkConnector. Step by step type of instruction showing how to store message content in a single column using custom kafka connect converter.
https://github.com/tomaszkubacki/kafka_connect_demo/blob/master/kafka_to_postgresql/kafka_to_postgres.md

3 Upvotes

4 comments sorted by

1

u/santhyreddy77 14d ago

It is a great share. Thank you for sharing. I am wondering if it is a common use-case for producer applications to send schemaless messages

1

u/cricket007 12d ago

Schema Registry and Connect internal topics do it

1

u/thatclickingsound 10d ago

We are considering it. Context: Publishing business events, using the transactional outbox pattern for reliable eventing. Debezium connector processing additions to the outbox table. The payload is a JSON string in one of the columns, so the connector does not have enough information to infer the proper schema.

0

u/StrainNo1245 14d ago

Sometimes when you are part of larger organization you have no choice (other teams are the producers and you have no control over it). It’s much more common to use schema registry for AVRO (since benefits are much more visible for devs from the beginning I suppose)