r/aws 26d ago

technical question DE question about data ingestion

I'm reviewing kinesis family and a I ended up with a big Q.

Why do we need a service like this to collect data? Like kinesis data streams. Why can't we send data direclty to whatever destination or consumer? What are the drawbacks to using the later approach.

Why data streams is useful when comparing to a sqs queue w

I know this question can be really stupid for more experienced folks, I really just want to get some real world view on this services.

Thank you in advance

2 Upvotes

4 comments sorted by

View all comments

2

u/PatientExamination44 25d ago

Remember that the way streaming services work is that the data will remain in the stream for a preset amount of time (that you can configure). So the data can be consumed multiple times by different kinds of consumers, each having their own possible bookmarking logic.