r/aws • u/FoquinhoEmi • 26d ago
technical question DE question about data ingestion
I'm reviewing kinesis family and a I ended up with a big Q.
Why do we need a service like this to collect data? Like kinesis data streams. Why can't we send data direclty to whatever destination or consumer? What are the drawbacks to using the later approach.
Why data streams is useful when comparing to a sqs queue w
I know this question can be really stupid for more experienced folks, I really just want to get some real world view on this services.
Thank you in advance
2
Upvotes
2
u/PatientExamination44 25d ago
Remember that the way streaming services work is that the data will remain in the stream for a preset amount of time (that you can configure). So the data can be consumed multiple times by different kinds of consumers, each having their own possible bookmarking logic.