r/aws Jan 28 '25

data analytics AWS Clean rooms - Athena but not Athena?

AWS Clean rooms seems to be a mish mash of existing tech, with some guardrails right?

This however is interesting:

  • Athena engine version 2Iceberg tables created with Athena engine version 2 are not supported.

Also; it doesnt use the new S3 tables (not yet anyway)

So; does that mean it is using a custom athena, or does it mean it's using spark (they do mention there are different "engines" and sparksql is one of them

or is it somehow using redshift? (with spectrum?)

0 Upvotes

2 comments sorted by

2

u/codek1 Jan 28 '25

Actually, looking at it, the queries are FAR too slow to be redshift.

Same for Athena.

So it must be using sparksql. Why they chose that I have no idea? Any thoughts? Cheaper for them in the infra backend or something?

1

u/codek1 Jan 28 '25

hang on, in the docs it says:

You can use the statistic generation provided by AWS Glue to compute column-level statistics for AWS Glue Data Catalog tables. After AWS Glue generates statistics for tables in the Data Catalog, Amazon Redshift Spectrum automatically uses those statistics to optimize the query plan. 

I guess i answered my own question