Amazon Exam DAS-C01 Topic 7 Question 89 Discussion

Actual exam question for Amazon's DAS-C01 exam

Question #: 89
Topic #: 7

A company is using an AWS Lambda function to run Amazon Athena queries against a cross-account AWS Glue Data Catalog. A query returns the following error:

HIVE METASTORE ERROR

The error message states that the response payload size exceeds the maximum allowed payload size. The queried table is already partitioned, and the data is stored in an

Amazon S3 bucket in the Apache Hive partition format.

Which solution will resolve this error?

AModify the Lambda function to upload the query response payload as an object into the S3 bucket. Include an S3 object presigned URL as the payload in the Lambda function response.

BRun the MSCK REPAIR TABLE command on the queried table.

CCreate a separate folder in the S3 bucket. Move the data files that need to be queried into that folder. Create an AWS Glue crawler that points to the folder instead of the S3 bucket.

DCheck the schema of the queried table for any characters that Athena does not support. Replace any unsupported characters with characters that Athena supports.

Show Suggested Answer

Suggested Answer: A

by Elke at Apr 13, 2024, 09:39 AM

Limited Time Offer

25%

Off

Get Premium DAS-C01 Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Rodrigo

5 months ago

You have a point, Markus. Option D might also be required to resolve the error.

upvoted 0 times

...

Markus

5 months ago

But wouldn't checking the schema of the queried table be helpful too? That's option D.

upvoted 0 times

...

Iola

5 months ago

I'm leaning towards C) Create a separate folder in the S3 bucket and move the data files there.

upvoted 0 times

...

Rodrigo

6 months ago

I disagree, I believe the correct solution is B) Run the MSCK REPAIR TABLE command on the queried table.

upvoted 0 times

...

Markus

6 months ago

I think the answer is A) Modify the Lambda function to upload the query response payload as an object into the S3 bucket.

upvoted 0 times

...

Leigha

6 months ago

That's a good point. Running the repair command could indeed be a simple fix to the issue.

upvoted 0 times

...

Yuki

6 months ago

I'm not sure about those options. I think running the MSCK REPAIR TABLE command as mentioned in option B could potentially solve the error.

upvoted 0 times

...

Hailey

6 months ago

I disagree. I believe option C might be better. Creating a separate folder in the S3 bucket and using an AWS Glue crawler could be more effective.

upvoted 0 times

...

Leigha

7 months ago

I think option A could work. Uploading the query response as an object into S3 sounds like a good solution.

upvoted 0 times

...

Okay, let's think this through. The table is already partitioned, so that's good. And the data is stored in Hive partition format, which is also a plus. I'm kind of leaning towards option C – creating a separate folder and using a Glue crawler. That way, we can potentially isolate the problematic data and work around the payload size issue. But I'd love to hear what the others think. Anyone have any other bright ideas?

upvoted 0 times

...

Remona

8 months ago

Option B, running the MSCK REPAIR TABLE command, could also be worth a try. That might help Athena better understand the partitioning of the data and allow the query to complete successfully.

upvoted 0 times

Abel

7 months ago

C: Let's give it a shot and see if it fixes the problem.

upvoted 0 times

...

Marion

7 months ago

B: Agreed. It's worth trying out multiple solutions to see which one works best.

upvoted 0 times

...

Annett

8 months ago

A: Maybe a combination of both solutions could resolve the error completely.

upvoted 0 times

...

Malissa

8 months ago

D: That's true. Including a presigned URL in the Lambda function response could help with the payload size.

upvoted 0 times

...

Loren

8 months ago

C: I think modifying the Lambda function to upload the query response payload to S3 might also work.

upvoted 0 times

...

Malika

8 months ago

B: Yeah, running the MSCK REPAIR TABLE command could definitely help with that.

upvoted 0 times

...

Margarita

8 months ago

A: Option B seems like a good idea to fix the partitioning issue.

upvoted 0 times

...

Barb

8 months ago

I'm leaning towards option A. Uploading the query response to S3 and returning a pre-signed URL seems like a reasonable workaround. That way, the client can download the data at their own pace without hitting the payload size limit.

upvoted 0 times

...

Junita

8 months ago

Haha, I love how specific this question is! It's like someone at AWS is just trying to trip us up. 'HIVE METASTORE ERROR' – what is this, a crossword puzzle? Anyway, my money's on option A. Sticking the response in S3 and using a pre-signed URL seems like a nice, clean solution. Although, I do wonder if that would introduce any performance issues or other complications. Hmm, decisions, decisions...

upvoted 0 times

...

Doug

8 months ago

Yeah, I agree. Payload size limits can be tricky, especially when dealing with large datasets. I wonder if we can optimize the query to return less data, or maybe partition the data in a different way.

upvoted 0 times

...

Dominga

8 months ago

Hmm, this is an interesting question. The error message suggests that the response payload size from the Athena query is exceeding the maximum allowed size. That could be a real problem, especially if this is a production workload.

upvoted 0 times

...

Latosha

8 months ago

You know, I was actually just reading about this kind of issue the other day. I think option D might be the way to go – checking for any unsupported characters in the schema and replacing them. Athena can be a bit picky about that stuff, and it could be the root cause of the problem. Although, I have to admit, I'm a little worried about the 'HIVE METASTORE ERROR' part. That's a new one for me.

upvoted 0 times

...

Luis

8 months ago

Okay, so we've got a few options here. Option B, running the MSCK REPAIR TABLE command, seems like it could be worth a shot. Maybe there's some issue with the partitions that's causing the problem. But I'm also intrigued by option C, creating a separate folder and using a Glue crawler. That could be a way to work around the payload size issue too.

upvoted 0 times

Lenita

6 months ago

Yeah, that could work. But option C also seems interesting. Creating a separate folder might be a good workaround.

upvoted 0 times

...

Kami

7 months ago

I think running the MSCK REPAIR TABLE command could help fix the issue.

upvoted 0 times

...

Cherri

8 months ago

Hmm, it sounds like the table is already partitioned, so that's good. But the payload size issue is a real head-scratcher. I'm leaning towards option A, since uploading the response to S3 and returning a pre-signed URL seems like a clever way to work around the payload size limit. But I'd love to hear what the others think.

upvoted 0 times

...

Brandon

8 months ago

Whoa, this question seems pretty tricky! A 'HIVE METASTORE ERROR' due to a response payload size exceeding the maximum allowed? That's a pretty specific issue. I'm not sure I'd know where to start, but I'm definitely curious to see what the other candidates think.

upvoted 0 times

...

Amazon Exam DAS-C01 Topic 7 Question 89 Discussion

Contribute your Thoughts:

Rodrigo

Markus

Iola

Rodrigo

Markus

Leigha

Yuki

Hailey

Leigha

Sanjuana

Remona

Abel

Marion

Annett

Malissa

Loren

Malika

Margarita

Barb

Junita

Doug

Dominga

Latosha

Luis

Lenita

Kami

Cherri

Brandon