Question: Why does AWS::CodeBuild::Project deployment fail with "CodeBuild currently doesn't support VPC in ..."?

"I want to deploy a CodeBuild project with a build environment of compute type LINUX_GPU_CONTAINER.This is the CDK code specifying the build environment:    codebuild_image_repo = aws_ecr.Repository.from_repository_name(self, "my-codebuild-mirror", "codebuild/amazonlinux2-x86_64-standard")    build_environment = aws_codebuild.BuildEnvironment(        build_image=aws_codebuild.LinuxGpuBuildImage.from_ecr_repository(codebuild_image_repo, "4.0"),        compute_type=codebuild.ComputeType.LARGE,        privileged=True,        )The cdk deployment fails with8:30:04 PM | UPDATE_FAILED        | AWS::CodeBuild::Project     | rjuenglinghfmcilum...ockerbuildC784821BFailed to call UpdateProject, reason: CodeBuild currently doesn't support VPC in us-east-1a, please select subnets in other availability zones. (Service: AWSCodeBuild; Status Code:400; Error Code: InvalidInputException; Request ID: e7894cde-5d45-4774-8862-9f070c95c8de; Proxy: null)In the CodeBuild project I am specifying vpc, security_groups and subnet_selection.  If in the code snippet above I use aws_codebuild.LinuxBuildImage instead of aws_codebuild.LinuxGpuBuildImage then the deployment succeeds.The error message does not seem to point to the root cause because deployment succeeds with the same network setup if I change the compute type.FollowComment"

Answer: "0Accepted Answerreason: CodeBuild currently doesn't support VPC in us-east-1a, please select subnets in other availability zonesDid you try a different Availability Zone? Based on the message I'd infer that compute type LINUX_GPU_CONTAINER is not available in us-east-1a--SydCommentShareSydanswered 2 months agoRalf J 2 months agoIndeed, using a different subnet for the CodeBuild environment the error went away.Share"


Question: How to Determine the Source of Billed CloudWatch Metrics?

"I enabled Detailed Monitoring on an instance for a few days to troubleshoot.   But I was just charged a full month for those metrics.   So how do I find where else the metrics I'm billed for are coming from?From the bill$0.30 per metric-month for the first 10,000 metrics - US West (Oregon)128.817 MetricsFrom Cost Explorer grouped by UsageTypeUSW2-CW:MetricMonitorUsage $40.29FollowComment"

Answer: "0Can you please provide more details about the usage? When you expand the line item in the bills, you will find more details about the usage.You can also use Cost Explore with Group By option set to UsageType and get a better understanding of what Type of Cloudwatch usage caused the spike.You will then have to work backwards based on the pricing details for the specific usage. Please update the question with the above details and I will try and provide further steps to help investigate. :)Edit 1:These charges are incurred either when you enable detailed monitoring or pushing custom metrics. Reviewing your initial query, I believe this is caused due to the detailed monitoring. EC2 instances push various metrics based on instance type. As a result, all these metrics are included in this charge when detailed monitoring is enabled. You can find the following in the pricing page:"Typically, EC2 Detailed Monitoring is charged at $2.10 per instance per month (assumes 7 metrics per instance) and goes down to $0.14 per instance at the lowest priced tier. As with all custom metrics, EC2 Detailed Monitoring is prorated by the hour and metered only when the instance sends metrics to CloudWatch."If you have disabled detailed monitoring, the charges should have stopped. You can confirm this by reviewing the Cost explorer daily view for the specific usage type. If you continue to incur charges, please reach out to the AWS Billing team and they will help you with it.Regards,HarshavardhanCommentShareSUPPORT ENGINEERHarshavardhan_Ganswered 2 months agorePost-User-8725074 2 months agoUpdated as requested, I believe.ShareHarshavardhan_G SUPPORT ENGINEER2 months agoReview my Edit 1 for further detailsSharerePost-User-8725074 2 months agoThanks.  How do I reach out to the billing team?ShareHarshavardhan_G SUPPORT ENGINEER2 months agoCreate a case in the support console here: https://support.console.aws.amazon.com/support/home?region=us-west-1#/case/createSelect Service: Billing and Category: Charge InquiryShare"


Question: Inspection of algorithm containers for Sagemaker

"We plan to provide a machine learning algorithm via a container image and are concerned about. Is it possible that other parties download the docker image for local inspection?FollowCommentDurga_S a year agoCan you clarify your question? Would you want members in your team to be able to download a custom image you have created? I'm assuming this question is specific to model monitoring.ShareNorbert a year agoThanks Durga_S, to clarify: is it possible for unrelated parties to get the source contained in the container image?That is, if the container contains for example Python code that is not open source, would it be possible for unrelated entities to obtain the Python sources?Share"

Answer: "0As long as you have the image pushed to an ECR repository you should be fine, you will want to check access and control permissions to your repository and if you want it in a VPC or not.CommentShareAWS-User-7417937answered a year agoNorbert a year agoYes, we are pushing to an ECR repository.One more thing I would like to clarify: We want third parties to use the container in sagemaker, but not inspect the containers. Does this align with your understanding?Thanks a lot!Share0That is, if the container contains for example Python code that is not open source, would it be possible for unrelated entities to obtain the Python sources?Third parties who can access or download the image will be able to access the internals, i.e. via docker run -it your_secret_image /bin/bash. If you are distributing your container for use, you are distributing the contents of the container for access as well.See also a similar question asked and answered elsewhere.CommentSharejggoyder_CloudStrifeanswered a year agoNorbert a year agoThanks, and yes, I am aware of the fact that if the image is generally available for download, then it can be inspected.The question is whether sagemaker algorithm containers can be used within sagemaker (that is on the AWS cloud servers) AND at the same time set to NOT be downloadable to unrelated computers.My idea of how it "should" work is that Sagemaker algorithm containers can be deployed to cloud nodes via the Python API, but not pulled via docker pull etc. That would protect the content of the image and still make the functionality available in  sagemaker.Share"


Question: DCV Microphone Privacy not showing up in Windows Privacy settings

"Has anyone had an issue where DCV privacy settings are not showing up in windows privacy settings and therefore not allowing Premiere audio playback functionality? Any workarounds? I tried forcing allow all microphones in GPM but that didn't seem to do anything...Edited by: thepostflow on Sep 14, 2021 2:38 PMEdited by: thepostflow on Sep 14, 2021 2:38 PMFollowComment"

Answer: 1"I tried forcing allow all microphones in local GPM but that didn't seem to do anything..."Actually this works.... changes take 10-15min to propagate.CommentSharethepostflowanswered 2 years ago


Question: Api Gateway cache key parameters - method level vs integration level?

"Hi, in api gateway with caching enabled, what's the difference to flag "caching" checkbox for a query string parameter at method request level versus integration request request level?Method request levelIntegration request levelIn addition, in a proxy type gateway, do we have to flag "caching" checkbox for the default "proxy" path parameter in order to have it included in the caching key?FollowComment"

Answer: "0As mentioned in the document https://docs.aws.amazon.com/apigateway/latest/developerguide/api-gateway-caching.html, "When a cached method or integration has parameters, which can take the form of custom headers, URL paths, or query strings, you can use some or all of the parameters to form cache keys. API Gateway can cache the method's responses, depending on the parameter values used." So where you define the cache key will determine at what point will the incoming request be evaluated against the cached keys.If you have defined a proxy resource only and no other resource in the API, then the settings on the proxy resource will apply on all resources. If there are more specific resources defined, then the settings on those specific resources will apply to those specific resources and the proxy settings will apply to every other resource. To understand how proxy resources work, please take a look at https://docs.aws.amazon.com/apigateway/latest/developerguide/api-gateway-method-settings-method-request.html under this section "Use a proxy resource to streamline API setup".CommentShareEXPERTIndranil Banerjee AWSanswered 8 months agolincetto 8 months agoHi Indranil, thank you.But in both the first 2 screenshots I'm inside the "proxy resource" and at GET method definition, I'm not configuring other resources or other methods, so I still have doubts ;)About the necessity to mark as cacheable the proxy path parameter, do you have any hint?Share"


Question: QuickSight Athena Dataset Issue

"Hi Team,I created an Athena table and used a quicksight dataset to connect to it. However, the quicksight page informed me that "The column(s) in this query are not found. Verify the column(s) specified in the dataset or in the custom SQL.". I checked the columns name from Athena and all looked good. What are the possible causes? Attached screenshot for your reference.Below screenshots are from Athena 'recent queries', If I run it manually, it worked.Successfully with manually running:FollowComment"

Answer: "0The "product_name" column is in Table. However, you need to check the Custom SQL Query while you are creating a dataset for analyses. From the error we can understand that there might be a issue in custom sql. If possible can you please share the Custom SQL here? OR You can check it by your end. The error says the query runs agains default database instead of SQL.CommentShareBharavi Desaianswered 6 days ago"


Question: UpdateThing (IoT) Attribute

"Hello,I do have a question. When I'm trying to update an attribute on a thing it takes 20-30s to update it, and when I'm trying to load those things again, the updated thing is still not updated. (only if i load those things again after 30s I will see the modifications.)I'm using fleet index and not a searchable attribute.So my questions is:** How can I see the modified value when I load the things before that 30s?**Thanks,RazvanFollowComment"

Answer: "0Hi,updating the fleet index can take some moments. If you want to see the result of attribute modification faster you can use the DescribeThing API. You can use the AWS CLI or the SDKs to query this API.KR,P.CommentSharePhilipp Sanswered a year ago0Hello,Thank you for your response, but I have to load all the things into a table filtered by an attribute and the item is not loading in time ( because the update takes a while).  I'm struggling with this to find a work-around.CommentShareAWS-User-7966217answered a year ago"


Question: Errors with nodejs lambda docker image

"Since upgrading a Dockerised Lambda to version public.ecr.aws/lambda/nodejs:16.2022.07.19.13 we have been getting lots of the following errors intermittently in the lambda function:Unexpected Top Level Error: Error: Failed to get next invocation, error -1Downgrading to public.ecr.aws/lambda/nodejs:16.2022.07.05.12 resolved this issue.FollowComment"

Answer: 0You can try it out https://docs.aws.amazon.com/lambda/latest/dg/troubleshooting-images.htmlCommentShareVan Hoang Khaanswered 10 months ago


Question: Amplify Push Fail - Appsync API error - S3 The specified key does not exist

"I am facing an error with cloudformation in which my nested stack got stuck in UPDATE_ROLLBACK_FAILED state causing my parent stack to failed.The reason I found out is S3 key missing for my appsync resolvers, although these files are there in S3 deployment bucket.The specified key does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchKey; Request ID: M2X7368PMNF1G; S3 Extended Request ID: WCIc1YLjxOR9KZRxkPb1AGI4xoM6KPofiohiP9ywyps8tSfP6ehHJl8gWk7o=; Proxy: null)FollowComment"


Question: DMS Migration Task is Not Creating Cdc-Files when source endpoint is S3

"In the past, a DMS migration tasks has sucessfully created the transaction files in the cdc-files folder when the target endpoint is configured as an S3 bucket.After a redeploy and today, the tasks have stopped creating the cdc transaction files, however, the Updates and Updates Applied are correctly showing updates coming through cdc. Nothing has changed as far as I can see.In the cloudwatch logs there is nothing indicating that files are being deposited.Target Bucket Actual:Target Bucket Expected:Edit:For some reason unknown, the cdc-files are now being deposited to the full load directory. No changes can be found but looking into target endpoint settings at the moment. Any guidance AWS?FollowCommentRoss Bush 5 months agoFor some reason all the cdc-files are now ending up in the full load buckets with timestamps and I cannot find this behavior documented anywhere.Share"

Answer: "1Accepted AnswerHello,By default when AWS DMS runs a CDC task with S3 as a target, it stores all the row changes logged in your source database in one or more files for each table. Each set of files containing changes for the same table reside in a single target directory associated with that table. AWS DMS creates as many target directories as database tables migrated to the Amazon S3 target endpoint.This behavior is being noticed in the screenshot where both the full load and CDC .csv files reside in the same directory inside the S3 bucket.Now, to capture source database changes in a manner that also captures the transaction order, you can specify S3 endpoint settings that direct AWS DMS to store the row changes for all database tables in one or more .csv files. These CDC files reside together in a single transaction directory that is specified on the S3 target endpoint settings. These CDC transaction .csv files follow the naming convention given below:CDC_TXN-timestamp.csvThis can be noticed in the "Target Bucket Expected" screenshot, as the .csv files reside in a different directory inside the S3 bucket and also follow the naming convention above.Please refer to the following documentation for more information:[+] https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.S3.html#CHAP_Target.S3.EndpointSettings.CdcPathTo tell AWS DMS to store all row changes in transaction order ie. to store all CDC changes in a separate directory please make sure that the following are settings are correctly configured for the S3 endpoint:Set the PreserveTransactions S3 setting on the target to true.Set the CdcPath S3 setting on the target to a relative folder path where you want AWS DMS to store the .csv transaction files.Note: AWS DMS creates this path either under the default S3 target bucket and working directory or under the bucket and bucket folder that you specify using the BucketName and BucketFolder S3 settings on the target.Please feel free to open a support case with AWS using the following link in case account-specific help is required:[+] https://console.aws.amazon.com/support/home#/case/createCommentShareSUPPORT ENGINEERPulkit_Banswered 5 months agoRoss Bush 5 months agoThanks for the thorough reply. The PreserveTransactions property was removed in one of the latest deployments :/Share"


Question: integrating IoT topic incoming JSON array of measurments with timestream

"Hi, I am trying to integrate IoT rule with timestream. I managed to handle a case when I have one incoming measurement per messages, but for network optimisation (or something) we receive packed measurements as JSON array (examples below).Is there a way to compose SQL code which will parse incoming array and put multiple measurements into timestream db?Single measurement example:{"value": 335,"dataId": "Wroclaw1""takenAt": "2022-02-01T11:40:46.770Z"}my case:[[{"value": 35,"dataId": "Wroclaw1""takenAt": "2022-02-01T11:40:46.770Z"},{"value": 37,"dataId": "Wroclaw2""takenAt": "2022-02-01T11:41:49.260Z"}]]FollowComment"

Answer: "0Hi kaczkaikielbasa!I am not sure if you can use SQL to access a Timestream - as for the documentation below, you can use API or AWS SDKs to do that (chapter "Accessing Timestream").https://docs.aws.amazon.com/timestream/latest/developerguide/what-is-timestream.htmlDepending on the amount and frequency of the data, you could try testing parsing using the language of your choice from available AWS SDKs and put that on the AWS Lambda (just to try it out, later on - in production - you would probably go for the EC2 or microservices).Please check out the code samples that are available in the documentation as well.CommentSharePiotr Blonkowskianswered a year agokaczkaikielbasa a year agonot the issue I was asking about. I am not accessing timestream with SQL. I want AWS IoT rule SQL to parse incoming JSON array to pass measurements to timestream. It is possible with single measurement data.Share"


Question: How to offload historical data to Redshift or S3?

A customer has a MySQL database and want to offload historical data to another platform for reporting and analysis. Currently they are facing performance issues during normal operations.What do I need to take into account to make the decision? I have seen that a possible way is to use DMS https://aws.amazon.com/blogs/database/archiving-data-from-relational-databases-to-amazon-glacier-via-aws-dms/. I wonder if Data Pipeline can also be used here. The destination is going to be s3 or Redshift depending on the data. Thanks!FollowComment

Answer: 0Accepted AnswerDMS and Kinesis data firehose can stream data changes from MySQL onto Redshift and S3. This is common pattern for transactional sources with primary key in source tables. Here is a blog that describes how to load ongoing changes from source using Glue and DMS https://aws.amazon.com/blogs/big-data/loading-ongoing-data-lake-changes-with-aws-dms-and-aws-glue/ .For historical data load into S3 and Redshift use DMS for low to moderate amount of data given that the customer have significant network bandwidth to AWS. For significant size data such as 10's TB exporting the MySQL data into raw files and move to  AWS Snowball and import to S3 can be more reasonable and time efficient.If the customer wants to have seamless ETL experience with sourcing capability from MySQL into Redshift and S3 they can use 3rd party product like Snaplogic. Here is a blog https://aws.amazon.com/blogs/apn/migrating-data-warehouse-workloads-from-on-premises-databases-to-amazon-redshift-with-snaplogic/CommentShareAWS-User-9244242answered 3 years ago


Question: CodeDeploy old versions on EC2 instances

"Hello,I'm using CodeDeploy and S3 to deploy my application to several EC2 instances. I'm saving a deployment with a date suffix in it's directoryname and later simlinking it in my web root. Whenever I run a new deploy the old folder gets cleanup, since it's not in my AfterInstall logic I presume AWS keeps track of deployments and cleans them up.Is this correct and can I turn this off and do my own cleanups?With kind regards,AndriesFollowComment"


Question: DynamoDB Javascript v3 API GetItemCommand UnknownOperationException

"I'm trying to use the JavaScript v3 api to retrieve a single item from DynamoDB in a nodejs lambda. I'm getting UnknownOperationException. Here's the parameter object I'm passing into GetItemCommand:{    "TableName": "test_biblestudy_tools_user",    "Key": {        "userid": {            "S": "06f4dc4b-3368-4277-9dbe-892edec668c6"        }    },    "ProjectionExpression": "email"}The lambda's execution role has GetItem on the table.One thing I wanted to do was turn on HTTP wire tracing for this, but I didn't see any example of how to do that when using the JavaScript v3 api. Right now all I'm configuring is the region, and I don't know how to configure anything else:import { DynamoDBClient, GetItemCommand, TransactWriteItemsCommand } from '@aws-sdk/client-dynamodb';const db_client = new DynamoDBClient({ region: 'us-east-1' });How can I configure this client for http wire trace? Would that likely show me something useful here? I tried CloudTrail Data Plane Event Logging, but the failed call doesn't create a log.Here's the full error from the CloudWatch log:UnknownOperationException: UnknownError      at throwDefaultError (/var/task/node_modules/@aws-sdk/client-dynamodb/node_modules/@aws-sdk/smithy-client/dist-cjs/default-error-handler.js:8:22)      at deserializeAws_json1_0GetItemCommandError (/var/task/node_modules/@aws-sdk/client-dynamodb/dist-cjs/protocols/Aws_json1_0.js:1740:51)      at processTicksAndRejections (node:internal/process/task_queues:96:5)      at async /var/task/node_modules/@aws-sdk/client-dynamodb/node_modules/@aws-sdk/middleware-serde/dist-cjs/deserializerMiddleware.js:7:24      at async StandardRetryStrategy.retry (/var/task/node_modules/@aws-sdk/middleware-retry/dist-cjs/StandardRetryStrategy.js:51:46)      at async /var/task/node_modules/@aws-sdk/middleware-logger/dist-cjs/loggerMiddleware.js:6:22      at async Runtime.handler (file:///var/task/index.js:139:23) {    '$fault': 'client',    '$metadata': {      httpStatusCode: 400,      requestId: 'c688c34f-7c64-4d9a-9eb4-3258ee5aecf6',      extendedRequestId: undefined,      cfId: undefined,      attempts: 1,      totalRetryDelay: 0    },    __type: 'com.amazon.coral.service#UnknownOperationException'  }FollowCommentLeeroy Hannigan EXPERT6 months agoPlease share the full code snippet you are trying to execute.Share"

Answer: 0Accepted AnswerI found my error. I was calling client.send(new GetItemCommand(...)) with a client that had been instantiated from a different service! That explains the UnknownOperationException. Thanks for asking me to post the entire code snipped I was running. That's what led to me spotting the error.CommentShareMatt Milleranswered 6 months ago-1I need you to check whether you are calling with a client having a request that might be originated from a different service ?CommentShareSUPPORT ENGINEERrePost-User-6470877answered 6 months agoLeeroy Hannigan EXPERT6 months agoWhat is the relevance of this answer?ShareMatt Miller 6 months agoThis did turn out to be my problem. My UnknownOperationException was being thrown because I was instantiating a client for Cognito and then using that client to execute a DDB command.Share


Question: Lambda: file descriptor limits - does it include network connections?

A customer has asked the following:Does max file descriptors of 1024 for lambdas also include open network connections?I believe the question could also be expended to:Are there any limitations on the number of open network connections?Any help appreciated!FollowComment

Answer: "0Accepted AnswerYes, each network connection will consume a file descriptor and count towards that limit. There's no specific limit on open network connections aside from the 1,024 file descriptor limit.CommentShareEXPERTAWS-User-0860851answered 7 years ago"


Question: Continuously replicate AWS Aurora MySQL to Redshift

"Is there an easy way to tell Glue to copy entire Aurora MySQL schema/all tables only over to Redshift? Also, how do I tell it to run continuously and update Redshift?FollowComment"

Answer: "0Accepted AnswerThis answer assumes you already have Glue connections to both Aurora and Redshift set up and have created a crawler for the Aurora database with an include path similar to "schema/%" to fetch all tables in that schema.Given that, when you create a Glue Job in the console, you select a single table from the Glue Data Catalog as the source. As the target, you choose to "Create tables in your data target" and select the Redshift connection previously created and specify the target table. Once that Glue Job is created, you can create a Trigger to run it on a scheduled basis.Now you're set up for one table, but if you wanted to do this for every table in that schema, you would have to modify the Glue script and either hard-code the list of tables that you want to sync and loop through them in the code, or you could also fetch the list of tables from the Glue API using the boto3 client if you're using pyspark.If you want to run this continuously, there are a couple things to mention:For tables that have sequential primary keys, you can enable job bookmarks as mentioned here such that only new data is inserted into Redshift: https://docs.aws.amazon.com/glue/latest/dg/monitor-continuations.htmlIf that's not an option, you'll likely need to truncate the table on every run. You can do this by adding a "preactions" key to the connection options when writing the dynamic frame."preactions":"truncate table target_table;"Without doing one of those, duplicate data will continue to get loaded into Redshift.For ongoing replication, Database Migration Service may be an option here. I realize there's more infrastructure to set up, but it replicates data using the binary logs and can be more efficient as a result. It can also do this continuously if near-real-time replication is important to you.CommentSharedacortanswered 4 years agoAlberto 10 days agoHi, I have the duplication problem, but I am using MySQL instead of Redshift as a target, I tried to use preactions but that doesn't work, is there any similar option or another way to avoid this problem?Share"


Question: Describe table in Athena fails with insufficient lake formation permissions

"When I try to run the following query via the Athena JDBC Driverdescribe gitlab.issuesI get the following error:[Simba]AthenaJDBC An error has been thrown from the AWS Athena client. FAILED: SemanticException Unable to fetch table gitlab. Insufficient Lake Formation permission(s) on gitlab (Service: AmazonDataCatalog; Status Code: 400; Error Code: AccessDeniedException; Request ID: be6aeb1b-fc06-410d-9723-2df066307b35; Proxy: null) [Execution ID: a2534d22-c4df-49e9-8515-80224779bf01]the following query works:select * from gitlab.issues limit 10The role that is used has the DESCRIBE permission on the gitlab database and DESCRIBE, SELECT permissions on the table issues.  It also has the following IAM permissions:{  "Version": "2012-10-17",  "Statement": [    {      "Action": [        "athena:BatchGetNamedQuery",        "athena:BatchGetQueryExecution",        "athena:CreatePreparedStatement",        "athena:DeletePreparedStatement",        "athena:GetDataCatalog",        "athena:GetDatabase",        "athena:GetNamedQuery",        "athena:GetPreparedStatement",        "athena:GetQueryExecution",        "athena:GetQueryResults",        "athena:GetQueryResultsStream",        "athena:GetTableMetadata",        "athena:GetWorkGroup",        "athena:ListDatabases",        "athena:ListNamedQueries",        "athena:ListPreparedStatements",        "athena:ListDataCatalogs",        "athena:ListEngineVersions",        "athena:ListQueryExecutions",        "athena:ListTableMetadata",        "athena:ListTagsForResource",        "athena:ListWorkGroups",        "athena:StartQueryExecution",        "athena:StopQueryExecution",        "athena:UpdatePreparedStatement"      ],      "Resource": "*",      "Effect": "Allow"    },    {      "Action": [        "glue:BatchGetCustomEntityTypes",        "glue:BatchGetPartition",        "glue:GetCatalogImportStatus",        "glue:GetColumnStatisticsForPartition",        "glue:GetColumnStatisticsForTable",        "glue:GetCustomEntityType",        "glue:GetDatabase",        "glue:GetDatabases",        "glue:GetPartition",        "glue:GetPartitionIndexes",        "glue:GetPartitions",        "glue:GetSchema",        "glue:GetSchemaByDefinition",        "glue:GetSchemaVersion",        "glue:GetSchemaVersionsDiff",        "glue:GetTable",        "glue:GetTableVersion",        "glue:GetTableVersions",        "glue:GetTables",        "glue:GetUserDefinedFunction",        "glue:GetUserDefinedFunctions",        "glue:ListCustomEntityTypes",        "glue:ListSchemaVersions",        "glue:ListSchemas",        "glue:QuerySchemaVersionMetadata",        "glue:SearchTables"      ],      "Resource": "*",      "Effect": "Allow"    },    {      "Condition": {        "ForAnyValue:StringEquals": {          "aws:CalledVia": "athena.amazonaws.com"        }      },      "Action": [        "s3:GetBucketLocation",        "s3:GetObject",        "s3:ListBucket",        "s3:ListBucketMultipartUploads",        "s3:ListMultipartUploadParts",        "s3:AbortMultipartUpload",        "s3:PutObject"      ],      "Resource": [        "arn:aws:s3:::aws-athena-query-results-123456789012-eu-west-1",        "arn:aws:s3:::aws-athena-query-results-123456789012-eu-west-1/*",        "arn:aws:s3:::aws-athena-federation-spill-123456789012-eu-west-1",        "arn:aws:s3:::aws-athena-federation-spill-123456789012-eu-west-1/*"      ],      "Effect": "Allow"    },    {      "Action": [        "lakeformation:CancelTransaction",        "lakeformation:CommitTransaction",        "lakeformation:DescribeResource",        "lakeformation:DescribeTransaction",        "lakeformation:ExtendTransaction",        "lakeformation:GetDataAccess",        "lakeformation:GetQueryState",        "lakeformation:GetQueryStatistics",        "lakeformation:GetTableObjects",        "lakeformation:GetWorkUnitResults",        "lakeformation:GetWorkUnits",        "lakeformation:StartQueryPlanning",        "lakeformation:StartTransaction"      ],      "Resource": "*",      "Effect": "Allow"    },    {      "Condition": {        "ForAnyValue:StringEquals": {          "aws:CalledVia": "athena.amazonaws.com"        }      },      "Action": "lambda:InvokeFunction",      "Resource": "arn:aws:lambda:*:*:function:athena-federation-*",      "Effect": "Allow"    },    {      "Condition": {        "ForAnyValue:StringEquals": {          "aws:CalledVia": "athena.amazonaws.com"        }      },      "Action": ["s3:GetBucketLocation", "s3:GetObject", "s3:ListBucket"],      "Resource": "*",      "Effect": "Allow"    }  ]}even if I make the role a LakeFormation Admin, Database Creator, assign Super Permissions to the table and database and add the AdministratorAccess IAM Policy to the role it still fails.FollowComment"


Question: Can't SSH after restarting

Restarted my EC2 instance and now I'm unable to connect via SSH or any of the other tools. Can someone point me in the right direction?Instance ID is: i-0e1e06c47777a22c1FollowComment

Answer: "0Hello,When doing a test to your instance I can see that it is timing out when trying to connect using netcat to Port 22. Looking at the console output I can see that uncomplicated firewall is starting on the instance. This can be enabled and lead to users not being able to SSH to their instances.The below steps may resolve your issue. But as I am unable to determine it fully, I would think this is causing it. If you can confirm that the UFW service was enabled this may resolve it.As always, before making any changes please ensure that you have created an AMI of your instance so that you have a backup of your data.Launched a recovery instance in the same AZ.Detached the root volume from the original instance and attached it to the recovery instance as /dev/sdf.Edit the firewall configuration by executing the following commands on recovery instance.$ sudo lsblk$ sudo mkdir /mnt/recovery$ sudo mount /dev/xvdf1 /mnt/recovery$ cd /mnt/recovery/etc/ufw$ sudo vi ufw.conf- changed ENABLED=yes to ENABLED=no$ cd ~$ umount /mnt/recoveryDetached the root volume and attached it back to the original instance as /dev/sda1.Start the original instance and you were able to access the instance after the boot.CommentShareAWS-User-8424448answered 3 years ago0That did it. Learned a lot from this, thank you very much. Despite me setting it as /dev/sda1 when reattaching, it looks like it ended up being /dev/nvme0n1p1. Is this normal? It seems to be functioning, regardless.CommentShareSouth41answered 3 years ago"


Question: Amazon Linux 2023 - tomcat versions available

"Hello,I would like to ask if tomcat10 available in the official repo of Amazon Linux 2023, or at least is there any way to install tomcat10 using yum?ThanksFollowComment"

Answer: "0You can most definitely install Tomcat 10 using DNF (which is the successor to YUM).I trust you understand the basics of RUNNING Tomcat, but once you have SSH'd into your instance running Amazon Linux 2023, here are the basic steps of installing Tomcat 10.I always like to update the package system:sudo dnf updateInstall default available Java:sudo dnf install javaNOTE: unsure which version of Tomcat you need, and which minimum version of Java? See Apache Tomcat Versions.Check that Java successfully installed by checking version:java -versionUse **dnf ** to install wget. It should already be there on Amazon Linux 2023 but just to make sure:sudo dnf -y install wgetChange to a directory to which you have write permissions, such as /usr/tmp.Do a wget to download Tomcat 10:wget https://archive.apache.org/dist/tomcat/tomcat-10/v10.0.23/bin/apache-tomcat-10.0.23.tar.gzNOTE: again, if you are unsure which version you need, see Apache Tomcat Versions.Extract the TAR you just downloaded and move the files to a new directory.tar -xvf apache-tomcat-10*.tar.gzsudo mv apache-tomcat-10.0.23 /usr/local/tomcatAfter this you'd create your Tomcat user(s), configure and run Tomcat.Hope this helps! It worked on an Amazon Linux 2023 instance that I just spun up.CommentShareSNelson AWSanswered 3 months ago"


Question: [SOLVED] AccessDenied on ChangeResourceRecordSets for S3 static website

"UPDATE:The problem was that I was not using the right zone Id in the POST, or for the alias target.  The request format below works, but two key things are needed:You need to retrieve the zone ID for your domain from Route 53 first and then include that in your post to create the record set.In the AliasTarget, the HostedZoneID must match the Route 53 value from  https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region .  Do not use your domain's zone ID.  You must use the zone ID of the S3 endpoint from the reference document.PROBLEMI was getting AccessDenied ((403) Forbidden) when trying to upload a resource record set.  What's made this so vexing is that different reference pages conflict with each other a bit on the exact structure and content of the request.  I've tried many different formats and data element combinations.The user has AmazonRoute53FullAccess, and I also added an in-line policy with additional granular Route 53 permissions (on all resources) just in case for some reason the FullAccess was missing something that's needed for this.My scenario is that I have an S3 bucket (example.com) and am trying to set static web hosting.  I created the zone programmatically with the same credentials, so I know that:My credentials work, at least partly, andThere should be no question as to ownership since the same credentials created the zone as are trying to subsequently upload a record set to it.I have used the following data, and have tried using both the actual ZoneID as seen in Route 53 as well as the bucket endpoint (see below).REQUEST<ChangeResourceRecordSetsRequest xmlns="https://route53.amazonaws.com/doc/2013-04-01/"><ChangeBatch><Changes><Change><Action>UPSERT</Action><ResourceRecordSet><Name>example.com</Name><Type>A</Type><AliasTarget><HostedZoneId>S3ZoneID</HostedZoneId><DNSName>example.com.s3-website-us-east-1.amazonaws.com</DNSName><EvaluateTargetHealth>false</EvaluateTargetHealth></AliasTarget><HealthCheckID></HealthCheckID></ResourceRecordSet></Change></Changes></ChangeBatch></ChangeResourceRecordSetsRequest>RESPONSE:<ErrorResponse xmlns="https://route53.amazonaws.com/doc/2010-10-01/"><Error><Type>Sender</Type>AccessDenied<Message>User: arn:aws:iam::1234567890:user/[******] is not authorized to perform: ChangeResourceRecordSets on resource: arn:aws:route53:::hostedzone/lofahasatehum.com</Message></Error><RequestId>6c871224-6859-11e9-b17f-799576e9e9c3</RequestId></ErrorResponse>P.S. The actual domain isn't registered, but that shouldn't affect this operation.Edited by: technonaut on Apr 28, 2019 6:48 AMFollowComment"

Answer: 0Details of the solution were added to the top of the post.CommentSharetechnonautanswered 4 years ago0Just a note that the IAM username got mangled when posting so ignore that.CommentSharetechnonautanswered 4 years ago


Question: Let's hope one of the devs will see this <3

"REMOVEDUPLOADGreetings.How do i get rid of this material ''shadow-preview''? Ichecked the documentation/googled it and couldn't find anything that could tell me what it is or how to turn it off.Thank you in advance!Edit.it's like this material ''cloud'' follows me whenever i move the cameraand restarting the editor/reloading pc didnt help. anybody?Edit 2. i found this option and i can change it for example to glass and it gets a little bit better. But there's no ''off'' option there.REMOVEDUPLOADREMOVEDUPLOADHowever, i don't want a material follow me around. It still disturbs what i see on my screen and it's just killing me. Closing/reloading materials/editors/map/my pc didn't help. Anybody guys ?Edit 2. The solution offered in the comments section (setting the opacity of the material to 0) did not work, cuz there is still some kinda lighting shadow keeps following you around. And anyways i want to find a way to simply turn that thing off.Lumberyard Devs humbly hope to see you in here <3.REMOVEDUPLOADFollow"

Answer: "0Accepted Answer@REDACTEDUSERWhat you are seeing is actually not a shadow. It is transition between the detail layer texture and the simplified texture underneath it. If you were using a Megaterrain Texture, you would see this blend into that.The Detail layer view distance parameter controls the distance from the camera where this transition happens. When set to 0 you would never see the detail layer texture. If you increase this value, to 10, it would draw the detail layer texture further from the camera.This setting can help with performance because it would not be performant to draw the detail layer textures farther than necessary.Also, the terrain should always use the Terrain.Layer shader.SharerePost-User-1190460answered 6 years ago0@REDACTEDUSERREMOVEDUPLOADI'm not sure if either option is the best way to do it however. Hope this helps.SharerePost-User-9601236answered 6 years ago0Well it worked for me so i finally can continue working. Thank you so much for the help!SharerePost-User-7805365answered 6 years ago0nvm. it still leaves a lighting effect even if opacity is at 0. dang. lets hope lumberyard can help us with thisSharerePost-User-7805365answered 6 years ago"


Question: Is librdkafka 1.6.0 compatible with AWS MSK(Kafka)

Is librdkafka 1.6.0(https://github.com/edenhill/librdkafka) compatible with AWS MSK(Kafka) ?If NOT compatible could you please mention theCompatible librdkafka versionOther C++ Kafka client Libraries which we can use with MSK.FollowComment

Answer: 0Thank you for reaching out to us. I have reached out to the internal service team with this request and I shall reach back to you soon.CommentShareSUPPORT ENGINEERAWS-User-2071047answered 10 months ago0All client libraries which are compatible with Kafka are also compatible with AWS MSK. In this case librdkafka is a primary community client for kafka as both the .net and python clients are wrappers around itPlease let us know for any further concerns.CommentShareSUPPORT ENGINEERAWS-User-2071047answered 10 months ago


Question: EC2 Renew IP for Network Interface from pool not Elastic

"Sorry if this is a really dumb question but I have done a fair amount of googling and cannot find an answer to my question.I have an EC2 instance with two network interfaces. One of them has an elastic IP address, the other does not. When I first launched the instance the non-Elastic interface was assigned a random public IP address from the pool. Perfect that's what I wanted. Effectively I can connect to my instance from the elastic IP and then I am routed through the other interface to access the internet, with that IP address changing from time to time. The problem is for some reason the non-Elastic interface seems to have dropped its random pool assigned public IP address and I for the life of me cannot figure out how to get it to go out and fetch a new pool IP address.I have tried rebooting it from SSH, restarting the instance from the management console and a lot of Googling but cannot find anything.FollowComment"

Answer: "0If you absolutely have to renew the ip, assign a elastic ip and then remove it directly after. You should now have a new non elastic ip.CommentShareEvolate-Timanswered 4 months ago0simple process will be. Allocate an elastic IP.Assign it to interface that lost the elastic IP.This way both interface will have elastic IP. I guess there is no charges difference between public ip and elastic IP.But if you really want random IP on other interface. Then check if subnet setting auto assign public IP is changed? if not, then may be time to restart the instance?CommentShareMuhammadanswered 4 months ago"


Question: Execute SQL Script from AWS RDS Oracle

"I am trying to execute  a SQL script from AWS RDS Oracle instance.The steps I followedCREATE D A Directory and GRANTED READ WRITEEXEC rdsadmin.rdsadmin_util.create_directory(p_directory_name => 'deployment_directory');GRANT READ,WRITE ON DIRECTORY DEPLOYMENT_DIRECTORY TO rdsadmin;Downloaded the file to AWS RDS instance from the S3 bucketSELECT rdsadmin.rdsadmin_s3_tasks.download_from_s3(p_bucket_name    =>  'ojp-bvp-dev-01',p_directory_name =>  'DEPLOYMENT_DIRECTORY')AS TASK_ID FROM DUAL;The file deploy-1.sql got downloaded to the AWS RDS database in the DEPLOYMENT_DIRECTORY that was just createdSELECT * FROM TABLE(rdsadmin.rds_file_util.listdir(p_directory => 'DEPLOYMENT_DIRECTORY'));FILENAME                                                               TYPE         FILESIZE MTIME01/                                                                    directory        4096 22-JAN-23deploy-1.sql                                                           file              674 22-JAN-23The path of the directorySELECT DIRECTORY_PATH FROM DBA_DIRECTORIES WHERE DIRECTORY_NAME='DEPLOYMENT_DIRECTORY';DIRECTORY_PATH/rdsdbdata/userdirs/01I try to execute the SQL script and I get an errorSQL> spool /rdsdbdata/userdirs/01/deploy-1.logSP2-0606: Cannot create SPOOL file "/rdsdbdata/userdirs/01/deploy-1.log"SQL> @/rdsdbdata/userdirs/01/deploy-1.sqlSP2-0310: unable to open file "/rdsdbdata/userdirs/01/deploy-1.sql"How do I execute sql scripts in AWS RDS Oracle? Is there a utility that can be used?ThanksRajanFollowComment"

Answer: "0The steps you've followed to download the script from an S3 bucket and create a directory in the RDS instance are correct. However, there seems to be an issue with the execution of the script.To execute the SQL script, you can use the @ command followed by the path of the script file. In this case, the path of the script file is '/rdsdbdata/userdirs/01/deploy-1.sql'The error message "SP2-0310: unable to open file "/rdsdbdata/userdirs/01/deploy-1.sql"" suggests that the SQLPlus client is unable to access the file. This could be due to file permissions or a lack of read access to the file. You should check the permissions of the file to ensure that the user running SQLPlus has read access to it.Another way to execute the script is to use the SQL*Plus command line utility, which can be run on the RDS instance or on a local machine to connect to the RDS instance. You can use the command: sqlplus -S <username>/<password>@<hostname>:<port>/<sid> @/rdsdbdata/userdirs/01/deploy-1.sqlAnother utility that can be used is the Oracle SQL Developer, which is a free GUI tool provided by Oracle for managing and executing SQL scripts on Oracle databases. It can be used to connect to the RDS instance and execute the script.Lastly, it is important to note that RDS instances have certain limitations, like the lack of access to the underlying file system. So, it is better to use a method that does not rely on the file system, such as using the SQL*Plus command line utility or SQL Developer to directly execute the script.CommentSharejayamaheizenberganswered 4 months ago0The sql script should be on the host where you are running sqlplus on, not on the database (RDS) server.CommentShareMark_Ganswered 4 months ago0Yes, thanks I  I  uploaded the sql script on the HOST where I am running sqlplus ran the scripts and it worked.I dont know why I thought I had to upload it onto the AWS RDS server.Thanks a lot!Appreciate itCommentSharerajaanswered 4 months ago"


Question: Custom Xray Trace for Graphql Mutation

"Hi there,I have Xray enabled in my NodeJs Express App with Graphql. I can see segments for other rest endpoints but the other query and mutation that goes through Graphql only /graphql  as the path with makes it hard if i need to troubleshoot. Is there a way i can trace GraphQL mutation with AWS xray?FollowComment"

Answer: 0You probably are looking for subsegments. So you would create a subsegment with a namespace of "remote" and add the mutation data in metadata. This way you can filter the traces based on the mutation performed.https://docs.aws.amazon.com/xray/latest/devguide/xray-sdk-nodejs-subsegments.htmlCommentSharetherealdakotalanswered 7 months ago


Question: When is PHP 8.1 coming to amazon-linux-extras?

"PHP releases in amazon-linux-extras are behind official releases -- that's not new, but will 8.1 be coming anytime soon? Or should we think about relying on some external repo for that moving on?FollowCommentKZenisek 8 months agoWhile we're currently left without knowing when/if it will be done (saying it won't be done, if true, will at least let people know they should do this a different way.) It's been asked here multiple times:https://bit.ly/3TwqRCZhttps://bit.ly/3Sb8P8ihttps://bit.ly/3TfJlImWhile it's also been brought up on the Elastic Beanstalk discussion at https://bit.ly/3ME1xsC where it was added to EB months ago while it's also been discussed there how it seems like a real oversight to not also add it to amazon-linux-extras at the same time (then discussing that lingering topic there as well.)SharerePost-User-2313392 6 months agoGood news. Amazon-Linux-extras 8.1 is AVAILABLE NOWShare"

Answer: "0Good news. Amazon-Linux-extras 8.1 is AVAILABLE NOWCommentSharerePost-User-2313392answered 6 months ago-1Greetings,I did some research on this issue and I found out that many people have been waiting for the release of PHP 8.1 in amazon-linux-extras.According to the official AWS Elastic Beanstalk Roadmap, PHP 8.1 is still in the We're working on it status.Refer to Amazon Linux 2 release notes for other updates.I hope this helps.CommentShareLungaanswered a year agothe-guy-with-a-problem 10 months agoNo, it's marked as "is shipped" since Nov 2021. Not sure what the relation between Beanstalk roadmap and AM2 roadmap (if that even exists) would be.Share"


Question: SQS Message retrival after message is deleted

"Hi Team,we have these aws sqs queues whose retention period is of 4 days.The messages were not retrieved between these 4 days and now those messages are not available.is there any way to retrieve those messages from that queue?FollowComment"

Answer: 1SQS deltes the message after reaching the retention period. There is no way to retrieve those messages any more.You might want to monitor the ApproximateAgeOfOldestMessage metric to avoid something like this happening in the future as described at Monitor SQS queues with CloudWatch metrics and alarms.CommentShareandreaswittiganswered 10 months ago


Question: Getting 502 Bad Gateway Error while accessing the end point from EBS

"Hello All, i am in the process of configuring Elastic Beanstalk and i have mentioned all the necessary Environmental variables and also configured the Load balancer as part of configuration. When i try to access the page i get " 502 BadGateway" nginx/1.20.0. I checked all the configurations and i don't see any issues. When i check the health it shows as " 100.0 % of the requests are failing with HTTP 5xx. ", I need some assistance in resolving this.  I am not sure where is the error. Any help is appreciated, provided with some screenshot which will guide me to resolve this at the earliest. I also checked the logs and found this "[error] 4413#4413: *1 recv() failed (104: Connection reset by peer) while reading response header from upstream,"ThankssriramFollowComment"


Question: Proper conversion of AWS Log Insights to Metrics for visualization and monitoring

"TL;DR;What is the proper way to create a metric so that it generates reliable information about the log insights?What is desiredThe current Log insights can be seen similar to the followingHowever, it becomes easier to analyse these logs using the metrics (mostly because you can have multiple sources of data in the same plot and even perform math operations between them).Solution according to docsAllegedly, a log can be converted to a metric filter following a guide like this. However, this approach does not seem to work entirely right (I guess because of the time frames that have to be imposed in the metric plots), providing incorrect information, for example:Issue with solutionIn the previous image I've created a dashboard containing the metric count (the number 7), corresponding to the sum of events each 5 minutes. Also I've added a preview of the log insight corresponding to the information used to create the event.However, as it can be seen, the number of logs is 4, but the event count displays 7. Changing the time frame in the metric generates other types of issues (e.g., selecting a very small time frame like 1 sec won't retrieve any data, or a slightly smaller time frame will now provide another wrong number: 3, when there are 4 logs, for example).P.S.I've also tried converting the log insights to metrics using this lambda function as suggested by Danil Smirnov to no avail, as it seems to generate the same issues.FollowComment"


Question: Glue Interactive sessions - how to monitor performance metrics

"Glue Interactive sessionsHow can one monitor job metrics like CPU utilisation, memory usage, and network activity when running job from interactive sessions.thanksFollowComment"

Answer: "1Accepted AnswerI don't think you can. Once you are happy with the code you can run it as a regular job, which does have those metrics.CommentShareGonzalo Herrerosanswered 2 months agoJorge Vidinha 2 months agoThanks Gonzalo ,Would you be able to help with the question , on how to set up correctly the execution class to FLEX when running a jupyter notebook job ?https://repost.aws/questions/QUHPzEaPxoTJuil56o2_SoSQ/glue-jupyter-job-execution-classThank youShare"


Question: aws cloudwatch custom metrics

"I want to stop sending custom mertrics in cloudwatch, because my cost occur form aws custom metrics, so how can I disable custom metrics or stop sending data in cloudwatch. in my cloudwatch dashboard nothing is there I clean all alram  logs everting but cost occur, that cost is related custom metrics we can't delete custom metrics in cloudwatch, but cost is occurs, so how can I stop using cloudwacth custom metrics.can we can remove cwagent from machine level or we can stop sending metrics from machine ?ThanksFollowComment"

Answer: "1Hi,if you are being charged for custom metrics, it can come from one of the following sources:you have activated Detailed Monitoring for some resources (e.g. EC2 or Lambda) - you can check if that is the case by looking at the cost explorer and filtering on the CloudWatch service, group by operation. If you get metrics with an operation that includes "EC2" or "Lambda" in its name, it is a sign that your metrics come from detailed monitoring for the corresponding service. You would need to turn off detailed monitoring.you have code sending logs in EMF format, or you are sending logs and have set a metrics filter on the log group. Those can also be identified from the cost explorer by looking at the operation (the operation will mention logs). You would need to stop sending logs in EMF format or delete the metric filter.you have activated Container Insights. You would need to turn it off.you have a CloudWatch agent running on one of your instances and sending custom metrics. You would need to stop the agent.you have code running and sending metrics. You would need to stop your program and modify your code.CommentShareJscanswered 6 months agoSRC 6 months agoHow we can stop CloudWatch agent running on  instances and sending custom metrics.  any commands or docs related them ?Share1Hello, the command to stop the CloudWatch Agent depends on which operating system you use. In all likelihood, the CloudWatch Agent is certainly installed as a service. So the first thing you can do is stop the service. Then, depending on your needs, you can modify the service configuration so that it doesn't start automatically when the environment starts, or uninstall it. Again, the commands for such actions will depend on your operating system.For example, assuming you are under Linux, you should be able to stop the service with a command like systemctl stop amazon-cloudwatch-agent.service.CommentShareJscanswered 6 months ago"


Question: AWS Pinpoint: Custom/ Dynamic data in email template

"HiI have a usecase where i need to include custom data generated dynamically in the email body.Is there a way to refer that within the template?I was hoping to use the attributes or user.userAttributes for the same.From the forum these are the ones I have tried and dint work in the html content.{Attribute.myCustom}{{Attribute.myCustom}}{{Attribute.myCustom}}{{{{Attribute.myCustom}}}}Use CaseI want to send an email in my campaigns having the following format.Hi {CustomerName},Please do something about the followingThen a table of data{AccountId},{Account Contact} ...RegardsWell WisherFollowComment"

Answer:
"0Accepted AnswerHello,You can definitely include personalization elements in your emails. To include substitution values, just include the attribute name in double curly braces.For example, if you have an attribute called User.UserAttributes.FirstName, you could include the following in your email:
Hello {{User.UserAttributes.FirstName}},
```If you have an attribute called Attributes.FirstName, you'd use {{Attributes.FirstName}} instead.    Hope that helps! Thank you for using Amazon Pinpoint.    Brent @ AWSCommentShareAWS-User-4207280answered 4 years ago"


Question: Cloudfare 403 ERROR

"Hello,I have a wordpress site and trying to use cloudfront in order to improve the website response time.I followed the steps in the article below: https://aws.amazon.com/blogs/startups/how-to-accelerate-your-wordpress-site-with-amazon-cloudfront/I completed all the steps and modified C:\Windows\System32\drivers\etc\hosts on my computer so that the domain name of my site points to the ip address of my cloudfare distribution. (when I ping www.domain.com => I get the ip address of my distribution).When I put the domain name of my site on a browser, I get the response below:403 ERRORThe request could not be satisfied.Bad request. We can't connect to the server for this app or website at this time. There might be too much traffic or a configuration error. Try again later, or contact the app or website owner.If you provide content to customers through CloudFront, you can find steps to troubleshoot and help prevent this error by reviewing the CloudFront documentation.Generated by cloudfront (CloudFront)Request ID: SVH3QfYg-qs-TkAfBIrIkFH-Er0R-V1aJGjORaub7-ApZ5Vdte372w==What did I do wrong ??FollowComment"

Answer: "0when I enter the distribution address XXXXXX.cloudfront.net, it also points to the same error!!??CommentShareAWS-User-9859004answered a year agoAWS-User-9859004 a year agoNot an answer (just a follow up of the Q)Share0There seems to be some configuration error in your Wordpress site. You say that "when I put the domain name of my site in a browser" that you get a 403 error. That's the HTTP error code for "Forbidden" - you don't have access. You'll need to fix that problem first so that you can get to your Wordpress site in a browser; then you can use CloudFront as the CDN.However: That you are getting a 403 error means that the web server is running and is providing a response. So that's a start.CommentShareEXPERTBrettski-AWSanswered a year ago"


Question: Fields in RDS Postgres are not showing in Appflow when doing the fields mapping

"I created an Appflow and use RDS Postgres as destination. When doing the fields mapping after setting set the connection to DB, only 4 fields can be selected from RDS Postgres, but there are 20 fields created in that table. I tried to use the different tables but still got this same situation. What possible issue this could be? Thank you!FollowComment"


Question: CDK EventBridge CfnRule does not put events to a CloudWatch Log Group

"Hello all, I am implementing a simple EventBridge rule which put events to a CloudWatch LogGroup as below. However, it does not put event into the log group through EventBridge monitor shows that events already recorded at EventBridgeconst role = new cdk.aws_iam.Role(      this,      "AllowEventBridgeWriteToLogs",      {        roleName: "AllowEventBridgeWriteToLogs",        assumedBy: new cdk.aws_iam.ServicePrincipal(          "events.amazonaws.com"        ),      }    );    role.addToPolicy(      new cdk.aws_iam.PolicyStatement({        effect: Effect.ALLOW,        resources: ["*"],        actions: ["*"],      })    );    new cdk.aws_events.CfnRule(this, "L1Rule", {      name: "L1Rule",      roleArn: role.roleArn,      eventPattern: {        source: ["entest.io"],      },      targets: [        {          arn: log.logGroupArn,          id: log.logGroupName,        },      ],    });I implement by L2 construct then it works. I notice that an additional lambda function is automatically added, don't know why?const rule = new cdk.aws_events.Rule(     this,      "WriteToEventLogRule",      {       ruleName: "WriteToEventLogRule",        eventPattern: {         source: ["entest.io"],       },       enabled: false,     }    );     rule.addTarget(     new cdk.aws_events_targets.CloudWatchLogGroup(log)     );FollowComment"

Answer: "1The reason why it is not working is because EventBridge only uses IAM roles for rules that send events to Kinesis streams. For rules that invoke Lambda functions or Amazon SNS topics, you need to provide resource-based permissions. Also, if you look at CloudTrail logs, you will find an error for CreateLogStream API call made by EventBridge. Again, EventBridge does not use the IAM role to create log streams and put events in CloudWatch logs, you need to set a resource policy for the CloudWatch log group.Here is a sample code snippet for creating a CloudWatch log group and EventBridge event rule (under default bus) to send events to CloudWatch Log.    const log = new cdk.aws_logs.LogGroup(this, "loggroup")    log.addToResourcePolicy(new cdk.aws_iam.PolicyStatement({      resources: [log.logGroupArn],      actions: ["logs:PutLogEvents","logs:CreateLogStream"],      effect: cdk.aws_iam.Effect.ALLOW,      principals: [new cdk.aws_iam.ServicePrincipal("events.amazonaws.com")]    }))    new cdk.aws_events.CfnRule(this, "L1Rule", {      name: "L1Rule",      // roleArn: role.roleArn,      eventPattern: {        source: ["entest.io"],      },      targets: [        {          arn: log.logGroupArn,          id: log.logGroupName,        },      ],    });The L2 construct has a Lambda function and a custom resource to set a resource policy for a CloudWatch log group. You can take a look at what it does in a synthesized CloudFormation template under the cdk.out directory.The IAM role associated with my rule is being ignored when the rule runsCommentShareTaka_Manswered 7 months ago"


Question: "Beanstalk randomly looses EC2 instances, scaling group, and is quite unstable"

"Hi,We have a beanstalk setup that is running for quite some time without bigger issues. Since mid December we are seeing that the hosted application becomes randomly unavailable multiple times a day. These outages are about 5-10 minutes long. It is really hard to nail down, but it looks like the instances are becoming unusable and it takes some time to spin them up again. To decrease the impact on our customers we moved to have at least two instances running, but now we are seeing both instances dying at the same time. We had also multiple occasions where the system didn't recover and we had to remove them manually to get everything back up and running again. Today we finally saw an error message when it happened:Service:AmazonCloudFormation, Message:Resource AWSEBAutoScalingGroup does not exist for stack awseb-e-qa3p27em2p-stackAny help would be appreciated.ThanksFollowCommentJoshua_B 10 months agoHello, can you provide the relevant cloudwatch logs so we can potentially pinpoint the issue? Thanks!Share"


Question: "How do we select the entire contents of a bucket (all images), and bulk copy URL list for all the objects?"

"How do we select the entire contents of a bucket, and bulk copy URL list for all the objects? Or generate a CSV with all of the URL's for every object in the bucket?FollowComment"

Answer: "0You can't do it with S3 features alone.But you can get a list of objects using S3's advanced API.list-objects-v2 — AWS CLI 2.5.8 Command ReferenceThen, you can format the acquired list into an easy-to-use form using another module such as jq.$ aws s3api list-objects-v2 --bucket bucketname | jq -r '.Contents[] | ["s3://bucketname/" + .Key] | @csv'"s3://bucketname/html/API_AddTags.md.html""s3://bucketname/html/API_AlgorithmSpecification.md.html""s3://bucketname/html/API_AlgorithmStatusDetails.md.html""s3://bucketname/html/API_AlgorithmStatusItem.md.html""s3://bucketname/html/API_AlgorithmSummary.md.html""s3://bucketname/html/API_AlgorithmValidationProfile.md.html""s3://bucketname/html/API_AlgorithmValidationSpecification.md.html":CommentShareEXPERTiwasaanswered a year ago0yes you can do it by using this command this will create a csv file with two column first is file name and the second is Object _url*** **for /f "tokens=2 delims=/" %a in ('aws s3 ls s3://bucketName/anyfolderif/ --recursive --region ap-northeast-1 ^| findstr ".aac$"') do echo %a,https://bucketName.s3.ap-northeast-1.amazonaws.com/anyfolderif/%a >> s3_urls.csv *****You have to set your region this is my region (ap-northeast-1)and if it not work then you have to install AWS CLI tool,https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-install.htmlAfter installation  do aws configure in your cmd(command prompt) it ask some key and secret key pin that you go through to any youtube video After configurationuse the command that I give you in the firstRemember that place you bucket_name or in you bucket have any folder then place the folder name to anyfolderif or one more change you region after thatYou can crate a csv file if you  have a million of data or a short data nothing matter it create a csv file according to dataCommentSharerePost-User-9339339answered 3 months ago"


Question: MongoDB Atlas VPC peering

"Hi AWS,I am deploying a web application backend for testing purpose on Amazon EC2 instance. The instance is inside a VPC. The EC2 and VPC are in us-east-2 Ohio region and the MongoDB Atlas cluster is in us-east-1 N. Virginia region.The Atlas CIDR (VPC region) is same as Amazon VPC i.e. us-east-2 Ohio. The VPC CIDR is 172.31.0.0/20 and the Atlas VPC CIDR is 192.168.248.0/21.When I am checking the logs on the EC2 instance I am seeing the error:ERROR [MongooseModule] Unable to connect to the database. Retrying (1)...The problem is I can't enable the Access from Anywhere option 0.0.0.0/0 assuming if I need to perform the same in production.Please suggest how to fix this.FollowComment"

Answer: "1If you are doing VPC peering, you can refer to the security group of the peering destination as shown in the following document.So try to put a setting in the Mongo DB security group to allow the EC2 security group.https://docs.aws.amazon.com/vpc/latest/peering/vpc-peering-security-groups.htmlCommentShareEXPERTRiku_Kobayashianswered 2 months agoGary Mclean 2 months agoAgree.. I have done the exact same before when using VPC peering, you can specifiy a security group from another VPCShare"


Question: SRT output from Medialive

"Hi everybodyWe'll begin using Medialive shortly.It would very useful to have the ability to send an SRT output from MediaLive, without having to use RTMP and then convert in SRT using Wowza. I see only UDP, RTP, RTMP, HLS choices.Is SRT support coming in MediaLive (aside from MediaConnect)FollowCommentrePost-User-9128667 9 days agoDid you ever find solution to this? I'm dealing with a similar setup.Share"


Question: EC2 Instance won't Stop

HiJust trying to reboot butCLI is not functionningStop or Force STOP don't have any actionPlease Helpi-0e13bb41dbb6061e2FollowComment

Answer: 0Ok stopped thxCommentShareMaximeSabourinanswered 3 years ago


Question: Creating hive external tables with s3 location error

"Hi,I'm working on a EMR application that leverages queries over S3 ORC data using Hive and Presto, I've been following AWS Guides, information on the forum, stackoverflow and other sources in order to achieve this goal, but I'm stuck trying to create an external table in hive, I'm getting the following error when running the create table statement:FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:Got exception: java.io.IOException com.amazon.ws.emr.hadoop.fs.shaded.com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: 817E60B9FFAD0392; S3 Extended Request ID: lM_tt8slxX14Svkfn_01tHTTRsz7YIBwbpRRYNDjWMUuUurywiHQou1wHMcNXmdKLN0eeGGaokE=), S3 Extended Request ID: lM_tt8slxX14Svkfn_01tHTTRsz7YIBwbpRRYNDjWMUuUurywiHQou1wHMcNXmdKLN0eeGGaokE=)I tried adding to the EMR role permissions for reading on S3 and recreated the cluster without results, when creating the table I'm using the following statement:CREATE EXTERNAL TABLE sensor(room       string,energy     double,temp       double,occupancy  int,awhen      timestamp)PARTITIONED BY (year string, month string, day string)STORED AS ORCLOCATION 's3://s3.us-west-2.amazonaws.com/a2g-hive-test/tempsensores/data/';Can anyone guide me on the best practice to achieve this?Thanks.FollowComment"

Answer: "0Hi,First of all, let's assume that your Roles/Permissions are correct. If yes, can you verify that the s3 folder exists. If no, try first creating this folder before running.s3://s3.us-west-2.amazonaws.com/a2g-hive-test/tempsensores/data/ If the folder exists, then you will need to carefully review the IAM permissions and making sure that the service roles that allow S3 access are properly passed/assumed so that the service that is making the call to s3 has the proper permissions. Can you please include all of the the IAM roles/policies and Trust relationships to help debug.-randyCommentShareRandyTakeshitaanswered 4 years ago0Hi Randy,The folder exists, I've already put data in ORC format before starting the tutorial.https://ibb.co/crGSGstiThe IAM roles being used are the default created by EMR when I created the first cluster, arn:aws:iam::753682516828:role/EMR_EC2_DefaultRole{"Version": "2012-10-17","Statement": [{"Effect": "Allow","Resource": "","Action": ["cloudwatch:","dynamodb:","ec2:Describe","elasticmapreduce:Describe*","elasticmapreduce:ListBootstrapActions","elasticmapreduce:ListClusters","elasticmapreduce:ListInstanceGroups","elasticmapreduce:ListInstances","elasticmapreduce:ListSteps","kinesis:CreateStream","kinesis:DeleteStream","kinesis:DescribeStream","kinesis:GetRecords","kinesis:GetShardIterator","kinesis:MergeShards","kinesis:PutRecord","kinesis:SplitShard","rds:Describe*","s3:","sdb:","sns:","sqs:","glue:CreateDatabase","glue:UpdateDatabase","glue:DeleteDatabase","glue:GetDatabase","glue:GetDatabases","glue:CreateTable","glue:UpdateTable","glue:DeleteTable","glue:GetTable","glue:GetTables","glue:GetTableVersions","glue:CreatePartition","glue:BatchCreatePartition","glue:UpdatePartition","glue:DeletePartition","glue:BatchDeletePartition","glue:GetPartition","glue:GetPartitions","glue:BatchGetPartition","glue:CreateUserDefinedFunction","glue:UpdateUserDefinedFunction","glue:DeleteUserDefinedFunction","glue:GetUserDefinedFunction","glue:GetUserDefinedFunctions"]}]}The trust relationship is as follows{"Version": "2008-10-17","Statement": [{"Sid": "","Effect": "Allow","Principal": {"Service": "ec2.amazonaws.com"},"Action": "sts:AssumeRole"}]}Is there any S3 permission missing?CommentSharecalvaradoanswered 4 years ago0Hi,The service role permissions looks fine to me. The only two other possibilities that I can think of at the moment are:If the LOCATION value does not exist, it will return an 'access denied' instead of a not found message (for security reasons so that probing tools can't easily deduce the structure of your bucket):Try changing:LOCATION 's3://s3.us-west-2.amazonaws.com/a2g-hive-test/tempsensores/data/';To just:LOCATION 's3://a2g-hive-test/tempsensores/data/';Double check the bucket policy for a2g-hive-test to see if there is anything that might restrict reading of the data.-randyCommentShareRandyTakeshitaanswered 4 years ago0Hi Randy,That worked out like a charm, I just modified the name in order to just reference the bucket/location:CREATE EXTERNAL TABLE sensor(room       string,energy     double,temp       double,occupancy  int,awhen      timestamp)PARTITIONED BY (year string, month string, day string)STORED AS ORCLOCATION 's3://a2g-hive-test/tempsensores/data/';With that, hive was able to create the table without issues.Thanks for your help,Best.Carlos.CommentSharecalvaradoanswered 4 years ago0All,Apparently the Hive S3 code does not know how to handle the region endpoint in the first URL path element and instead only expects a globally unique bucket name there.If you to be able to specify the region endpoint it will probably take an EMR (or Hive) feature request to support it.Regards,-KurtCommentShareklarsonanswered 4 years ago"


Question: Direct Connect Failover with two Virtual Interfaces (VIFs)

To test a Direct Connect (DX) failover using two VIFs on the same Direct Connect connection using the documentation AWS Direct Connect Failover Test. Does a resiliency model of at least two Direct Connect connections required for this type of failover testing?FollowComment

Answer: "0Accepted AnswerThe failover test simulates when one VIF is out of service, not if the entire DX is interrupted.A fiber cut or single device failure; as specified in the resiliency models, would require more than one physical connection.for maximum resiliency, the documentation say:separate connections that terminate on separate devices in more than one locationFor high resiliency, the documentation say::by using two single connections to multiple locationsMaximum resiliency requires two separate connections that terminate on two separate devices as shown in the docs.CommentShareBMacanswered 2 years ago"


Question: authentication for APIGateway using CloudFront cookies

I am working on a setup where website access to abc.example.com and def.example.com and so on is secured using CloudFront signed cookies set by Lambda@Edge.There also is a central APIGateway-based web API under the domain api.example.com that is being called from all websites.I am now trying to add authentication to the API so that only users having the cloudfront signed cookies can make a call on behalf of the website where call originates from.Is there a way to do so?FollowComment

Answer: "0Accepted AnswerYou could put the traffic to your API gateway via CloudFront, and protect API gateway with API key.So you would have "api.example.com" -> CloudFront (Where you verify the cookie + add X-API-KEY to request -> API GatewayTo add the x-api-key you can specify it in the CloudFront settings without the need to use Lambda@Edge https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/add-origin-custom-headers.htmlHere the information on how to set up API Gateway with its own CloudFront distributionCommentShareMikianswered a year agoMarco a year agoI did check it out but got the impression it is not a fit. the challenge is that I need to use a cookie that belongs to domain abc.example.com to authenticate against api.example.com. But I cannot set that cookie when at abc.example.com as it is another domain. I would have to use a higher domain like example.com. However, then users from abc.example.com could access def.example.com what I don't want them to be able to.I now ended up with a scenario where I have Lambda@Edge create a JWT that has the originating domain, e.g. abc.example.com as payload and I do set that cookie under .example.com so it will be sent along with every api call to api.example.com.ShareMarco a year agostill, looks like that approach is the only feasible solutionShare"


Question: ec2 ubuntu would not completely start. "Instance reachability check failed"

"my t3.micro have been runing fine. Now I stopped and restarted today, it only passed one of 2 status check. Tried "reboot", and retried "stop and start", same issue. The system log indicates no error, and the last line is: "Ubuntu 22.04.1 LTS ip-172-30-1-84 ttyS0".FollowComment"

Answer: "0Since there are various causes for instance failures, please check the following document and take appropriate action for the error.Check the status of the instancehttps://docs.aws.amazon.com/ja_jp/AWSEC2/latest/UserGuide/monitoring-system-instance-status-check.htmlTroubleshooting instances that failed status checkhttps://docs.aws.amazon.com/ja_jp/AWSEC2/latest/UserGuide/TroubleshootingInstances.htmlCommentShareTTTT1234answered 4 months ago"


Question: Automatic logout + lockout accounts for some time after failed logins

"Hello,Our organization is targeting HIPAA compliance. Part of the policy is enforcing an automatic logout policy, and also a lockout policy for a specified amount of time after a specified amount of login failures. We want to achieve this for the AWS Console. I can't find these options in the IAM settings. Is this possible to adjust?I'm aware that AWS already does an automatic logout after a certain period of inactivity. I can't find the documentation regarding how much time that is.I'm not aware of AWS enforcing lockout after a number of failed login attempts. Is this possible to enforce?FollowComment"

Answer: 0HelloI found these old posts and nothing on the documentationhttps://forums.aws.amazon.com/thread.jspa?messageID=824356https://forums.aws.amazon.com/thread.jspa?threadID=31950RTCommentSharerttanswered 2 years ago


Question: Uniqueness checks when streaming data via firehose to s3

Hi there! I'm streaming a bunch of json data into an s3 bucket via firehose. I was wondering what's the best practice for uniqueness checks on those individual json objects since firehose aggregates them into one s3 object. (If firehose didn't aggregate i guess i could identify the uniqueness of the objects by their respective key in the bucket)Thanks for reading!FollowComment

Answer: "0Greetings,Lambda functions can be a good choice for processing data in a streaming pipeline, but the specific concurrency limits of Lambda may need to be taken into account when designing the pipeline.Lambda functions can be invoked in response to events, such as data being streamed to an Amazon Kinesis stream. Each Lambda function invocation processes a single event, and the concurrency limit determines how many invocations can run concurrently. If the pipeline receives more events than the concurrency limit allows, some events may need to wait for a Lambda function to become available.To mitigate this issue, the pipeline can be designed to use multiple instances of Lambda functions or to batch events before invoking Lambda functions. Additionally, the pipeline can be designed to use other AWS services, such as Amazon Kinesis Data Analytics or Amazon EMR, which can handle larger amounts of data.Overall, Lambda functions can be a good choice for processing data in a streaming pipeline, but the specific design of the pipeline should take into account the concurrency limits of Lambda to ensure that the pipeline can handle the expected data volume.Please let me know if that helped your questionCommentShareZJonanswered 3 months agorePost-User-7356035 3 months agoHey! thanks again for a thorough answer! It did help my question for sure. I don't understand what you mean by "designing a pipeline to use multiple instances of Lambda functions". What is a multiple instance of a lambda function?ShareZJon 3 months agoGreetings,When we talk about multiple instances of a Lambda function, we mean that there are multiple copies of the same function running concurrently to process incoming events.AWS Lambda automatically scales the number of instances of a function based on the incoming event rate and the amount of memory allocated to the function. Each instance of the function runs independently and can process a single event at a time.Designing a pipeline to use multiple instances of Lambda functions involves breaking down the pipeline into smaller, independent stages, and configuring each stage to use a separate Lambda function instance. This allows for parallel processing of events across multiple instances of the function, which can improve throughput and reduce latency.For example, in a streaming pipeline that ingests, processes, and stores data, you might design the pipeline to use multiple instances of a Lambda function to handle the processing stage. Each instance of the function would process a subset of the incoming events in parallel, and the output of each instance could be combined or aggregated in a downstream service such as Amazon S3 or Amazon DynamoDB.By using multiple instances of a Lambda function in this way, you can achieve greater scalability, resilience, and cost efficiency in your pipeline architecture.Please let me know if i answered your questionSharerePost-User-7356035 3 months agoHey Zokir! Thanks again for answering! I don't understand - If "Lambda concurrency limits" references to the maximum number of concurrent lambdas you can run at a time (3000 or something) and "multiple instances of a Lambda function" refers to "scaling automatically the number of instances of a function", aren't these the same thing? how is latter a solution to the former ? (as suggested in your first answer). Thanks for your patience! Feel free to link me some documentation you may think i'm missing btw :)ShareZJon 3 months agoLambda concurrency limits refer to the maximum concurrent executions allowed for all Lambda functions in an AWS account within a region. Multiple instances of a Lambda function refer to the automatic scaling of a single Lambda function to handle multiple requests concurrently.To address Lambda concurrency limits, you can request an increase in the concurrency limit from AWS, allowing more instances of your Lambda functions to run simultaneously without hitting the account-level limit. Both concepts are related but address different aspects of Lambda usage.AWS provides a good overview of Lambda concurrency and how to manage it in their documentation: https://docs.aws.amazon.com/lambda/latest/dg/concurrent-executions.htmlI hope this clears up any confusion. If you have further questions, feel free to ask.SharerePost-User-7356035 2 months agothanks!! this is tons of info for now :)ShareShow 1 more comment0Greetings,When streaming a bunch of JSON data into an S3 bucket via Firehose, it can be challenging to enforce uniqueness checks on individual JSON objects since Firehose aggregates them into one S3 object. However, there are a few options you can consider:Include a unique identifier in each JSON object: One solution is to include a unique identifier in each JSON object before sending it to Firehose. You could use a UUID, timestamp, or other identifier that is guaranteed to be unique for each object. This way, even if the objects are aggregated into a single S3 object, you can still identify each object based on its unique identifier.Use an AWS service for deduplication: You can use an AWS service like Kinesis Data Streams or Kafka to deduplicate the JSON objects before sending them to Firehose. Both Kinesis Data Streams and Kafka provide mechanisms for identifying and removing duplicates based on a unique identifier or other criteria.Use a Lambda function to process the data: Another option is to use a Lambda function to process the data before it is sent to Firehose. The Lambda function can check each JSON object for uniqueness and either discard duplicates or send only unique objects to Firehose.It's important to note that enforcing uniqueness checks on individual JSON objects can add some overhead and complexity to your pipeline. Therefore, you should consider the trade-offs and choose a solution that meets your requirements while minimizing the impact on performance and cost.Please let me know if I answered your question or you need more helpCommentShareZJonanswered 3 months agorePost-User-9147478 3 months agoHey Zokir! Thank you for the thorough answer! It does indeed confirm what i understood of the problem. If i may ask a follow up, given a context where large amount of data are being streamed and given the concurrency limits of lambda, are lambdas actually a good idea to be used as part of a streaming pipeline?Share"


Question: Migrate data using windows deduplication function to FSx(windows)

"HelloCurrently, 100TB of data is compressed to 50TB using the deduplication function of Windows.(EC2 on AWS)I want to migrate this data to FSx for windows.(The FSx pricing structure costs because of storage and throughput capacity)ec2⇒robocopy⇒FSx for windowsHowever, if you remove the deduplication function when performing data migration, the data capacity will return to 100 TB and a lot of costs will be incurred.Is there a specific way to migrate data to FSx with the data deduplicated?We want to reduce the cost and migrate data to FSx.I want to use windows robocopy as the data migration method.FollowComment"

Answer: "0Hi fuka,In this case, you can create an Amazon FSx file system that is closer to the size you expect to get to - 50 TB. As soon as you create the Amazon FSx file system, you can enable Data Deduplication, and set the Deduplication optimization schedule to run aggressively (see our documentation for details on how to set the schedule: https://docs.aws.amazon.com/fsx/latest/WindowsGuide/using-data-dedup.html). When you then initiate the copy of your existing file content to your Amazon FSx file system, the data will be continuously getting deduplicated, and your overall data set can fit in the smaller file system.Thank you,Amazon FSx teamCommentShareAWS-User-9252611answered 3 years ago0Thank you !CommentSharefukaanswered 3 years ago"


Question: Notification when code change occur in lambda

"Hi,Actually i have alarms for some errors and performance monitoring with Lambdas, but since last days i have a doubt, its possible get a notification when, for example, a variable or a portion of the code change in lambda? like a Audit monitoring of the code ?Thanks for guidance in advance,FollowComment"

Answer: "0Accepted AnswerYou could run get-function-configuration every 5 minutes (from another Lambda function), store the results of LastModified and Environment.Variables in a cache, and compare the new results to the old ones.CommentShareAndre Zanswered a year ago"


Question: Multiple Mac EC2 instances on one Dedicated Host?

"Hi, my company have been playing with getting a Mac EC2 instance running. We've successfully done this, but now we're wondering if it's possible to tear down the instance and boot up a fresh one on the same Dedicated Host within the same 24 hour billing period? As it stands, we've deleted the instance and the Dedicated Host is now stuck in Pending state.This is in aid of testing notarized Mac application installs.FollowComment"

Answer: "0Update: it seems you can tear down an instance then start another one, there's just quite a long lag (about an hour) between the instance being 'Terminated' and the space actually being available on the Dedicated Host. Question answeredCommentShareslockanswered 2 years ago"


Question: Human review in Textract

"I was exploring AWS Textract, and I want to understand that when we use the Human review function using A2I and Sage, once the human review is added, does the model learn from it? So that the next time if I upload an invoice of similar type, the model will be able to read it perfectlyFollowComment"

Answer: "1Short answer NoAmazon Textract is an automated text recognition service that uses machine learning to extract text and data from scanned documents. When you use the Human Review feature with Amazon Augmented AI (A2I) and Amazon SageMaker, you are adding a layer of human review to the process of text recognition. This means that a human worker will review the output of the Textract model and make any necessary corrections.The Textract model does not directly learn from the human review process. However, you can use the output of the human review process to train a separate machine learning model that can learn from the corrected data and improve its performance on similar documents. This is known as supervised learning, where you provide labeled training data to the model so that it can learn to make predictions on new, unseen data.To do this, you would need to export the output of the human review process, which includes the original text that was recognized by Textract as well as any corrections made by the human worker, and use this data to train a new machine learning model. You can then use this model to perform text recognition on new documents, and it should be able to make more accurate predictions as a result of having learned from the corrected data.It's important to note that the effectiveness of this approach will depend on the quality and quantity of the training data that you use to train the new model. The more data you have and the more diverse and representative it is, the better the model will be able to generalize to new, unseen data.@seekrsiCommentShareSeanSianswered 5 months agoRahul 5 months agoThanks a lot!SharerePost-User-9146392 3 months agoI was expecting it can learn from human review. Thanks for the answer.Share"


Question: "Unknown type: geometry" when creating a view in "Athena engine version 3"

"When creating a view (in a Glue Catalog Database) which uses geometric functions using Athena engine version 3, I get the error Unknown type: geometry. Using "Athena engine version 2" I don't get an error.Example query:CREATE VIEW test_view1 AS SELECT * FROM (Values (1)) as t(id) WHERE ST_CONTAINS(ST_GeometryFromText('POLYGON((0 2,1 1,0 -1,0 2))'), ST_Point(0.9, 1))Note: This is a simplified query to be able to quickly reproduce the error. The error message is also shown when using an existent table instead of (Values (1)) as t(id) or when reading the values ('POLYGON((0 2,1 1,0 -1,0 2))', 0.9, 1) from other tables or when using other functions but ST_CONTAINS.When running:SELECT ST_CONTAINS(ST_GeometryFromText('POLYGON((0 2,1 1,0 -1,0 2))'), ST_Point(0.9, 1))The result is "true" as expected.Creating views without geometric functions also works.Also when creating the view directly locally in Trino version 398 (using docker run --name trino -d -p 8080:8080 trinodb/trino:398) in the predefined memory catalog, this error is not displayed.Can those geometric functions somehow be used when creating views using Athena 3 in a Glue Catalog Database?FollowComment"

Answer: 0Accepted AnswerIt works now. Looks like the Bug has been fixed.CommentShareMattias Hilligesanswered 12 days ago


Question: Edit an uploaded CW Evidently event

"I see the CloudWatch Evidently PutProjectEvents API returns an eventId attribute for each loaded event, but can't find any mention of inputting event IDs.Is it possible to edit the data of a previously recorded event by providing eventId in the request? (Or some other way?)This would be useful for updating an event if new information becomes available later, to prevent outdated, inaccurate information from skewing experiment results. For example, I believe this is possible today already in the Personalize PutEvents API?FollowComment"


Question: Instance unreachable intra-region.

"Instance ID : i-083cefe3bf5337adfStatus checks: 2/2 checks passedInstance unreachable from home region.SSH, HTTPI can reach the instance via HTTP when using a VPN node that is outside my home region.Instance is reachable again from home region for a few days if I stop and start the instance.After several days the instance becomes unreachable again.How can I solve this issue?FollowComment"

Answer: 0Issue was narrowed down to client ISP.CommentSharealawsec2answered 4 years ago


Question: Greengrass V2 Component Publish - SNAPSHOT Version Support

"Hi Team,I have build component in java & maven as build tool. Is there anyway I can release SNAPSHOT version of artifacts to IoT Core ?? I have explore GDK where it always checked for NEXT_VERSION from IoT Core and increment the version and release to IoT core while publish. Since we want to implement CICD in project we want SNAPSHOT version to be deploy on DEV environment for developer to do functional/Integration testing.Regards,Nalay PatelFollowComment"

Answer: "1Hi Nalay,"SNAPSHOT" style semantics are not supported by the Greengrass or the GDK. You cannot re-create a component version that already exists. You would need to first delete the component and then re-upload.Thanks,-joeCommentShareJoeAtAWSanswered 8 months agoEXPERTGreg_Breviewed 8 months agoNalay Patel 8 months agoHey Joe,Thanks for the response. I am looking for SNAPSHOT publish.For e.g if I want to publish 1.0.0-SNAPSHOT to IoT core using GDK. Will it possible ?? If yes, then what am I suppose to provide in GDK config json.Regards,Nalay PatelShareJoeAtAWS 8 months agoOk, I've updated my answer. I misunderstood your original intent.I'd recommend against that approach though. Have you considered publishing pre-release versions instead? (E.g. 1.0.0-RC1?) This way you gain all the benefits of a "SNAPSHOT" component, but without any of the pitfalls of deleting and re-creating component versions.ShareNalay Patel 8 months agoHey Joe,Yes, we want to support pre-release versions publish on IoT Core.Could you please guide to how to address this requirement ?? Since GDK is not supporting, is there any alternate way to handle this ??Our requirement is like for development team's testing we wants to keep using SNAPSHOT build and deployment over greengrass v2 components.Regards,Nalay PatelShare"


Question: How to start a track sequence from Lua

"I have seen that track view now support component entity in preview and creates a new sequence component, but it seems that there is no bus for it so I don't know how to start a sequence from lua.I have to start it from Flow Graph where I didn't understand how to play the sequence in reverse.I tryed negative speed and sequence not starting from beginning.Follow"

Answer: "0Accepted AnswerREMOVEDUPLOADHi @REDACTEDUSERThank you for this post. The component entity support in Track View in 1.8 is a preview release and missing Lua support, as you have discovered. We will be adding this in a future release.Playing a sequence backwards using negative speeds doesn't work, as you've noted. I'll add this feature request into our queue, although I would predict several other things might behave unexpectedly in reverse. Keys that are active for a time region, such as Animation Keys, Boolean Keys and Audio Triggers, would not behave as expected because these expect time to be running forwards.In the meantime, one work around that might work in Flow Graph is to compute the reverse time and use the JumpToTime input of the Animatinos:PlaySequence node, as shown in the attachment. This is not ideal but hopefully will get you unstuck.SharerePost-User-5663512answered 6 years ago0Thanks.It looks like a very clever solution.As for the Play in reverse These things doesn't constitute an issue for my simple use case(just transforms) howerver I got your point and yes work will be required to support the play in reverse consistently across all the key types.You can fake bool support making double keys(a key just before values invert ), but things that supports some kind of duration needs a specific implementation, but it may really worth it to have a play animation and sound in reverse too.SharerePost-User-7621041answered 6 years ago0@REDACTEDUSERIs component entity in Track View now support lua in 1.15 ?Tks,NassimSharerePost-User-3140358answered 5 years ago"


Question: Verification Email daily limit in Cognito. SES maybe not an option.

My app requires someone to first download and create an account. As part of the process they receive an email with a 6-digit verification code. Once the code is entered they and their email become verified. THey're listed as such in the USERPOOL.Currently using Cognito system to send the email but there's a daily quota limit of 50 (yes 'fifty"). That is non-negotiable. It cannot be changed. Well - my app has begun to hit that limit on some days and with projected growth it will happen regularly. I tried to switch to SES but SES emails (even Transactional emails) can only be sent to verified emails so it failed to send and everyone got errors. Chicken and the egg problem. I need the email with 6-digit verification code to go to the user in order to verify the email but Cognito limits to 50 sends per day. SES won't send an email to the user until they are confirmed.  How do the bigger apps get around this?Would love to hear from someone.FollowComment

Answer: "0Hi,If I'm understanding well your problem, you seem to be using SES in sandbox mode which allows send email only to verified accounts.If this is the problem, you will see a warning message in your SES Dashboard saying: "Your Amazon SES account is in the sandbox". To change this, you have to request moving it out the sandbox following these instructions: https://docs.aws.amazon.com/ses/latest/dg/request-production-access.htmlHope it helps,CommentSharemtindanswered 7 months ago"


Question: CDK CodeBuild Pipeline - possible to skip a phase on last github commit message?

"Hi,Is it possible to skip a phase in the buildspec based on last github commit message on the selected branch? For example, if the commit message includes  "SKIP_BUILD"/"SKIP_TEST"/"SKIP_DEPLOY" then skip the relevant phase(s).FollowComment"

Answer: "0Accepted AnswerCurrently, AWS CodePipeline does not support skipping a stage or an action. However, there is an existing feature request for AWS CodePipeline to support skipping a stage or action. Additionally, there is also a feature request to skip a pipeline execution completely.While I have no information on whether/when this feature may be released, I encourage you to keep an eye on our What's New pages for any new feature announcements.As a workaround, you can implement an AWS Step Functions stage in your pipeline. That stage would decide whether to execute particular child stages based on your criteria. In this blog post, you can read about implementing a Step Functions stage in a CodePipeline. Step Functions can call CodeBuild or CodeDeploy  actions or even execute another CodePipeline.If you want to skip some particular actions in a CodeBuild stage itself, you can manually get the last commit message and decide. Here's an idea of what you buildspec script might contain:CODEBUILD_COMMIT_MESSAGE="$(git log -1 --pretty=%B)"if [[ $CODEBUILD_COMMIT_MESSAGE == *"SKIP_BUILD"* ]]; then    echo "Skipping build actions"else    build.shfiCommentShareDmitry Balabanovanswered a year agoManav a year agoHi,Thank you for your reply. Do you know how I can put multiline commands (Such as conditionals) in my buildspec in CDK?Here is a starter buildspec I've written:          version: '0.2',          phases: {            install: {              commands: [                `CODEBUILD_COMMIT_MESSAGE="$(git log -1 --pretty=%B)"`              ],              onFailure: 'ABORT'            },            pre_build: {              commands: [                `if [[ $CODEBUILD_COMMIT_MESSAGE == *"SKIP_BUILD"* ]]; then`,                `echo "Skipping build actions"`,                `else`,                `build.sh`,                `fi`              ],              onFailure: 'ABORT'            },            build: { commands: [`echo reached home safely`] },            post_build: { commands: [`echo reached home safely`] }          },          proxy: {            uploadArtifacts: 'no'          }        }),```ShareDmitry Balabanov a year agoUnfortunately, JSON does not allow multi-line strings which you need for conditional shell commands. You can use the \n control character, but this affects the readability. Alternatively you can write your buildspec in YAML because YAML is the native format for buildspecs: https://docs.aws.amazon.com/codebuild/latest/userguide/build-spec-ref.html. Use the | character for a multi-line string value in YAML. CDK does not expose a method to inline a YAML buildspec at synth-time. You could do this yourself by parsing existing YAML into a JS object and passing the result to BuildSpec.fromObject.Share"