Question: Change Columns Ordinal Position

"Is it possible to change the ordinal position of table column(s) via a Data Migration Task? If a Table in a Source Endpoint has columns out of order with regard to the Target Endpoint, can the order be changed without manual coding?The existing migration is as follows.Hop 1 (data migration task): On-Prem-DB ---> S3:OneHop 2 (Lambda copy): S3:One ---> S3:TwoHop 3 (data migration task): S3:Two ---> RDS-DBNOTE: These are "Full-Load, Ongoing" replication tasks with three hops. The S3 buckets contain the standard "dbo" folders for full load and "cdc-files" folder for ongoing. The On-Prem is using SQL Server CDC to log changes. Also, I can't change the table names in the target as this is a many to one replication and 80% of the databases contain identical tables. There are just a few older source databases with column ordinality differences.I can ignore columns, add columns, however the order in which the columns are placed in "cdc-files" and "full-load" seem to be dictated by the Source table structure and can't be changed. Hoping for confirmation on this.FollowComment"

Answer: "0Accepted AnswerYou are correct.  DMS task  cannot handle change in the ordinal position of target table column(s)  in the given scenario.However , if we  migrate directly from source database to target database , DMS can migrate to target table  (manually created) with different column order  using  "Do nothing" or  "Truncate"  for  "target table preparation mode"  in task settings  link  .CommentShareAWS-User-6238408answered 3 months agoRoss Bush 3 months agoThank you for taking he time to answer. I will research other avenues and the link you posted.Share"


Question: Received notification of Undelivered Email in Workmail but recipient keep receiving duplicated email

"Two Emails were sent to a recipient last night (1st mail with 11 attachments/total 5.1MB at 10:40UTC 14/07/2022 and 2nd mail with 22 attachments/total 22.1MB at 10:40UTC 14/07/2022) but I received a notification email "Undelivered Mail Returned to Sender" for the 2nd email this morning (at 01:48UTC 15/07/2022) with content below:Technical report:Reporting-MTA: dns; xxx.smtp-out.us-west-2.amazonses.comAction: failedFinal-Recipient: rfc822; aaa@abc.comDiagnostic-Code: smtp; 550 4.4.7 Message expired: unable to deliver in 840 minutes.<421 4.4.2 Communication interrupted>Status: 4.4.7I tried to re-send both emails to the recipient this morning. However, the recipient has contacted me that he received 33 duplicated emails for the 2nd email I sent last night (from 10:44UTC 14/07/2022 to 01:49UTC 15/07/2022) and keep receiving my re-sent 2nd email now. It seems that amazoneses try to resend the 2nd email until 840 minutes reached. The recipient was serious affected since his mailbox was full due to my duplicated emails.In Workmail, I cannot find the duplicated email from sent folder.I just wonder why would this happened and what should I do to prevent this issue.FollowComment"


Question: Read back an entered value as a sequence of numbers

"Withing the Play Prompt of the Contact Flow, I am attempting to read back to the user, a 10-digit number. However, it is reading it as a formatted number, not a sequence of numbers. By this I mean, it reads it back as "2 billion, 9 hundred and 64 million, 5 hundred and 12 thousand ...". I just want it to be read back as "2 9 6 4 5 1 2 ..."How do I get the Play Prompt to read it as a sequence of numbers?FollowComment"

Answer: "0Figured it out, need to use SSML. The text that is read back needs to be similar to this:<speak>      You entered <say-as interpret-as="digits">$.Attributes.SomeNumber</say-as> Is that correct? Press 1 for Yes and 2 for No.  </speak>  And set the type with the Get Customer Input to SSML.CommentSharePerryHoekstraanswered 3 years ago"


Question: Unable to exclude and refresh in Trusted Advisor

The option to Exclude and Refresh TA checks is grayed out for all checks/resources. I'm logged in as a user with full admin privileges on the account. Any help with this would be appreciated as there are some checks that I would like to exclude. Thanks.FollowComment

Answer: "1Accepted AnswerHi,There are 2 main reasons for this behavior:1) List is not fully retrievedSometimes it takes 30-60 seconds until the list is fully retrieved. In that case you have to wait until the button becomes active2) Checks sourced from Security HubIf the source of a check is Security Hub then you cannot exclude the resource in Trusted Advisor but need to do this in the Security Hub Console (see: https://docs.aws.amazon.com/awssupport/latest/user/security-hub-controls-with-trusted-advisor.html#security-controls-trusted-advisor-console). If a check is sourced from Security Hub it has a field called Source in the Description which points you to the Security Hub Control that you need to check (e.g. IAM.6).If you exclude the resources there Trusted Advisor will reflect it on the next refresh.CommentShareEXPERTAndreas Seemuelleranswered a year agoAWS-wonhuh a year agoIn addition, many checks (and all new checks that has been launched since 2021) automatically refreshes several times a day so you don't need to manually refresh. The caveat is that you can't exclude resources from these 'automatically refreshed' checks today. You can find information on "automatically refreshed" checks here: https://docs.aws.amazon.com/awssupport/latest/user/trusted-advisor-check-reference.htmlShare"


Question: FSX Deployment Type

"HiWe have an FSX configured with Multi-AZ in deployment type, and we want to alter for SINGLE_AZ_2.We are trying to alter the deployment type by way of CloudShell, but not we are getting, not localize the function DeploymentType inside Windows configuration.Could you help us?FollowComment"

Answer: 0It is not possible to migrate from a multi-AZ FSx to a single AZ deployment:https://docs.aws.amazon.com/fsx/latest/WindowsGuide/migrate-files-to-fsx-datasync.html (see "Migrating between two Amazon FSx file systems")What you could do is leverage the bellow blog/solution and customize the Cloudformation template to do the inverse of what it was intended for.You would then be able to fire up the Cloudformation template and the DataSync process from the command line.https://aws.amazon.com/blogs/modernizing-with-aws/automate-the-upgrade-of-an-amazon-fsx-for-windows-file-server-to-a-multi-az-deployment/CommentShareJS-AWSanswered 3 months ago


Question: AWS SES bounce Email

I am using AWS SES for an application to send email to some recipients and I figured out that the email that is being sent is to one of the recipient is being bounced back.I have not configured any configuration set for my application. I need to figure out the reason why the email is getting bounced from the recipient. How could I resolve this issue.FollowComment

Answer: 0You can setup bounces to be handled through email or an SNS topic. Setting up once of those would allow you to see the response back from the mail server on why the email bounced.CommentShareMichael_Kanswered a year agoAWS-User-5866157 a year agoI have not configured any configuration set for sending it to sns..if i need to do it I need to change my app code as well..can u suggest any other ways to do thatShare


Question: ECS Fargate Task STOPPED with reason Timeout waiting for EphemeralStorage provisioning to complete. and code TaskFailedToStart

"Hello Community,As per the subject, I am getting this Error time to time from (not producible) ECS Fargate Task and container don't start.These containers are programmatically initiated with the following attribute....ecsTaskConfig.overrides.ephemeralStorage = {sizeInGiB: 21};...I tried to find the solution, but so far no luck, Well I thought about implementing a background job to check if the initiated task started or not, but looking for some better solution.Any tip/guidance would be helpful.Thanks,FaizFollowComment"

Answer: "0Well, didn't find any recommended approach yet.So, I resolve this issue as follows:When the container initiated from the code, maintaining the taskId reference in db.EventBridge to capture all the container events from the required ECS cluster and send to Lambda function.At lambda function, capturing the required stopReason and calling the API call for reprocess.Because the lambda function is firing multiple times with the same taskId (actually taskArn) so at the API level maintaining the reprocess counters.Do let me know if is there any better way to do it.CommentSharefaizulhaqueanswered 3 months ago"


Question: Additional verification required to request certificates for one or more domain names in this request

"I'm trying to create a new certificate but am getting a failed error saying "Additional verification required to request certificates for one or more domain names in this request".I can't believe this is the only way to try to get this issue resolved. Kind of feels like screaming into the void, but just in case anybody is out there, please help!FollowComment"

Answer: "0Hi, this isn't the only way to get issues resolved - the best way is to have a support agreement with AWS, but otherwise here on re:Post the AWS community may be able to help.  How much help you get here often depends on how well you explain your problem.You haven't provided much info, but maybe I can help in general terms.  To create a certificate for a domain, the domain must be verified as being owned by you.  Ideally this is via DNS validation, where you write a CNAME record to your DNS configuration to establish you have control of your domain name. ACM can update your DNS configuration for you if you manage your DNS records with Amazon Route 53.After you have configured the CNAME record, ACM can automatically renew DNS-validated certificates before they expire.Another option is email validation where ACM sends email to the domain's contact addresses and five common administrative addresses for the domain, i.e.administrator@your_domain_namehostmaster@your_domain_namepostmaster@your_domain_namewebmaster@your_domain_nameadmin@your_domain_nameCommentShareEXPERTskinsmananswered a year ago"


Question: Amazon Linux 2 default filesystem has switched to XFS???

"HelloToday i noticed that new amazon linux 2 instances are being created with XFS for the root filesystem instead of ext4:mount | grep nvm/dev/nvme0n1p1 on / type xfs (rw,noatime,attr2,inode64,noquota)Is there are reason for this change? Where can i follow a release notes or a changelogof these types of changes???ThanksEdited by: Kr4t0s on May 25, 2020 6:54 AMFollowComment"

Answer: "0Amazon Linux 2 images have used XFS since sometime in 2017.Changing the default filesystem is the kind of change we would only make on a product release boundary - say, from AL AMI to AL2.  We strive to maintain as much consistency as possible throughout the life cycle of a product.  AL AMI uses ext4 filesystems by default, and AL2 uses XFS, and both will continue to do so.CommentShareAWS-User-6280256answered 3 years ago0ok i might got confused because the Amazon Linux 2 ECS AMI  still uses ext4 for the rootfs. Anyway can you tell me why amazon decided to use XFS instead of ext4 for the base Amazon Linux 2 AMI?ThanksCommentShareKr4t0sanswered 3 years ago0bump, i would like to know why amazon decided to switch ext4 to xfs for amazon linux 2?thanksCommentShareKr4t0sanswered 3 years ago0Probably because XFS has much larger limits for filesystem and file sizes. I also think it supports multiple threads better than EXT4 if I recall correctly. HTH.CommentShareTIEsystemsanswered 3 years ago0While there's been a lot of progress on ext4 and concurrency over the years, XFS does maintain a clear advantage for a good selection of workloads. Scalability across cores and IO load is certainly a big part of it.CommentShareAWS-User-1004892answered 3 years ago"


Question: CloudWatch : Repeating Alerts on Insufficient State Change

I am using AWS CLI with cloudwatch put-metric-alarm to set up custom memory alarms when over 50%. It is successful at sending alerts when shifting into the Alarm state from OK or Insufficient and when going from Alarm state to OK. However now it is sending alerts at the same rate when shifting from Insufficient state to Okay.Looking into the documentation it states that the Ok actions trigger when the alarm transitions to an OK state from any other state. Is there a way to stop alerts from the Insufficient State -> OK state?FollowComment

Answer: "0Accepted AnswerHello -I think you'll want to configure Amazon CloudWatch to treat a lack of data differently. In short,  you can specify CloudWatch to treat missing data points as any of the following:notBreaching – Missing data points are treated as "good" and within the thresholdbreaching – Missing data points are treated as "bad" and breaching the thresholdignore – The current alarm state is maintainedmissing – If all data points in the alarm evaluation range are missing, the alarm transitions to INSUFFICIENT_DATA.The default option is missing, so I think this is why you are seeing the alarm back to OK. You might consider ignore or notBreaching depending on the behavior you are looking for.You can find more information here: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/AlarmThatSendsEmail.html#alarms-and-missing-dataCommentSharePaul Frederiksenanswered 10 months ago0Hi,your question makes me wonder why your alarms transition from Insufficient state to OK - is it a one-off event only happening at alarm creation time, or is it a recurring behavior, in which case is it because your resources are transient and you turn them off making them stop emitting the metric, or is there another reason for your alarms to switch to the insufficient state?If it's a one-off event at alarm creation time, how impactful is it to your workflow? is it something that can be neglected?If it's recurring, you could work around it by using Paul's suggestion in the previous answer or apply metric math to your metric to fill missing datapoints with a 0 value, which would prevent your alarm from flipping to the insufficient state?CommentShareJscanswered 10 months ago"


Question: IAM user is unable to access AppSync console

"Trying to give a IAM user access to AppSync. I have set the following policies to this IAM user:{    "Version": "2012-10-17",    "Statement": [        {            "Sid": "VisualEditor0",            "Effect": "Allow",            "Action": "amplify:*",            "Resource": "*"        }    ]}{    "Version": "2012-10-17",    "Statement": [        {            "Sid": "VisualEditor0",            "Effect": "Allow",            "Action": "amplifybackend:*",            "Resource": "*"        }    ]}{    "Version": "2012-10-17",    "Statement": [        {            "Sid": "VisualEditor0",            "Effect": "Allow",            "Action": "appsync:*",            "Resource": "*"        }    ]}Each is its own policy because I used the visual editor to create the policies.And yet when my IAM user tries to open AppSync there is a "Network error" message and inspecting the console I seem to be getting a bunch of 403s from the API requests.What's the correct policy to give full access to the AppSync console?FollowCommentJoshua_B 10 months agoHello,Can you describe in more detail what API errors you are getting? I created an IAM user with the exact permissions here and was able to access the AppSync Console with no issues.Since AppSync interacts with several other services (such as DynamoDB, other backend services) those API calls may be getting errors.Shareandrei_calazans 10 months agoThat's odd. I'm guessing I got into an unexpected state somehow since I did create that AppSync app with a root user and before I added any of the new IAM users so maybe something went wrong there.For the error all I get is a "Network error" red box at the top of the screen without any descriptions. Looking at the network tab I do see a few 403s happening.Share"


Question: AWS SAM: set the authorization cache TTL in the resource template (AWS::Serverless::Api)

"Hi all, I am using SAM in order to deploy my serverless application which consist of a REST API and a lambda authorizer. The REST API is not triggering a Lambda. It integrates other public services.When declaring the AWS::Serverless::Api and its auth attribte, I cannot find a way to configure the authorization-cache's TTL as in the AWS::ApiGateway::Authorizer resource. Am I missing something? If not, is there any reason the  authorization-cache's TTL configuration is not made available in the AWS::Serverless::Api element?This potentially missing feature is something minor for us, and does not block us in our project. It is more a nice-to-have, as I would prefer to not have to copy/paste the whole OpenAPI specification directly in the template file, but  rather use the SAM feature to specify the API via the AWS::Serverless::Api 's DefinitionUri attribute. This makes it possible to not have an API definition in the template, but to embbed this definition in a local file which will be automatically uploaded to S3 during the SAM deploy step.ThanksFollowComment"

Answer: "0Looking deeper, I realized that it may be possible to reference a AWS::ApiGateway::Authorizer as the DefaultAuthorizer in the ApiAuth attribute.Trying to do so leads me to another problem when deploying the stack using SAM deploy:Auth works only with inline Swagger specified in 'DefinitionBody' property.I guess features like "Authentication" or "Cors enable" requires CloudFormation's transform macro to access the OpenAPI/Swagger configuration in order to modify it. Hence this OpenAPI/Swagger declaration must be part of the template given to CloudFormation and cannot be provided as a separated file from S3 anyway.CommentShareAWS-User-2851010answered a year ago"


Question: where does this vpc endpoint coming from

"I have a interface VPC endpoint created,  service name: com.amazonaws-us-east-1.execute-api.  I remember I only create vpc, but no vpc end point. so where does this vpc endpoint coming from, and which api is executed to generate this vpc endpoint? thanksFollowComment"

Answer: "0Given the endpoint name, you've created a private interface to API Gateway: https://docs.aws.amazon.com/apigateway/latest/developerguide/apigateway-private-apis.htmlCommentShareEXPERTBrettski-AWSanswered a year ago0how can a api gateway create vpc endpoint?CommentShareAWS-User-6667474answered a year ago0Read here: https://docs.aws.amazon.com/apigateway/latest/developerguide/apigateway-private-apis.html :)CommentShareA-Shevchenkoanswered a year ago"


Question: AWS certification account without Credly email

"I have two accounts in AWS, one with Credly email and another one without Credly email and this have a exam completed.This certification not showing in credly.I just want to add my email in AWS account that have the certification to get a badge.AWS not answer the case or support.FollowComment"

Answer: "0Accepted AnswerYou should be able to add multiple certification emails under settings in Credly.However, you can work with the AWS Training and Cert team to consolidate but the process is long.If you go this route, I encourage consolidating on an email that you own and will own indefinitely to use as there are many places linking certs can be difficult if you use different email addresses.CommentShareRoss Wickmananswered 6 months agohcljunior 6 months agoThe AWS support did it.Working now.ThanksShare0You can contact customer service at AWS Training and Certification. Please review Training FAQs and Certification FAQs prior to contacting them. The url to submit query is at: https://support.aws.amazon.com/#/contacts/aws-trainingCommentShareronald_lanswered 6 months agohcljunior 6 months agoI opened. But not have answer yet. 1 week the case is openShare"


Question: Role switch IAM Identity Center user

"Hi,is it possible to let the user from IAM Identity Center to get its role switched? How to setup the policy and permission? Any best practice? ThanksFollowComment"

Answer: "1We can make use of  Permission Set in IAM Identity Center.After the user login the IAM Identity Center, they can select the Permission Set(role) to use and can also switch to another Permission Set that is assigned to them.For more details, refers to: https://docs.aws.amazon.com/singlesignon/latest/userguide/permissionsetsconcept.htmlCommentShareronald_lanswered 4 months ago0Hi Ronald,thanks for the answer. Is there any possibility to use an inline policy to switch the role for an IAM Identity Center user? I didn't see there is any ARN for the an IAM identity center user.What I know that an IAM user can assume a role if needed. Ref.: https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_use_permissions-to-switch.htmlCommentShareschmidtjoeanswered 4 months agoAWS-Everett 4 months agoTo Ronald's point, when you access a permission set in IAM Identity Center, you are effectively switching roles into an AWS account. Maybe you could explain a little more about what you are trying to accomplish by switching roles after authenticating to IAM Identity Center instead of using a permission set?ShareAWS-User-7083746 3 months agoIdentity Center users are only users in the context of Identity Center. They don't have ARNs. When you log into Identity Center and assume a permission set, you're assuming a role and the Identity Center username is used as the role session name.Consider user John Doe with username john.doe@example[.]com. If they were to access an AdministratorAccess permission set for account 111122223333, the principal ARN would be something like: arn:aws:sts::111122223333:assumed-role/AWSReservedSSO_AdministratorAccess_XXXXXXXXXXXXX/john.doe@example[.]com. You could use that ARN in your policies.Share"


Question: how to schedule the managed image updates in appstream

Is there is any way to schedule the managed imaged updates in appstream rater than doing it manually every single time.FollowComment

Answer: 1Here is a blog on how to schedule managed image updateshttps://aws.amazon.com/blogs/desktop-and-application-streaming/scheduling-managed-image-updates-for-appstream-2-0/You will need to update your fleet after testing / validating the new image works properly.edit - Here is another blog on automating the image deploymenthttps://aws.amazon.com/blogs/desktop-and-application-streaming/how-to-automate-amazon-appstream-2-0-image-deployment/CommentShareJeremy_Sanswered a year ago


Question: Can't get AWS CLI transcribe outputkey formatted correctly

aws transcribe start-transcription-job --region us-east-1  --transcription-job-name 22-000123CF --media MediaFileUri=s3://1910/22-000123CF/videoplayback.mp4 --language-code en-US --output-bucket-name 1910 --output-key 22000123CF --media-format mp4These formats throw errors as welloutput-key 22000123CFoutputkey 22000123CF/output-key /22000123CFoutput-key 22000123CF/something.jsonI simply can't get this command to work in any format using the AWS CLIFollowCommentDani M a year agoHi! Can you provide the error message you are getting back?Share


Question: What service(s) do you recommend for running Simple full-stack app?  What costs can we expect?

"Hello, we have a full-stack app that we would like to run on AWS.  This is a React frontend, node backend and a Postgres db.  We've got docker images for the front and back and a docker-compose to run everything together.  Can anybody with a similar app setup please provide some input on the particular AWS services they use to host and run the containers and associated costs the incur?  EC2?  Fargate?We are trying to gauge what services and what size are necessary if traffic to the site is 1k visitors / month, 10k visitors / month, 100k visitors a month.  The site itself is pretty straightforward...a simple management application with only  a handful of models.Any input and direction would be greatly appreciated!FollowComment"

Answer: "0Hi,as i understand you have a docker container for the backend with the business logic, accessing Postgres, and providing some kind of API (REST, GraphQL, etc.) to the frontend. For the frontend itself, you also have docker container which just serves the static assets to the client. Just Client Side Rendering or also Server Side Rendering?If you do not know the traffic to the site yet, or expect fluctuating requests, and want to keep costs low, i would suggest to look into AWS Lambda for your backend business logic, API Gateway or AWS AppSync for the API Layer, and Aurora Serverless v2 for Postgres, and Amazon Cloudfront as the CDN serving the static assets directly from S3. There is also a quite generous Free Tier for most of the mentioned services. This setup scales very well, performance wise and operation wise.An alternative approach could be AWS Amplify Hosting, which also comes with an integrated CI/CD Pipeline.Here are some sample architecture patterns. Some parts shown are optional which you may not need, for example the Lambda Authorizer, Route53, Certificate Manager, Cognito, ElastiCache, and instead of DynamoDB you can use Aurora Serverless Postgres for instance.I think the "Single Page Application" is closest to what you are asking for:CommentShareThomasFranswered 8 months ago"


Question: MTurk: Different rates for full and partial survey completion

"For an MTurk HIT (survey) - I have a knowledge check (basic arithmetic) approximately 3 minutes into the survey. I only want those that pass the check to complete the full survey. My intended payment scheme is $5 for those who complete the full survey, and $0.3 for those who fail to pass the knowledge check.How do I implement this? (For ex: if I just provide a code at the end of the full survey, only those who complete the full survey will be paid.)I also want 50 participants completing the full survey, subject to not more than 200 participants dropping out at the knowledge check.FollowComment"

Answer: "0You can try creating a qualification requirement before allowing users to complete the survey. Here's a tutorial you can use: Tutorial: Create a qualification requirement that workers have achieved at least 80% accuracy on previous tasks. With this method, you can set different pay rates for the qualification task, and the actual task.CommentShareBriNasAWSanswered 23 days ago"


Question: Migration from Transit VPC to AWS Transit Gateway

"For customers who are using Transit VPC and now moving to Transit Gateway, is there any migration tool available?FollowComment"

Answer: 0Accepted AnswerHave a look at the blog post Migrate from Transit VPC to AWS Transit Gateway and TGW Migrator Tool.CommentShareEXPERTRizwan_Manswered 3 years ago


Question: Calculating the Natgateway DataTransfer-Out costs down to instance or tag level

"IHAC who have ec2 nodes tagged. When they send traffic out to the Internet from these nodes, they can see that traffic (DataTransfer-Out-Bytes) in the aggregate outbound reporting, but the traffic outbound to the Internet passes through a NAT gateway (for example, nat-XXXXXX). Passing through the NAT gateway, the tagging attribution is lost. Consequently, when they use cost explorer and filter on Tag and Usage type: DataTransfer-Out-Bytes, they get nothing. Is there a solution for this, so that they can correctly attribute data transfer out costs from natgateway by product or tag.FollowComment"

Answer: "0Not exactly, what you are looking for but throwing alternate approach to find data transfer Bytes for individual hosts by querying the data.https://aws.amazon.com/premiumsupport/knowledge-center/vpc-find-traffic-sources-nat-gateway/https://aws.amazon.com/premiumsupport/knowledge-center/cloudwatch-vpc-flow-logs/https://aws.amazon.com/premiumsupport/knowledge-center/vpc-flow-logs-and-cloudwatch-logs-insights/https://aws.amazon.com/about-aws/whats-new/2021/04/amazon-vpc-flow-logs-announces-out-of-box-integration-with-amazon-athena/CommentShareMuhammadanswered 4 months ago"


Question: AWS quickstart vpc: s3endpoint

"I would like to use the quickstart dragen to create all the infrastructure required to run Dragen. Something that is not clear for me as i'm new, is the VPC part of this quickstart that use an other quickstart as a submodule. I would like to be sure that it use a S3 gateway endpoint because the pipeline transfers large files between s3 and the ec2 instanceFollowComment"


Question: Cloudformation Bug when creating VPCE and GWLB Instance Targets

"I am creating a CDK app to deploy a NGFW behind a GWLB with all of the routing in place.  When I launch the cdk app, the VPCEndpoints always fail to create if I register the EC2 Instance (NGFW) in same template.  I've tried to add dependson conditions but nothing seems to happen.  Simply including the instance targets causes the VPC endpoints to fail.This config does not impact the vpce creation  gwlbtarget:    Type: AWS::ElasticLoadBalancingV2::TargetGroup    Properties:      HealthCheckPort: "443"      HealthCheckProtocol: TCP      Name: gwlb-targetgroup      Port: 6081      Protocol: GENEVE      VpcId:        Ref: firewallvpc63A6EE9C    Metadata:      aws:cdk:path: GwlbExampleStack/gwlb-targetThis causes vpce endpoint to fail with error: "VPC Endpoint vpce-xxxxx did not stabilize.  Current state: failed"  gwlbtarget:    Type: AWS::ElasticLoadBalancingV2::TargetGroup    Properties:      HealthCheckPort: "443"      HealthCheckProtocol: TCP      Name: gwlb-targetgroup      Port: 6081      Protocol: GENEVE      Targets:        - Id:            Ref: ngfw      VpcId:        Ref: firewallvpc63A6EE9C    Metadata:      aws:cdk:path: GwlbFirewallStack/gwlb-targetFollowComment"


Question: Ingress rules for a private subnet NACL with VPC endpoints: Are AWS service CIDR ranges required?

"I have an API running on ECS Fargate behind an ALB. It's accessing data in DynamoDB. ECS is in a private subnet, ALB in a public subnet. I have VPC endpoints set up for all related services.Until today, whenever I would try to apply a NACL to the private subnet, I would lose access to the API. I tried all manner of ingress/egress rules to no avail; I could only get it to work by disabling the NACL (or just opening it up to all addresses/ports).The docs are kind of cryptic about NACLs and endpoints. I finally found a line somewhere that prompted me to look for service IP ranges which led me to this document re: public IP ranges. I added the Dynamo ranges for my region to the private subnet NACL and voila, it works.But why does this work? These IPs I added to the NACL are public, but this is a subnet with no route to the public internet. The way I understood it, endpoints are assigned ENIs/private IPs from your subnet, so I'm having trouble understanding why ingress using the local CIDR wouldn't be enough.FollowComment"

Answer: "4Accepted AnswerThere are two types of VPC Endpoints. One is Interface Type VPC endpoint and the other one is Gateway Type VPC Endpoint. Currently, DynamoDB does NOT support Interface type VPC endpoint but support Gateway Type VPC endpoint only. This is the reason why you need to add IP Range of Dynamo DB to NACL. If you use S3 VPC endpoint with Gateway Type, you must add S3 IP range as well.Gateway Type VPC Endpoint does NOT have network interface and it's not final destination of client. The client will reach out the service(DynamoDB or S3) using Public IP through the endpoint. This is the reason why you must modify route table of each subnet you want to use Gateway Type VPC Endpoint to have route table with IP prefix of DynamoDB/S3.Please refer to below.https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/vpc-endpoints-dynamodb-tutorial.htmlThanksCommentShareEunsu_Shinanswered a year agoEXPERTToni_Sreviewed a year agoAWS-User-8658107 a year agoThank you so much for explaining that. I completely forgot about the differences between interface and gateway!Sharesetheliot a year agoNote that S3 now offers an interface endpoint option as well.  DDB is the only VPC Endpoint with only a Gateway endpoint optionShare0When you create the VPC Endpoint for DynamoDB, you must select a VPC and a Route Table. After creating the endpoint if you look at the route table you will see an entry with Destination pl-12345 and Target vpce-123456789abcdef. So any traffic destined for you DDB VPC Endpoint (VPCE) will be sent to Prefix List pl-12345. A Prefix List is a list of IP addresses.  These used to be opaque, but in June 2020 AWS released functionality so you can manage and view prefix lists. So you can click on the PL in your Route table and see what IP addresses it contains.AFAI can tell, you unfortunately cannot use the Prefix List directly in the NACL (at least not yet). But you could use the IP addresses in the list to configure your NACL.CommentSharesetheliotanswered a year ago"


Question: Recovering and syncing files from S3 Glacier Flexible Retrieval

"Hello everyone.I have two AWS accounts. Account A and account B. Account A has 30 Tb of information archived on S3 Glacier Flexible Retrieval (05 buckets). I need to move this information to account B on a S3 standard storage.Im trying this:First, restore the objects from glacier with this command (one bucket at a time)aws s3 ls s3://bucket1 --recursive  | awk '{print $4}' | xargs -L 1 aws s3api restore-object --restore-request '{"Days":10,"GlacierJobParameters":{"Tier":"Standard"}}' --bucket bucket1 --keySync the information from the bucket restored between the accounts with this command. I´ve created the restored-bucket1 bucket on account B and has all the policies needed applied to it.aws s3 sync s3://bucket1 s3:restored-bucket1Even when the s3 console shows that the information has been restoredObject: Amazon S3 > Buckets > Bucket1 > file1.pngRestoration statusCompletedRestoration expiry dateJanuary 14, 2023, 21:00:00 (UTC-03:00)I still get the error:warning: Skipping file s3://bucket1/file1.png . Object is of storage class GLACIER. Unable to perform download operations on GLACIER objects. You must restore the object to be able to perform the operation. See aws s3 download help for additional parameter options to ignore or force these transfers.I have all the policies that allow file transfer between those accounts set up and running ok. I can sync other information that is not on Glacier with no issues.Anyone could help me?FollowComment"

Answer: "2Accepted AnswerThe command you want to do is aws s3 sync s3://bucketname1 s3://bucketname2 --force-glacier-transfer --storage-class STANDARDThere is a known issues here - https://github.com/aws/aws-cli/issues/1699Basically, when you do a restore, the CLI still thinks it's an archived object. The above command will force it to do the sync anyway, and wont initiate a new restore.CommentSharemicahanswered 5 months agoEXPERTMatt-Breviewed 5 months agoTarcisio M 5 months agoHey micahThanks for the message. The article you mentioned helped me with other minor issues related to this transfer. And I used --force-glacier-transfer as you also mentioned.Share2Try to check this page(https://awscli.amazonaws.com/v2/documentation/api/latest/reference/s3/sync.html) and play with different params.Maybe you should provide --storage-class GLACIER or pass --force-glacier-transfer.In general, I do not think moving 30 Tb using s3 sync is the best option. If your buckets are in the same region, I would suggest to try Amazon S3 Batch Operations. You create a job, specify source, destination, maybe smth. else and AWS will run this job for you. I did it couple of times and it worked just fine.CommentShareMaxanswered 5 months agoTarcisio M 5 months agoHey MaxBorysovThanks for the message. I used --force-glacier-transfer and it workedShare1Hi ThereCan you try adding the --force-glacier-transfer option to the CLI command?--force-glacier-transfer Forces a transfer request on all Glacier objects in a sync or recursive copy. [1][1] https://awscli.amazonaws.com/v2/documentation/api/latest/reference/s3/sync.htmlCommentShareEXPERTMatt-Banswered 5 months agoTarcisio M 5 months agoHey Matt-BThanks for the message. I add the --force-glacier-transfer and it did the trick.Share"


Question: The redshfit auto-snapshot retention period has expired. The snapshot does not delete and exists. why?

"Hello,Currently, I set the redshift auto-snapshot retention period to 1 day. The redshift version is ra3.xplus.As far as I know, redshift auto-snapshots are automatically deleted when the retention period is exceeded in redshift.However, if you check the snapshot in the redshift console, the snapshot still exists even after the retention period has expired.Can someone please assist with this issue?FollowComment"

Answer: "1Amazon Redshift retains the latest automated snapshot until you disable automated snapshots or delete the cluster. You can't disable automated snapshots for RA3 node types.Do you see just the latest snapshot (which should be the case) or do you see multiple older snapshots getting retained?CommentShareEXPERTBehramanswered a year ago0Behram thank you for the quick response.until yesterday, Korean time, the latest snapshot (within retention period) and the previous snapshot (over retention period) were retained with.However, when I checked today in Korean time, the previous snapshot (over retention period) was automatically deleted and only the latest snapshot (within retention period) is maintain.I think the redshift automatic deletion is not regular but irregularly deleted when the snapshot retention period exceeds, is it correct?CommentShareAWS-User-5187120answered a year ago"


Question: Missing values For SageMaker Endpoint Invocation Metrics

"Hi,I've deployed a custom model container as Sagemaker Async Endpoint which works fine so far. It's callable and provides results as expected.I now want to apply a TargetTrackingScalingPolicy but some of the metrics specified here seem to be not reported, they're also not visible in CloudWatch, e.g Invocations and InvocationsPerInstance. On the other hand, metrics like ModelLatency, TotalProcessingTime and TimeInBacklog show reasonable values.I guess due to these values missing e.g. applying this policy config doesn't have any effect either:TargetTrackingScalingPolicyConfiguration={    "TargetValue": 2.0,  # The target value for the metric. - here the metric is - SageMakerVariantInvocationsPerInstance    "CustomizedMetricSpecification": {        "MetricName": "InvocationsPerInstance",        "Namespace": "AWS/SageMaker",        "Dimensions": [{"Name": "EndpointName", "Value": endpoint_name}],        "Statistic": "Average",    },    "ScaleInCooldown": 60,    "ScaleOutCooldown": 60},Thanks a lot for any advice!FollowComment"


Question: Writing glue dynamic frame to s3 is taking too long

"Hi I have a glue job running with PySpark. Its taking too long to write the dynamic frame to s3. For around 1200 records writing it too around 500 seconds alone for writing to s3. I have observed that even if data frame is empty still it takes same amount of time to write to s3.Below are code snippets -test1_df = test_df.repartition(1)invoice_extract_final_dyf = DynamicFrame.fromDF(test1_df, glueContext, "invoice_extract_final_dyf")glueContext.write_dynamic_frame.from_options(frame=invoice_extract_final_dyf,connection_type="s3",connection_options={"path": destination_path},format="json")The conversion in 2nd line and writing to s3 both of these consumes most of the time. Any help will be appreciated. Let me know if any further details are needed.FollowComment"

Answer: "1Notice that when you "repartition(1)" only one core of the cluster can do work from them all, if you want to just generate a file put the repartition as late as possible (just before the write).Also bear in mind that when you run the write, that is not running the write but all the work from source to the point it writes (e.g. repartition, filtering, etc), so even if at the end there is no data coming out, it has to do all the work to reach that.CommentShareGonzalo Herrerosanswered 2 months agoSuraj-3691281 2 months agoThanks for the reply !!The above 3 lines are the last 3 lines of the glue job. Do you still have any suggestions in the ordering of these lines ?Share0Then you can't move the repartition down further (you could move it after the conversion but I don't think it will make any differenceCommentShareGonzalo Herrerosanswered 2 months agoSuraj-3691281 2 months agoI even tried to write data frame directly to s3, skipping both the repartitioning and data frame to dynamic frame conversion. But still it was consuming same amount of time -test_df.write.mode("overwrite").format('json').save(destination_path + '/testing-perf3')Share"


Question: Syhthesis err:[Timing 38-17] An error was encountered initializing graph

"When I synthesis project in vivado/2019.2. I encounter errs. The details are shown below:Timing38-246 Caught exception ‘ ERROR: [Timing 38-432] Unexpected exception thrown while building timing graph ’ while reading timing library and applying constraints.Resolution: For technical support on this issue,please visit http://www.xilinx.com/support[Timing 38-17] An error was encountered initializing the graph.Analysis will not be performed.FollowComment"

Answer: "0Hi zqsteve,Thanks for contacting us regarding the issue. Could you please attach the full log into the thread?Regards,BaserCommentShareawsbaseranswered 3 years ago0Hi awsbaser ,Because this forum does not support uploading log files, so I past the relevant sections here. The details is attached the following.Processing XDC ConstraintsInitializing timing engineCaught ... exception.ERROR: [Timing 38-246] Caught exception 'ERROR: [Timing 38-432] Unexpected exception thrown while building timing graph' while reading timing library and applying constraints.Resolution: For technical support on this issue, please visit http://www.xilinx.com/supporttcmalloc: large alloc 1073741824 bytes == 0x2000832000 @  0x2ad1ca2f663f 0x2ad1ddd4480e 0x24d4832000tcmalloc: large alloc 1523728384 bytes == 0x20f0832000 @  0x2ad1ca2f663f 0x2ad1e170f9a0tcmalloc: large alloc 1523728384 bytes == 0x243c732000 @  0x2ad1ca2f663f 0x2ad2030b6350tcmalloc: large alloc 2147483648 bytes == 0x2d90b0a000 @  0x2ad1ca2f663f 0x2ad1ddd4480e 0x2040832000tcmalloc: large alloc 2147483648 bytes == 0x24e52a4000 @  0x2ad1ca2f663f 0x2ad2030b5e3e 0x1fc8c32000tcmalloc: large alloc 3094233088 bytes == 0x2a6f8da000 @  0x2ad1ca2f663f 0x2ad1e170f9a0tcmalloc: large alloc 3094233088 bytes == 0x2b27fbe000 @  0x2ad1ca2f663f 0x2ad2030b6350tcmalloc: large alloc 4294967296 bytes == 0x28e786a000 @  0x2ad1ca2f663f 0x2ad1ddd4480e 0x2e10b0a000tcmalloc: large alloc 4294967296 bytes == 0x275f3c2000 @  0x2ad1ca2f663f 0x2ad2030b5e3e 0x25652a4000tcmalloc: large alloc 6283452416 bytes == 0x25d4896000 @  0x2ad1ca2f663f 0x2ad1e170f9a0tcmalloc: large alloc 6283452416 bytes == 0x2bf782a000 @  0x2ad1ca2f663f 0x2ad2030b6350INFO: [Common 17-83] Releasing license: Synthesis224 Infos, 138 Warnings, 0 Critical Warnings and 2 Errors encountered.synth_design failedERROR: [Timing 38-17] An error was encountered initializing the timing graph. Analysis will not be performed.Resolution: For technical support on this issue, please visit http://www.xilinx.com/supportINFO: [Common 17-206] Exiting Vivado at Tue Nov  3 13:41:06 2020...CommentSharezqsteveanswered 3 years ago0Hi zqsteve, this appears to be a memory related issue. Could you let us know how much memory is available on the machine you are running on? It may be the case that the run needs more memory than is available to the machine.An option to try would be to add -stack 2000 when launching Vivado, which allocates more memory for runs.CommentSharekmorrisXilinxanswered 3 years ago0Hi kmorrisXilinx,How should I use command "-stack 2000"? Is it a tcl command. When I use it in tcl console in vivado, the vivado does not recognize the command correctly. Then I use command "vivado& -stack 2000" in the linux , it still failed.CommentSharezqsteveanswered 3 years ago0Hi zqsteve,I believe kevin suggested calling vivado -stack 2000 &Let me know if that doesn't work for you.-DeepCommentShareDeep_Panswered 3 years ago"


Question: RDS MySQL stuck offline & upgrading

"One of our DB instances on MySQL 8.0.29 was crashing with regular "DB instance restarted" in the logs. I tried modifying it to 8.0.30, but now it's stuck upgrading, with regular "Error restarting mysql: MySQL process is not running and the restart attempt failed." in the logs.The error log contains the following over and over again:2022-09-23T16:03:46.082336Z 0 [Warning] [MY-011068] [Server] The syntax 'log_slave_updates' is deprecated and will be removed in a future release. Please use log_replica_updates instead.2022-09-23T16:03:46.082352Z 0 [Warning] [MY-011069] [Server] The syntax '--master-info-repository' is deprecated and will be removed in a future release.2022-09-23T16:03:46.082362Z 0 [Warning] [MY-011069] [Server] The syntax '--master-info-repository' is deprecated and will be removed in a future release.2022-09-23T16:03:46.082415Z 0 [Warning] [MY-011069] [Server] The syntax '--relay-log-info-file' is deprecated and will be removed in a future release.2022-09-23T16:03:46.082425Z 0 [Warning] [MY-011069] [Server] The syntax '--relay-log-info-repository' is deprecated and will be removed in a future release.2022-09-23T16:03:46.082457Z 0 [Warning] [MY-011068] [Server] The syntax 'skip_slave_start' is deprecated and will be removed in a future release. Please use skip_replica_start instead.2022-09-23T16:03:46.082469Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_exec_mode' is deprecated and will be removed in a future release. Please use replica_exec_mode instead.2022-09-23T16:03:46.082483Z 0 [Warning] [MY-011068] [Server] The syntax 'slave_load_tmpdir' is deprecated and will be removed in a future release. Please use replica_load_tmpdir instead.2022-09-23T16:03:46.082676Z 0 [Warning] [MY-010101] [Server] Insecure configuration for --secure-file-priv: Location is accessible to all OS users. Consider choosing a different directory.2022-09-23T16:03:46.082703Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead.2022-09-23T16:03:46.082719Z 0 [System] [MY-010116] [Server] /rdsdbbin/mysql/bin/mysqld (mysqld 8.0.29) starting as process 7262022-09-23T16:03:46.085105Z 0 [Warning] [MY-010161] [Server] You need to use --log-bin to make --log-replica-updates work.2022-09-23T16:03:46.089322Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.2022-09-23T16:03:46.095259Z 1 [Warning] [MY-012191] [InnoDB] Scan path '/rdsdbdata/db/innodb' is ignored because it is a sub-directory of '/rdsdbdata/db/2022-09-23T16:03:48.212117Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.InnoDB: Progress in percents: 116:03:49 UTC - mysqld got signal 11 ;Most likely, you have hit a bug, but this error can also be caused by malfunctioning hardware.Thread pointer: 0x1518a5406000Attempting backtrace. You can use the following information to find outwhere mysqld died. If you see no messages after this, something wentterribly wrong...stack_bottom = 15189fcc63e8 thread_stack 0x40000/rdsdbbin/mysql/bin/mysqld(my_print_stacktrace(unsigned char const*, unsigned long)+0x2e) [0x2097dae]/rdsdbbin/mysql/bin/mysqld(print_fatal_signal(int)+0x2bb) [0x102057b]/rdsdbbin/mysql/bin/mysqld(handle_fatal_signal+0xa5) [0x1020625]/lib64/libpthread.so.0(+0x118e0) [0x1518c0d458e0]/rdsdbbin/mysql/bin/mysqld(page_cur_search_with_match_bytes(buf_block_t const*, dict_index_t const*, dtuple_t const*, page_cur_mode_t, unsigned long*, unsigned long*, unsigned long*, unsigned long*, page_cur_t*)+0x190) [0x22d69b0]/rdsdbbin/mysql/bin/mysqld(btr_cur_search_to_nth_level(dict_index_t*, unsigned long, dtuple_t const*, page_cur_mode_t, unsigned long, btr_cur_t*, unsigned long, char const*, unsigned long, mtr_t*)+0x1ec2) [0x2406642]/rdsdbbin/mysql/bin/mysqld(row_search_on_row_ref(btr_pcur_t*, unsigned long, dict_table_t*, dtuple_t const*, mtr_t*)+0xd2) [0x233d2c2]/rdsdbbin/mysql/bin/mysqld(row_undo_search_clust_to_pcur(undo_node_t*)+0x15f) [0x234bd4f]/rdsdbbin/mysql/bin/mysqld(row_undo_mod(undo_node_t*, que_thr_t*)+0x18f) [0x258461f]/rdsdbbin/mysql/bin/mysqld(row_undo_step(que_thr_t*)+0x52) [0x234c542]/rdsdbbin/mysql/bin/mysqld(que_run_threads(que_thr_t*)+0x5c8) [0x22f3da8]/rdsdbbin/mysql/bin/mysqld(trx_rollback_or_clean_recovered(bool)+0x9a5) [0x23a4475]/rdsdbbin/mysql/bin/mysqld(trx_recovery_rollback_thread()+0x1c) [0x23a53fc]/rdsdbbin/mysql/bin/mysqld(std::thread::_State_impl<std::thread::_Invoker<std::tuple<Detached_thread, void (*)()> > >::_M_run()+0xb0) [0x2296fc0]/rdsdbbin/mysql/bin/mysqld() [0x2baabf0]/lib64/libpthread.so.0(+0x744b) [0x1518c0d3b44b]/lib64/libc.so.6(clone+0x3f) [0x1518c052040f]Trying to get some variables.Some pointers may be invalid and cause the dump to abort.Query (0): Connection ID (thread ID): 0Status: NOT_KILLEDThe manual page at http://dev.mysql.com/doc/mysql/en/crashing.html containsinformation that should help you find out what is causing the crash.Is there any way to fix this, or are we going to have to delete / recreate the instance?FollowComment"


Question: Open Search Service CORS Support

"Hello,Is there any way to enable cors on an open search public domain? If not are there any plans for possible future support. It would be ideal if clients could communicate with open search domains using zero-trust signed urls directly in the browser rather than requiring a proxy. This is not possible without a proxy at the moment due to cors limitations. However, on other services like s3 direct secure communication with s3 rest api can be achieved using zero-trust signed urls directly in the browser. It would be nice to be able to do the same thing with open search domain.ThanksFollowComment"


Question: "Behavior Context, Lua, Passing a table from C++ code to Lua."

"So im trying to create a SQLite component system with lua interface and im hitting a snag. How do i pass an array to lua from c++?int SQLiteSystemComponent::LuaHandler::SqlCallback(void * cbargs, int argc, char **argv, char **azColName) {int ret;CallResult(ret, FN_SqlCallback, cbargs, argc, argv, azColName);return ret;}as you can see, i have a "char ** argv" and a "char ** azColName".How would I convert those into tables for lua?EDIT:Also, how can i have C++ code return multiple returns to lua?I.E.var1, var2 = EBus.Event.Func(self.entityID, param1)This would be especially useful for when coders need to provide an error code and data.Follow"

Answer: "0Hey @REDACTEDUSERFor question 1, I would suggest constructing a vector of supported types (in this case, strings). Like this:int SQLiteSystemComponent::LuaHandler::SqlCallback(void * cbargs, int argc, char **argv, char **azColName){int ret;AZStd::vector<const char*> argvVector(argv, argv + argc);AZStd::vector<const char*> azColNameVector(azColName, azColName + argc);CallResult(ret, FN_SqlCallback, cbargs, argvVector, azColNameVector);return ret;}I'm not quite sure about cbargs, that depends on what you plan on passing through there.As for question two, unfortunately the only way to have bus events return multiple events is with multiple handlers (one return value per handler). This probably isn't what you want. You can, however, provide a global function (or a class member function) with a Lua specific override that returns as many things as you want. For an example of this, see Vector3GetSinCosMultipleReturn in MathReflection.cpp (in AzCore). Keep in mind this will only work for Lua function overrides as ScriptDataContext is a Lua specific class, and you'll need a different approach for other BehaviorContext consumers such as the TrackView, should you choose to support them.Hope that helps!Cheers,ColdenSharerePost-User-2329383answered 6 years ago0cbargs is callback args that are passed to the sql callback function from an event:SQLite.Event.Exec(self.entityId, "sql", cbargs)argc is the size of the array of both argv and azColName.EDIT:Also, how to i make a custom struct be available in lua, create a new lua type, or convert a struct to a userdata type?EDIT2:Doesnt seem to be working right for the vectors...<00:48:14> Selecting Data.<00:48:14> First = 0<00:48:14> Second = FIRST<00:48:14> cbargs type: userdata<00:48:14> argc: 2<00:48:14> argv type: string<00:48:14> azColName type: string<00:48:14> i: 1<00:48:14> i: 2<00:48:14> First = 1<00:48:14> Second = SECOND<00:48:14> cbargs type: userdata<00:48:14> argc: 2<00:48:14> argv type: string<00:48:14> azColName type: string<00:48:14> i: 1<00:48:14> i: 2<00:48:14> First = 2<00:48:14> Second = THIRD<00:48:14> cbargs type: userdata<00:48:14> argc: 2<00:48:14> argv type: string<00:48:14> azColName type: string<00:48:14> i: 1<00:48:14> i: 2<00:48:14> 0<br>SqlCallback lua function:function menu:SqlCallback(cbargs, argc, argv, azColName)Debug.Log("cbargs type: " .. type(cbargs))Debug.Log("argc: " .. argc)Debug.Log("argv type: " .. type(argv))--Debug.Log("argv: " .. argv)Debug.Log("azColName type: " .. type(azColName))--Debug.Log("azColName: " .. azColName)for i=1, argc,1 doDebug.Log("i: " .. i)if azColName[i] ~= nil then Debug.Log("azColName: " .. azColName[i]) endif argv[i] ~= nil then Debug.Log("argv: " .. argv[i]) endendreturn 0endSqlCallback Handler Function:int SQLiteSystemComponent::LuaHandler::SqlCallback(void * cbargs, int argc, char **argv, char **azColName) {int ret;int i;for (i = 0; i<argc; i++) {AZ_Printf("SQLite", "%s = %s", azColName[i], argv[i] ? argv[i] : "NULL");}AZStd::vector<const char*> argvVector(argv, argv + argc);AZStd::vector<const char*> azColNameVector(azColName, azColName + argc);CallResult(ret, FN_SqlCallback, cbargs, argc, argvVector, azColNameVector);return ret;}ExecLua Event Function:int SQLiteSystemComponent::ExecLua(const char *sql, void * cbarg) {typedef struct {void* cbarg;AZ::EntityId id;} ARGS;ARGS args;args.cbarg = cbarg;args.id = this->GetEntityId();auto callback = [](void* cbarg, int argc, char **argv, char **azColName) -> int {int ret;ARGS* args = (ARGS*)cbarg;SQLite::SQLiteLuaBus::EventResult(ret, args->id, &SQLite::SQLiteLuaBus::Events::SqlCallback, args->cbarg, argc, argv, azColName);return ret;};//char * errmsg = 0;return sqlite3_exec(this->m_pDB,sql,callback,&args,nullptr);}EDIT3:Looking at the the code that I have provided, is it possible to have the SqlCallback provide a key-value table in lua?For the example above, basicly have the lua table:table = { First = 0, Second = "FIRST" }table["First"] = 0table["Second"] = "FIRST"Which for each call of the SqlCallback would be one row of the sql data that was provided as a key value pair table.So i could have the SqlCallback Lua code be:function menu:SqlCallback(cbargs, row)for k,v in pairs(row) doDebug.Log(k .." = ".. v)endreturn 0endEDIT4:I've been trying various methods of trying to get an array passed to lua but all of it doesnt seem to work.I've tried AZStd::vector<char *>, AZStd::vector<AZStd::pair<char , char>>, AZStd::unordered_map<char *, char *>, and even AZStd::vectorAZStd::string.All of it did not work. Heck if i just use the vector without making it a pointer it causes the program to error out. And if i do have it as a pointer it makes it a userdata type where i cant even use it.SharerePost-User-8564951answered 6 years ago0That doesnt help. I can tell that Platform is using behavior contexts and Windows64 is just an enum within the Platform name.What I need is a way of having a C++ function pass an array as a Lua table in Lua. As it stands, there doesnt seem to be any way of doing this unless im missing something.SharerePost-User-8564951answered 6 years ago0Hey @alatnet,Any luck with passing data over to Lua? A userdata type in Lua essentially means it's an undefined block of memory. You will need to define it to properly use it. A good example to follow would be the ScriptSystemComponent.cpp where the PlatformId enum class is exposed as well as properties and any methods that go along with it - allowing you to access it in Lua just like this:Debug.Log(Platform.GetName(Platform.Current)) -- prints the string version of the current platformif Platform.Current == Platform.Windows64 then-- Since the properties are exposed, you can also do comparison checks.endHope that helps,Thanks!SharerePost-User-5162062answered 6 years ago0Hello @alatnet,What version of Lumberyard are you using? In 1.9, AZStd::vector is already handled to be treated as a Lua table and I'm quite positive that in earlier versions that is also the case but I could be wrong. The same goes for AZStd::string.Technically speaking, it should automatically convert AZStd::vectorAZStd::string to a lua table accessible as a 1-indexed array since both of those class types are registered. Another good example file to check is TransformComponent.cpp where the event GetAllDescendants is exposed to Lua which returns an AZStd::vectorAZ::EntityId and that is being treated as a table in Lua.SharerePost-User-5162062answered 6 years ago"


Question: Elastic beanstalk and env variables

"I need to deploy to Elastic Beanstalk a next.js application which reads some values from a .env file in my local dev environment.I was suggested to use a .config extension, but I don't want to put this file under version control.Is there any other option? AWS secrets manager is a bit expensive so I'd prefer not to use it.thanksMFollowComment"

Answer: "1Accepted AnswerWith above constraints, a possible option is to then use SSM Parameter Store secure strings.It tends to be generally cheaper than Secrets Manager. To decide whether that cheaper is enough for you to choose it over Secrets Manager, you can look at its price under the "Paramster Store" sub section: https://aws.amazon.com/systems-manager/pricing/Refer to this article to learn about SSM parameter store secrets strings: https://docs.aws.amazon.com/kms/latest/developerguide/services-parameter-store.htmlCommentShareEXPERTalatechanswered 4 months ago"


Question: Cannot update canary using 'aws-sdk'

"Hi all,I'm trying to update canary to the most recent '.zip' archive from S3 bucket with code(using sdk):let synthetics = new AWS.Synthetics();let params = {Name: "canary-name",Code: {Handler: 'canary.handler',S3Bucket: 'bucket-name',S3Key: 'bucket-key',S3Version: "version-id"}};let response = await synthetics.updateCanary(params).promise();After invocation, response is empty object({}), no errors occuredI use S3 bucket, because '.zip' archive contains some additional node librariesAlso how could I set up the flow of updating code in repo and automatically update canary?As for now I guess, I just can create canary single time and have no way to continuously update canary codeThanks to all for any comments!FollowComment"

Answer: "0I've already solved the issue. Maybe it'll be helpful for somebodyWhen using aws-sdk - "S3Bucket" in params object need to be added without "s3://"Use getCanary() method to get canary object, which in my case contains validation errorsCommentSharevradiukinanswered 2 years ago"


Question: How to search for Amazon SageMaker Models using Tags?

"When I open the Model details in the Amazon SageMaker console, the details clearly show Tags that have been added to the model during it's creation.| Tags || Key || sagemaker:project-name || aws:cloudformation:stack-name|| sagemaker:deployment-stage|| sagemaker:deployment-stage|But the Search API provided by Amazon SageMaker, https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_Search.htmlmentions only the following resources can be searched for using Tags:Valid Values: TrainingJob | Experiment | ExperimentTrial | ExperimentTrialComponent | Endpoint | ModelPackage | ModelPackageGroup | Pipeline | PipelineExecution | FeatureGroup | Project | FeatureMetadataI wish to obtain Model details, not the ModelPackageGroup/ModelPackage details, using Tags so if there is a way to do that, please share. Also if there is no way to obtain it using Tags, like the Search API Documentation suggests, what is the purpose of the Tags still present in the Model details?FollowComment"

Answer: "0DescribeModel will provide information about model details, the tags in the model was created as a part of the CloudFormation deployment. It identify each resources by CF.To search by tags, you could add custom tags for your purpose.CommentShareJadyanswered a year agorePost-User-0352853 a year agoThank you for replying! Even if I add custom tags, the resource: 'Model' is not accepted by the search API. (An error occurred (ValidationException) when calling the Search operation: 1 validation error detected: Value 'Model' at 'resource' failed to satisfy constraint: Member must satisfy enum value set: [Pipeline, ModelPackageGroup, TrainingJob, ExperimentTrialComponent, FeatureMetadata, FeatureGroup, ProcessingJob, TransformJob, BulkFeatureMetadata, Endpoint, PipelineExecution, Project, ExperimentTrial, Image, ImageVersion, Experiment, ModelPackage])Share0To use custom tag, you will need to search by GetResources from AWS Resource Groups:https://docs.aws.amazon.com/ARG/latest/userguide/find-resources-to-tag.htmlCommentShareJadyanswered a year ago"


Question: [AWS Javascript SDK V3] How to activate debug log?

The answer here: https://repost.aws/knowledge-center/sqs-queuedoesnotexist-errors says (in the Incorrect Region section) "You can also verify the Region of the request by activating the debug log on the SDK or AWS CLI. Debug logs show the destination host for the request."How do I activate the debug log for the AWS Javascript SDK v3? Could someone please point out the relevant documentation? I looked in https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/ and https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/welcome.html and failed to find relevant sections.FollowComment

Answer: "0I'm using below sample code to log the verbose information of AWS JS SDK v3.import { DescribeParametersCommand, SSMClient } from "@aws-sdk/client-ssm";import * as log4js from "log4js";log4js.configure({  appenders: { cheese: { type: "file", filename: "cheese.log" } },  categories: { default: { appenders: ["cheese"], level: "error" } },});const logger = log4js.getLogger();logger.level = "debug";async function main() {  const ssmClient = new SSMClient({    logger: logger,  });  const parameters = await ssmClient.send(new DescribeParametersCommand({}));  console.log(parameters);}CommentShareKaneanswered a month ago-1Hi there,Thank you for reaching out to us.Please check this link to enable Logging AWS SDK for JavaScript Calls. (Version 2)https://docs.aws.amazon.com/sdk-for-javascript/v2/developer-guide/logging-sdk-calls.htmlTo turn on the logger and print log entries in the console, add the following statement to your code.[ AWS.config.logger = console; ]Please check this link to enable Logging AWS SDK for JavaScript Calls. (Version 3)https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/interfaces/_aws_sdk_types.logger-1.html#debughttps://github.com/aws/aws-sdk-js-v3/blob/e77e1150/packages/types/src/logger.ts#L31For AWS CLI, you can add " --debug " at the end of the command as well. [Check the example on the link below]https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-troubleshooting.html#general-debugI hope this helps!  Thank you!Have A Nice Day!CommentShareSUPPORT ENGINEERSagar_Tanswered 2 months agoKane a month agoThe step 2 for SDK v3, the link is about to the logger utility of SDK library, not it's a doc about how enabling debugging log of SDK itself.Share"


Question: Gamelift fleet creation from real-time script stuck in "Activating" status with insufficient event logs

"Hi community,I was trying to initiate a Gamelift fleet using an zip file from s3 (created by CDK Asset). However the fleet created will get stuck in "Activating" for more than one hour and then error. No usable event log is emitted from console during "Activating". I can ssh into the game server in error status but not sure if that is helpful.Any help would be appreciated on how to debug further.(More context: the server files themselves are fine. I uploaded the zip file directly to create the script and the fleet from the script is created just fine). The s3 access rights seem to be okay too, I followed the example here . The CDK code for uploading server to s3 and creating the script is as follows)import { Role, PolicyStatement, ServicePrincipal } from "aws-cdk-lib/aws-iam";import { Asset } from "aws-cdk-lib/aws-s3-assets";import { Bucket } from "aws-cdk-lib/aws-s3";import { CfnScript } from "aws-cdk-lib/aws-gamelift";...// Upload gamelift real-time server script as cdk asset    const scriptAsset = new Asset(this, "MyAsset", {      path: pathToScript,    });    const assetBucket = Bucket.fromBucketName(      this,      "ScriptAssetBucket",      scriptAsset.s3BucketName    );        const scriptAccessRole = new Role(this, "ScriptAccessRole", {      assumedBy: new ServicePrincipal("gamelift.amazonaws.com"),    });    scriptAccessRole.addToPrincipalPolicy(      new PolicyStatement({        actions: ["s3:GetObject", "s3:GetObjectVersion"],        resources: [`${assetBucket.bucketArn}/${scriptAsset.s3ObjectKey}`],      })    );    const script = new CfnScript(this, "RealTimeScript", {      name: `my-script`,      version: "0.1",      storageLocation: {        bucket: scriptAsset.s3BucketName,        key: scriptAsset.s3ObjectKey,        roleArn: scriptAccessRole.roleArn,      },    });    script.node.addDependency(scriptAccessRole);FollowCommentrePost-User-4613249 6 months agoDid you solve this issue? If yes, please share. I am stuck for 3 days.SharerePost-User-2492096 6 months agoOp here. I solved it. The actual reason seems to be: CDK Asset cannot be used to host a game lift script. I ended up using a custom s3 bucket and that solved it.SharerePost-User-4613249 6 months agoSir, it's not happening. Even I am manually passing the s3 bucket and object key. It's not happening.  Script size is showing 0 bytes.  Error in Aws console is Resource fleet-2d5a0ff4-b794-4188-adbe-xxxxxxxx is not in a taggable state. In doing ssh, I am finding that code has been uploaded. But it's stuck in the Activating part for 1 hour. Also, I have tried manually, from the AWS console, same situation occurs. Only when I upload through the zip file (which is for less than 5 mb), then only the fleet gets activated. Please help me. I am simply uploading the most minimal code which is just having an init function for example purpose.SharerePost-User-2492096 6 months agoIn my case I always uploaded the script as a zip file and no problem.SharerePost-User-2492096 6 months agoMaybe this post can help you: https://github.com/aws/aws-cdk/pull/21805 to disable automatic unzipping when uploading to s3.ShareShow 1 more comment"

Answer: "0Hi,One common reason a fleet goes from the ACTIVATING status into ERROR is due to an invalid LaunchPath in the ServerProcess configuration https://docs.aws.amazon.com/gamelift/latest/apireference/API_ServerProcess.htmlHope that helps.CommentShareJuneHoP_AWSanswered 9 months agorePost-User-4613249 6 months agoThere are 2 ways to upload the script; 1 by uploading zip file and 2 by using s3. It is clearly mentioned in the problem statement that when uploaded through the zip file directly, the fleet runs properly. During activation, the LaunchPath is checked separately. We see in the events sections. Hence, there should be no question about invalid launch Path. The real problem is the fleet is not activated when we create the fleet from the script uploaded by s3. Also, by ssh in fleet instance, we see that script is loaded in the fleet server from s3. Hence, there must be something that we are missing here. AWS console showing error Resource fleet-2d5a0ff4-b794-4188-adbe-xxxxxxxx is not in a taggable stateShare"


Question: Migration from CEDR to DRS

"I am trying to migrate Source Machine from CEDR to DRS. When trying to start the upgrade, getting below mentioned error:# python3 cloudendure_to_drs_upgrade_tool.py start-upgrade --api-token <**APITOKEN**> --project-id <**ProjectID**> --aws-access-key-id <**ACCESSKEY**> --aws-secret-access-key <**SECRETKEY**> -–import-blueprint –-import-replication-configuration -–import-test-snapshotRunning the CloudEndure to DRS Upgrade tool.usage: cloudendure_to_drs_upgrade_tool_internal_64 [-h]                                                   {start-upgrade,finalize-upgrade}                                                   ...cloudendure_to_drs_upgrade_tool_internal_64: error: unrecognized arguments: -–import-blueprint –-import-replication-configuration -–import-test-snapshotI have IAM user "DRSAgent" Created and have attached AWS Managed Policy "WSElasticDisasterRecoveryAgentInstallationPolicy" to it.Do I need to attach any other Policies?How can I overcome this error and proceed ahead with Migration?FollowComment"

Answer: 0Hi ThereCHeck the way you are entering the 3 parameters: -–import-blueprint –-import-replication-configuration -–import-test-snapshotLook at the "dashes" you have two different dash characters there-hyphen-minus–en dashif you are doing a copy/paste just try typing them manuallyCommentShareEXPERTMatt-Banswered 4 months ago


Question: GreenGrass IoT Core

"Can one GreenGrass device connect to and be managed by another?Customer would likely be deploying this solution in networks that may not have internet connectivity for all devicesso if they only have to get their customers to enable internet access for 1 single device, instead of several, it will be easier for themFollowComment"

Answer: "0Hey tarushtg,I will assume based on your statement the goal is "only have to get their customers to enable internet access for 1 single device". It will all depend the customer needs, you could deploy multiple components and "Things" into a single physical device. Basically, your device would be running Greengrass as one process and you could run other processes that act as "Things" on the same device that interact with the Core process and only provide internet access to a single physical device.If what I described is not what you are looking for and you have multiple physical devices that need to interact with just one core device able to access the internet. Initially your devices that want to interact with the core would need internet connectivity to perform a cloud discovery and get the core device's ip address, and public certificate so they can communicate with the core device over MQTT on the same local network . After that, the devices can be offline (except the core) and communicate with the core over MQTT on the local network or VPN having the core act as a "gateway", granted, to do this you would need to write a custom component and deploy it to the core that acts as a gateway for forwarding requests to the internet.This is similar to what got replied on this other post https://repost.aws/questions/QUCBjGPygyTRWN2V-ACZ9JWQCheers,NelsonCommentShareochoanelanswered 3 months ago"


Question: V2 Lex Order Flowers Lambda error

"I am following the V2 Lex Developer Guide to create a bot from the OrderFlowers Blueprint.  When I add the Lambda function to the bot (page 145 of the V2 Guide), I receive the error below.  Any idea why this is happening?  I have followed the steps in the V2 Developer Guide.Invalid Lambda Response: Your request to Amazon Lex couldn't be completed. Lambda function arn:aws:lambda:us-east-1:994504927747:function:OrderFlowersCodeHook:OrderFlowersCodeHook encountered a problem while processing Amazon Lex request 6406cf16-5cd5-4c72-8a2a-fed1717e5e3a. The error message from the Lambda function is Unhandled. Check the Lambda function log for error details, then try your request again after fixing the error.FollowCommentiwasa EXPERTa year agoHi, @Jennifer.What is output in the Lambda function log?ShareJennifer a year agoThere is no output in the Lambda logs within CloudWatch. The AWS X-ray Map shows a picture of the client invoking the Lambda function.  The CloudWatch Trace references a "Error (4xx)" but I can't see what it is.I am new to using Lex, Lambda, and Cloudwatch. I turned on XRay and Lambda Log Insights but I can't find any details on what happening.ShareJennifer a year agoI deleted the Lambda function and started over.  I now see the following errors in the CloudWatch logs:[ERROR] KeyError: 'userId'Traceback (most recent call last):  File "/var/task/lambda_function.py", line 206, in lambda_handler    return dispatch(event)  File "/var/task/lambda_function.py", line 182, in dispatch    logger.debug('dispatch userId={}, intentName={}'.format(intent_request['userId'], intent_request['currentIntent']['name']))Share"


Question: AWS Cloud Directory - unable to determine node type

"On trying to run JAVA DK of AWS clouddirectory and creating an object ... i always get this ERROR:Unable to determine if node is one of LeafNode, Node, Policy, Index (Service: CloudDirectory, Status Code: 400, Request ID: 3448687c-d30f-434e-a4e6-76fbb057f5f1)I tried to create a specific node, of type index, but it didn't work well! I had same output errors on aws cli, but then it just worked ... still not working with JAVA☕TestAWSCloudDirectory.java code snippet:package com.pontusvision.graphutils;import software.amazon.awssdk.auth.credentials.DefaultCredentialsProvider;import software.amazon.awssdk.services.clouddirectory.CloudDirectoryClient;import software.amazon.awssdk.services.clouddirectory.model.*;import java.util.ArrayList;import java.util.Collection;public class TestAWSCloudDirectory {  public static void main(String[] args) throws Exception {    DefaultCredentialsProvider credentials = null;    try {      credentials =  DefaultCredentialsProvider.create(); // where is the file ?!    } catch (Exception e) {      throw new Exception(        "Cannot load the credentials from the credential profiles file. " +          "Please make sure that your credentials file is at the correct " +          "location, and is in valid format.",        e);    }    CloudDirectoryClient client = CloudDirectoryClient.builder()      .credentialsProvider(credentials).build();    AttributeKey attributeKey = AttributeKey.builder().schemaArn("***********************************************************")      .facetName("DynamicObjectFacet")      .name("Person_Natural").build();    TypedAttributeValue attributeValue = TypedAttributeValue.fromStringValue("Leo");    AttributeKeyAndValue attrib = AttributeKeyAndValue.builder().key(attributeKey).value(attributeValue).build();    SchemaFacet schemaFacet = SchemaFacet.builder().facetName("DynamicObjectFacet").schemaArn("***********************************************************").build();    Collection<AttributeKeyAndValue> objectAttributeList = new ArrayList<>();    objectAttributeList.add(attrib);    ObjectReference objectReference = ObjectReference.builder().selector("/").build();    client.createObject(CreateObjectRequest.builder().directoryArn("***********************************************************")      .objectAttributeList(objectAttributeList)      .schemaFacets(schemaFacet)      .build());    client.close();  }}pom.xml aws and cloud-directory dependencies:(...)    <dependency>      <groupId>software.amazon.awssdk</groupId>      <artifactId>clouddirectory</artifactId>      <version>2.20.26</version>    </dependency>    <dependency>      <groupId>software.amazon.awssdk</groupId>      <artifactId>auth</artifactId>      <version>2.20.26</version>    </dependency>(...)FollowComment"


Question: Picking the correct Opensearch index date from the Kinesis Delivery Stream

"When using Kinesis firehose to opensearch / elasticsearch, while the delivery stream is super convenient, one major limitation I find is that one cannot override the timestamp field that is use to decide on the destination index (it always uses the estimated arrival time). This means that for backfill jobs (which are super common for us) all the data ends up in the current daily index, which reduces read/write scalability and also makes index-based management much more difficult (e.g. compact / archive index older than N days). Another example is when querying dashboards, some indices have data for a large range of dates and end up becoming a bottleneck for performance.Ideally one could pick a timestamp field from the events, or set it as part of the lambda processing, so that a record with date D goes to index of date D. Thanks for suggestions!FollowComment"


Question: "RDP connection failed, password error, but password is correct"

"As the title, built in lightsail Windows Host, I want to use the local Windows built @ - @ in RDP tool connection, but always prompted the password error, I should not have changed the passwordFollowComment"

Answer: "0Hi, here's a detailed guide on how to connect to a Lightsail windows instance using Windows default RDC client: https://lightsail.aws.amazon.com/ls/docs/en_us/articles/amazon-lightsail-connecting-to-windows-instance-using-rdcCommentSharerePost-User-1170069answered 5 months ago"


Question: Egress Port 25 (SMTP) redirecting to itself (localhost)

"Hi,I'm having a strange behavior.From my EC2 Instance, if i try to:telnet externalhost 25telnet anyotherexternalhost 25It connects back to it instance's own mail server (localhost 25).I'm using a cPanel instance at Amazon, there's nothing on iptables -L -n.Also, if I try to use any other port, it works:openssl s_client -starttls smtp -connect externalhost:587It connects sucefully to externalhost:587, but not at port 25.Does anybody can help me?Edited by: Ramiro on Aug 18, 2021 10:31 PMAlso, theres another thing.With root:I cannot telnet anyhost 25With centos (user):I can telnet anyhost 25, but it redirects the connection to my localhost mail server.FollowComment"

Answer: "0Accepted AnswerI'm kind of surprised that you see it going to itself, but AWS does have lots of restrictions on port 25. Have you gone through the process to get it unblocked?https://aws.amazon.com/premiumsupport/knowledge-center/ec2-port-25-throttle/While it is possible to run your own mail server on EC2 if you go through the process, generally it's a lot easier to use SES (or a competitor's mail sending service) if all you're doing is sending emails out and don't need a full mail server.CommentSharepetercooperjranswered 2 years ago"


Question: Stackset operation stuck at STOPPING

"Hello,Can you help check why my stackset operation got stuck at the STOPPING, as it cannot finish we could not execute any other operation on this.Stackset ID: CustomControlTower-iam-roles:b6c902d0-9183-4af0-b63a-424e38402fb4Operation ID: 8562d033-08a8-6451-c372-6d4a3e4f48fdThanks.FollowComment"

Answer: 0Verify your CloudTrail/Cloudwatch logs to identify if the Resource that cause the Cloudformation to get stuck went through and error.CommentSharevtjeananswered 2 months ago


Question: ElasticBeanstalk can't find jsp in WEB-INF/views - Springboot

"I'm creating a Springboot app with OAuth2, which means I need to be able to parse a login.jsp file for users to log in through. This all works locally but on EB I get 404s for all JSP targets. The OAuth endpoints work fine on EB and I can still request tokens manually but all requests that require the users to login just result in the following webpage:There was an unexpected error (type=Not Found, status=404)./WEB-INF/views/login.jspHaving looked at the debug log the only difference in the logs are the following, which to me would appear to imply that path on EB is no longer valid and it can't find the src/main/webapp within which I've put WEB-INF/views/login.jspOn localhost:2017-01-17 23:50:15.406 DEBUG 11872 --- [           main] .t.TomcatEmbeddedServletContainerFactory : Code archive: /home/cillian/workspace/CogTracker/target/CogTracker-0.0.1-SNAPSHOT.jar2017-01-17 23:50:15.407 DEBUG 11872 --- [           main] .t.TomcatEmbeddedServletContainerFactory : Code archive: /home/cillian/workspace/CogTracker/target/CogTracker-0.0.1-SNAPSHOT.jar2017-01-17 23:50:15.407 DEBUG 11872 --- [           main] .t.TomcatEmbeddedServletContainerFactory : Document root: /home/cillian/workspace/CogTracker/src/main/webappOn AWS ElasticBeanstalk:2017-01-17 23:23:12.438 DEBUG 1065 --- [           main] .t.TomcatEmbeddedServletContainerFactory : Code archive: /var/app/current/application.jar2017-01-17 23:23:12.440 DEBUG 1065 --- [           main] .t.TomcatEmbeddedServletContainerFactory : Code archive: /var/app/current/application.jar2017-01-17 23:23:12.441 DEBUG 1065 --- [           main] .t.TomcatEmbeddedServletContainerFactory : None of the document roots [src/main/webapp, public, static] point to a directory and will be ignored.So the question is, does the upload to EB require the files to be in a different location? Does the ServletContext require a specific parameter to be able to find files on EB?For reference my WebApplicationInitializer classpublic class DispatcherServletInitializer implements WebApplicationInitializer {    @Override    public void onStartup(ServletContext servletContext) throws ServletException {        AnnotationConfigWebApplicationContext context = new AnnotationConfigWebApplicationContext();        context.scan("uk.ac");        servletContext.addListener(new ContextLoaderListener(context));        ServletRegistration.Dynamic dispatcher = servletContext.addServlet("dispatcher", new DispatcherServlet(context));        dispatcher.setLoadOnStartup(1);        dispatcher.addMapping("/");    }}and my WebMvcConfigurerAdapter:@Configuration@EnableWebMvcpublic class AppConfig extends WebMvcConfigurerAdapter {    @Override    public void configureDefaultServletHandling(DefaultServletHandlerConfigurer configurer){        configurer.enable();    }    @Override    public void addViewControllers(final ViewControllerRegistry registry){        super.addViewControllers(registry);        registry.addViewController("/login.html");        registry.addViewController("/welcome.html");    }    @Bean    public InternalResourceViewResolver viewResolver(){        final InternalResourceViewResolver resolver = new InternalResourceViewResolver();        resolver.setViewClass(JstlView.class);        resolver.setPrefix("/WEB-INF/views/");        resolver.setSuffix(".jsp");        return resolver;    }}FollowComment"

Answer: "0Hello,Thank you for reaching out,The actual deployment directory would be in the configuration and could be determined using :grep -i "app_deploy_dir" under under /opt/elasticbeanstalk/bin/ and if you are referencing files in the app, it would be required to refer to its path, depending upon the determined value you can fix the path in the code. Thereby resolve the 404 error.I hope the information helps. If the problem persists please feel free to reach out to me.Regards,Ashwin ACommentShareAWS-User-8591090answered 6 years ago0aHi,Sae here. I'm trying to deploy a war file generated from spring boot.I'm getting same issue and i am banging my head on my computer, my head is bleeding. Seriously this issue has wasted so much of timeI did the same steps however and i'm unable to find the exact issue.Please suggest. Hopefully i get some help from you guys . The application on localhost is working fine but when i deploy it on beam stalk. error shows upCommentShareMukianswered 5 years ago"


Question: AMAZON SIMPLE STORAGE SERVICE

How can we add cache control in AWS S3?FollowComment

Answer: "2Accepted AnswerDo you mean for each individual object?You would have to use something like this to add it to existing objects:aws s3 cp s3://<yourbucket>/ s3://<yourbucket>/ --recursive --metadata-directive REPLACE \--expires 2022-01-01T00:00:00Z --acl <your-acl> --cache-control max-age=2592000,publicReplace the place holders as necessary / needed. And that should be fine.When you put new object you need to ensure you set the metadata as well.See https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingMetadata.html for more information.CommentShareStewart Wallaceanswered 2 years ago"


Question: AWS Cert Manager: Additional Verification Required

"ACM requires additional information to process this certificate request. This happens as a fraud-protection measure if your domain ranks within the Alexa top 1000 websites. To provide the required information, use the Support Center to contact AWS Support. If you don't have a support plan, post a new thread in the ACM Discussion Forum.arn:aws:acm:us-east-1:811691864949:certificate/e7fc01d2-043f-4189-aabf-faf521db9fb7So what kind of information do I need to provide to issue the certificate?FollowComment"

Answer: "-2Hello,You can simply raise a support case and provide the ARN of the affected certificate.Let us know if you have any other questions.CommentShareNicholas Doropoulosanswered a year agoAWS-User-42015599 a year agoThanks for your reply, but I don't have a support plan and I am unable to create a technical support case. Does it require a support plan to validate the domain like this?Share"


Question: How to convert binary file to pandas dataframe

"I use Amazon Sagemaker for model training and prediction. I have a problem with the returned data with predictions. I am trying to convert prediction data to pandas dataframe format.After the model is deployed:from sagemaker.serializers import CSVSerializerxgb_predictor=estimator.deploy(initial_instance_count=1,instance_type='ml.g4dn.xlarge',serializer=CSVSerializer())I made a prediction on the test data:predictions=xgb_predictor.predict(first_day.to_numpy())But, returned prediction results are in a binary file. This is a sample returned predictions:b'2.092024326324463\n10.584211349487305\n18.23127555847168\n2.092024326324463How can I convert prediction data to pandas dataframe?FollowComment"

Answer: "0Hi!It looks like you have a bytes response, have a look at this post, this will help you with the transform to dataframe.Hope it helps :)CommentShareDani Manswered 10 months ago"


Question: server error and estimated grand billing total

"hello, I opened my aws account today, and I found a server on and looking in the invoices I have an estimated grand total of 613.84 USD . i hadn't logged into aws for two weeks and i'm sure i didn't leave the aws server on. but I'm 100% sure I turned it off. there must have been a mistake and I am not going to pay much in excess of what I would have spent on this mistake. is there any way to fix?FollowComment"

Answer: "0Hello,I'm sorry for any concern these unexpected charges may have caused.I think it would be best to reach out to our Support team in order for them to help identify the source of these charges. You can do so by creating a case through the Support Center, here:go.aws/support-center.Regards,- Craig M.CommentShareEXPERTAWS Support - Craiganswered 11 days ago"


Question: Source code for built in lua functions?

REMOVEDUPLOADWhere can I find the source for the built in functions i.e. the ones in the Class Reference of my screenshot?Follow

Answer: "0Accepted AnswerThose functions are exposed through C++, some may be using the new BehaviorContext already and some probably still use the AZ_SCRIPTABLE_EBUS.... macros.The easiest way to find those functions is to search for the relevant bus and then work your way through (though that works only partly since VisualStudio can't follow the references completely). The Project you're probably going to find the most of them in is called "LmbrCentral" inside the code solution.See the "Programming" section here: https://gamedev.amazon.com/forums/tutorials to get an idea on how to access the code solution.Also there is reference documentation on the functions here: http://docs.aws.amazon.com/lumberyard/latest/developerguide/lua-api.htmlTake note that the class reference shows functions of the new ComponentEntity system, while the file you opened is using the old entity system inherited from CRYENGINE. Specifically it looks like some sort of AI script which are different from the regular legacy entities... it's complicated, use ComponentEntities wherever you can :)Could you tell us which project you got that file from so people can assist better?SharerePost-User-0887237answered 6 years ago0There is no script.pak file anywhere in my Lumberyard directories? (I looked around for a bit and ran "$find -maxdepth 30 | grep script.pak" in /dev but still nothing).SharerePost-User-8222216answered 6 years ago0those are in cryengine script.pak of gamesdk projectunzip it use 7zipopen folder Script folder using babelua extension in vs2015 .then you will see the source code.SharerePost-User-9069667answered 6 years ago04801-scriptspak.zip|attachment (703 KB)scriptspak.ziphttps://aws.amazon.com/cn/lumberyard/downloads/CryEngine GameSDK projectrename scripts.pakSharerePost-User-9069667answered 6 years ago0Thanks! I wasn't talking about the specific file open in the screenshot, just the files on the left hand side. Also, yes, I'm confused about the difference between the old component entity system and the new one?It seems to be an odd time of Lumberyard -- they said they're taking out flowgraph, yet the sample game uses a lot of flow graph scripting.SharerePost-User-8222216answered 6 years ago"


Question: Help Enable CDN CloudFront on wordpress lightsail

"Hi everyoneI want to ask for your help, the first step is to enable cloudfront in wordpress.I just installed and migrated to the latest AWS account, I'm still a beginner, please help meRegardsTaufiq SFollowComment"

Answer: "1Accepted AnswerI would start by reading this article: https://aws.amazon.com/blogs/networking-and-content-delivery/accelerating-wordpress-with-cloudfront-using-the-aws-for-wordpress-plugin/.This blog shows the end-to-end process of self-hosting a WordPress site with Amazon Lightsail, installing the plugin, and using the  CloudFront workflow.CommentShareEXPERTalatechanswered 4 months ago1This documentation walks through a lot of the steps.Essentially you create your Cloudfront Distribution and point the origin to your LightSail instance.CommentShareCarlo Mencarellianswered 4 months ago0hello everyone actually I just want to activate the security header and h/2 on my wordpress account.is there any other way, other than to activate the free package.regardtaufiq sCommentShareTaufiqanswered 4 months ago"


Question: TypeError: 'JavaPackage' object is not callable - jvm.io.delta.tables.DeltaTable.isDeltaTable

"Hi,I finally got my pyspark code to mostly work using an EMR Serverless application, but according to the logs it seems like there is a particular problem with this line    if (DeltaTable.isDeltaTable(spark, targetDeltaTableURI)):The error message from the log is listed below, you can see at the top of the log the dataframes were created, but it errors out when I check if a the delta table exists|135123   |1670038    |13558561-12 |2018-03-19         |36.01    |2023-03-22 16:51:05.35525||668217   |1361372    |13563506-22 |2018-03-22         |27.19    |2023-03-22 16:51:05.35525|+---------+-----------+------------+-------------------+---------+-------------------------+only showing top 20 rowsTraceback (most recent call last):  File "/tmp/spark-9a694201-d321-475f-9855-7d4ada8da0e5/main.py", line 337, in <module>    main()  File "/tmp/spark-9a694201-d321-475f-9855-7d4ada8da0e5/main.py", line 135, in main    processRawData(spark, s3BucketName, objectName, schema, 'bmi')  File "/tmp/spark-9a694201-d321-475f-9855-7d4ada8da0e5/main.py", line 317, in processRawData    if (DeltaTable.isDeltaTable(spark, targetDeltaTableURI)):  File "/home/hadoop/environment/lib64/python3.7/site-packages/delta/tables.py", line 562, in isDeltaTable    return jvm.io.delta.tables.DeltaTable.isDeltaTable(jsparkSession, identifier)TypeError: 'JavaPackage' object is not callableHere is my submit commandaws emr-serverless start-job-run --profile 000000_SD \    --name nw_raw_data1 \    --application-id $APPLICATION_ID \    --execution-role-arn $JOB_ROLE_ARN \ --job-driver '{         "sparkSubmit": {             "entryPoint": "s3://'${S3_BUCKET}'/scripts/main.py",              "sparkSubmitParameters": "--jars s3://'${S3_BUCKET}'/scripts/pyspark_nw.tar.gz --py-files s3://'${S3_BUCKET}'/scripts/variables.ini --conf spark.driver.cores=1 --conf spark.driver.memory=2g --conf spark.executor.cores=4 --conf spark.executor.memory=4g --conf spark.executor.instances=2 --conf spark.archives=s3://'${S3_BUCKET}'/scripts/pyspark_nw.tar.gz#environment --conf spark.emr-serverless.driverEnv.PYSPARK_DRIVER_PYTHON=./environment/bin/python --conf spark.emr-serverless.driverEnv.PYSPARK_PYTHON=./environment/bin/python --conf spark.emr-serverless.executorEnv.PYSPARK_PYTHON=./environment/bin/python"         }     }' \    --configuration-overrides '{        "monitoringConfiguration": {            "s3MonitoringConfiguration": {                "logUri": "s3://'${S3_BUCKET}'/logs/"            }        }    }'And below are the pip packages used to build the Virtual Envboto3==1.26.74botocore==1.29.74delta-sparkfhir.resources==6.5.0pyspark==3.3.0Thanks for your helpFollowComment"

Answer: "2Accepted AnswerHi there - I think the last bit is getting the right --jars setting. The one you provided looks to be the packaged pyspark environment(?) and not the actual delta-core jar file.Depending on the version of EMR you're running, you have a few options.For EMR 6.9.0, Delta Lake 2.1.0 is included on the EMR Serverless image. If you're using the same version, you can specify spark.jars=/usr/share/aws/delta/lib/delta-core.jar,/usr/share/aws/delta/lib/delta-storage.jar as a --conf item in your sparkSubmitParameters. You may need to add additional items there too (like spark.sql.extensions) as mentioned in the quick start.Prior to EMR 6.9.0, you have to use the --packages flag to specify your Java dependencies or upload the delta-core jar to S3. You can find more details on that approach in the EMR Serverless docs on Delta Lake.If the version of Delta Lake you're using doesn't match what's installed on EMR Serverless, you can also use the --packages flag or upload the delta-core jar as mentioned above. The --packages flag would be part of the sparkSubmitParameters: --packages io.delta:delta-core_2.12:2.2.0.CommentSharedacortanswered 2 months agorePost-User-7280708 2 months agoThanks dacort.Now I ran into a new issueI tried the 1st and second options. Both give me this new error;:: retrieving :: org.apache.spark#spark-submit-parent-a8946b71-ba44-400b-b227-f7ffe4290c90confs: [default]4 artifacts copied, 0 already retrieved (3759kB/11ms)Exception in thread "main" org.apache.spark.SparkException: Failed to get main class in JAR with error 'null'.  Please specify one with --class.at org.apache.spark.deploy.SparkSubmit.error(SparkSubmit.scala:1023)at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:491)atSharedacort 2 months agoHm, that's odd - makes it seem like your entrypoint is a jar file. :\ What's your entire start-job-run command? Your jobDriver should look something like this:{    "sparkSubmit": {        "entryPoint": "s3://bucket/prefix/main.py",        "sparkSubmitParameters": "--conf spark.archives=s3://bucket/prefix/pyspark_deps.tar.gz#environment --conf spark.emr-serverless.driverEnv.PYSPARK_DRIVER_PYTHON=./environment/bin/python --conf spark.emr-serverless.driverEnv.PYSPARK_PYTHON=./environment/bin/python --conf spark.executorEnv.PYSPARK_PYTHON=./environment/bin/python --conf spark.jars=/usr/share/aws/delta/lib/delta-core.jar,/usr/share/aws/delta/lib/delta-storage.jar"    }}Share-1Hello,The error clearly indicates the  JAVA/JAR is not loaded inside the Python.In order to make delta lake work on pyspark, You must include required jars and python modules . for example your pythong code should have correct jar provided as below , for reference check [1] [2].config("spark.jars.packages", "XXXXXXXXXXX")[1] https://wind010.hashnode.dev/problem-with-pyspark-and-delta-lake-tables-unit-tests[2] https://github.com/JohnSnowLabs/spark-nlp/issues/232CommentSharepriyathamanswered 2 months ago"


Question: EMR Serverless application stuck in starting state

"Hello,today my EMR Serverless application suddenly decided to not start. It's staying in "Starting" state and won't reach "Started" state. Usually it starts in less than a minute, today I have waited for over 15 minutes with no change.I have tried creating a new application with default settings and it won't start either.There are no visible errors in AWS console... what might be the reason for this?FollowCommentnikos64 a month agoProblem happens in us-east-1 region, it is not reproducible in us-east-2 region.Share"

Answer: "0We are seeing a similar issue on our end. We haven't made any changes to our application config, etc.Our scheduler is still submitting jobs to the application but after some time, we get a:Application Artifact Response is empty for customerId: xxx and applicationId: xxxxPresumably this is due to the application staying in the "starting" state while jobs are being submitted.CommentShareukayanianswered a month agonikos64 a month agoIt seems to be working now...Shareukayani a month agoyup, it started working on its own. Would be good to have AWS acknowledge an outage for the service thoughShare"


Question: Lambda function failing with "cannot import name 'etree' from 'lxml' (/var/task/lxml/__init__.py)"

I'm creating a lambda function using a virtual env in Windows 10. I'm adding site-packages to a .zip archive and updating the lambda function.Currently this is failing with "cannot import name 'etree' from 'lxml' (/var/task/lxml/init.py)"My venv is using Python 3.8 as is the runtime environment in lambda. Some previous solutions suggest setting runtime on lambda to Python 3.6 but this is no longer an option. I've tried 3.7 and 3.9 but the problem persists. Other solutions on re:Post discuss docker containers rather than zip archives and linux environments rather than windows.FollowComment

Answer: "0Accepted AnswerI fixed this by spinning up an ec2 machine, creating a directory named python, using pip3 to install the libraries I needed, creating a .zip archive out of the python directory and uplodaing that .zip to s3. From there I could create a layer for aws lambda using the .zip archive.If you're running into similar problems it may be because you are using Mac OS or Windows to build libraries. Much better to use a Amazon AMI machine to ensure compatibility wiith Lambda.CommentShareOjaybeeanswered 8 months ago"