Question: Lightsail instance firewall rule for WSS

"I'm trying to set up a secure web socket connection to my lightsail instance, and I need help determining the correct firewall rule setting to use. As I have it now, my web client fails to connect.
I have a web socket listener running on my server:
(Log Output)
Server started
Listening on: 0.0.0.0:2000
Server's ip: 127.0.1.1
Server's host: ...
Client connected
My web page is trying to connect:
var socket=$.websocket('wss://[my_domain_name_here]:2000');
And besides the regular SSH, HTTP, and HTTPS firewall rules for my lightsail wordpress instance, I have added:
**ApplicationProtocolPort or range / CodeRestricted to**
CustomTCP2000  Any IPv4 address
Is this the correct firewall setting for this connection setup? The web page request hangs (pending) and then fails about 30 seconds later.FollowComment"

Answer: "0Hello, the firewall rule is correct. I think the issue is that you are trying to establish a secure websocket connection (wss://). Using ws:// should work. If you want a secured connection, you can setup a load balancer with a certificate and put it in front of your instance. The load balancer can be configured to send the request to the required port on the instance.https://www.reddit.com/r/aws/comments/p3pje9/using_aws_ec2_instance_as_a_websocket_server/Creating Lightsail load balancer and attaching instance: https://lightsail.aws.amazon.com/ls/docs/en_us/articles/create-lightsail-load-balancer-and-attach-lightsail-instances.Attaching SSL/TLS certificate to load balancer: https://lightsail.aws.amazon.com/ls/docs/en_us/articles/create-tls-ssl-certificate-and-attach-to-lightsail-load-balancer-https.CommentShareAWS-User-6091936answered 5 months agoPaul Sumares 5 months agoThanks, I will check it out.Share"


Question: Cloudformation + AWS Batch - stack-level tags -> EC2 tags

"When creating an AWS Batch stack with CloudFormation, I'd like to be able to set tags to all resources, to track costs related to the stack.I noticed that it's possible to set a stack-level tag with aws cloudformation deploy ... --tags tagName=tagValue, and that the tag is added to all resources that support it.That's great, but there seems to be one crucial one missing: the EC2 tags in the ComputeEnvironment configuration. It seems to me that it's a crucial one when it comes to costs derived from the use of an AWS Batch stack.Anyone has any idea how to do something like that, without going back to having to manually add tags within the template on all resources?FollowComment"

Answer: "0Hi, good question!One way to do so is to use the Tags property of the AWS::Batch::ComputeEnvironment resource.  Unfortunately, not all tags propogate by default at the Stack Level.One those tags are set at the Compoute Resource, it will tag the EC2 instances: https://docs.aws.amazon.com/batch/latest/APIReference/API_ComputeResource.html#Batch-Type-ComputeResource-tagsFor example, the AWS::Batch::JobDefinition resource will only propogate tags when the property, PropogateTags is set to true.  Same goes for an Autoscaling group with TagProperty.CommentSharejsoncanswered a year agoFabreLambeau a year agoSo, essentially, you are confirming that it's not possible to dynamically and meaningfully set tags on all significant resources, when deploying a Cloudformation stack. That's very sad, as it's going to make it significantly more complex to evaluate costs for my AWS Batch-based applications. If only because the tags on ComputeResource are in the format Name=Value (and not {Name=name, Value=value} as for tags on most resources), thereby not making it possible to have tag names defined via template parameters.AWS Batch and CFN teams, if you are reading, this is something you might want to improve on...Share"


Question: CNAMEAlreadyExists

I am trying to associate a CNAME record in my route53 hosted zone to a CloudFront distribution and am seeing this error message:com.amazonaws.services.cloudfront.model.CNAMEAlreadyExistsException: One or more of the CNAMEs you provided are already associated with a different resource. (Service: AmazonCloudFront; Status Code: 409; Error Code: CNAMEAlreadyExists; Request ID: 3349d478-c36e-45aa-a658-8e0b7ef76d01; Proxy: null)I have no other cloudfront distributions. Please advise.ThanksFollowComment

Answer: 0This has to do with attempting to use an S3 & Cloudfront deployment after using the amplify console kept failing at the build stage. Using python > 3.7 in lambdas caused a backend build error which was resolved using:https://github.com/aws-amplify/amplify-console/issues/595#issuecomment-761049327Erasing the S3 Cloudfront instances and erasing the custom domain from wihtin the amplify console then re-configuring it sorted out all the issues.The confusing part was an error message referencing the domain being associated with another cloudfront distribution when there was no other cloudfront distribution.CommentShareHICadminanswered 2 years ago


Question: "FileNotFoundError: [Errno 2] No such file or directory: '/opt/ml/input/data/training/train/data.csv'

"I want to run sagemaker and I adjusted my code according to the following example:step 3: https://docs.aws.amazon.com/sagemaker/latest/dg/ex1-preprocess-data.htmlandstep 4: https://docs.aws.amazon.com/sagemaker/latest/dg/ex1-train-model.htmlbut I can't finish the training. Sagemaker returns the following error:ErrorMessage "FileNotFoundError: [Errno 2] No such file or directory: '/opt/ml/input/data/training/train/data.csvTo upload data on s3, in my code I set the paths as follows:bucket = sagemaker_session.default_bucket()prefix = 'sagemaker_forecasting_ml'train_1d.to_csv('train_1d.csv', sep=',', index=False, header=False)boto3.Session().resource('s3').Bucket(bucket).Object(os.path.join(prefix, 'data/train_1d.csv')).upload_file('train_1d.csv')training_1d_s3_path = TrainingInput("s3://{}/{}/{}".format(bucket, prefix, "data/train.csv"), content_type="csv")Why sagemaker can't find a path when data is on it?FollowComment"

Answer: "1Hi! Looks like you are uploading a file called "train_1d.csv" and then requesting a file with a different name called "train.csv". Might this be the error? Hope it helps.CommentShareDani Manswered 10 months agoDani M 10 months agoHey, did this work for you? Remember to accept the answer if it has helped you (^_^)Share"


Question: Possible to experiment with AWS Deep Learning Containers on nonAWS machine?

"I'm excited about the prospects of experimenting with the recently announced preconfigured Deep Learning containers. I'd like to set things up on my local Docker server, in order to ensure I waste as little time as possible when I move to AWS for the GPU horsepower. Unfortunately, when I rundocker pull 763104351884.dkr.ecr.us-east-1.amazonaws.com/mxnet-inference:1.4.0-cpu-py36-ubuntu16.04on my local machine I getError response from daemon:  no basic auth credentials. Which credentials should I be using, and where should I set them?Edited by: ivar vasara on Mar 28, 2019 6:55 PMFollowComment"

Answer: "0Hi ivar vasara,You should be able to do pull the image to your local machine. AWS Deep Learning Container images are public and hosted on Amazon ECR - https://aws.amazon.com/ecr/faqs/. In order to securely access the repository, proper authentication from the Docker client to the repository is important. This can be done with a docker login command to authenticate to an ECR registry that provides an authorization token valid for 12 hours. If you’re using the AWS CLI, you can use a get-login command which retrieves the token, decodes it, and converts into a docker login command for you. You will need an AWS account and export/configue the credentials of an IAM user with Amazon ECR access to do this.See here for an example on how to login to the Amazon ECR repository where AWS Deep Learning Containers images are hosted: https://docs.aws.amazon.com/dlami/latest/devguide/deep-learning-containers-ec2-setup-prerequisites.htmlRead more about authenticating Amazon ECR repositories here: https://aws.amazon.com/blogs/compute/authenticating-amazon-ecr-repositories-for-docker-cli-with-credential-helper/AWS docs on ECR registry authentication docs: https://docs.aws.amazon.com/AmazonECR/latest/userguide/Registries.html#registry_authLet us know if you have more questions.ThanksCommentShareAWS-User-9540326answered 4 years ago0Hi  ivar vasara,Let us know if you have additional questions. You can also find support on the DL Containers forum here: https://forums.aws.amazon.com/forum.jspa?forumID=341Best,AdityaCommentShareAWS-User-7300759answered 4 years ago"


Question: Recognition of German invoices

"I'm in the process of recognizing the Textract for German invoices. The result was very bad. out of 20 invoices, none of the fields were recognized.Is there a way to training data?FollowComment"

Answer: "0Hello,Thanks for using Textract.Can you provide the name of the API you are using?Based on the FAQs (https://aws.amazon.com/textract/faqs/) , Textract supports receipts and invoices processing only for English.Make sure your document uses a language supported by Amazon Textract (currently English, Spanish, Italian, Portuguese, French and German; handwriting, invoices and receipts processing for English only).CommentShareAWS-User-4284296answered a year ago"


Question: AWS Transit Gateway using multiple site VPN connections to a single VPC

"I'm using multiple remote (end-user) sites with private networks across the globe. Each private network might have conflicting CIDR ranges (since they're owned by seperate entities) because they aren’t connected today with each other. Each private network has a public IP bearing firewall. If I want connect them to AWS Transit Gateway using multiple VPCs in AWS, would this architecture cause any scalibility issues (other than the 5,000 limit of transit gateway)? Are there any other design patterns that I can leverage for this scenario?FollowComment"

Answer: "0Accepted AnswerIf you connect to VPN using the provider's TGW, an IP clash can occur.If the connections are TCP-based and only initiated in one way, then consider using AWS PrivateLink. With AWS PrivateLink, IP overlap issues are removed, because you can either VPN into a dedicated VPC with AWS PrivateLink, or you can provision your own private link. For more information, see the Private Access to Saas Applications section in this whitepaper, or review this YouTube video.CommentShareSev_Ganswered 4 years ago"


Question: I accidentally rewrote RDS table with a blank table. There is no snapshot.

"Today while trying to access my table through API, I accidentally ran the initialization function, which rewrote my data table with a blank one. We have not set up automatic backups nor taken a snapshot of the table as of yet. I found the event in the event stream, and I am wondering if there is any way that we can recover the data from the table. It happened 20 minutes ago, and we have been trying to figure out a way.FollowCommentFarzana Rahman 4 months agoBy default RDS kept automated backup. If you don't retention set time to 0, then there will have an whole database instance backup in s3. Please see this link: https://aws.amazon.com/rds/features/backup/Share"

Answer: "1Unfortunatelly, you can not recover it without snapshots. If you had enabled automated snapshots, you would have used "Restore to point in time" feature, but it creates a new RDS instance. In case of using AWS Aurora, you could enable a "Backtrack" that lets you quickly rewind the DB cluster to a specific point in time, without having to create another DB cluster.CommentShareOleksii Bebychanswered 4 months ago"


Question: "CDK vs CloudFormation: is the latter somehow deprecated, in favour of the the newer? Or do they cover different use cases?"

"I've come across different tools explaining how to migrate from a CloudFormation template to CDK - I seem to understand CDK comes with more features, hence the question: when starting from scratch, is it always worth using CDK? Or are the 2 tools covering different use-cases?If someone needs to start now, is it still worth using CloudFormation, or could a newbie go straight to CDK?ThanksFollowComment"

Answer: "1If anything, CDK is making CloudFormation even more so required: CDK generates the templates that are then used to deploy your resources in AWS via CloudFormation, not instead of using CloudFormation.Now, is it always worth using it ? I do not think so at all. CDK fits some needs, but why spend the time and effort into writing a script in CDK that should really just be a simpler template?Plus, again that's just my opinion, using CDK also takes away some of the key functionalities that make CFN so great. You might end up feeling like you have to "hardcode" values into your templates, which could just have been a parameter, a mapping, or have in code conditions that will only work for a narrow case but a CFN Conditon would have done just fine.Seen plenty of CDK generated stuff where the template becomes un-reusable in different accounts, regions, partitions and so on. And that's a damn shame considering that CFN is here to allow taking one template, and it will work, anywhere in AWS.I much prefer Troposphere to CDK too. At least in Python. Troposphere in version 4+ generates his code from the AWS CloudFormation specifications, and the property names are a 1:1 match to the documentation, whereas in CDK so many resources have their properties renamed.As for CDK doing lookup of existing resources, nothing you could not do with the APIs anyways, and again, often, that's a hardcode.CommentShareJohnPrestonanswered a year agotux 7 months agoGood answer! In my opinion, Terraform and CloudFormation are most easy and beautiful!!!Share1It depends on your preference. If you are comfortable writing Infrastructure as Code in YAML (or JSON), then you should use Cloudformation.If you are comfortable writing code in a programming language like Java, Python, Javascript, Go etc. then CDK is the tool you may want to use. You should take a look at the CDK FAQs to better understand all the capabilities that CDK offers - https://aws.amazon.com/cdk/faqsIf my answer resolves your question, please upvote and accept my answer. ThanksCommentShareEXPERTIndranil Banerjee AWSanswered a year ago"


Question: Architectural Guidance on data processing use case

""For a Food procuring company which will procure thousands of products from farmers each product having a UPC(Unique Product Code) that are listed in an excel sheet with 500000 records and this sheet has to be read and sent to third party databases outside AWS through API Gateway however those databases can only process one record at a time(this is the limitation of those 3 external databases) and will return metadata of a product for each individual UPC as we do not know which database that product can be found so 3 calls has to be made for one UPC and likewise 500000*3 calls(only one call at a time and NOT batch processing) and store the metadata in DynamoDB and then we need to be able to query and display the product UPC with metadata in a dashboard for a BusinessAnalyst to easily refresh or query the product metadata details in a dashboard.All AWS Services must be accessibel only through Intranet using a VPN connection.Please let us know what would be the efficient architecture for this use case with all the services, protocols and implementation details."FollowComment"


Question: AWS SDK Documentation is a mess

"I am busy doing an implementation of Cognito and am wanting to use the aws-sdk for node.js. From the aws console I make my way to the node.js web app page and it takes me to the developer guide. Clicking on the CognitoIdentityClient hyperlink on the first page takes me to a "Looking for Something?" page because that link does not exist. That means that most of the developer guide is out of date. Some of the links to the API docs take me to the old API docs, some to the new. Once I finally find the "AWS SDK for JavaScript v3" I then click on @aws-sdk/cognito-identity which I have used before in this project. That takes me into a loop of the page endlessly reloading. The same happens with @aws-sdk/cognito-identity-provider. I eventually find @aws-sdk/credential-providers and that takes me to a completely different site (npmjs.com) for the docs for that. I guess my question is "How is a developer supposed to navigate the docs if the docs are not up to date and are not intuitive?".FollowComment"

Answer: "0For the full documentation for AWS SDK for JavaScript v3 you should use https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/.When needing to find document, you should use https://docs.aws.amazon.com/ to find the latest documentation for AWS services, SDKs, Toolsets, etc.If you do find an issue, please post the URL and issue so we can work at fixing the problem.CommentSharematthew_danswered 2 months agorePost-User-9050106 2 months agoThe issues with @aws-sdk/cognito-client and @aws-sdk/client-cognito-identity-provider seem to be fixed. So has the CognitoIdentityClient in https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/getting-started-browser.html. It would be helpful if there was a lambda function for linking accounts provided in the same way that the user migration lambda is provided. Specifically, if a user signs in with a federated identity first I want to create a normal user and link them.Share"


Question: Handle errors in lambda hapening on the init phase

"Hi team,I have set the connection opening code for my Redis cluster outside the event handler code in the lambda,I would like to handle any (Redis connection) error(happening outside the lambda handler function) like I handle any other error happening inside the lambda handler code.so that the lambda doesn't fail and the caller did not get InternalServerError but gets a proper response (StatusCode, errorCode, message...).I added in the Redis connection code the error catch/ handling (on the init phase outside the handler function):return {    statusCode:"500",    headers: {      "Content-Type": "application/json",      "Access-Control-Allow-Origin": "*",    },    body: JSON.stringify(MyresponseErrorObject),  };but lambda still fails and I did not get that error response object I set on the catch part.is there a way to return a response back when any error happens on the init phase of lambdaand make lambda not fail but return the error object?FollowComment"

Answer: "0Take a look at the Example app.py in this tutorial - https://docs.aws.amazon.com/lambda/latest/dg/services-rds-tutorial.html for sample code in Python.This example is specific to RDS, but you will need to apply the same principle to Redis.Note how a sys.exit() is called if the connection code results in an exception. It makes no sense to keep the lambda instance alive if the connection could not even be established. Then that particular lambda instance will keep receiving new events and they will all fail. It is better to start a new lambda instance with a new event, just in case it is able to establish the connection and process new events.CommentShareEXPERTIndranil Banerjee AWSanswered 7 months agoJess 7 months agoThank you for your answer,my code is in nodeJs not in python, so I did  process.exit(); instead of sys.exit() but the lambda still fail and no custom error returnedShare"


Question: AWS S3: Delete a file x days after last modification

"I'm struggling with the following use case in AWS S3 and life cycle rules:In my application, a user can ask for file deletion.When it does i want to keep the file 90 days and then delete it.I don't want to delete the file 90 days after the date it was created (uploaded)For example:I have a life cycle rule in my bucket that will expires files with tag "to_delete" 90 days after creation date.I upload file for the first time in bucket: last modified date is today (creation date), let's say D1.In 3 days i edit the file, i add the "to_delete" tag: last modified date is D1 + 3 days, let's say D3.Will the life cycle rule apply 90 days from today (D1) or from today + 3 days (D3) ?FollowCommentrePost-User-2738569 10 months agoHave you enabled versioning? And is the modified object name going to remain the same?SharerePost-User-0697681 10 months agoNo bucket versioning is not enabled and yes the modified object will still have the same nameShare"

Answer: "0Hello,I understand you have a question about S3 lifecycle policies.According to the S3 Lifecycle Policy documentation on AWS Docs [1], you can use Expiration actions. These actions define when objects expire. Amazon S3 deletes expired objects on your behalf asynchronously. With S3 Lifecycle configuration rules, you can tell Amazon S3 to transition objects to less-expensive storage classes, or archive or delete them. However, this alone does not solve your problem since, as you said, policies only allow you to delete objects from its creation date.Per rePost-User-2738569, this is where versioning comes in. If you set a lifecycle policy with bucket versioning enabled, every time a user changes an object, the object gets a new "version id". This becomes the newest version of the object and the main one that the user will see. You can set the number of days for when a object becomes noncurrent, and the number of newer versions to retain. That way, even though a number of objects are noncurrent, only the number of objects you specify will be retained.Thus, you can set the number of days for expiration to be 90. You can set final deletion for 90 days this way as well.CommentShareJoshua_Banswered 10 months agorePost-User-0697681 10 months agoBut the file will never be versioned, it's uploaded and then deleted but nothing happens between this two events. If versioning is enabled i will always have one version (current version) so if delete the file the problem remain the same ?Share0How about i add a to_delete tag and a to_delete metadata when the user wants to deletes the file. If my understanding is correct, if  a file metadata is added aws creates a copy of the file which would resolves the problem of the creation date ?CommentSharerePost-User-0697681answered 10 months ago"


Question: Customizing the Keypoint Template

"I've gone through the whole process and have successfully created and received results for an image landmarking task using the crowd-keypoint element and template.  However, looking at my results, there are things I'd like to restrict to guarantee cleaner data:I'd like to make every keypoint label required (i.e. task cannot be submitted if a label is missing)I'd like to make every keypoint restricted to one instance (right now, task can be submitted with multiple instances of the same label and I only need one very specific point landmarked for each label); ideally a new placement of a point removes the old instance or gives an error messageDoes anyone know if it is possible and how to do these types of restrictions with the Keypoint Template?Edited by: MaimoOKF on Jul 30, 2019 2:46 PMEdited by: MaimoOKF on Jul 30, 2019 2:47 PMFollowComment"

Answer:
"0Accepted AnswerHello,This should suit your use case. On submit, it validates that each label was used once and only once.Here's a working JSFiddle for you to demo it https://jsfiddle.net/01jpzs2n/<crowd-form>

     <crowd-keypoint    src="https://s3.amazonaws.com/cv-demo-images/ken-griffey-jr.jpg"    labels="['Item A', 'Item B', 'Item C']"            header="Please locate the centers of each item."    name="annotatedResult">    <short-instructions>      Describe your task briefly here and give examples    </short-instructions>    <full-instructions>      Give additional instructions and good/bad examples here    </full-instructions>     </crowd-keypoint></crowd-form>Please let us know if you have any additional questions.Thank you,SamCommentShareAWS-User-6870314answered 4 years ago0Tried this out in the sandbox, and it looks great.Thanks, Sam.  You are always posting awesome replies.CommentShareMaimoOKFanswered 4 years ago0You're welcome. Always happy to help.SamCommentShareAWS-User-6870314answered 4 years ago0Hello,I have a similar question. I have been trying to combine the Keypoint Crowd HTML Element with the bouding box one.  My goal is to have a keypoint that has an additional resource: a bounding box.  (I guess a more general question here would be: how to merge or combine Crowd HTML Elements?)   Thank you and have a wonderful day!CommentSharefeliottanswered 4 years ago0Hello,Unfortunately there currently is not a way to have the worker draw keypoints and bounding boxes at the same time on the same image.You could post two separate tasks for this.Or, you could use our polygon template (select Polygon on https://requester.mturk.com/create/projects/new). In this use case the worker draws connected keypoints, which form a closed polygon.Would this help?Additional documentation:https://docs.aws.amazon.com/sagemaker/latest/dg/sms-ui-template-crowd-polygon.htmlThank youSamCommentShareAWS-User-6870314answered 4 years ago"


Question: Delivery errors sending to amazon workmail

"Hello. We have a problem with Amazon Workmail.I can send an email to our account, the message will be received, but I as a sender receive a Non-delivery message with a errorContent-Type: message/delivery-statusContent-Transfer-Encoding: 7bitContent-Description: Delivery Status NotificationReporting-MTA: dns; inbound-smtp.us-east-1.amazonaws.comArrival-Date: Thu, 01 Sep 22 12:30:43 UTCAction: failedFinal-Recipient: rfc822; customerservice@domain.comOriginal-Recipient: rfc822; customerservice@domain.comDiagnostic-Code: smtp; 451 4.3.0 This message could not be delivered due to a recipient error. Please try again later.Status: 4.3.0This happens when I send from gmail account to amazon workmail. All other senders (protonmail, for example) works fine.FollowComment"

Answer: "0Hi,I'm sorry to hear you're experiencing problems receiving mail. I checked with the service team but your account seems to be configured correctly and they do not see any problems that would cause that bounce.Is there anything specific about that sender or mail that you can pass, this can help the service team investigate this.Kind regards,Robinps. I replace the domain from your message.CommentShareMODERATORrobinkawsanswered 9 months ago"


Question: MySQL upgrade to version 8.0.17

"I've been struggling with the bug #92976 for the past 4-5 months.Today MYSQL relased version 8.0.17 which fixes said bug. Does anyone know if there will be an upgrade to MYSQL 8.0.17? I really need it!Edited by: FernandoSedano on Jul 26, 2019 9:18 AMFollowComment"

Answer: "0Same here, the bug for me is using JSON tables inside a function that was fixed in 8.0.17.  Really need this as it speeds up my SQL by 20%CommentSharejpleveneanswered 4 years ago0+1 need json_table fixesCommentShareaaronmvanswered 4 years ago0Hello,I understand that you want to know when RDS MySQL 8.0.17 version will be available.As you might be aware, Amazon RDS currently supports the following minor versions for MySQL 8.0, and MySQL 8.0.16 is the latest one for RDS MySQL 8.0 at present.8.0.168.0.158.0.138.0.11I would like to inform you that MySQL 8.0.17 is in the roadmap for RDS MySQL. At this point, there is no ETA as when RDS MySql version 8.0.17.Also as mentioned in the RDS FAQ's: https://aws.amazon.com/rds/faqs/Does Amazon RDS provide guidelines for support of new DB engine versions?Over time, Amazon RDS adds support for new major and minor database engine versions. The number of new versions supported will vary based on the frequency and content of releases and patches from the engine’s vendor or development organization, and the outcome of a thorough vetting of these releases and patches by our database engineering team. However, as a general guidance, we aim to support new engine versions within 5 months of their general availability.I would like recommend you to consider keeping an eye on the below links and for announcements about new features and improvements to RDS and other AWS services that might be of interest to you.[+] https://aws.amazon.com/new/[+] https://aws.amazon.com/blogs/database/[+] https://aws.amazon.com/about-aws/whats-new/database/[+] https://aws.amazon.com/releasenotes/I hope this helps.Thank You.Ashika.CommentShareAshikaAWSanswered 4 years ago"


Question: Getting Access Denied when trying to access my website

Hey all.  I'm very much a novice so please bear with me.  I have recently set up a custom domain and a static website from a s3 bucket.  Everything was working well.  I have attempted to get an SSL cert and have gotten everything set up with the cert.  I have public access to my bucket and I'm pretty sure I have all of my routes correct but I keep getting this error when trying to load the site.  It seems like it's treating my index.html as XML?  This is just listing my file tree in the bucket.This XML file does not appear to have any style information associated with it. The document tree is shown below.<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>arosedesign.me</Name><Prefix/><Marker/><MaxKeys>1000</MaxKeys><IsTruncated>false</IsTruncated><Contents><Key>.gitattributes</Key><LastModified>2020-04-29T16:27:31.000Z</LastModified><ETag>"dcb240655dcbf79b8706d11c8c2a169c"</ETag><Size>68</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>.vscode/settings.json</Key><LastModified>2020-04-29T16:27:31.000Z</LastModified><ETag>"19751b2a32e46d1ba1477f357123a898"</ETag><Size>42</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>README.md</Key><LastModified>2020-04-29T16:27:31.000Z</LastModified><ETag>"3ed9f715ca05b78aceb5705a682af4dd"</ETag><Size>157</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>css/styles.css</Key><LastModified>2020-04-29T16:27:31.000Z</LastModified><ETag>"819f2e7d555f28282eb54de12d06f5ab"</ETag><Size>5270</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>index.html</Key><LastModified>2020-04-29T16:27:31.000Z</LastModified><ETag>"6dafa06451362443dab57e5780c626cb"</ETag><Size>3211</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>pics/ABC.jpg</Key><LastModified>2020-04-29T16:27:33.000Z</LastModified><ETag>"97f4e0eb867ba688071c56456c749908"</ETag><Size>605156</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>pics/beer.jpg</Key><LastModified>2020-04-29T16:27:32.000Z</LastModified><ETag>"102506cb7f94ed55008f225c450d5e24"</ETag><Size>160001</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>pics/chargoLogo1.jpg</Key><LastModified>2020-04-29T16:27:32.000Z</LastModified><ETag>"ddf16827a8f70e12c244df914c231dec"</ETag><Size>259460</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>pics/flowers.jpg</Key><LastModified>2020-04-29T16:27:32.000Z</LastModified><ETag>"17019fb045663b188a7cfce0c3e286d9"</ETag><Size>157952</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>pics/leaf.jpg</Key><LastModified>2020-04-29T16:27:33.000Z</LastModified><ETag>"548a9f5e5318aed8e592f57fcd1ec0a7"</ETag><Size>118779</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>pics/manAndDaughter.jpg</Key><LastModified>2020-04-29T16:27:33.000Z</LastModified><ETag>"a795a8718715761bc175a5989e7139b1"</ETag><Size>82798</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>pics/succulents.jpg</Key><LastModified>2020-04-29T16:27:33.000Z</LastModified><ETag>"70dfad57c2d95152c7064dc64b0b2f68"</ETag><Size>229634</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>pics/wine.jpg</Key><LastModified>2020-04-29T16:27:33.000Z</LastModified><ETag>"50a24752b35fb2a6053c0af910d8252e"</ETag><Size>71196</Size><StorageClass>STANDARD</StorageClass></Contents><Contents><Key>workspace/Portfolio Home Page.code-workspace</Key><LastModified>2020-04-29T16:27:33.000Z</LastModified><ETag>"28e6c7462fb8ab91cc2dde6256ae17be"</ETag><Size>67</Size><StorageClass>STANDARD</StorageClass></Contents></ListBucketResult>I'm not sure what information you need from me to further help me but I would appreciate someone walking me through this.  Thank you in advance!FollowComment

Answer: 0SOLVED!  I did not set my default root object (index.html) in my cloudfront distribution for my bucket.CommentSharephilisanswered 3 years ago


Question: WAF Setting CVE-2021-44228

"Dear AWS,thank you for reacting so quickliy to mitigate CVE-2021-44228. We have enabled AWS WAF for our workloads but see some room for improvement:check all headersIt looks as if the WAF filteres nicely all strings that might result in an JNDI call. But it looks as if not every header is checked. So we see 'x-forward-for' or 'http_user_agent' headers in our logs that contain malicious data without being blocked (they have Status Code 200 instead of 403). Examples: ;-) are not possible due to the AWS WAF.suppress malicious contentEven if the WAF works nicely and blocks the malicious content, an entry is written to the logs. So a unpatched system reading this log will be bitten by the vulnerability. In our case it is the AWS Opensearch and we should be fine. But the possibility to have something like "don't log blocked requests" might be an idea for improvement. Doing so on the AWS side would help people to really "don't even get in contact" with malicious content.Just my 2 cents ;-)Warm regards from Munich!ThorstenFollowCommenthameedullah a year agoThank you for the feedback. It would be better if you post the feedback as per following document. https://aws.amazon.com/premiumsupport/knowledge-center/send-feedback-aws/re:Post is question and answer forum.Share"

Answer: "0Hi Thorsten,thank you for the feedback. We continue to iterate the AWSManagedRulesKnownBadInputsRuleSet Rule Group as we learn more. To receive automatic updates to the AWSManagedRulesKnownBadInputsRuleSet, please choose the default version - see https://aws.amazon.com/security/security-bulletins/AWS-2021-006/ for the latest updates.Re the log filtering, you can add filtering to specify which web requests are kept in the logs and which are dropped. You can filter on the rule action and on the web request labels that were applied during the request evaluation. You can use the awswaf:managed:aws:known-bad-inputs:Log4JRCE label as log filter. See https://docs.aws.amazon.com/waf/latest/developerguide/logging-management.html and https://docs.aws.amazon.com/waf/latest/developerguide/aws-managed-rule-groups-baseline.html#aws-managed-rule-groups-baseline-known-bad-inputs for additional details.CommentShareEXPERTLuca_Ianswered a year ago"


Question: Automate creation of AWS support case

"Hello,I want to automate whole things as described below:-If any resources get down or anything happens to resources(Eg:- High CPU Utilization, Memory Utilization) then a support case needs to be created automatically.FollowComment"

Answer: "0I believe this is possible since AWS Support has an API of its own.[1]References:[1] Programming an AWS Support case - https://docs.aws.amazon.com/awssupport/latest/user/Case_Life_Cycle.htmlCommentShareTimothy_Manswered a year agoShubham a year agoThanks for the quick response. I have seen it but there we have to enter some of the things manually.For Eg:- I want that if an EC2 Instance is above Cpu Utilization limit then CloudWatch trigger AWS lambda function and we have some function which will create AWS support case automatically.. no need to enter manually anything.ShareShivam_G a year agoYes, that's the correct way to go about it with an event triggering a Lambda function. Can you provide more context around what information it is asking for manually? Secondly, is there a specific use case you are trying to resolve? eg. It would be a good to create a support case for when something goes does, but not necessarily high usage which could be due to workload and would need initial troubleshooting.ShareShubham a year agoHello @Shivam_G, My use-case is that if any AWS resource misbehaves (eg:- Not working as expected) then there should be a trigger or something which can auto-generate an AWS support case..Share0Hi,I understand that you want to create an automated case creation when the resources reaches a certain limit. You can follow the below steps to configure:  Create a cloudwatch alarm for a metric [1]  Trigger a lambda function  Configure lambda with this API - https://docs.aws.amazon.com/awssupport/latest/APIReference/API_CreateCase.htmlSupports all of these:  AWS Command Line Interface  AWS SDK for .NET  AWS SDK for C++  AWS SDK for Go  AWS SDK for Java V2  AWS SDK for JavaScript  AWS SDK for PHP V3  AWS SDK for Python  AWS SDK for Ruby V3I hope this helpsResources:-[1] https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/US_AlarmAtThresholdEC2.htmlCommentShareAsisiphoanswered a year agoShubham a year agoThanks for the help mate! I will go through this and will try to create one.Share"


Question: Lambda Handler No Space On Device Error

"Have a lambda function that is throwing an error of "No space left on device".   The lambda function creates a custom resource handler defined within the lambda python code:response = cfn.register_type(Type='RESOURCE',TypeName='AWSQS:MYCUSTOM::Manager',SchemaHandlerPackage="s3://xxx/yyy/awsqs-mycustom-manager.zip",LoggingConfig={"LogRoleArn": "xxx", "LogGroupName": "awsqs-mycustom-manager-logs"},ExecutionRoleArn="xxx"The lambda function when created has the following limits set:  4GB of Memory and 4GB of Ephemeral space.However, I was still receiving a no space on device even thought the '/tmp/' is specified and this is plenty of space. Doing additional digging I added a "df" output inside of the code/zip file.  When the output prints is shows that only 512MB of space is available in temp?Filesystem                                                          1K-blocks     Used Available Use% Mounted on/mnt/root-rw/opt/amazon/asc/worker/tasks/rtfs/python3.7-amzn-201803  27190048 22513108   3293604  88% //dev/vdb                                                              1490800    14096   1460320   1% /dev/dev/vdd                                                               538424      872    525716   1% /tmp/dev/root                                                            10190100   552472   9621244   6% /var/rapid/dev/vdc                                                                37120    37120         0 100% /var/taskIts like a new instance was created internally and did not adopt the size from the parent.  Forgive me if technically my language is incorrect as this is the first time busting this out and seeing this type of error.Just has me confused as too what is going on under the covers, and I can find no documentation on how to increase the ephemeral storage within the handler even though the originating lamda function in which this is defined has already had the limits increased.FollowComment"

Answer: "0Does it happen on each invocation or only after a few of them? the /tmp remains between invocations in the same sandbox. If it happens in each invocation, need to further investigate. If it only happens after a few invocations, make sure to delete the files that were created in the previous invocations.BTW, I tried df and it worked just fine:Filesystem                          1K-blocks    Used Available Use% Mounted on/dev/vdd                             4130944   17736   4096824   1% /tmpMaybe there is something wrong in the way you configured it?CommentShareEXPERTUrianswered a year agorePost-User-7422686 a year agoit happens each and every time.  The invocation of a DF in the originating lambda shows exactly as you have described, yet when the code is invoked inside of the handler it shows a different space size for /tmp.  That is what is throwing me off.  Like its a new boto instance created within the lambda handler.  Again forgive me if my technical language is a challenge.ShareUri EXPERTa year agoWhat is your function doing? Can you share the code?ShareUri EXPERTa year agoWhat do you mean by "originating lambda"? How many functions do you have?SharerePost-User-7422686 a year agoI have a few functions but when I modify the original lamda code with the following:def register(cfn):response = cfn.register_type( Type='RESOURCE', TypeName='AWSQS:MYCUSTOM::Manager', SchemaHandlerPackage="s3://xxx/yyy/awsqs-mycustom-manager.zip", LoggingConfig={"LogRoleArn": "xxx", "LogGroupName": "awsqs-mycustom-manager-logs"}, ExecutionRoleArn="xxx")dfout = os.popen('df')print( dfout.read())I can view the cloudwatch logs and see the output for the lambda:/mnt/root-rw/opt/amazon/asc/worker/tasks/rtfs/python3.7-amzn-201803   8351792 6720731   1626965  81% //dev/vdd                                                              4229728   18152   4195192   1% /tmpWhich is 4GB and good.However, when the awsqs-mycustom-manager.zip is updated with the exact same debug:Filesystem                                                          1K-blocks    Used Available Use% Mounted on/mnt/root-rw/opt/amazon/asc/worker/tasks/rtfs/python3.7-amzn-201803   8351792 6720731   1626965  81% //dev/vdb                                                              1490800   14092   1460324   1% /dev/dev/vdd                                                               538424     876    525712   1% /tmp/dev/root                                                            10190100  552464   9621252   6% /var/rapid/dev/vdc                                                                37120   37120         0 100% /var/taskreturns 512MB ...ShareUri EXPERTa year agoIf I understand correctly,  awsqs-mycustom-manager is a new function. As a new function you need to change its configuration as well. It does not inherit the configuration from this function.Share"


Question: Amazon Polly changes intonation during playing audio.

"Hello,Amazon Polly changes intonation during playing audio.Step to reproduce:Open https://us-west-2.console.aws.amazon.com/polly/home/SynthesizeSpeech?region=us-west-2#Choose voice Matthew, MaleTurn on SSMLTry to play this:<speak>"Hold it up to the light."I did so, and saw a large "E" with a small "g," a "P," and a large "G" with a small "t" woven into the texture of the paper. "What do you make of that?"</speak>You can hear that second sentence playing with different intonation. This issue is related to each voice from the list of voices.If you remove from the second sentence "g," a "P," then intonation does not change.Thanks.FollowComment"

Answer: "0Have you used prosody tag [1] ?It is something that is recommended to control the Volume, Speaking Rate, and Pitch. I believe you can use the prosody tag with the right attribute to set the pitch (Value) on here.For example:pitchdefault: Resets pitch to the default level for the current voice.x-low, low, medium, high, x-high: Sets the pitch to a predefined value for the current voice.+n% or -n%: Adjusts pitch by a relative percentage. For example, a value of +0% means no baseline pitch change, +5% gives a little higher baseline pitch, and -5% results in a little lower baseline pitch.You can try the above variations and check if you are able to get the intonation desired.Regarding checking the audio in the account. I do not believe anyone will have the permission to view the same, except if you can open the case with AWS Support.Link- https://docs.aws.amazon.com/polly/latest/dg/supportedtags.html#prosody-tag -- [1]CommentShareSUPPORT ENGINEERAWS-User-Chiraganswered 9 months ago"


Question: Stop all resources

"I do not want pay anything because I do not use AWS resources.If there are any avaialble resources, please stop and cancel all resources.I was just tying to create my account only for the styding.For sure, I have not been using any service in AWS.Finally, please check again whether there is any resources or services relevant any payment.Thank you.FollowComment"

Answer: "0I do not want pay anything because I do not use AWS resources.If there are any avaialble resources, please stop and cancel all resources.I was just tying to create my account only for the styding.For sure, I have not been using any service in AWS.Finally, please check again whether there is any resources or services relevant any payment.Thank you.CommentShareAWS-User-9139521answered a year ago0Hey, you might wanna use Cloud Nuke, an open source tool by Gruntwork [1]You can install this in AWS Cloudshell (a browser-based CLI right from AWS Management Console) [2] and do the cleanupCloud nuke basically crawl and remove all AWS resources in the given account.Please note there are no turning back, and Cloud Nuke is VERY destructive, make sure you really want to clean the account up.[1] - https://github.com/gruntwork-io/cloud-nuke[2] - https://aws.amazon.com/cloudshell/CommentSharewijayahanswered a year ago"


Question: EC2 instance is very slow

Hi ExpertsWe launched our mobile app recently .our EC2 Performance is very poor . please help us how to improve mobile app performance.Please see below detailsInstance typet2.xlargeEnabled Regions.17 Regions.Subnets60 in 17 Regionsinstances12 in 3 RegionsSecurity groups33 in 17 RegionsVPCs20 in 17 RegionsVolumes12 in 3 RegionsFollowComment

Answer: 0We would need a lot more information to be able to tell what's going on here.What exactly is "slow"?What does your CPU metrics look like?Do you have enough memory available on the EC2 server?Is it a networking issue causing the slowness?  Can you ping the server and get a decent response time?CommentSharekyageranswered 7 months ago


Question: EKS Node Not Ready

"I have EKS cluster with 4 t.3large which has approx ~50 pods(small size). Often whenever I tried to update the application version from x to y and then few nodes goes into not ready state.Then I have to clean few resources and reboot the worker node and then situation back to normal.Any suggestions ?Logs from kube-proxyI0927 16:12:05.785853       1 proxier.go:790] "SyncProxyRules complete" elapsed="104.231873ms"I0927 16:18:27.078985       1 trace.go:205] Trace[1094698301]: "iptables ChainExists" (27-Sep-2022 16:16:36.489) (total time: 66869ms):Trace[1094698301]: [1m6.869976178s] [1m6.869976178s] ENDI0927 16:18:27.087821       1 trace.go:205] Trace[1957650533]: "iptables ChainExists" (27-Sep-2022 16:16:36.466) (total time: 67555ms):Trace[1957650533]: [1m7.555663612s] [1m7.555663612s] ENDI0927 16:18:27.124923       1 trace.go:205] Trace[460012371]: "DeltaFIFO Pop Process" ID:monitoring/prometheus-prometheus-node-exporter-gslfb,Depth:36,Reason:slow event handlers blocking the queue (27-Sep-2022 16:18:26.836) (total time: 186ms):Trace[460012371]: [186.190275ms] [186.190275ms] ENDW0927 16:18:27.248231       1 reflector.go:442] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeedingW0927 16:18:27.272469       1 reflector.go:442] k8s.io/client-go/informers/factory.go:134: watch of *v1.EndpointSlice ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeedingI0927 16:18:31.339045       1 trace.go:205] Trace[1140734081]: "DeltaFIFO Pop Process" ID:cuberun/cuberun-cuberun,Depth:42,Reason:slow event handlers blocking the queue (27-Sep-2022 16:18:30.696) (total time: 116ms):Trace[1140734081]: [116.029921ms] [116.029921ms] ENDI0927 16:18:32.403993       1 trace.go:205] Trace[903972463]: "DeltaFIFO Pop Process" ID:cuberundemo/cuberun-cuberundemo,Depth:41,Reason:slow event handlers blocking the queue (27-Sep-2022 16:18:31.657) (total time: 196ms):Trace[903972463]: [196.24798ms] [196.24798ms] ENDI0927 16:18:33.233172       1 trace.go:205] Trace[1265312678]: "DeltaFIFO Pop Process" ID:argocd/argocd-metrics,Depth:40,Reason:slow event handlers blocking the queue (27-Sep-2022 16:18:32.738) (total time: 359ms):Trace[1265312678]: [359.090093ms] [359.090093ms] ENDI0927 16:18:33.261077       1 proxier.go:823] "Syncing iptables rules"I0927 16:18:35.474678       1 proxier.go:790] "SyncProxyRules complete" elapsed="2.867637015s"I0927 16:18:35.587939       1 proxier.go:823] "Syncing iptables rules"I0927 16:18:37.014157       1 proxier.go:790] "SyncProxyRules complete" elapsed="1.45321438s"I0927 16:19:08.904513       1 trace.go:205] Trace[1753182031]: "iptables ChainExists" (27-Sep-2022 16:19:06.254) (total time: 2266ms):Trace[1753182031]: [2.266311394s] [2.266311394s] ENDI0927 16:19:08.904456       1 trace.go:205] Trace[228375231]: "iptables ChainExists" (27-Sep-2022 16:19:06.299) (total time: 2255ms):Trace[228375231]: [2.255433291s] [2.255433291s] ENDI0927 16:19:40.540864       1 trace.go:205] Trace[2069259157]: "iptables ChainExists" (27-Sep-2022 16:19:36.494) (total time: 3430ms):Trace[2069259157]: [3.430008597s] [3.430008597s] ENDI0927 16:19:40.540873       1 trace.go:205] Trace[757252858]: "iptables ChainExists" (27-Sep-2022 16:19:36.304) (total time: 3619ms):Trace[757252858]: [3.61980147s] [3.61980147s] ENDI0927 16:20:09.976580       1 trace.go:205] Trace[2070318544]: "iptables ChainExists" (27-Sep-2022 16:20:06.285) (total time: 3182ms):Trace[2070318544]: [3.182449365s] [3.182449365s] ENDI0927 16:20:09.976592       1 trace.go:205] Trace[852062251]: "iptables ChainExists" (27-Sep-2022 16:20:06.313) (total time: 3154ms):Trace[852062251]: [3.154369999s] [3.154369999s] ENDFollowComment"

Answer: "0t3.large has only 2 cpu, sounds like you are running over 10 pods on 2 cpu instances. this might cause the instance CPU to max out and cause slowdowns and problems.Check that your instance CPU and memory usage isnt to high and if it is use larger or more instancesCommentSharedovanswered 3 months ago"


Question: Adding new S3 bucket to existing distribution

"Hi, first post here so please excuse my lack of knowledge of AWS.I have just taken over support & development of a site that is hosted in AWS.  It has been stripped out of a larger group of sites and resources that were acquired in a recent company takeover and is mostly working okay.  I have scant documentation on the AWS setup and to me it seems to be overly complicated.  For background I am much more of a developer than a sysadmin or architect and I only have experience of Azure previously but anyway, onto my issue...So there is an S3 bucket that is currently being served through a CloudFront distribution for CDN type purposes and this works fine.  For reasons I will leave out (but it's a must) I need to "rename" the bucket, but I believe to do this I must create a new bucket and sync the content over.  I have done this so currently have 2 buckets with the same content and exact same permissions etc.Links direct to the new S3 bucket work fine but links through the CloudFront cdn are broken. e.g.:https://public-forcesreunited.s3.amazonaws.com/fr-website-assets/images/logos/armed-forces-services-logos/british-army-logo-359-x-601.png works.https://dmffixln4zsgf.cloudfront.net/fr/s3/public-forcesreunited/fr-website-assets/images/logos/armed-forces-services-logos/british-army-logo-359-x-601.png doesn't work, and comes back with {"response":"No config entry found for account key / file source root combination"}.So I'm guessing that somewhere there is a link to the existing S3 bucket and I need to configure the new bucket too, but I'm really struggling to find out where.  The CloudFront distribution https://dmffixln4zsgf.cloudfront.net has just one Origin configured which has the domain cloud-front-web-proxy-1738297328.eu-west-1.elb.amazonaws.com.  So this must be an "Elastic Load Balancer"?  I've had a look at this in the EC2 -> Load Balancers page and cannot see any linking to the original S3 bucket.Could anyone suggest any further places to look please?FollowComment"

Answer: "0Have figured it out (and nobody here would have got it).There was a virtual server running some sort of home grown content proxy service that uses a SQLite database with a single table it it.  The existing bucket name was featured in one of the rows so I added another row with my new bucket name in, restarted the service and voila!CommentSharecoopermotoanswered 2 years ago"


Question: [🚀Launch Announcement] AWS IoT TwinMaker Launches Enhancements for Scaling Digital Twins and Building Data Connectors

"AWS IoT TwinMaker is launching enhancements to simplify our customers’ experience as they scale their digital twins and build data connectors. AWS IoT TwinMaker makes it easier for developers to create digital twins of real-world systems such as buildings, factories, industrial equipment, and production lines. Digital twins are virtual representations of physical systems that can be regularly updated with real-world data to mimic the structure, state, and behavior of the systems they represent to drive business outcomes.Prior to this launch, customers had to submit a request in order to support more than 1k entities per workspace. To make it easier for our customers to scale their digital twins, we have increased our service quota to support up to 10k entities per workspace. You can review the new AWS IoT TwinMaker service quotas here.We have also have created a new guide to provide customers detailed instructions on developing time-series data connectors and how to connect that data to their digital twins faster. Lastly, we added a new built-in component for Amazon Kinesis Video Streams to help customers quickly connect and easily steam video to their digital twin. To learn more about the built-in Kinesis Video Streams component, please refer to this section in our developer guide.Before getting started with AWS IoT TwinMaker, customers can experience a demo of a cookie factory digital twin dashboard with Amazon Managed Grafana here. To build this cookie factory digital twin dashboard, you can use the AWS IoT TwinMaker Getting Started example on GitHub to access all required resources and code. To learn more, please visit the developer guide.FollowComment"


Question: AWS Glue Image issue

"Team,I have created AWS  glue container using aws glue image .When I am logging into docker using bash command I can see aws credentials  are set in docker . When I am running  aws s3 ls from docker it s providing me list of s3 buckets.I have written small code to test to connection to aws but it is giving error .import osimport boto3boto3.__version__client = boto3.client('sts')response=client.get_caller_identity()error I am getting is :An error was encountered:An error occurred (InvalidClientTokenId) when calling the GetCallerIdentity operation: The security token included in the request is invalid.Traceback (most recent call last):File "/usr/local/lib/python3.6/site-packages/botocore/client.py", line 314, in _api_callreturn self._make_api_call(operation_name, kwargs)File "/usr/local/lib/python3.6/site-packages/botocore/client.py", line 612, in _make_api_callraise error_class(parsed_response, operation_name)botocore.exceptions.ClientError: An error occurred (InvalidClientTokenId) when calling the GetCallerIdentity operation: The security token included in the request is invalid.I have tried unset the existing credentials and set new still getting same issueI am using 1.0 glue image.FollowComment"

Answer: "0Hello,Looks like some issue with your credentials or configuration.Below steps worked fine for me:docker pull amazon/aws-glue-libs:glue_libs_1.0.0_image_01docker run -it amazon/aws-glue-libs:glue_libs_1.0.0_image_01 bashroot@98c197939c1b:/# aws configureroot@98c197939c1b:/# aws sts get-caller-identity --no-cli-pagerroot@98c197939c1b:/# python --versionPython 3.6.15root@98c197939c1b:/# pythonPython 3.6.15 (default, Dec  3 2021, 03:07:35)[GCC 10.2.1 20210110] on linuxType "help", "copyright", "credits" or "license" for more information.>>> import os,boto3>>> print(boto3.__version__)1.8.9>>> client = boto3.client('sts')>>> print(client.get_caller_identity())Ref docs:[1. Configuring AWS CLI ] (https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-configure.html)[2. GetCallerIdentity api call] (https://docs.aws.amazon.com/STS/latest/APIReference/API_GetCallerIdentity.html)3. Glue local development using DockerCommentShareSUPPORT ENGINEERChiranjeevi_Nanswered a year ago"


Question: Configure DNS record in CloudFormation for Elastic Beanstalk Environment

"HiI have a CloudFormation template where I try to create an A record as alias to my Elastic Beanstalk environment in the eu-west-1 region:...DNSRecord:    Type: AWS::Route53::RecordSet    Properties:      HostedZoneId: !Ref ZoneID      Comment: DNS name for elastic beanstalk.      Name: !Ref AppUrl      Type: A      AliasTarget:        EvaluateTargetHealth: false        DNSName: !GetAtt AppEnvironment.EndpointURL        HostedZoneId: Z2NYPWQ7DFZAZH...The hosted zone id of the AliasTarget is configured as provided in this postHowever, this always gives an error in CloudFormation:Tried to create an alias that targets ...., type A in zone Z2NYPWQ7DFZAZH, but the alias target name does not lie within the target zoneI also created the record manually in the AWS Console. When I describe this record set with the CLI with this command:aws route53 list-resource-record-sets --hosted-zone-id ******* I see the same zoneId for the alias.{   "ResourceRecordSets": [      ...      {            "Name": "**********",            "Type": "A",            "AliasTarget": {                "HostedZoneId": "Z2NYPWQ7DFZAZH",                "DNSName": "**********",                "EvaluateTargetHealth": false            }        },      ...   ]}Did I make a mistake in the CloudFormation config?FollowComment"

Answer: "0Are you using an Elastic Load Balancer? If so specify the value of the hosted zone ID for the load balancer.You can do this command to get the CanonicalHostedZoneNameIDaws elb describe-load-balancers --region eu-west-1Fromhttps://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-route53-aliastarget.htmlELB load balancerSpecify the value of the hosted zone ID for the load balancer. Use the following methods to get the hosted zone ID:* Service Endpoints table in the "Elastic Load Balancing Endpoints and Quotas" topic in the Amazon Web Services General Reference: Use the value that corresponds with the region that you created your load balancer in. Note that there are separate columns for Application and Classic Load Balancers and for Network Load Balancers.AWS Management Console: Go to the Amazon EC2 page, choose Load Balancers in the navigation pane, select the load balancer, and get the value of the Hosted zone field on the Description tab.Elastic Load Balancing API: Use DescribeLoadBalancers to get the applicable value. For more information, see the applicable guide:Classic Load Balancers: Use DescribeLoadBalancers to get the value of CanonicalHostedZoneNameID.Application and Network Load Balancers: Use DescribeLoadBalancers to get the value of CanonicalHostedZoneID.CloudFormation Fn::GetAtt intrinsic function: Use the Fn::GetAtt intrinsic function to get the applicable value:Classic Load Balancers: Get CanonicalHostedZoneNameID.Application and Network Load Balancers: Get CanonicalHostedZoneID.AWS CLI: Use describe-load-balancers to get the applicable value. For more information, see the applicable guide:Classic Load Balancers: Use describe-load-balancers to get the value of CanonicalHostedZoneNameID.Application and Network Load Balancers: Use describe-load-balancers to get the value of CanonicalHostedZoneID.*CommentShareEXPERTMatt-Banswered 10 months agorePost-User-5720851 10 months agoNo I do not use a load balancer, it is a Single Instance environmentShare0OK you mentioned its a single instance environment but i noticed in your CF template you are getting the DNS name like this:DNSName: !GetAtt AppEnvironment.EndpointURLHowever in single instance environments that will give you the IP address NOT the CNAMEhttps://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-beanstalk-environment.html#aws-properties-beanstalk-environment-return-valuesFn::GetAttThe Fn::GetAtt intrinsic function returns a value for a specified attribute of this type. The following are the available attributes and sample return values.For more information about using the Fn::GetAtt intrinsic function, see Fn::GetAtt.EndpointURLFor load-balanced, autoscaling environments, the URL to the load balancer. For single-instance environments, the IP address of the instance.Example load balancer URL: awseb-myst-myen-132MQC4KRLAMD-1371280482.us-east-2.elb.amazonaws.comExample instance IP address:192.0.2.0CommentShareEXPERTMatt-Banswered 10 months ago"


Question: Are there any performance advantages to having multiple ENIs?

"Is there any benefit to having separate ENIs on an EC2 instance to separate traffic, maybe to separate web traffic from backup traffic?The documentation is very clear that adding extra ENIs does not increase bandwidth:http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-eni.htmlbut assuming bandwidth is not a problem, would having separate ENIs result in a more consistent performance for whatever application is being hosted?Thanks in advance!FollowComment"

Answer: "0Accepted AnswerThere is no performance benefit to multiple ENIs. Some customers will use this to "multi-home" a server into multiple subnets. However, you can usually address the security and traffic segregation requirements through a combination of security groups and ACLs.The complexity of managing multiple ENIs will generally outweigh the benefits. Unless the customer has a compelling requirement, I would advise against it.CommentShareRonnie_AWSanswered 6 years ago"


Question: Displaying images from an AWS bucket in another application

"Hello,Beginners here - we would appreciate your assistance.We are designing an app on Bubble where a User uploads their photo with some information (e.g. location). We have written some script which connects to the AWS bucket through an API (following this link https://www.youtube.com/watch?v=rx7wsXqMUo0).In a nutshell this is the process that we've designed - the user on the bubble application selects their photo and then clicks view image. Once view image is clicked the application sends the image to AWS via API, and then displays the same image in the bubble application. Ideally, this process would be quite quick, but we have set some wait times (10 seconds) on the application before the bubble application looks for the image in the AWS bucket to display it.Seems simple enough, and following the link above, everything seems to work fine. However, we run into some problems once we begin testing it more vigorously, which we're not sure if it is on the AWS side, or the bubble side.Problem: It appears that some images don't display in our application (despite being in the AWS bucket). The error we receive in Bubble is:The image could not be loaded: https://d1muf25xaso8hp.cloudfront.net/https%3A%2F%2F5f8316d6ec5a770d0465f37a2697e910.cdn.bubble.io%2Ff1683101435365x646561104326294700%2F1683101426407x113430567633551360-IMG_8627.jpg?w=384&h=384&auto=compress&dpr=2&fit=max .We have tested from different browsers, from Iphones and with different sized photos. The only pattern we can identify is that it doesn't seem to work with files greater than ~1.5MB. We are completely stumped - it works sometimes but not others - how can we identify what the issue is?FollowComment"

Answer: "0That link you provided shows this for me:<?xml version="1.0" encoding="UTF-8"?><Error>NoSuchBucket<Message>The specified bucket does not exist</Message><BucketName>fliktripsource</BucketName><RequestId>ENYE7DVGZ9KWTD3A</RequestId><HostId>cdn6+hzesPmFafQ6Vo0qYW0/AYMSvgP7wyPLdvFhLv0ggEr4ou4t0F9OGXUCy5pfQ39NX1JJjfk=</HostId></Error>So the bucket fliktripsource doesn't exist.  Is this the error you're getting?  If so, check that this S3 bucket really does exist.CommentShareEXPERTskinsmananswered a month ago"


Question: Help with Permissions for MySQL select query from master EC2 to slave EC2

"2 EC2 instances both running Ubuntu 20.04.3 LTS and MySQL 8.0.26-0I need to be able to run read-only queries FROM the master TO the slave and retrieve the result back on the masterPROBLEM: I can not create a configuration that allows me to connect to the SLAVE databases FROM the MASTERRegardless of host or Security Group settings, I receive either 'Connection Refused' or 'Connection Timed Out'Master MySQL set up on Instance A (running for several months) along with the rest of the LAMPP stackSlave MySQL set up on Instance B (running for a week, replication works flawlessly) only running MySQL, no web servicesFROM SLAVE: I can log into MySQL using the same user/password/mysql_native_password as on the master.I have tried setting the Security Group to allow 3306 inbound as well as 44508 inbound, which is the port the master says the slave's host is using (issuing the 'show full processlist' command on the master), using slave/master IP addresses or host names, and every combination of those that I can think of.I have even tried allowing ALL TCP traffic from any source into the slave, but still received the 'Connection Refused' errorIs there a guide for which Security Group and MySQL connection settings to use to allow the master to query the slave? TIAFollowComment"

Answer: "0RESOLVED:In the slave's /etc/mysql/mysql.conf.d/mysqld.cnf I needed to comment out the 'bind-address' and 'mysqlx-bind-address' lines, stop the slave, restart mysqld and start the slave, again.Having 'bind-address = 127.0.0.1' prevented connections from anywhere else.Commenting it out allows access from all sources, not just localhost.EC2 Security Group restricts access to port 3306 to just the master server's IP block.Working great all around, now.Thank you for your attention.CommentShareDGPanswered 2 years ago"


Question: Custom domain for "cognito-idp.us-east-1.amazonaws.com"

"I have a Cognito app client configured to use USER_PASSWORD_AUTH flow. By POSTing this request:{"AuthParameters": {"USERNAME": "{{Username}}","PASSWORD": "{{Password}}"},"AuthFlow": "USER_PASSWORD_AUTH","ClientId": "{{AppClientId}}"}to "cognito-idp.us-east-1.amazonaws.com", I am able to successfully authenticate and retrieve JWTs.I would like to CNAME the URL to be something like "auth.mydomain.com", but when I do that, I get a client certificate validation error. Is there anyway to associate a valid certificate so I can CNAME the URL successfully?FollowComment"

Answer: "2Hi,You will not be able to CNAME the cognito endpoint domain but you can create a proxy to this endpoint using API Gateway or CloudFront and you can assign a custom domain to your proxy endpoint. You may find this blog post helpful which demonstrates using CloudFront as a proxy to Cognito endpoint but you can also implement a simpler proxy using API Gateway.CommentShareEXPERTMahmoud Matoukanswered a year agomaxmoore14 a year agoThanks for this answer. Is there any alternative method to get the JWT ID Token from the Cognito username/password using a custom domain name? Or is a proxy the only solution here?Share1Hey there,It sounds like you're looking to use a custom domain name in Cognito. Give this doc a look and come back to us if you have more questions.CommentShareCiaran Carragheranswered a year agomaxmoore14 a year agoNot trying to do this for the Hosted UI. Trying to use a simple request with username/password flow to get a JWT ID Token. This works using cognito-idp.us-east-1.amazonaws.com, not mydomain.auth.us-east-1.amazoncognito.com. If I am mistaken, please let me know how to do this without a user entering credentials into a website.Share0sorry i wasn't able to help, removing my answerCommentShareSrianswered a year ago"


Question: probably elasticache redis bug when updating to v7.0.7 with dualstack connection

"Hi All,We just updated our redis cluster in elasticache redis cluster from v7.0.5 tov7.0.7 with dualstack connection and it just went down and keep resetting all incoming connections. After investigation, we found out it may be a bug that can reproduce on all AWS accountexpected output: Everything should works fine after redis upgradeactual output: redis cluster keep reset all incoming connectionsstep to reproduce:Open a new redis cluster with the following settings:choose "dualstack" in connection section instead of default ipv4 optionchoose redis v7check if AWS choose v7.0.7, we can only reproduce this in v7.0.7, not v7.0.5 not v6.2 or v6try to connect to this redis cluster and will find out all connection refused.Thanks for every folks in AWS User Group Taiwan that help us to narrow down the issueOriginal Post on Facebook in Chinese Traditional: https://www.facebook.com/groups/awsugtw/posts/5984294404980354/FollowCommentVignesh N 22 days agoI am also facing the same issue.Share"

Answer: "1Hi, Thanks for reaching out. The fix for it has been deployed in the latest v7.0 update. Your clusters should already be fixed at this point.CommentShareAWS-User-3466136answered 14 days ago"


Question: Execution Error in Join Operation in AWS Glue

I am trying to join two tables in CSV format(saved in S3 bucket).Target is also an empty folder in S3.Everytime getting the following error:AnalysisException: Cannot resolve column name "device_id" among ()where**** device_id**** is the unique id for joining the tables.Please helpFollowCommentGonzalo Herreros 3 months agoHow are you defining that join? (there are multiple ways)ShareMagneto 3 months agoDid you find any solution for this ??Share


Question: Sagemaker Studio API to get original s3 dataset path of an AutoMLJob

"Is there any API of Sagemaker Studio that can help us get the complete path of the original dataset that was imported from s3 in Canvas for model training, in an autoMLJob?I have imported a dataset from my own s3 bucket in Canvas and trained a model using that dataset. When the training is triggered, Canvas saves the copy of that original dataset to a new path in s3, trains the model on that dataset and saves the path of that dataset in the autoMLJob of that model in Sagemaker Studio under the tag InputDataConfig. Is there any way that we can get the s3 path of the original dataset too from where we have imported the dataset, through any API of Sagemaker Studio or through the describeAutoMLJob API?FollowComment"

Answer: "0Hi Aamna,You can use the describeAutoMLJob API to retrieve the original datasource that you have input for the job. It falls under the tag [InputDataConfig][Datasource][S3Uri].Here is a link for your reference to the API's response syntax.Let me know if it works!CommentSharejunkaianswered 4 months agoAamna Mohsin 4 months agoHi Junkai,Thankyou for your response.I have tried the describeAutoMLJob API but under the tag [InputDataConfig][Datasource][S3Uri] I am getting the path of the copy of dataset that Canvas have created and saved for the training of model, I need the path/information of the actual dataset from which the copy is created. Do you have any idea about that?Sharejunkai 4 months agoHi Aamna,Unfortunately this information is not captured currently. You may name the imported dataset in a way that helps you associate with the original dataset from S3 easily.ShareAamna Mohsin 4 months agoThankyou for your response Junkai. Much appreciated.Share"


Question: "Can't get mysql started, accidentally messed up permissions?"

"I ran this command sudo find /opt/bitnami/apps/wordpress/htdocs/mydomainname.com / -type d -exec chmod 775 {} ;(notice the accidental space after mydomainname.com)After running this command, I could no longer ssh into the server. ('ssh_exchange_identification: read: Connection reset by peer' error)...a reboot of the instance fixed that.I just can't get mysql to start running no matter what I try. What did that accidental space in that command do ? Did I mess up permissions somewhere in mysql that I can reset or correct? Please help, trying to recover a decent day's work on a WordPress website, thanks!FollowComment"

Answer: "0Wow, after hours or searching and attempting different commands to repair mysql permissions, just now found the one that worked! Here it is for anyone else:sudo chown -R mysql:mysql /opt/bitnami/mysql/tmpThanks to Davidg for the answer here: https://community.bitnami.com/t/edited-permissions-incorrectly-mysql-will-not-start/66191/5CommentShareBJSawsanswered 2 years ago"


Question: Gamelift Health Check Issue With Unreal Engine 5

"We are using Unreal Engine version 5.0 along with a plugin that is linked below that allows us to interface with AWS SDK in blueprints. This was working on a test project but when we went into a new project it started giving us the "SERVER_PROCESS_TERMINATED_UNHEALTHY " after our fleet is activated. We have verified that we are making all the correct SDK calls to initialize gamelift but have not been able to fix the error below. The code below is a log from the aws server machine that we acquired via SSH. We have also made sure that the  "libaws-cpp-sdk-gamelift-server.so" file is properly linked to the Linux executable.[2023.01.24-15.34.54:491][  0]LogLoad: (Engine Initialization) Total time: 34.90 seconds^M[2023.01.24-15.34.54:525][  0]LogNet: UNetDriver::TickDispatch: Very long time between ticks. DeltaTime: 0.03, Realtime: 14.61. IpNetDriver_2147482510^M[2023.01.24-15.34.54:559][  1]LogLevel: ActivateLevel /Game/Maps/PowEng2/L_PE2_Gameplay 1 1 0^M[2023.01.24-15.45.05:534][255]LogStreaming: Display: 0.023 ms (0.005+0.018) ms for processing 46/46 objects in NotifyUnreachableObjects( Queued=0, Async=0). Removed 0/0 (1374->1374 tracked) packages and 10/46 (3569->3559 tracked) public exports.^M[2023.01.24-15.45.57:509][727]LogCore: === Critical error: ===Unhandled Exception: SIGSEGV: unaligned memory access (SIMD vectors?)^M[2023.01.24-15.45.57:509][727]LogCore: Fatal error!0x00000000060892cc Moh_PowerEngServer!UClass::FindFunctionByName(FName, EIncludeSuperFlag::Type) const [A:/Jenkins/workspace/UE5_Dev/UE5/Engine/Source/./Runtime/CoreUObject/Private/UObject/Class.cpp:5523]0x00000000062367cf Moh_PowerEngServer!UObject::FindFunctionChecked(FName) const [A:/Jenkins/workspace/UE5_Dev/UE5/Engine/Source/./Runtime/CoreUObject/Private/UObject/ScriptCore.cpp:1320]0x0000000004ed01d9 Moh_PowerEngServer!UProcessParameters::HealthCheck() [A:/Jenkins/workspace/UE5_Dev/UE5/Engine/Source/./../../Projects/Mohawk/Moh_PowerEng/Intermediate/Build/Linux/B4D820EA/Moh_PowerEngServer/Inc/GameLiftServerSDK/ProcessParameters.gen.cpp:53]0x00007f5580b28dee libaws-cpp-sdk-gamelift-server.so!UnknownFunction(0x40ded)0x00007f5580b1da0e libaws-cpp-sdk-gamelift-server.so!UnknownFunction(0x35a0d)0x00007f55814b71db libpthread.so.0!UnknownFunction(0x61da)0x00007f5580b2b5ec libaws-cpp-sdk-gamelift-server.so!UnknownFunction(0x435eb)0x00007f557ff38890 libstdc++.so.6!UnknownFunction(0xbb88f)0x00007f55814b8e75 libpthread.so.0!UnknownFunction(0x7e74)0x00007f5580516a2d libc.so.6!clone(+0x6c)Plugin Link: https://www.unrealengine.com/marketplace/en-US/product/aws-cognito-dynamodb-gamelift-lambdaFollowComment"

Answer: "0Hi,Amazon GameLift has added support for Unreal Engine 5, please check out the latest developer guide for instruction to integrate: https://docs.aws.amazon.com/gamelift/latest/developerguide/integration-engines-setup-unreal.htmlRelated: https://aws.amazon.com/about-aws/whats-new/2023/04/amazon-gamelift-unreal-engine-5/CommentSharefzehaoanswered 2 months ago0I am currently working on Unreal Engine 5.1.1 game project. I have integrated GameLiftServerSDK in to our game as we want to use dedicated servers hosted on AWS GameLift. I have downloaded latest version of Unreal - GameLift plugin SDK (5.0.0) and fallowed latest tutorial for integration in to UE.For testing purpose I have created simple Unreal project from Third Person Template with GameLiftServerSDK plugin. I have added code from latest integration guide:https://docs.aws.amazon.com/gamelift/latest/developerguide/integration-engines-setup-unreal.htmlto the GameMode class of the test project.I have access to Amazon GameLift Console where I have setup Fleet (type Anywhere) and I have configured my desktop workstation as compute in custom location in that fleet.Before running dedicated server package, I run aws gamelift get-compute-auth-token command, and use token as parameter in executable shortcut.Every time I try to run dedicated server (with all preparations) I get crashEXCEPTION_ACCESS_VIOLATION  <CallStack>ProjectServer!OnHealthCheckInternal() ...\Plugins\GameLiftServerSDK\Source\GameLiftServerSDK\Private\GameLiftServerSDK.cpp:245]CommentSharerePost-User-2802544answered 20 days ago"


Question: Pearson Vue terminated the exam without violation

"I had a technical issue during my AWS Certified Developer - Associate exam on 27th December 2021. The exam was interrupted.  I got an email from AWS today that I of course  failed the exam (since I only got halfway through before the technical issue on Pearson Vue's end happened), and that I can reattempt the exam in 14 days. I have a deadline to complete my certification by 31/12/2021 and I want my exam to be rescheduled within the time.Thank YouFollowComment"

Answer: "3Hello,I would reach out to the Pearson Vue's customer support chat to get further assistance. https://home.pearsonvue.com/aws/contact They should be able to help you out with this and hopefully schedule a new exam date this year.CommentShareazalenskianswered a year ago0I got the voucher from Pearson Vue, it is showing that I cannot book the exam slot before 14 days. But I need to complete my certification before 31 December 2021.CommentShareShusovananswered a year ago"


Question: Unable to create Tag to restrict resource deployment

Requirement:We are trying to restrict users resource provisioning with Tags and any instance created should be successful only if Key1 = "UserID"Followed this article but it is not workinghttps://aws.amazon.com/premiumsupport/knowledge-center/iam-policy-tags-restrict/FollowComment

Answer: "0That article should be fine, though it's a bit confusing!  As it says, "Note: Modify key1 and value1 in the example policies to include the tags and values that apply to your resources".  So are you using their examples with "key1" replaced by "UserID"?Since your tag is "UserID" I'm guessing you want to make sure any instance created has this tag key, but you don't care about the specific value.  So the section "Launch EC2 instances that have at least one matching tag key" is what you're after?  If so, e.g.:"Condition": {  "ForAnyValue:StringEquals": {    "aws:TagKeys": [      "UserID"    ]  }}CommentShareEXPERTskinsmananswered a year agoAWS-User-2034690 a year agoHi,Tried with changes mentioned above still able to create instances without tag{"Version": "2012-10-17","Statement": [{"Sid": "AllowToDescribeAll","Effect": "Allow","Action": ["ec2:Describe*"],"Resource": ""},{"Sid": "AllowRunInstances","Effect": "Allow","Action": "ec2:RunInstances","Resource": ["arn:aws:ec2:::image/","arn:aws:ec2:::snapshot/","arn:aws:ec2:::subnet/","arn:aws:ec2:::network-interface/","arn:aws:ec2:::security-group/","arn:aws:ec2:::key-pair/"]},{"Sid": "AllowRunInstancesWithRestrictions","Effect": "Allow","Action": ["ec2:CreateVolume","ec2:RunInstances"],"Resource": ["arn:aws:ec2:::volume/","arn:aws:ec2:::instance/","arn:aws:ec2:::network-interface/"],"Condition": {"StringEquals": {"aws:RequestTag/key1": "value1","aws:RequestTag/key2": "value2"},"ForAnyValue:StringEquals": {"aws:TagKeys": ["key1","Share"


Question: HLS CHARACTERISTICS Values

"Hi,We use MediaLive for Live streaming. Our streams have multiple audio tracks with one track being use for Descriptive Video Service (DVS). For proper presentation on Apple devices the track must be marked with the attribute CHARACTERISTICS="public.accessibility.describes-video".How do we apply the attribute to the audio track?Thank YouFollowComment"

Answer: "0AWS MediaLIve does support something similar to what you request. For each **Output **created, select the **Audio **stream under Stream Settings. Expand the Additional Settings drop menu and there will be field label Audio Type. Select VISUALLY_IMPAIRED_COMMENTARY. Check if this works for your application.CommentShareMike-MEanswered a year ago"


Question: pyspark.sql.utils.AnalysisException• Cannot resolve column name "previous_project_id among ()

"Hi, I'm relatively new to AWS glue and was having trouble in the following transformation codes:DataSource4 = glueContext.create_dynamic_frame.from_catalog(database = "beta", table_name = "[table_name]", transformation_ctx = "DataSource4")Transform9 = ApplyMapping.apply(frame = DataSource4, mappings = [("project_unique_id", "int", "(src) project_unique_id", "int")], transformation_ctx = "Transform9")Transform9DF = Transform9.toDF()Transform3DF = Transform3.toDF()Transform12 = DynamicFrame.fromDF(Transform3DF.join(Transform9DF, (Transform3DF['project_unique_id'] == Transform9DF['previous_project_id']), "leftanti"), glueContext, "Transform12")The job is failing with error :raise AnalysisException:(s.split(': ',1)[1], stackTrace)'Cannot resolve column name "previous_project_id" among ((src) project_unique_id);'on checking the tables, both columns "project_unique_id" and "previous_project_id" are filled with NULL values, could that be the reason for the above error?FollowComment"

Answer: "0Hi ,could you please clarify the statement:on checking the tables, both columns "project_unique_id" and "previous_project_id" are filled with NULL valueswhich table? the source table? or which DataFrame? Transform9DF or Transform3DF ?could you post the schema of these 2 dataframes?I might be mistaken, but I think that  the apply mapping you are using is dropping any field other than "(src) project_unique_id" so when you trying to join on Transform9DF['previous_project_id'] this field is not found.thank youCommentShareEXPERTFabrizio@AWSanswered a year ago"


Question: AWS Instance Error

"Hi every time I try to connect to my AWS instance in diffrent ways like with PuTTY or on the AWS web, I can't connect to my instance. And this is what it always say on the AWS web:Failed to connect to your instanceError establishing SSH connection to your instance. Try again later.Can anyone please help me? This solving problem is very important to me.FollowComment"

Answer: "0Let's start with the networking area.Does the inbound rule for the security group allow SSH?Are the required communications allowed by the network ACLs for the subnet on which the EC2 is running?Is a route to Internet Gateway configured in the route table of the subnet on which EC2 is running?We also recommend that you review the following document, which describes general troubleshooting methods when you cannot connect to EC2.https://repost.aws/knowledge-center/ec2-linux-ssh-troubleshootinghttps://docs.aws.amazon.com/AWSEC2/latest/UserGuide/TroubleshootingInstancesConnecting.htmlCommentShareEXPERTRiku_Kobayashianswered 6 days agoEvoker 4 days agoEverything is ok for 1, 2, and 3 and those website didn't help very much...Share0we may have a long list for troubleshooting (in addition to Riku)Check your security group rules to make sure that inbound traffic for SSH (port 22) is allowed from your IP address.If your instance is in a VPC, ensure that the associated Network Access Control Lists (NACLs) allow inbound and outbound traffic for SSH (port 22).Make sure your VPC has the correct route to the internet. This typically means having a route to an Internet Gateway (IGW).Make sure you're using the correct SSH key pair to connect to your instance.You can check whether SSH service is running or notIf you're behind a corporate firewall, it might be blocking SSH connectionCommentShareEXPERTsdtslmnanswered 6 days agoEvoker 4 days agoEvery there are all good, but it's still not running...Actually, NACL rule number * is denied.Share"


Question: glacier.us-east-1.amazonaws.com timeouts during retrieval

"I'm trying to DOWNLOAD files from Glacier vaults at us-east-1 . RETRIEVE is submitted successfully, but after 4 hours, when I try to download the files, https and http connections to glacier.us-east-1.amazonaws.com timeout after about 60 seconds.Retrieval/download jobs at us-west-1 work flawlessly.sample request below:   "GET /-/vaults/vaultname/jobs/XXX/output HTTP/1.1\r    TE: deflate,gzip;q=0.3\r    Connection: TE, close\r    Authorization: AWS4-HMAC-SHA256 Credential=X/20220414/us-east-1/glacier/aws4_request, SignedHeaders=host;x-amz-date;x-amz-glacier-version, Signature=X\r    Host: glacier.us-east-1.amazonaws.com\r    User-Agent: agent string\r    X-Amz-Date: 20220414T205439Z\r    X-Amz-Glacier-Version: 2012-06-01\r    \r   "FollowComment"

Answer: "0Accepted AnswerAfter dealing with helpless AWS support and trying everything I could think of, I discovered that the file couldn't be downloaded whole but could be downloaded in segments via by passing 'range:' header in the download call. I have no idea why glacier in different regions behaves differently and why it fails so miserably without any error messages in us-east-1. But I have to conclude that at this point I can not recommend using AWS Glacier to anyone. Use GCP instead - it works flawlessly every time and there is no annoying 4h retrieve window to wait.CommentShareAWS-User-3702780answered a year ago"


Question: Does Amazon Workspace support docker on Windows 10 ?

"I have an Amazon workspace on which I'm trying to Docker Desktop for windows. Installation is successful, But can't run the hello-world container in my docker.Here is the error I'm getting.docker: Error response from daemon: hcsshim::CreateComputeSystem c0123bb1fafc4e6706afb240dcf173c531976eaaaef75c57edb7c55f929471a7: The virtual machine could not be started because a required feature is not installed.Please assist !FollowComment"

Answer: "0Hello,Unfortunately Nested virtualization (including the use of Docker) is not supported on Amazon WorkSpaces for Windows or Linux.  This is mentioned in our AWS documentation here [1]That being said, I would encourage you to have a look into Amazon ECS if your use case allows it, which is a highly scalable, high-performance container orchestration service that supports Docker containers and allows you to easily run and scale containerized applications on AWS. For more information on this, refer to [2].Thanks,awsabdallahReferences:[1] Troubleshooting Amazon WorkSpaces Issues - I'm having trouble using Docker with Amazon WorkSpaces - https://docs.aws.amazon.com/en_us/workspaces/latest/adminguide/amazon-workspaces-troubleshooting.html#docker_support[2] Amazon ECS: https://docs.aws.amazon.com/AmazonECS/latest/developerguide/Welcome.htmlCommentShareAWS-User-3262046answered 3 years ago"


Question: Alternatives to minimize data transfer costs for backup solutions

"A customer is experimenting a high data transfer cost when using Commvault backup solution. Commvault is deployed in an EC2 instance and is copying EBS snapshots to another S3 bucket, being all the resources in the same region.According to S3 pricing documentation:You pay for all bandwidth into and out of Amazon S3, except for the following:..• Data transferred out to an Amazon Elastic Compute Cloud (Amazon EC2) instance, when the instance is in the same AWS Region as the S3 bucket....Customer was not expecting any data transfer cost for the backup solution but they detect high costs associated to the concept EU-DataTransfer-Regional-BytesMaybe I'm missing something but I do not see why this cost is there, as this concept is related with The amount of data transferred from Amazon S3 to AWS resources within the same AWS Region  but that message seems counterposed with the s3 pricing documentation.Any clarification around that would be appreciated and also other options if this scenario really implies a high transfer cost.FollowComment"

Answer: "0Accepted AnswerWhen EC2 instance and S3 bucket are in the same region - customer needs to ensure they use VPC Gateway Endpoint for communication between the two. If VPC endpoint is not used - this will likely fall under the Regional (Inter-AZ) data transfer category. That's exactly what "EU-DataTransfer-Regional-Bytes" usage type tells us.Note that the charge should not be on the S3 side, but you should see it linked to EC2, as the instance will be communicating with S3 via public endpoint / public IP address.More info in the blogpost about VPC endpoints: https://aws.amazon.com/blogs/aws/new-vpc-endpoint-for-amazon-s3/And documentation: https://docs.aws.amazon.com/vpc/latest/userguide/vpc-endpoints.htmlCheck out EC2 pricing for more info about Data Transfer here (specifically section around Regional Data Transfer charges): https://aws.amazon.com/ec2/pricing/on-demand/CommentShareEXPERTNataliya_Ganswered 3 years ago"


Question: Issue in the installation of the AWS CodeDeploy Agent in EC2 instance with AMI - Ubuntu Server 22.04 LTS

"have created an Amazon EC2 instance with AMI - Ubuntu Server 22.04 LTS (Free Tier) and try to install AWS CodeDeploy Agent into it.I am following the official documentation from Amazon to install CodeDeploy agent into the Ubuntu server. [https://docs.aws.amazon.com/codedeploy/latest/userguide/codedeploy-agent-operations-install-ubuntu.html](AWS Documentation Link)I have connected the EC2 instance with SSH Keypairs and run the following commands:sudo apt updatesudo apt install ruby-fullsudo apt install wgetwget https://aws-codedeploy-ap-south-1.s3.ap-south-1.amazonaws.com/latest/installchmod +x ./installsudo ./install autoIn the last command, I got the following error message:I, [2022-11-25T20:22:45.262298 #4303] INFO -- : Starting Ruby version check.E, [2022-11-25T20:22:45.262740 #4303] ERROR -- :Current running Ruby version for root is 3.0.2, but Ruby version 2.x needs to be installed.E, [2022-11-25T20:22:45.262959 #4303] ERROR -- : If you already have the proper Ruby version installed, please either create a symlink to /usr/bin/ruby2.x,E, [2022-11-25T20:22:45.263173 #4303] ERROR -- : or run this install script with right interpreter. Otherwise please install Ruby 2.x for root user.E, [2022-11-25T20:22:45.263378 #4303] ERROR -- : You can get more information by running the script with --help option.Please let me know if there is any other hacks, I should employ to install AWS CodeDeploy agent in the EC2 instance with with AMI - Ubuntu Server 22.04 LTS (Free Tier).Thanks in advance!!FollowComment"

Answer: "1Hello,Ubuntu 22.04 is currently not officially supported for the CodeDeployAgent, see:https://docs.aws.amazon.com/codedeploy/latest/userguide/codedeploy-agent.htmlSupported Amazon EC2 AMI operating system:The CodeDeploy agent has been tested on the following Amazon EC2 AMI operating systems:   - Amazon Linux 2018.03.x   - Amazon Linux 2 (ARM, x86)   - Ubuntu Server 20.04 LTS, 18.04 LTS, 16.04 LTS, and 14.04 LTS   - Microsoft Windows Server 2019, 2016, 2012 R2, and 2008 R2   - Red Hat Enterprise Linux (RHEL) 8.x, 7.xSo I would suggest you switch to another operating system like Ubuntu Server 20.04 LTS.But you can still try to install an older rubyversion and test if it works. Check out this blog for installing an older rubyversion on ubuntu-22-04:https://blog.francium.tech/setting-up-ruby-2-7-6-on-ubuntu-22-04-fdb9560715f7Basically what he does are three commands:sudo apt install gnupg2rvm pkg install opensslrvm install 2.7.6 --with-openssl-dir=$HOME/.rvm/usrOther way:https://stackoverflow.com/questions/72162001/aws-code-deploy-agent-needs-ruby-2-x-to-run-and-you-cant-install-older-version-oYou could also open an github-issue to ask for 22.04-support:https://github.com/aws/aws-codedeploy-agentCommentShareHeikoMRanswered 6 months agoDebaditya Bhar 6 months agoThanks for your suggestion.Share"


Question: EC2 RebootInstances performs dirty restart

"Hello,I am using eventbride to issue EC2 RebootInstances API Call to a number of machines.Most shutdown and boot well. 1 does not seem to receive the shutdown request and does a dirty restart.I can see that successful machines have an event 109: 'The kernel power manager has initiated a shutdown transition.  Shutdown Reason: Kernel API' .The failed machine does  not.Checking the SSM logs on a good and bad machine, the log before the reboot looks identical other than time stamps.  These two comparison machines are same ssm agent version, same windows, instance type.Cloudtrail / eventbridge logs don't show failures.Can anybody give me a pointer where to look for this issue?thank youFollowComment"