Question: ClientError: object_detection_augmented_manifest_training template

"Hello,My aim is to create a model for garden birds. I have 293 photos of birds that I have put through 2 custom labelling jobs in ground truth for training and validation. The issue I encountered was being able to have multiple labels on the bounding box which I managed to do via creating a custom labelling job with the following labels:<crowd-bounding-box    name="annotatedResult"    labels="['Blackbird', 'Blue tit', 'Coal tit', 'Dunnock', 'Great tit', 'Long-tailed tit', 'Nuthatch', 'Pigeon', 'Robin']" .....I now have 2 output manifest files with many lines of this:{"source-ref":"s3://XXXXX/Blackbird_1.JPG","BirdLabel":{"workerId":"privateXXXXX","imageSource":{"s3Uri":"s3://XXXXX/Blackbird_1.JPG"},"boxesInfo":{"annotatedResult":{"boundingBoxes":[{"width":1619,"top":840,"label":"Blackbird","left":1287,"height":753}],"inputImageProperties":{"width":3872,"height":2592}}}},"BirdLabel-metadata":{"type":"groundtruth/custom","job-name":"birdlabel","human-annotated":"yes","creation-date":"2019-01-10T15:41:52+0000"}}After this job was successful, I made an ml.p3.2xlarge instance, using the object_detection_augmented_manifest_training template.I have filled in the necessary sections, I then run it and received this error when I have the Content Type to 'application/x-image' with Record wrapper type:RecordIO : 'ClientError: train channel is not specified.'I then changed the channel to train_annotation instead of train and I receive this error message: "ClientError: Unable to initialize the algorithm. Failed to validate input data configuration. (caused by ValidationError)\n\nCaused by: u'train' is a required propertyAdditional information can be provided if neccessary.Any help would be much apreciated! Thank you.Edited by: LuciA on Jan 16, 2019 1:12 PMEdited by: LuciA on Jan 16, 2019 1:18 PMEdited by: LuciA on Jan 16, 2019 1:19 PMFollowComment"

Answer: "0Accepted AnswerHi LuciA - I'm an engineer at AWS. Thanks for continuing to try the service in the face of some difficulties. Can you please cross-reference your augmented manifest against the samples shown in https://aws.amazon.com/blogs/aws/amazon-sagemaker-ground-truth-build-highly-accurate-datasets-and-reduce-labeling-costs-by-up-to-70/, https://github.com/awslabs/amazon-sagemaker-examples/blob/master/ground_truth_labeling_jobs/object_detection_augmented_manifest_training/object_detection_augmented_manifest_training.ipynb, and https://github.com/awslabs/amazon-sagemaker-examples/blob/master/ground_truth_labeling_jobs/ground_truth_object_detection_tutorial/object_detection_tutorial.ipynb?It looks like your format is a little different, e.g., the algorithm expects to see keys called "annotations" and "image_size". Can you please check the syntax and let us know if your results change?CommentShareAWS-User-5907386answered 4 years ago0Hi LuciA,Thanks for trying out the SageMaker object detection algorithm. When using the Pipe mode with an AugmentedManifestFile, you need to specify the RecordWrapperType as RecordIO and ContentType as application/x-recordio. Can you please retry with these suggestions and revert back if you continue to see issues.Thanks!Regards,Amazon SageMaker TeamCommentShareAWS-User-6593450answered 4 years ago0Hi vrkhareatawsThank you for getting back to me. I have tried the changes suggested and now recieve a new error message, 'InternalServerError: We encountered an internal error. Please try again.' I have added a snippet of code below for more insight:training_params = \{    "AlgorithmSpecification": {        "TrainingImage": training_image,         "TrainingInputMode": "Pipe"    },    "RoleArn": role,    "OutputDataConfig": {        "S3OutputPath": s3_output_path    },    "ResourceConfig": {        "InstanceCount": 1,           "InstanceType": "ml.p3.2xlarge",        "VolumeSizeInGB": 50    },    "TrainingJobName": job_name,    "HyperParameters": {          "base_network": "resnet-50",         "use_pretrained_model": "1",         "num_classes": "1",         "mini_batch_size": "1",         "epochs": "5",         "learning_rate": "0.001",         "lr_scheduler_step": "3,6",         "lr_scheduler_factor": "0.1",         "optimizer": "rmsprop",         "momentum": "0.9",         "weight_decay": "0.0005",         "overlap_threshold": "0.5",         "nms_threshold": "0.45",         "image_shape": "300",         "label_width": "350",         "num_training_samples": str(num_training_samples)    },    "StoppingCondition": {        "MaxRuntimeInSeconds": 86400    },    "InputDataConfig": [        {            "ChannelName": "train",            "DataSource": {                "S3DataSource": {                    "S3DataType": "AugmentedManifestFile", # NB. Augmented Manifest                    "S3Uri": s3_train_data_path,                    "S3DataDistributionType": "FullyReplicated",                    "AttributeNames": ["source-ref","Bird-Label-Train"]                 }            },            "ContentType": "application/x-recordio",            "RecordWrapperType": "RecordIO",            "CompressionType": "None"        },        {            "ChannelName": "validation",            "DataSource": {                "S3DataSource": {                    "S3DataType": "AugmentedManifestFile", # NB. Augmented Manifest                    "S3Uri": s3_validation_data_path,                    "S3DataDistributionType": "FullyReplicated",                    "AttributeNames": ["source-ref","Bird-Label"]                 }            },            "ContentType": "application/x-recordio",            "RecordWrapperType": "RecordIO",            "CompressionType": "None"        }    ]}I had run 2 seperate labelling jobs to get my training and validation set which have different names. "Bird-Label" for my validation and "Bird-Label-Train" for training. As you can see in the "AttributeNames" fields.I would also like to point out that my decision for using the image content type was due to this sentence, "However you can also train in pipe mode using the image files (image/png, image/jpeg, and application/x-image), without creating RecordIO files, by using the augmented manifest format." from this guide (https://docs.aws.amazon.com/sagemaker/latest/dg/image-classification.html).Please let me know if you understand what is causing this error. Thank You!CommentShareLuciAanswered 4 years ago0Hi JonathanB-AWSThank you for sending me really useful links.Having sorted through the information, I understood that my JSON was slightly different. Having gone back to basics, I created another labelling job, but used the 'Bouding Box' type as opposed to the 'Custom - Bounding box template'. My output matched what was expected. This ran with no errors!As my purpose was to have multiple labels, I was able to edit the files and mapping of my output manifests, which also worked!i.e.{"source-ref":"s3://xxxxx/Blackbird_15.JPG","ValidateBird":{"annotations":[{"class_id":0,"width":2023,"top":665,"height":1421,"left":1312}],"image_size":[{"width":3872,"depth":3,"height":2592}]},"ValidateBird-metadata":{"job-name":"labeling-job/validatebird","class-map":{"0":"Blackbird"},"human-annotated":"yes","objects":[{"confidence":0.09}],"creation-date":"2019-02-09T14:23:51.174131","type":"groundtruth/object-detection"}}{"source-ref":"s3://xxxx/Pigeon_19.JPG","ValidateBird":{"annotations":[{"class_id":2,"width":784,"top":634,"height":1657,"left":1306}],"image_size":[{"width":3872,"depth":3,"height":2592}]},"ValidateBird-metadata":{"job-name":"labeling-job/validatebird","class-map":{"2":"Pigeon"},"human-annotated":"yes","objects":[{"confidence":0.09}],"creation-date":"2019-02-09T14:23:51.074809","type":"groundtruth/object-detection"}}The original mapping was 0:'Bird' for all images through the labelling job.Thank you for your help!CommentShareLuciAanswered 4 years ago"


Question: We need to point two domains to the same EC2. It is not working.

"We are looking to solve a problem with NGINX in AWS. It is not pointing correctly and pointing to a port 5000. We have not specified the setting in the config file. Also, our EC2 is showing that is not connected to the domain but it is the only EC2 we have, which in fact points to our domain. There are no errors shown.We need to point two domains to the same EC2. We are using AWS and trying to avoid having to create a new server. Is there a video anyone may be able to share or correct the process? Thank you!FollowComment"

Answer: "0Hello there, I understand that you  need to point two domains to the same ec2, and the resolution to that would be the following:Make sure that your instance has an elastic ip address which helps the instance to have a static ip. See reference [1] for Elastic IP addresses.Create the two A records (Domains) in the DNS Zone of your same or different registrar pointing to the elastic ip of your EC2 instance to get the requests routed. See reference [2] for more information on creating records.Please note that if you are having a public DNS instead of an Elastic IP address, you can add CNAME records instead of A records.References:[1] https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/elastic-ip-addresses-eip.html[2] https://docs.aws.amazon.com/Route53/latest/DeveloperGuide/resource-record-sets-creating.htmlCommentShareAsenathianswered a year ago"


Question: Custom User Authentication through SOAP Call from Cognito

"Hi All, I am trying to build a solution for a customer and the requirement is to authenticate the user using their LoginService (Legacy SOAP Call) from Cognito.  The flow looks like this  UI-->Cognito-->SOAP Call-->Cognito--UI. Any suggestions on this implementation?FollowComment"

Answer: "0You can use a Pre authentication Lambda trigger. Now within your Lambda function you can make a call to your SOAP service (provided it has connectivity and has access) and receive the response (authenticate).  For Pre authentication response parameters,Amazon Cognito does not expect any additional return information in the response. Your function can return an error to reject the sign-in attempt, or use API operations to query and modify your resources. Once authenticate Cognito can return response to your UI.CommentShareEXPERTParnabanswered 9 months ago"


Question: Delete an SSL/TLS certificate for distribution

"Hi,I used some test certificates for a distribution.Now these certificates are no longer in use and distribution is disabled.I've also removed all DNS referrals although in theory this shouldn't affect it.As indicated in the guides I should be able to delete the certificates if they are no longer in use, but no menu appears to be able to do so.Guide references:https://lightsail.aws.amazon.com/ls/docs/en_us/articles/amazon-lightsail-deleting-distribution-certificatesThanksFollowComment"

Answer: "0Accepted AnswerHi,You can view certificates by navigating to the Account page via the dropdown at the top-right of the console. Once on the Account page, select the Certificates tab to view and manage your certificates.CommentSharejsctaanswered 4 months ago"


Question: Installing extra modules in PHP 7.3 in Codebuild

We are attempting to install an extra module into PHP however getting an error when we enable amazon linux extras:From the build log:Running command /usr/bin/amazon-linux-extras enable php7.3 /usr/local/bin/python: No module named amazon_linux_extrasRelevent section of Buildspec (in the install phase):    commands:      - php -v      - yum -y install amazon-linux-extras yum-utils python-boto      - /usr/bin/amazon-linux-extras enable php7.3      - yum install -y php-mcrypt What are we missing????FollowComment

Answer: "0Hi jorgr,We do not add amazon-linux-extras as a module for Python 3. You can copy this module fromPython 2 to Python 3 by using the following command:cp -r /lib/python2.7/site-packages/amazon_linux_extras /usr/local/lib/python3.7/site-packagesBest,ZhenCommentShareAWS-User-7837917answered 4 years ago0Correct command to copy the module would be:cp -r /usr/lib/python2.7/site-packages/amazon_linux_extras /usr/local/python37/lib/python3.7/site-packagesCommentSharedmitrypischalnikovanswered 3 years ago0As noted in another reply, amazon-linux-extras is only available under python 2. Python 2 is officially sunsetted. Now that python defaults to python3 in Amazon Linux 2, this has broken amazon-linux-extras and AWS should address the issue.After inspecting the script amazon-linux-extras, I saw that if the variable PYTHON is not defined, it uses python by default. To work around, rather than copying any files, we can simply tell it to use python 2:PYTHON=python2 amazon-linux-extras enable <package-name>CommentSharedustin-rcganswered 3 years ago"


Question: Amazon Polly Not Working  on my Website

I have been using Amazon Polly to make Text to Speech audios on my website but it stopped working. The problem is that I cannot see any error log on my web server. Can someone help? Thank you!FollowComment

Answer: "0Hi,To understand more about the issues, could you please provide more information about how the Polly integrate with your website? Did you utilize with AWS SDK to enable it for you website?Or some customers are installed AWS for WordPress plugin to enable it on the website, if this is the case, please check the plugin version and try to upgrade/downgrade to another version. Here is the link for the details of the plugin - https://wordpress.org/plugins/amazon-polly/Thanks,CommentShareJadyanswered 9 months ago"


Question: should i need to use global accelerator?

"hello guys , i am hosting my landing page in amazon ec2 , my all traffic is from india only and my ec2 server location is mumbai , should i need to use global accelerator for me ? because i want to make my landing page as fast as possible , if yes then i tried to create but i got health check error so , can you give any good doc for setup accelerator for ec2FollowComment"

Answer: "1Curious why you want to use Global Accelerator and not Cloudfront. If it is a web application, Cloudfront is a better option compared to Global Accelerator.Please take a look at this in the Global Accelerator FAQs - https://aws.amazon.com/global-accelerator/faqs/Q: How is AWS Global Accelerator different from Amazon CloudFront?A: AWS Global Accelerator and Amazon CloudFront are separate services that use the AWS global network and its edge locations around the world. CloudFront improves performance for both cacheable content (such as images and videos) and dynamic content (such as API acceleration and dynamic site delivery). Global Accelerator improves performance for a wide range of applications over TCP or UDP by proxying packets at the edge to applications running in one or more AWS Regions. Global Accelerator is a good fit for non-HTTP use cases, such as gaming (UDP), IoT (MQTT), or Voice over IP, as well as for **HTTP use cases that specifically require static IP addresses **or deterministic, fast regional failover. Both services integrate with AWS Shield for DDoS protection.Does your web application require static IP addresses?CommentShareEXPERTIndranil Banerjee AWSanswered 8 months agoTushar_J EXPERT8 months ago+1, good pointsShare0Accepted AnswerHello,There are some considerations when you add an EC2 as endpoint to Global Accelerator, see the list here:Amazon EC2 instance endpointsAn EC2 instance endpoint can't be one of the following types: C1, CC1, CC2, CG1, CG2, CR1, CS1, G1, G2, HI1, HS1, M1, M2, M3, or T1.EC2 instances are supported as endpoints in only some AWS Regions. For a list of supported Regions, see Supported AWS Regions for client IP address preservation.We recommend that you remove an EC2 instance from Global Accelerator endpoint groups before you terminate the instance. If you terminate an EC2 instance before you remove it from an endpoint group in Global Accelerator, and then you create another instance in the same VPC with the same private IP address, and health checks pass, Global Accelerator will route traffic to the new endpoint.EC2 instances cannot be added as dual-stack endpoints.Here is the user guide for Adding, editing, or removing a standard endpointCommentShareEXPERTTushar_Janswered 8 months ago"


Question: FTPS server unreachable with Internet Facing

"I have set up an FTPS  Server using AWS Server Family but cannot connect.My Identity Provider is Custom Lambda and Endpoint Type is VPC/Internet Facing. During configuration, I selected Public Subnet and Elastic IP.I probably misconfigured the network components:VPCSubnets (1 public and 1 private)Elastic IPI am using the WINSCP client configured this way:File Protocol:  FTPEncryption: TLS/SSL Explicit encryptionPort number: 21Username / PasswordConnection failed.Login with USER firstThanksLFollowComment"

Answer: "0@luk3tt0 Difficult to diagnose with the information provided, but this error message would suggest you sent a PASS command with the password before sending a USER <user id> command.CommentShareEXPERTAWSTransferFamilyanswered 8 months ago0How can I do a complete troubleshooting? I changed VPC configuration. Now I can connect but I can't show files. Probably there is a permission issueThis is policy attached to role.{    "Version": "2012-10-17",    "Statement": [        {            "Action": [                "s3:ListBucket",                "s3:GetBucketLocation"            ],            "Resource": [                "arn:aws:s3:::*"            ],            "Effect": "Allow",            "Sid": "ReadWriteS3"        },        {            "Action": [                "s3:PutObject",                "s3:GetObject",                "s3:DeleteObject",                "s3:DeleteObjectVersion",                "s3:GetObjectVersion",                "s3:GetObjectACL",                "s3:PutObjectACL"            ],            "Resource": [                "arn:aws:s3:::*"            ],            "Effect": "Allow",            "Sid": ""        }    ]}CommentShareluk3tt0answered 8 months ago0This is FTP Client LogCommentShareluk3tt0answered 8 months ago0@luk3tt0,As per the FTP client log that you shared, it seems there might be an issue in Security Groups not allowing traffic through required DataChannel ports. User is able to login to the server implies that Security Group allows ControlChannel traffic. However, a subsequent timeout for an ls might indicate that Data Channel traffic is blocked.AWS Transfer Family uses Port 21 for Control Channel and Port Range [8192-8200] for Data Channel for FTP/FTPS protocols.Would you be able to update your Security Group associated to the server endpoint and allow inbound traffic through these ports and retry ?Also, the permissions you shared above for accessing S3 seem correct and grant defined permissions to all S3 buckets. However, do note that if your HomeDirectory is explicitly set to / and you are not using Logical Directories for your User, you are basically at the root of S3 - implying that an ls operation at this level would return all S3 buckets in your account. If you intend to do that, you would require additional permissions for s3:ListAllMyBuckets for the Resource: *.Let me know if you have further questions.-- SagarCommentShareEXPERTsagarb-awsanswered 8 months ago"


Question: How many times was a HIT returned?

"Hi,We currently have a set of HITs uploaded on Mechanical Turk and we realize that the uptake (the number of workers accepting and submitting our tasks) is very low. It has been 3 days since our HITs were uploaded and I am wondering if the low uptake has to do with the complexity of our HIT.My question is - is there as way to fetch the number of times a HIT was accepted and returned? The current API and data structure for a HIT does not include a field with this information - https://docs.aws.amazon.com/AWSMechTurk/latest/AWSMturkAPI/ApiReference_HITDataStructureArticle.htmlAny pointers greatly appreciated.Best,FollowCommentAWS-User-2773962 a year agoPlease check the amount of time required to complete the task and consider adjusting rewards. Alternately, I recommend reviewing the qualifications to ensure that you haven't selected many premium qualifications and thus reduced the number of eligible workers below what is needed for effective throughput.Share"


Question: Cannot delete ENI attached to destroyed EKS

"Hello. via terraform I've created a stack with EKS. On EKS I did setup aws-load-balancer-ingress-conotroller and traefik.Before to destroy everything via terraform I didn't delete the 2 pods for my alb and traefik service.Doing so I'm not able to delete the eni created by these process.I'm root in my account and I run also the following commandaws ec2 detach-network-interface --attachment-id eni-attach-xxxxxxxx --forceAn error occurred (AuthFailure) when calling the DetachNetworkInterface operation: You do not have permission to access the specified resource.Also I've a basic account, so I cannot contact the support in order to ask them to delete for me.Can please someone shed some light ?ThanksFollowComment"

Answer: "0Hello Michael and thanks for answering :)The problem is that my cluster is already deleted but there is some security groups which was created by our deployment (aws-alb-ingress-controller) did created these eni.Because I deleted the cluster before to delete the aws-alb-ingress-controller, this made the ENI still attached and impossible to be removed.How I can do that now ? I don't have the paying support :(CommentShareAWS-User-7974421answered a year agoMichael_F EXPERTa year agoThat ENI is probably associated with an Application Load Balancer associated with your account that was created by the controller. Destroy the ALB and the ENIs will also be deprovisioned.Share0You are most likely trying to delete one of the network interfaces associated with the EKS cluster endpoint that is projected into your VPC. Since the EKS cluster is "owned" by AWS, you cannot delete the cluster's ENIs, even as the root account. Once you successfully destroy the cluster, the ENIs will disappear.Also, please be advised that accessing AWS via the root account is a disfavored approach and so we do not recommend it. See our best practices guidance for additional details.CommentShareEXPERTMichael_Fanswered a year ago"


Question: In game purchasing of assets

"Hi,Is there a way of adding functionality to allow in game purchasing of assets e.g. weapons with Unity and GameKit/Lift/Sparks? Or a third party plugin that'll allow this.Thanks,BhavFollowComment"

Answer: "0That functionality is not currently available as part of GameKit, GameLift or GameSparks directly.CommentShareJohnanswered 8 months agoND Bhav 8 months agoOkay thank you John. Do you know of a third-party solution which does this?Share"


Question: Setup AWS Cloudistribution for multiple flutter apps

"Hi AWS, we deployed multiple flutter apps in a single bucket in different folders. We want to access all these apps using a single distribution in cloudformation. We are unable to do this because we are getting "Access Denied".Can you please help in rectifying this and give some sample templates which can relate to this issue?ThanksFollowComment"


Question: AWS RUM is not showing HTTP requests other than scripts

"I have added AWS RUM to an Angular app by using TS snippet. In the config I'm using this telemetry configtelemetries: ["performance","errors",[ 'http', { recordAllRequests: true } ]],I can see in my app dev tools network tab that request are being sent with http_eventstype: "com.amazon.rum.http_event"with details containing http method type call etc..The problem is in AWS console in RUM module Requests tab I see only requests for scripts, css files. Is there any extra config needed to see GET/POST requests in aws console?FollowComment"

Answer: "0Hello, and thanks for reaching out!When configuring the telemetries parameters in the config and specifying non-default options, you'll want to be sure to specify each telemetry as its own array, as seen in the examples here.Try specifying the telemetries as the following and let me know if you see any changes in behavior:telemetries: ["performance","errors",["http",{recordAllRequests: true}]],CommentShareSUPPORT ENGINEERJustin_Banswered a year agoAWS-User-7162334 a year agoI am experiencing the same thing with a React APP. Not seeing any of the com.amazon.rum.http_event on the console for API calls being made. I have        telemetries: [            "performance",            "errors",            [ 'http', { recordAllRequests: true, addXRayTraceIdHeader: true } ]        ],Share0I have forked the RUM client. Quick fix for our specific use case, but it tracks ALL API calls (including after initial page load and ignoring max events configuration) as performance metrics.You will have to force the OTHER type in all recorded types rather than sampled        telemetries: [            [ "performance", {recordAllTypes: ['document', 'script', 'other']} ],            "errors",            "http"        ],https://github.com/samholton/aws-rum-web/releases/tag/v1.5.1-api-patchCommentShareAWS-User-7162334answered a year ago"


Question: Producing percentage outputs on Quicksight

"When I try to populate a range of percentage values in my column, it seems to just aggregate all the percentages and provide (before selection) outputs like:2,291.88 % or 2,700 %The values in my columns are already in percentage form.I would like to produce the exact percentage value on my KPI visualisation tile, if one day is selected on my calendar. If I select a few days, can I produce a more resonsable average percentage value for those days instead of values like: 2,291.88 % or 2,700 %FollowComment"


Question: Amazon Connect Chat Flows based on website

"I'm comparing Amazon Connect Chat with our vendors and not real familiar with Amazon Connect.  We host many different websites for clients and need chat widgets on those different websites for different clients.  So we would need to have a route/flow for the chat request to the correct agent based on the web site it came from.  Is there an easy way in the widget code to pass the website page that the chat request started from into the flow and make it go to different queues based on that?  I'd rather not create our own chat widget using the API but would also be curious if it could be done with that.  Also, is the 5 domain a hard limit or is there a way to allow more domains?FollowComment"

Answer: "0This is exactly why we made Amazon Connect Chat Widget to drop a few line of codes to enable websites to have a chat icon to initiate chat, try it out!https://docs.aws.amazon.com/connect/latest/adminguide/add-chat-to-website.htmlCommentShareClarenceChoianswered 6 months agoNathan 6 months agoYes, but if we put the widget on multiple websites, how do we know what website the chat is coming from?  We want to route the chat to different agents based on the website the chat originates from.Share0Please find answers to your queries below:Query 1 : Is there an easy way in the widget code to pass the website page that the chat request started from into the flow and make it go to different queues based on that?I believe we can achieve this with JSON Web Tokens (JWTs) for new chat requests. This provides you more control when initiating new chats, including the ability to verify if the chat requests sent to Amazon Connect are from authenticated users. However, using this you have to manually pass the “Domain name” and further you can pass contact attributes, which you can then check in the flow and branch to different queues based on that. Kindly refer to links [1] and [2] for your reference.Query 2 :  I'd rather not create our own chat widget using the API but would also be curious if it could be done with that.Yes this is possible. Please refer to the link [3] for the same. This repo contains examples on how to implement the customer side of Amazon Connect chat. I would also request you to refer the sub links in [3] as it will help you understand the possibility of your use case in the best way possible.Query 3 : Also, is the 5 domain a hard limit or is there a way to allow more domains?Currently, 5 domains is the threshold limit and it’s not allowed to increase this limit as per the instance level.References:-[1] Add a chat user interface to your website: https://docs.aws.amazon.com/connect/latest/adminguide/add-chat-to-website.html[2] Pass contact attributes when a chat initializes: https://docs.aws.amazon.com/connect/latest/adminguide/pass-contact-attributes-chat.html[3] Amazon Connect Chat UI Examples: https://github.com/amazon-connect/amazon-connect-chat-ui-examples/CommentSharerePost-User-9867428answered 6 months ago"


Question: Trying to ensure ECS service only has one task running at a time

"I have a container that I only ever want one instance of running at a time.I have my ECS deployment configured to have minimum healthy during deploy to be 0%, and max healthy to be 100%, and desired tasks to be 1.This was working great for a while, when deploying it would wait until the running task completely stopped, and then start a new one, but in the past couple weeks this changed. It shows as stopped in the console for several minutes before the process actually receives a SIGTERM.As far as I can tell this seems to be a change on amazon's side, perhaps what I was doing was not an intended use-case?Is there a way to ensure there is ever only 1 instance of the task running even during deploy?FollowComment"

Answer: 0Is your Service's schedulingStrategy set to REPLICA instead of DAEMON? Has your cluster's capacity changed?CommentShareBrad Werneranswered 4 months agoAdamB 4 months agoWe are using FARGATE which looks like it does not support DAEMON.Share


Question: SES:535 Authentication Credentials Invalid

"Hi,We have been using SES for the past 4 years without any problem.Last Saturday 19 March 2023, I created a new set of SMTP credentials  to configure email sending method in Region Asia Pacific (Mumbai).Encountered the below in Oracle Apex Mail Queue:ORA-29279: SMTP permanent error: 535 Authentication Credentials InvalidUpon searching and enquiring the reason, I found the policy attached  - AmazonSesSendingAccess - has some Unrecognized actions .Copy of the text from the page Edit AmazonSesSendingAccess is below:ServicePinpoint EmailActionsUnrecognized actionsIAM does not recognize one or more actions. The action name might include a typo or might be part of a previewed or custom service.SendRawEmailResourcesAll resourcesRequest conditionsSpecify request conditions (optional)ServiceSES v2ActionsUnrecognized actionsIAM does not recognize one or more actions. The action name might include a typo or might be part of a previewed or custom service.SendRawEmailResourcesAll resourcesServiceSESActionsWriteSendRawEmailResourcesAll resourcesWhere am I going wrong? Or Is it a problem at AWS SES, yet to be fixed?Any help on this will be highly appreciated.Thank you all.RajaFollowComment"

Answer: "0Resolved, problem was with the client application, not updating the credentials.ThanksRajaCommentSharerePost-User-9410375answered 2 months ago"


Question: Cloudformation changesets

"I am in the need to update a Cloudformation stack that has references of another stack. I created a changeset with the updated template and modified the reference to the actual value. The value of change is the web-acl ID. I am hoping that the minor change I made does not recreate the load balancers. My question is, if I only change the web-acl reference to the value of the actual ID, does it recreate everything when I commit the change.FollowComment"

Answer: "0Accepted AnswerHi ,CloudFormation updates the stack. If there is a diff, it will create the resources and rest of things are updated.To have a better view, follow below steps:Go to Cloud Formation console.Select your stack. It will take you to stack detail page.Click on Events header ( next to Stack Info ). It will provide granular details on what resources is being created & what is updated.CommentShareUchiha_Madaraanswered a year agoStephenMichael a year agoThank you! I will check those granular details and let you know my outcome.Thanks again!ShareStephenMichael a year agoI see these changes in the gui and cli, so I think I am good, it's just changing a web-acl ID."Details": [{"Target": {"Attribute": "Properties","Name": "WebACLId","RequiresRecreation": "Conditionally"},"Evaluation": "Static","ChangeSource": "DirectModification"Thanks for your help.Share"


Question: S3 bucket blocking request

"Hello,I'm using my s3 bucket for storage our NFT collection metadata also jpegs.Yesterday we shared our collection and NFT market places can't show our images and they said your server has high request error. And also some other error.For example; https://www.topaz.so/assets/HalloweenBoi-834048d84a/HalloweenBoi%20%2374/0My bucket sample json url: http://mutantboi.xyz.s3-us-west-1.amazonaws.com/hb/g/44.jsonImage can't seen on website and has some error on network section like that: "mixed Content: The page at '<URL>' was loaded over HTTPS, but requested an insecure XMLHttpRequest endpoint '<URL>'. This request has been blocked; the content must be served over HTTPS."So1- How can I fix that high request problem on AWS?2- How can I fix "Mixed Content: The page at '<URL>' was loaded over HTTPS, but requested an insecure XMLHttpRequest endpoint '<URL>'. This request has been blocked; the content must be served over HTTPS." problem?Anyone has Idea?FollowComment"

Answer: "0Are you using CloudFront? In the tags you mentioned it but not in the issue description. If you use CloudFront, you can setup CORS headers to allow requests coming from 3rd party domain names (lile www.topaz.co). You can do it by using Response Headers policy as described here: https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/adding-response-headers.htmlYou can aslo configure Redirect HTTP to HTTPS viewer request policy to make users send only HTTPs: https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/distribution-web-values-specify.html#DownloadDistValuesViewerProtocolPolicyFinally, it is recommended to disable public access to S3 and use CloudFront Origin Access Control instead: https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/private-content-restricting-access-to-s3.htmlCommentShareYury Yakubovanswered 7 months ago0Hello, Answering your both queries:How can I fix that high request problem on AWS?A. You can send 3,500 PUT/COPY/POST/DELETE and 5,500 GET/HEAD requests per second per partitioned prefix in an Amazon S3 bucket. When you have a sustained, increased request rate to your bucket, S3 can return 503 SlowDown errors while scaling to support the request rate. This scaling process is called partitioning.To avoid this high request problem with S3 bucket, you can configure your application to gradually increase the request rate and retry failed requests using an exponential back-off algorithm or you can distribute objects and requests across multiple prefixes.[+] Amazon S3 Best Practices - https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimizing-performance.htmlHow to fix "Mixed content" problem?A. The best strategy to avoid mixed content blocking is to serve all the content as HTTPS instead of HTTP.For your own domain, serve all content as HTTPS and fix your links. Often, the HTTPS version of the content already exists and this just requires adding an "s" to links - http:// to https://.Amazon S3 website endpoints do not support HTTPS or access points. If you want to use HTTPS, you can use Amazon CloudFront to serve a static website hosted on Amazon S3.Using CloudFront with S3 - https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/using-https-cloudfront-to-s3-origin.htmlCommentShareSUPPORT ENGINEERAafreen_Kanswered 7 months ago"


Question: Restore Deleted S3 Bucket

I deleted some of my S3 buckets few months ago. Is it possible to restore them?FollowComment

Answer: 0Only if you made a backup of them or copied them somewhere else.Here is some information on creating S3 backups.https://docs.aws.amazon.com/aws-backup/latest/devguide/s3-backups.htmlCommentSharetedtrentanswered 5 months ago


Question: SageMaker Data Wrangler UI Features

"The SageMaker Data Wrangler UI in SageMaker Studio doesn't seem to support all the features that the API does.  When will the UI support:Loading all s3 objects under a prefix?  https://aws-data-wrangler.readthedocs.io/en/stable/stubs/awswrangler.s3.read_csv.html#awswrangler.s3.read_csvLoading JSON objects in addition to CSV and Parquet files?  https://aws-data-wrangler.readthedocs.io/en/stable/stubs/awswrangler.s3.read_json.html#awswrangler.s3.read_jsonFollowCommentTulio Alberto a year agoThese two have no relation whatsoever. SageMaker Data Wrangler is a UI feature inside SageMaker Studio to accelerate your data cleaning/processing. AWS Data Wrangler is an open-source Python library to load different AWS sources, such S3, Athena or Redshift, directly into pandas.Share"

Answer: "2Accepted AnswerAs mentioned by Tulio Alberto in comments, Amazon SageMaker Data Wrangler (the graphical data preparation feature inside Amazon SageMaker) is separate from AWS Data Wrangler (an open-source data prep utility published by AWS Labs): The two tools are based on different technologies and don't necessarily aim for full feature parity - they just happen to share similar names.To my knowledge there's no committed timeline we can share at the moment for when these particular features will make it to SageMaker Data Wrangler, but I think as feature requests they make sense and the reasoning for both is pretty clear: I'm aware that both have been discussed to some extent internally already, and I'd personally like to see them launch too!Thanks for sharing the feedback, and apologies for the naming confusion!CommentShareEXPERTAlex_Tanswered a year ago0Hi Tulio, thanks for the clarification.  But doesn't SageMaker Data Wrangler generate code that complies with/uses AWS Data Wrangler?  Isn't there some (if tenuous) connection between the two?CommentSharezzzz8888answered a year agoAlex_T EXPERTa year agoHi zzzz - Tulio is correct here: AWS DW and SageMaker DW aren't really related and are certainly not feature-matched... They just happen to share the 'data wrangler' name. Sorry for the confusion!Share0Hi,SageMaker Data Wrangler in Studio  just launched the JSON/ORC support and we support import files under a prefix already. Please see the following linkshttps://docs.aws.amazon.com/sagemaker/latest/dg/data-wrangler-import.html#data-wrangler-import-s3https://aws.amazon.com/blogs/machine-learning/prepare-and-analyze-json-and-orc-data-with-amazon-sagemaker-data-wrangler/CommentShareTheDataWranglersanswered a year ago"


Question: Need Help in Migrating documents from Corporate workdocs to private workdocs

"Hi ,I have a task to migrate documents of size more than 400 GB from corporate workdocs to team specific private workdocs. There is very less space in my laptop. Hence cannot download documents in Bulk.Any leads or help would be appreciatedRegards,NeethuFollowComment"

Answer: "0One way could be to download the files to S3 and then migrate to S3. Instead of laptop, you can if possible , also spin up a server in the cloud to do the migration.CommentShareEXPERTAWS-User-Nitinanswered 6 days ago"


Question: Call Third party API call from Amplify Lambda

"Hello,I would like to create a third party API call from an amplify lambda.I have seen the following page: https://docs.amplify.aws/cli/function/but no example of a simple external API call with an Authorization Bearer token which is quite common. Could someone provide one example for the supported Lambda runtimes ?Thanks in advance.FollowComment"

Answer: 0This is a external example (not provided by AWS or any of AWS architects) but it can help you in your situation: https://levelup.gitconnected.com/calling-external-rest-service-from-aws-lambda-part-2-c83f87b1e88aCommentShareEXPERTDaniel ABIBanswered 5 months ago


Question: Mapping subdirectory to lightsail instance

"Hello,I'm building a website (Nextjs) on example.com deployed with AWS Beanstalk.I'd like to create a second website on example.com/blog, a wordpress instance on Lightsail.Do you know how can I map example.com/blog/* to lightsail and example.com to my EC2 instance ?ThanksFollowComment"

Answer: "0To do that, you'll probably need a server of some kind that has a static IP and that has example.com associated with it. This server would be in front of Beanstalk and Lightsail and could route the traffic appropriately. You could manage such a server yourself or use a managed load balancer with some custom rules to do the job. Here's some info about ALB that might be helpful: https://docs.aws.amazon.com/elasticloadbalancing/latest/application/listener-update-rules.html.Another option to consider is to host your blog at blog.example.com. That way, you could use a simple A record to point to the static IP of your Lightsail Instance for your blog. You could use another ALIAS or CNAME record to point to your Beanstalk app. Here's some more info: https://docs.aws.amazon.com/Route53/latest/DeveloperGuide/routing-to-beanstalk-environment.html.CommentShareAlexanswered a year ago0I would use CloudFront for this. It gives you the ability to map URL paths to specific destinations (origins in CloudFront). You also get caching; global reach; the ability to use Lambda@Edge to manipulate requests and responses in (near) real-time; and lower data transfer rates from origins in AWS.CommentShareEXPERTBrettski-AWSanswered a year ago0Thanks for your answers !I managed to do that with another method that I'll describe below just so you know.Create a Wordpress instance on lightsail.Set up Amazon VPC peering to work with AWS resources outside of Amazon Lightsail : https://lightsail.aws.amazon.com/ls/docs/en_us/articles/lightsail-how-to-set-up-vpc-peering-with-aws-resourcesCreate a AWS Beanstalk and follow this tutorial on the EC2 instance associated with my Beanstalk https://blog.commutatus.com/how-to-configure-a-reverse-proxy-in-aws-b164de91176eJust use the private IP associated with your Wordpress lightsail instead of an EC2 instance in Step 6It works !Don't hesitate to tell me if my method is not good, but it works so far.CommentSharebbourgeoisanswered a year ago"


Question: Configure request and response mapping template when creating a resolver

Where has the option of configuring request and response mapping template gone when creating a resolver for your data source? The way it was done in VTL?FollowCommentMLGuy 4 months agoWhat is the issue?Share


Question: Does deleting EKS nodes also delete corresponding EC2 instances?

"If i delete the kubernetes nodes using   kubectl delete node node_name , will EKS automatically deletes the EC2 VM's too?FollowComment"

Answer: "0Hi,No,  removes the node from EKS,  but doesn't terminate the EC2 instance. If you want to completely remove your worker nodes, you should use "eksctl" (or the AWS console):eksctl delete nodegroup --cluster=clusterName --name=nodegroupNameAccording to AWS documentation, this command sets the minimum, maximum, and desired size of your Auto Scaling group to zero, and sends a signal to drain the Pods before terminating the instance.CommentShareMikel Del Tioanswered 16 days agoAWS-Harrison 13 days agoAnd if you want to delete just one node, but not the whole node group:You the kubectl drain command on that node to remove the pods from it. Validate.Terminate the instance through AWS. You could do this through the CLI, Console, or AutoScaling Group.Share"


Question: "schema name was not found when running a query lambda function into Athena. However,  when running in Athena it works"

"schema name was not found when running a query lambda function into Athena. However, when running the same exact query in Athena it works (see attachment)FollowComment"

Answer: "0Is your boto3.client for the right region and account?  Regio nwill be picked up from your environment or you can specify it to boto3.client('athena', region_name).CommentShareEXPERTskinsmananswered 4 months agorePost-User-2065931 4 months agoya its the right region and account, tried stating the region name, still returning the same error :/Shareskinsman EXPERT4 months agoOut of curiosity I tried pretty much exactly what you're doing and it worked fine until I deliberately put a wrong schema name in the query, then I got your error.  I'm stumped, I can't think of anything else that could be wrong.Share"


Question: Instance reachability check failed

"HiIn the Instance status checks show "Instance reachability check failed" and I am unable to SSH to the Instance.The AWS Compute Optimizer was throwing an error in EBS for reading and write bandwidth, so I decided to upgrade the instance from t2.medium to t3.large, also the hard drive from 8GB to 16GB to gp3. Now It shows Running. But in Status checks, Instance status check shows "Instance reachability check failed". The instance was working fine a few days back.I tried rebooting instance. It doesn't reboot. I start stop and start, that works and shows Running, but same instance status check issue.I tried rescue option mentioned in https://aws.amazon.com/premiumsupport/knowledge-center/ec2-instance-boot-issues/, but still the same issue.Here is the system log[   12.483121]  </TASK> [   12.485967] Kernel Offset: 0x10600000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff) [   12.497046] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000100 ]---FollowComment"

Answer: "0Hi TherePlease take a look at this support article, there are several reasons why a Linux instance might fail to start when moving from t2 to t3.Here are some common reasons why a Linux instance might not boot after you change it to a Nitro-based type:1.The Elastic Network Adapter (ENA) enaSupport attribute is disabled for the instance.2.The ENA module isn't installed on the instance.3.The NVMe module isn't installed on the instance, or, if installed, the NVMe module isn't loaded in the initramfs image of the instance.4.You are trying to mount the file systems at boot time in the "/etc/fstab" file using a device name. Amazon Elastic Block Store (Amazon EBS) volumes are exposed as NVMe devices to these instance types, and the device names are changed. To avoid this, mount the file systems using UUID/Label. For more information, see Amazon EBS and NVMe on Linux instances.https://aws.amazon.com/premiumsupport/knowledge-center/boot-error-linux-nitro-instance/√ If my answer addressed your question adequately, please consider clicking the ACCEPT button. It helps the community find answers to similar questions more quicklyCommentShareEXPERTMatt-Banswered 8 months ago"


Question: Charge for download Get-S3PreSignedURL inside AWS network?

I want to have RDS SQL Server SQL Agent job import data from a S3 Get-S3PreSignedURL source using a Powershell script job step.Since this is inside the AWS framework (The RDS server is AWS and the S3 link is AWS and both are my account) do I get charged for the transfer of the data from the S3 to my RDS SQL Server instance?FollowComment

Answer: "0Hi,there is no change for transferring the data between S3 to the VPC where the RDS is running as long they are in the same region (https://aws.amazon.com/s3/pricing).However, if your RDS instance is running on a private subnet you might need to setup a NAT gateway (or 2 for high availability ) to reach Internet and the S3 bucket. In this case you will pay for the NAT gateway.To avoid that cost you could use a VPC Gateway endpoint https://docs.aws.amazon.com/vpc/latest/privatelink/gateway-endpoints.html that will allow you to reach the S3 bucket directly from the internal AWS network and without the need of paying a NAT gateway.CommentShareSimone Tallevianswered a month agoSimone Tallevi a month agoDid this answer your question?Share"


Question: EC2 suddenly became very slow

"Hi, I'm using EC2 (t2.micro free tier) for my final year project. When I kept generating data and testing the query rate for my database, it suddenly became very slow and the query rate dropped from 1.46 queries/sec to 0.41 queries/sec, while I never changed my database. Firstly I thought it may be due to the CPU credits, but it was still slow after I earned 120 credits. How to solve this problem? Thanks!FollowComment"

Answer: "0t2.micro are small instances with 1 vCPUs and 1 RAM (GiB) and baseline performance is 10% of this vCPU. You may want to look at your cloudwatch logs or your custom logs to see where the utilization is happening. You can perhaps try t2 unlimited or t3 instances.CommentShareEXPERTAWS-User-Nitinanswered 7 months agorePost-User-4805362 7 months agoThanks! Each time I conducted the test, the CPU utilisation was over 90%. However, earlier it performed much better even with high CPU utilisation (nothing changed and I just ran the same script again). For some query types, the rate even dropped from 37.56 queries/sec to 3.57 queries/sec. Why is it the case?Share"


Question: How to delete glue interactive session from the list of sessions?

"I have a session that I am using now for development, but I created some test sessions when I started using glue interactive sessions. I can see them when I list sessions with: %list_sessions.How do I delete them?I also have one with a name that I want to reuse, but when I try and create a session with that name, I get an error. I want to delete it to reuse it.botocore.errorfactory.AlreadyExistsException: An error occurred (AlreadyExistsException) when calling the CreateSession operation: Session already created, sessionId=<name I want to use.>FollowComment"

Answer: "3Hi , currently you can delete a specific session id using the CLI or APIs:aws glue delete-session --id <sessioID>as described in the documentation to get interactive session work you need to copy (only for the preview) the service json into the botocore folder.AWS CLI works as well with botocore, so you would need to copy/install the AWS CLI inside the Virtual env you are using and then copy the service json inside the botocore library in the AWS CLI path.Alternatively you could update the botocore service json for Glue in the native AWS CLI path (with the risk to have that updated with a preview content.)please consider that interactive session is still in preview.hope this helps,CommentShareEXPERTFabrizio@AWSanswered a year agojb-po a year agoWhat version CLI? I tried with aws-cli/2.4.19.   Not sure if I need to install via a different none v2 Github branch.ThxShareFabrizio@AWS EXPERTa year ago@jb-po please see my updated answerShare"


Question: What are some of the most important AWS terminologies and jargon that we must know:

So far I only found the following resources:https://enterprise.arcgis.com/en/server/10.3/cloud/amazon/introduction-to-aws-terminology.htmhttps://intellipaat.com/blog/tutorial/amazon-web-services-aws-tutorial/aws-cheat-sheet/FollowComment

Answer: "1The AWS Glossary from General Reference documentation is another great resource for AWS-related terms.CommentShareSUPPORT ENGINEERRon_Hanswered a year agoSUPPORT ENGINEERMonica_Lluisreviewed a year ago0Check out The 5 Pillars of the  AWS Well-Architected Framework as wellCommentShareRobert_Fanswered a year ago0If you want to do deep drive then you can go thru below documents.Architecting for the cloud:  https://d1.awsstatic.com/whitepapers/AWS_Cloud_Best_Practices.pdf (Archived)Whitepapers related to well-architected framework are mentioned here:  https://aws.amazon.com/blogs/aws/aws-well-architected-framework-updated-white-papers-tools-and-best-practices/Disaster recovery whitepaper:  https://d1.awsstatic.com/whitepapers/aws-disaster-recovery.pdf (Archived)AWS now recommends a well-architected framework whitepaper:  https://d1.awsstatic.com/whitepapers/architecture/AWS_Well-Architected_Framework.pdfCommentShareMaulik_Makadiyaanswered a year agoSUPPORT ENGINEERMonica_Lluisreviewed a year ago0Hello AWS-User-8231125, let us know if any of the answers provides solves your question. If so, please remember to click on the "Accept" button to let the community know that your question is resolved. This helps everyone. Thank you in advance.CommentShareSUPPORT ENGINEERMonica_Lluisanswered a year ago"


Question: lex fulfillment

"I want to give condition in fulfillment of an  intent but it's not working its saying invalid slot name.FollowCommentDon 5 months agoSwarup, We will help with this. Can you please share a request id for us to dive deep into this further?Shareswarup 4 months agoI don't have any request id for now, if you can solve my issue then tell meShare"


Question: Can I use IAM condition keys for iam:*ServiceSpecificCredential to only allow creation of CodeCommit credentials?

"I am looking to allow people to create service specific credentials but want to restrict them to only being able to create credentials for the CodeCommit service. I see the "Resource": "arn:aws:iam::*:user/${aws:username}" restriction in many of the example policies, and in the sample response I see the <ServiceName> constraint in the JSON return. What I can't find though is if there's a way in the IAM policy granting permission to restrict authorization to just allowing CodeCommit credentials, as opposed to Amazon Keyspaces.Is there a condition available to restrict this access? Thank you.FollowComment"

Answer: "0Unfortunately the documentation doesn't list any Conditions supported by that API method, which suggests you cannot limit it to just CodeCommit credentials (and not Keyspaces).Depending on if you actually  use Keyspaces, could you potentially deny the users access to Keyspaces in the same policy, so that any created credentials would be useless?CommentSharerowanuanswered 3 months ago"


Question: Can I use the RDS Postgresql S3 export query to replicate changes from RDS to S3?

"I found the link  for Postgres to s3 query export, and I wanted to check if I can use this to perform change data capture from RDS to S3.FollowComment"

Answer: "0Accepted AnswerWe recommend AWS Database Migration Service (DMS) to replicate changes or CDC from RDS to S3. The PostgreSQL query export copies data into S3, but not for CDC. You can add logic to the RDS to S3 query, which will only get the incremental changes. However, it is better to use DMS as this solution already manages the replication activities for you. DMS uses the pglogical extension, runs a query and writes the output to S3.CommentShareDevinder-theDBGuyanswered 2 years agoEXPERTJohn_Freviewed 2 years ago0As explained by @AWS-User-0586262 you can design your own CDC solution which leverages S3 export. You can use triggers to collect changes in a shadow table and then export them to S3 bucket at the end of the day (or any other defined frequency). Another approach could be to use a timestamp field to propagate changes at a defined frequency. Both these approaches will require you to devise your own solution which handles various scenarios and also does exception handling.An alternative could be to use wal2json plugin with AWS Lambda function and Amazon Kinesis stream. This option requires more effort to build but offers much greater level of flexibility. If you are looking for least effort solution then Amazon Database Migration Service will be a better fit. For both solutions, you need to enable logical replication on RDS PostgreSQL instance.CommentShareSameer@AWSanswered 2 years ago0You should consider Amazon Database Migration Service (DMS). Here is a lab which will help to understand the steps involved.https://catalog.us-east-1.prod.workshops.aws/v2/workshops/976050cc-0606-4b23-b49f-ca7b8ac4b153/en-US/400/401/430-main-labCommentShareRahul_Sanswered 2 years ago"


Question: "When using Kinesis Producer Library to aggregate records, send them to a Kinesis Data Stream, and run a Kinesis Data Analytics application, how is de-aggregation handled?"

"The Kinesis Producer Library aggregates records before sending them to a Kinesis Data Stream.When consuming records from that Data Stream with the Kinesis Consumer Library, record de-aggregation is automatic.For consuming records from that Data Stream with a Kinesis Data Analytics application, how is de-aggregation handled?Does the Data Analytics application de-aggregate records automatically?Does this case require running the Kinesis Consumer Library inside a Data Analytics application?Something else?FollowComment"

Answer: "0So this is a depends question.  The older Flink producer(org.apache.flink.streaming.connectors.kinesis.FlinkKinesisProducer) for kinesis did use de-aggregation by default, I believe, but there was a Flink configuration to turn it off.  The newer producer does not use de-aggregation.  I think that the version of KDA currently running today uses the older Flink Producer.https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/kinesis/As for consumers receiving these de-aggregated records, we use Lambda's written in GoLang to read the de-aggregated records and write them to our data store.  We used this in our consumer to help pull out the records: https://github.com/awslabs/kinesis-aggregationCommentSharesmithatlantaanswered 7 months ago"


Question: CloudFormation Invalid PhysicalResourceID - how to fix?

"Hi all, I am attempting to integrate an application I have running on The Things Stack into AWS IoT and keep running into issues on CloudFormation when trying to create the stack. It is always in the same place where the Logical ID column says Configuration, I get Status -CREATE_FAILED and Status Reason - Invalid PhysicalResourceId. I am led to believe that this is due to the cluster address being invalid, but how can that be when you select that cluster address from 1 of 3 pre-defined options?For reference I am linking from https://www.thethingsindustries.com/docs/integrations/cloud-integrations/aws-iot/deployment-guide/ and my app is running on eu1.When I ran into an IoT issue on here before, the solution turned out to be to sign into eu-west-1 (Ireland) as opposed to eu-west-2 (London) so I have attempted that here as well but to no avail.FollowComment"

Answer: "0I see this forum post on the things network. The answer there notes:I solved this issue. The documentation for the nam1 cluster is outdated. There is no tenant ID and it is not “.industries”it is “nam1.cloud.thethings.network” for your cluster addres[s]I am not an expert in the service but that above forum post may be related to your issue. I recommend reaching out to The Things Stack for their deployment issues. However, in general, when using a CloudFormation's custom resource, the resource provider should be sending back a PhysicalResourceId.This value should be an identifier unique to the custom resource vendor, and can be up to 1 KB in size. The value must be a non-empty string and must be identical for all responses for the same resource.CommentShareTaka_Manswered 10 months ago0Hi. Since you mentioned eu1, I take it you're using Things Stack Community Edition? (https://eu1.cloud.thethings.network is the EU cluster of the Community Edition.) If so, please ensure that you have selected Community when deploying the template. I think the user in the forum post that Taka_M has linked, probably picked Cloud when it should have been Community. Regardless, you need to pick the right deployment type to match your Things Stack account/deployment.CommentShareEXPERTGreg_Banswered 10 months ago"


Question: Kinesis Broken pipe

"HiI reading from Kinesis and writing into dynamodb. While looping through the records, after 2 hours I get :"Exception has occurred. Broken pipe".After doing some research I added the following code :Aws::SDKOptions options;options.httpOptions.installSigPipeHandler = true;Aws::InitAPI(options);But this was not successful . I did turn on AWS debugger but no specific error came out of the trace.Here is the line that is bringing the error :while (shardIterator != ""){getRecordsRequest.SetShardIterator(shardIterator);Aws::Kinesis::Model::GetRecordsOutcome getRecordsResult = kinesisClient.GetRecords(getRecordsRequest);  // <= this line.....Could you please help ?Thank!FollowComment"


Question: Update DNS - domain owner help pls

"Hi - A couple of years ago someone in my company (now left) set up a website with Go Daddy. I've has emails asking me to Update DNS to keep your site up - I called them and they said I had to speak to gandi.net as they registered the domain name ? No one knows anything about this as the guy who did website sadi he did it all with Go Daddy. I contacted gandi and they now tell me this - is in fact registered at Gandi, its management has been delegated to AMAZON WEB SERVICES (AWS), a Gandi reseller.I have no clue as to what this means and I don't have an account linked to this website with AWS HELP as our website will go down today if I don't update the DNS (I don't really understand what this even means either TBF)FollowCommentnavaz 3 months agoWhat is your domain name ? You can identify the Registrar of record for any Registered Name by performing a WHOIS query : https://registrar.amazon.com/whoisIf it's registered with Amazon Registrar, you can also view the contact information for the owner and for the administrative and technical contacts.Share"

Answer: "0Hello,Your question covers several topics that are all related to DNS and domain name management, so let me try and break this down.Based on the description, i think that you have confused registering a domain and pointing it at a DNS server.  Based on your problem description, i believe that your co-worker likely registered the domain at go daddy, and at some point might have transfered it to gandi.net.  So at this point the domain is likely either owned by godaddy, or gandi.  Assuming that Gandi.net is correct, it's likely the ownership is there.  Next is what DNS servers the domain is pointed at.  Based on what I am reading above it sounds like the authoritative name servers are configured to point at route53.  Likely that's what Gandi meant by this statement "is in fact registered at Gandi, its management has been delegated to AMAZON WEB SERVICES (AWS),"This is a configuration that would be setup at either godaddy or gandi and will list 4 different nameservers in the format of ns-1234.awsdns-123.com (.net, .org, and .co.uk).  Its this configuration at your registrar that allows DNS to work.To confirm this, you can login to your AWS account and goto route53 to find the zone listed there.  Once you have found where that zone is hosted in route53, you would be able to make the changes necessary there.   If this does not completely help out, please let me know where there is any confusion.  Thank you!CommentShareCraig Simonanswered 3 months ago0Hello & thank you for such a comprehensive reply :) since posting I have discovered more about this but I am now completely stuck as I have no idea who registered the account with AWS (as no one knew it has been moved from go daddy to Gandi) and therefore don’t what email was used so I am unable to login and check anything :(It’s a nightmare that just seems to go round in circles …CommentShareGYRcoanswered 3 months ago"


Question: Greengrass V2 & AWS IoT Core: Update connected µController

"Hi,I have a Raspberry PI which is a core device and connected to the AWS IOT Core via Greengrass V2. Connected to the Raspberry PI there is a µController which has it's own Firmware. I want to update that Firmware from within the AWS; what would be the best possible way to do it. The µController itself is no device in the AWS IOT Core.Thanks and Best Regards,ManuelFollowComment"

Answer: "0Hello Manuel,Thank you for your Question.We have an AWS Blog that discusses performing secondary processor over-the-air updates with FreeRTOS - https://aws.amazon.com/blogs/iot/how-to-perform-secondary-processor-over-the-air-updates-with-freertos/ . For additional details on how to set up OTA using FreeRTOS and AWS IoT Device Management, refer to the FreeRTOS OTA tutorial [1].Here the OTA update and secondary device ( in your case the microcontroller ) running FreeRTOS, which is connected to the Raspberry Pi requires that the device must support installing FreeRTOS.Coming to the recommended communication protocols (SPI or I2C) between your Raspberry Pi and MicroController, these protocols are supported by the hardware which you may use and is limited to the recommended protocol by the hardware vendors. The communication between the devices Greengrass Core device and the IoT Core is done over MQTT. The use of hardware communication protocols would not affect the Greengrass communication performance. For example, if you have a sensor or a camera running on your MicroController board, the connection between the sensor and the MicroController board can be via GPIO pins, SPI or I2C or whichever protocol is supported by the MicroController board. The communication between the MicroController board and the Raspberry Pi will take place over MQTT as they will be a part of the Core device.However, if the workaround suggested in the blog is not suitable for your use-case, then you may need to develop a custom component[2] to download the firmware to your Greengrass Core device first and then using MQTT, transfer the same to your end device (Microcontroller).References:[1] OTA tutorial - https://docs.aws.amazon.com/freertos/latest/userguide/dev-guide-ota-workflow.html[2] AWS IoT Greengrass development tools - https://docs.aws.amazon.com/greengrass/v2/developerguide/greengrass-development-tools.htmlCommentShareSUPPORT ENGINEERRahul_Panswered a month ago0Hi Rahul,thank you for your quick answer and the links. I've looked into it and the option to use the µController as IoT client things looks fine; but I have to check whether this is possible with my Firmware & operation System. See we don't use freeRTOS - we use Zephyr. WE also have to different sensors connected to the CORE device. (One time via UART and one time via Bluetooth Low Energy)In case I decide to develop a custom component and take care of the OTA Update myself. How would you handle the different updates and firmware versions.Should each µController-update be like a component revision? So the firmware (HEX file) is coupled with the Greengrass component version. If a new update is needed I have to publish a new component version (with the HEX file in it)Or is there a way where the component version is fix and I only can send the hex file to it. I think of it like a configuration file. So my component is handling the update, if it receives a new hex file, it starts the OTA. Is there a simple way to do that?CommentSharePhobiosanswered a month ago"


Question: DeepLens - How to fix "The security token included in the request is invalid"?

"I'm going through the process of registering my DeepLens.The moment I go to the page for registering my lens with V1, I get a message of "The security token included in the request is invalid".If I instead go through the V1.1 process, I get the same message after hooking up my DeepLens, and setting up the internet.Under either path, the lens fails to register.Any ideas?Trouble Shooting So Far:Tried issuing new security keyTried using root account and IAM roleTried clearing cacheTried using a different accountTried using a different computerFollowComment"

Answer: "0The path that worked for me so far (there is no way this is intended):Start to register the camera using V1.0. Make it far enough to get wifi enabled, but not far enough that they let you download a cert...Cancel out of that, and go to register with V1.1, make it almost all the way through till it blocks you at "The security token included in the request is invalid"Go into IAM and delete all of the service roles related to DeepLens/GreenGrassWatch as randomly it lets you through when you keep trying to register (what the heck)Cry as it infinitely spins on trying to get certs, and eventually you deregister it.Make sure your device is plugged in, and go to http://deeplens.config/ in your browser. This will let you set up an ssh password.SSH into the computer and run these commands:sudo apt-get updatesudo apt-get install awscamsudo rebootRegister again using V1.1....again....delete IAM roles and randomly keep trying to push through the registration processWrite up a 7 step process document because AWS doesn't seem to care about this service anymore :(CommentShareRosackeranswered a year agobrock a year agoAWS has really screwed over anyone who is trying to get a deeplens to work off the shelf.  I agree they don't care -- and it sucks.Share0I had same issue, but after enable MFA, then logout and login, it works. Give it a try! :)CommentSharewmzanswered 10 months ago"


Question: Eventbridge Pattern - Tag Change on Resource

"Hi! I'm trying to create at rule in Eventbridge that will target a Lambda function when an RDS snapshot tag is changed. I followed the Tag Change on Resource sample and came up with{"source": ["aws.tag"],"detail-type": ["Tag Change on Resource"],"resources": ["arn:aws:rds:::snapshot:*"],"detail": {"changed-tag-keys": ["ShareStatus"],"service": ["rds"],"resource-type": ["snapshot"],"tags": {"ShareStatus": ["ready"]}}}Changing or adding the tag to the RDS snapshot failed to trigger this event. I then modified the pattern to read:{"source": ["aws.tag"],"detail-type": ["Tag Change on Resource"],"resources": ["*"]}This too failed to trigger the event. I stripped it down further to simply read:{"source": ["aws.tag"]}This finally yielded the expected result. With that said, this event would now pick up on any tag change on any resource as opposed to my desired limit to RDS snapshots. So how can I adjust my event pattern to satisfy these needs? Thanks!FollowComment"

Answer: "0When editing the tags of an RDS snapshot, the events "AddTagsToResource" and "RemoveTagsFromResource" are logged in CloudTrail.I created an event pattern so that Lambda can be executed using this event.However, this event pattern also catches events about editing RDS instance tags, etc., in addition to RDS snapshots.Therefore, please include a process on the Lambda side to determine whether the event is a snapshot tag edit event or an instance tag edit event.{  "source": ["aws.rds"],  "detail-type": ["AWS API Call via CloudTrail"],  "detail": {    "eventSource": ["rds.amazonaws.com"],    "eventName": ["AddTagsToResource", "RemoveTagsFromResource"]  }}CommentShareEXPERTRiku_Kobayashianswered 16 days ago"


Question: Amazon Inspector - Unmanaged EC2 instance

"Hi, we are having issues with AWS Inspector because all new EC2 instances are shown as "Unmanaged EC2 instance" despite of having the SSM agent installed, having the right role with "AmazonSSMManagedInstanceCore" permissions attached, and being listed in the Managed Nodes within the SSM.When we try to run the "AWSSupport-TroubleshootManagedInstance" automation, it gets stuck in step 4 "GetEC2InstanceProperties" in Pending state. Any idea about how to fix this? Thanks.FollowComment"

Answer: "0Have you made sure the EC2 can reach to Systems Manager service on port 443 via IGW; NAT gateway or SSM VPC endpoint?? EC2 needs the Systems manager prerequisites as following (IAM role; OS supports; connectivity; etc.)https://docs.aws.amazon.com/systems-manager/latest/userguide/systems-manager-prereqs.htmlCommentShareSamuelanswered 6 months ago0If you have the agent installed and correct IAM role assigned, please create an endpoint to enable connectivity between ec2 and systems manager.https://docs.aws.amazon.com/systems-manager/latest/userguide/setup-create-vpc.htmlCommentShareRishianswered 6 months ago"


Question: Issue with claiming 2nd DID number

"I tried to claim the 2nd DID number for my 1st Amazon Instance, but showing an error like "You've reached the limit of Phone Numbers. To increase the limit, contact support."How can I solve this issue? I am using AWS free account with a basic support plan.FollowComment"

Answer: "0Hi there!Please file a service quota increase for phone numbers on your instance using the AWS Management Console. AWS Support can assist in raising service limits.Happy building!CommentShareEXPERTAWS-samfredanswered 2 months agoNishat 2 months agoRaised quota request.Share0Hi Nishat,Your 2nd line is not necessarily to be as same as inbound line. choose another country, usually US lines are available and will not ask you for limit increase.Best Regards,Ramy HusseinCommentShareRamyHanswered 2 months agoNishat 2 months agoI tried, other countries line too. But it's showing the same error yet. Is there any app available for calling using that app, so I can call and test my flow?Share"


Question: S3 bucket policy to allow CloudFront logging

"Hi,I have two S3 buckets, and one of them has a website.Thanks fort he help, Route 53, CloudFront, and S3 are all working well to serve the website now.I have also enabled CloudFront standard logging and selected an S3 bucket for log data.Is there an example policy I can apply to the logging S3 permission?I found this but I get 'Invalid principal in policy' error:  https://docs.aws.amazon.com/AmazonS3/latest/userguide/example-bucket-policies.html#example-bucket-policies-cloudfront{    "Version": "2012-10-17",    "Id": "PolicyForCloudFrontPrivateContent",    "Statement": [        {            "Effect": "Allow",            "Principal": {                "AWS": "arn:aws:iam::cloudfront:user/CloudFront Origin Access Identity E27xxxx"            },            "Action": "s3:GetObject",            "Resource": "arn:aws:s3:::DOC-EXAMPLE-BUCKET/*"        }    ]}Also, are there any disadvantages to turning on Cookie Logging?Thanks!FollowComment"

Answer: "1Accepted AnswerI would refer this doc for the error and make sure the Syntax and steps are accurate.Link- https://docs.aws.amazon.com/AmazonS3/latest/userguide/example-bucket-policies.html#example-bucket-policies-cloudfrontRegarding Cookie Logging, The Cookie header in the request, including name—value pairs and the associated attributes.If you enable cookie logging, CloudFront logs the cookies in all requests regardless of which cookies you choose to forward to the origin. When a request doesn’t include a cookie header, this field’s value is a hyphen (-).Refer https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/Cookies.html to check for more use-cases and features.CommentShareSUPPORT ENGINEERAWS-User-Chiraganswered 10 months agoEXPERTToni_Sreviewed 10 months ago0Thank you!CommentSharenewbieanswered 10 months ago"


Question: ALB Best Practice

"Customer is testing two different applications. One is portal (with multiple ports) and one is API server (multiple ports also). Should we recommend for them to use a single ALB or should we tell them to create a separate one for the other application? Plan also in the future is to utilise ASG per app. What's the best practice? Any reference or guide on this, please? Thank you.FollowComment"

Answer: "0Accepted AnswerIn my opinion, this depends on your architecture but also, the traffic that is receiving both applications.Check your load requests. If you can go with a single ALB, I would go for this option. You can use WAF andmultiple SSL certificates and you save the cost (and maintenance) to use a second ALB.Using ALB, the ASG will be associate to a TG with their own health check: https://docs.aws.amazon.com/elasticloadbalancing/latest/application/load-balancer-target-groups.htmlCommentShareAWS-User-3082121answered 3 years ago"


Question: Parquet vs ORC on EMR

What are the general pros and cons for Parquet vs. ORC specifically as it relates to EMR (EMRFS)If the customer is planning to also leverage Redshift and Athena on the same data lake does this change the equation?FollowComment

Answer: "0Accepted AnswerFor EMR:Parquet and ORC overlap quite a bit in terms of use cases as both are columnar formats.  The last time (a few years ago) I was involved in a design evaluation to choose between the two, ORC's native indexing ended up being a measurable advantage in terms of performance in our use case, namely Hive queries that filtered results based on a handful of columns with (relatively) low cardinality (at least when compared with the number of rows in the data set).  If that fits the customer's use case, that may be a good reason to go the ORC route.  The caveat here is that there are third party solutions available in the ecosystem that can help close that index feature gap if the customer is willing to install and manage them.For Athena/Redshift:As a straightforward consideration of compatibility, Athena supports both formats.  Assuming the same compression library is used with both formats (the two have different defaults), I am not yet aware of a significant performance delta between the two if all other things are equal.Assuming your question regarding Redshift is in the context of leaving the data in S3 and leveraging Spectrum, based on the docs Parquet is currently supported but not ORC.http://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-data-files.htmlCommentShareMODERATORAWS-User-0164599answered 6 years ago"


Question: I created rds aurora and stopped it and not able to start and asking for kms. If I give kms also not able to start because kms should be given while starting. I need help to delete my rds aurora db

I created rds aurora and stopped it and not able to start and asking for kms. If I give kms also not able to start because kms should be given while starting. I need help to delete my rds aurora dbFollowComment

Answer: "0To delete an Amazon RDS Aurora database, follow these steps:Open the Amazon RDS console.In the navigation pane, choose Databases.Find the database that you want to delete, and choose the check box next to its name.Choose Delete.In the Delete DB Instance dialog box, choose the appropriate options and then choose Delete DB Instance.Note: Deleting a database cannot be undone, and all data will be permanently lost. Make sure to backup your data before deleting the database.CommentShareDivyam Chauhananswered 4 months ago"


Question: EMR Serverless "Run status"

My job is still running even though I have received the results. why is that ??I have successfully go the results.Can I manually set the "Run status" as "Success" after I got result ? I mean are there any Pyspark code to do so ??FollowComment

Answer: "2https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs.htmlIf your job is still running even though you have received the results, it could be due to several reasons:Long-running Spark Context: If you've set up a long-running Spark context or Spark session, the job might continue to run even after the specific computation is complete.Delayed Shutdown: There might be a delay in shutting down the job or the underlying infrastructure, causing the job to appear as still running.Status Update Delay: There might be a delay in updating the job's status in the EMR Console, causing it to show as still running even though it has been completed.https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs-spark.htmlCommentShareEXPERTsedat_salmananswered 19 days ago"


Question: Spam emails from my own spoofed addresses

"We received spam messages from our own email address.I read the forum question related to a similar problem (: https://forums.aws.amazon.com/thread.jspa?messageID=891187)It looks to me that we have everything correctly set up, yet we get these spoofed emails. What can I do to stop it?FollowComment"

Answer: "0Hi,I'm sorry to hear you're experiencing problems with spoofed mail from your own domain. The forum suggests enabling DMARC enforcement in the WorkMail console. To make sure this works effectively for your own domain you do need to configure the DMARC domain records. Did you configure these domain records for your domain? If not. you can find the required records for that in the WorkMail console.Kind regards,RobinCommentShareMODERATORrobinkawsanswered a year agoAWS-User-7199214 a year agoThank you Robin. Indeed, the DMARC domain records on Route 53 were not added. I appreciate your help.Share"


Question: OTA update for raspberrypi4

"Hello, Nik here, I want to upload and update my normal python files to raspberry pi remotely (through OTA) using Greengrass core. Can anyone tell me, How can I do this with Greengrass, or is it possible to do by using AWS Greengrass?Thank youFollowComment"

Answer: "1Accepted AnswerHey Nik,Not sure what the end goal is here but on Greengrass you would have to create a component (your python files) and provide a recipe which then you would have to deploy to your core device. You can follow this tutorial on how to do it using the GDK (Greengrass Development Kit)If you are just asking a general question regarding how to copy files over to a remote device where you have greengrass installed without creating a component, you could use tools linux provides (if you are using linux) to copy or sync files such a scp or rsync rsync tutorialHope this helps,NelsonCommentShareochoanelanswered 3 months ago0Hi Nik,you can use the Systems Manager Agent component. AWS Systems Manager has a Patch Manager to automate patching.Cheers,PhilippCommentSharePhilipp Sanswered 3 months agoNik 3 months agoThank you Philipp, but according to me System manager agent service is used for  manage the core IoT devices. Can you Please elaborate how can I deploy my python files...?Share"


Question: Incorrect storage available space for users on Workdocs

"This is related to an not to much old post (https://repost.aws/questions/QUyfOFM2yAQY6iEvZQIGWr8A/incorrect-storage-for-users-on-workdocs)Still facing this issue under Windows 11, showing only  Users have 1TB on Workdocs site but when using Workdocs drive it only have 199gb.I need to upload using drive about 600Gb information toward WorkDocs but I'm not able to accomplish that and upload it using a Web browsers is not an option. Did you found a solution regarding this issue?https://freeimage.host/i/Qvsk2sThanks!FollowComment"


Question: Cannot have more than 0 active builds - AccountLimitExceededException

"I've used codestar to set up a new project, but when it gets to the "build" step of the pipeline, I simply get the error:Action execution failedError calling startBuild: Cannot have more than 0 active builds for the account (Service: AWSCodeBuild; Status Code: 400; Error Code: AccountLimitExceededException; Request ID: <x>)".I raised a support request and it took about a week for them to say they've raised the limit to 20 for my account (which seems like it should be default), but.. I still get the same error. This makes me think the error may be incorrect or I've set up something incorrectly. Has anyone else seen this before? I couldn't find this particular error mentioned anywhere else.FollowComment"

Answer: "0I have the same problem. I've just created a new Build Project (in AWS CodeBuild Developer Tool). I'm trying to "start build". But I see the same error over and over:"Build failed to start. The following error occurred: Cannot have more than 0 builds in queue for the account."Also, when I'm trying to change the Project configuration option "Enable concurrent build limit - optional" (Limit the number of allowed concurrent builds for this project) to true and set "Restrict number of concurrent builds this project can start" (Concurrent build limit) on at least 1. I hae the error:"Project-level concurrent build limit cannot exceed the account-level concurrent build limit of 0."But I didn't set those account-level concurrent build limit to 0! And I can't find where it can be changed!CommentShareAleksBanswered 2 years agoKris 2 months agoHave you resolved this issue ? i need workaroundShare0I've the same problem.Have you solved the problem?I'm using AWS CodeStar.Edited by: carlosfaria on Jan 6, 2018 8:41 AMCommentSharecarlosfariaanswered 5 years ago0If you are still seeing this error, you can contact AWS support. Please refer to https://docs.aws.amazon.com/codebuild/latest/userguide/limits.html. Thanks.CommentShareAWS-User-9350444answered 5 years ago0Hi,we have the same problem in codebuildand we just have 80 build projectsError: Cannot have more than 0 active builds for the accounthow to check active builds?CommentSharePaul777answered 5 years ago0Paul,Are you using the account Id (35****94) with which you posted this message? If yes, you should get the default 20 concurrent builds and not be seeing this error message. Could you private message me the buildARN that you got this error message for?CommentShareSubin Manswered 5 years ago0I've the same problem.How can I get help with this?CommentSharecristianoncruzanswered 2 years ago0The same problem for me.I have  one build project only.Need some advice to resolve this.Edited by: nguyentrunghau on Aug 18, 2021 6:35 AMCommentSharenguyentrunghauanswered 2 years ago"


Question: Duplicated logs entries on my clouwatch generated by Beanstalk Application

"I have an EB application which I run Docker running on 64bit Amazon Linux/2.12.2 and a single instance of Docker. I do restart the containers and it generates a new log file for each docker instance and on cloudwatch I see all logs as being duplicated..On the host instance, the one who runs the container, of my aws application, I see the old files and the new ones on /var/log/eb-docker/containers/eb-current-app/-rw-r--r-- 1 root root    0 May 18 12:01 2db23dfc8d41-stdouterr.log-rw-r--r-- 1 root root    0 May 15 20:01 2fe606dbd6c8-stdouterr.log-rw-r--r-- 1 root root    0 May 13 22:01 40caccccbb32-stdouterr.log-rw-r--r-- 1 root root    0 May 17 16:01 68d068a069a9-stdouterr.log-rw-r--r-- 1 root root    0 May 13 20:01 7bd09d66e4cc-stdouterr.log-rw-r--r-- 1 root root    0 May 13 10:01 7dfe28ba4c5c-stdouterr.log-rw-r--r-- 1 root root    0 May 17 11:01 7e4a8f32ebd5-stdouterr.log-rw-r--r-- 1 root root 1.8M May 18 20:58 898c4310b883-stdouterr.log-rw-r--r-- 1 root root    0 May 18 17:01 d768990b0076-stdouterr.log-rw-r--r-- 1 root root    0 May 17 12:01 e8921e2bb3a7-stdouterr.log-rw-r--r-- 1 root root    0 May 17 09:01 e8f31d8d68f8-stdouterr.logdrwxr-xr-x 2 root root 4.0K May 18 20:01 rotated```Is there any configuration I need to make to avoid the duplication?FollowComment"


Question: S3 External Account ACL Disappears

"My company has two AWS accounts and syncs files periodically between S3 buckets in the different accounts. We do this by having an ACL entry on the bucket with a grantee of the external account canonical ID of the other account. This works fine initially, but when I try to sync files again (via AWS cli) a few weeks later, this ACL entry has disappeared and files can't be synced. This has happened several times now, over the past year or so. How can I find out what's causing the ACL entry to disappear and prevent that from happening?FollowComment"

Answer: "0You should check if the bucket ACL has been disabled or not. S3 recently launched ACL disabling bucket. Buckets created earlier than that can be changed to ACL disabled by bucket admin. If that's the case, you will have to use bucket policy to get access files in S3.CommentShareVanswered a year ago"


Question: Does regexp_count work in athena?

"Hi all,I've googeld the function regexp_count and all I can see that it's supported by presto and by athena. But I'm using it like:, case when wc.da_waarnemingsequence not like '%Q02%' and (regexp_count(wc.da_waarnemingsequence, 'B01') = 1) then 1 else 0 end Aantal_SpookzendingenI get the error: function regexp_count not registered. Is there an alternative way to use a regexp_count?FollowComment"

Answer: "0Accepted AnswerI was able to replicate this issue in Athena V2. regexp_count is one of the functions for which support was added in V3. Please change your Athena version to V3 using these instructions - https://docs.aws.amazon.com/athena/latest/ug/engine-versions-changing.htmlWhen I change it back to V3, I was able to execute the below query.SELECT regexp_count('1a 2b 14m', '\s*[a-z]+\s*'); Please let me know if you have any questions.CommentShareAnanth Tirumanuranswered 6 months ago"


Question: ALMA LINUX OR ROCKY LINUX WILL BE AVAILABLE IN AMAZON LIGHT SAIL?

CPANEL block new cPanel & WHM installations and upgrades on CentOS 7 and CloudLinux 7 in cPanel & WHM version 112. We will support existing CentOS 7 and CloudLinux 7 servers running cPanel & WHM version 110 until these operating systems reach their EOL (End of Life).FollowComment

Answer: "0Cutoff in September 2021, neither Alma Linux nor Rocky Linux were available in Amazon Lightsail. However, it's possible that this has changed since then, so I would recommend checking the Lightsail documentation or contacting their support team for the most up-to-date information on supported operating systems.Regarding cPanel & WHM, it's true that cPanel has announced that they will no longer support new installations or upgrades on CentOS 7 and CloudLinux 7 as of version 112, and will continue to support existing installations until the operating systems reach their EOL. cPanel has also announced that they will be adding support for Alma Linux and Rocky Linux in future releases, so it may be possible to use these operating systems with cPanel & WHM in the future.CommentSharehashanswered a month ago"


Question: Billing for canceled services

I took a free tire database service for my cloud database. It's already running out of due date. So I removed my database from my account and I have terminated all instances. But still they are charging $0.02. Let me know how I need to reduce this to 0 balance?FollowComment

Answer: "0Hello,You may want to check your invoice to see what type of usage you're being billed on.  You can also check Cost Explorer and group by "Usage Type" to see what type of RDS usage you are being charged.It is most likely RDS Snapshots.  Verify that you have no snapshots stored in your account.There are a few other threads with similar answers here:https://repost.aws/questions/QUu01P_i5nSUCOYV2lRF4tUA/there-is-nothing-on-my-rds-databases-but-i-keep-getting-charged-for-rds-usagehttps://repost.aws/questions/QUhB335G7ES0OoFEif6Wf8eg/i-am-getting-charged-for-rds-usage-despite-having-0-databases-and-0-snapshotsCommentShareEXPERTChris_Ganswered 2 months agoEXPERTskinsmanreviewed 2 months ago"


Question: "REST API sent to API Gateway, how to access POST body data (application/json type) from within lambda application?"

"Placing data in POST body of a rest api request.  Looks like below:{"Email":"testemaillogs@logs.com","comment": "message one is here"}So far so good, can use Postman to hit API Gateway, and use lambda functions to do various things like access comprehend API.  Now when I need to access this data to write it somewhere (like dynamoDB), I try like this:def lambda_handler(event, context):         email = event["Email"]        comment = event["comment"]Getting a "key error" in cloudwatch logs from this approach like this:FieldValue@ingestionTime1594168745270@log255070150261:/aws/lambda/Feedback@logStream2020/07/08/$LATEST616634687067483d9e6f07d95fb20b30@messageERROR KeyError: 'Email'Traceback (most recent call last):File "/var/task/lambda_function.py", line 7, in lambda_handleremail = event"Email"@timestamp1594168736201In API Gateway I have set up a Model schema like this and required it under Method Execution in the API Gateway resources manager.{"type":"object","properties":{"Email":{"type":"string"},"comment":{"type":"string"}},"title":"Input"}Anything else to check here?FollowComment"

Answer: "0Accepted AnswerIf you used Lambda Proxy Integration, you get in the event much more details, and the content is under a "body" field. Best would be to print the event object and then you will be able to see exactly where your data is within the event object.CommentShareEXPERTUrianswered 3 years ago"


Question: Get ARN for Classic WAF rules

"Hi There,I'm looking for a way to check rules tags with Classic WAF in python. However list_tags_for_resource requires an ARN. As far as I know, it is not possible to get an ARN with get_rule or create_rule (or update_rule).  Is there a way to get the ARN for a Classic WAF rule in python or to get rule tags without using an ARN ?Thanks.FollowComment"

Answer: "0Accepted AnswerHi,would it be possible for you to construct it yourself? I guess the nature and format of a WAF ARN is kinda of known.arn:aws:waf::<WAF_REGION>:rule/<RULE_ID>You would need to find the specific rule id you need, and the list_rules https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/waf/client/list_rules.html may do that trick, unless you already have it.Hope it helps ;)CommentShareEXPERTalatechanswered 2 months agoAWS-User-5786690 2 months agoIt works, Thanks a lot !Share"


Question: I am not able to find this solution in sagemaker jumpstart

"Link for the post:https://aws.amazon.com/blogs/machine-learning/build-custom-amazon-sagemaker-pytorch-models-for-real-time-handwriting-text-recognition/I am unable to find this in sagemaker jumpstart. Please guide me through this.FollowCommentAlex_T EXPERTa year agoCan confirm it appears for me in JumpStart search. Are you able to see other JumpStart solutions like Document Understanding & Credit Rating and just this is missing? Or are you not able to see any at all? As a first idea if only this one is missing, I would suggest closing and restarting your JupyterServer/default app might help if you've not done it for a long time (File > Shut Down, or by clicking on your username in the AWS Console for SageMaker Studio and deleting the 'default' app)Share"

Answer: 0I can confirm that the solution is available in JumpStart. Can I ask what steps you have undertaken to find the solution?CommentShareHeikoanswered a year ago


Question: Quicksight API for Refreshing a dataset

"Is there a quicksight api (REST or any other) available to refresh a dataset? I looked at the API reference guide and did not find on to refresh a dataset.There are API's available to create/update/delete datasets, but none to refresh it:https://docs.aws.amazon.com/quicksight/latest/APIReference/qs-data.html#qs-datasetsAny help would be appreciated.FollowComment"

Answer: "2It isn't listed in the API guide link above but try -$ aws quicksight create-ingestion helpNAMEcreate-ingestion -DESCRIPTIONCreates and starts a new SPICE ingestion on a datasetThis blog - https://aws.amazon.com/blogs/big-data/event-driven-refresh-of-spice-datasets-in-amazon-quicksight/, has the following snippet in the Cloud Formation Template .      def create_ingestion(account_id, data_set_ids):          logger.info('Creating the SPICE ingestions')          for data_set_id in data_set_ids:              dt_string = datetime.now().strftime("%Y%m%d-%H%M%S")              ingestion_id = dt_string + '-' + data_set_id              try:                  response = quicksight.create_ingestion(AwsAccountId=account_id, DataSetId=data_set_id,                                                          IngestionId=ingestion_id)                  logger.info('Created ingestion for dataset {} with an ingestion id of {}.'.format(data_set_id, ingestion_id))              except quicksight.exceptions.ResourceNotFoundException as rnfe:                  logger.error('Dataset with id {} not found. {}'.format(data_set_id, rnfe))                  return FalseCommentShareChris_Panswered a year agoFabrizio@AWS EXPERTa year agoplease see the other answer for details on the API referenceShare0it is available here - https://docs.aws.amazon.com/quicksight/latest/APIReference/qs-data.html. (under "QuickSight API Operations to Refresh SPICE Data (SPICE Ingestion)" section )CommentShareAlex_Tanswered a year agoEXPERTFabrizio@AWSreviewed a year ago"


Question: Can we add column to an existing table in AWS Athena using SQL query?

I have a table in AWS Athena which contains 2 records. Is there a SQL query using which a new column can be inserted in to the table?FollowComment

Answer: "0Accepted AnswerYou can find more information about adding columns to table in Athena documentationOr you can use CTASFor example, you have a table withCREATE EXTERNAL TABLE sample_test(id string)LOCATION's3://bucket/path'and you can create another table from sample_test with the queryCREATE TABLE new_testASSELECT *, 'new' AS new_col FROM sample_testYou can use any available query after ASCommentShareharshmanvaranswered 4 years ago"


Question: Lightsail Distribution Certificates not validating

"Hello all, I'm trying to finish setting up my ssl certificate for a custom domain and the dns records for the certificate don't seem to be validating. How can I resolve this? Please let me know if I need to share anything so you can help assist me since I'm pretty new to AWS. ThanksFollowComment"

Answer: "0Hello,When did you start the certificate validation request? Please note that your new certificate might continue to display a status of Pending validation for up to 30 minutes. {1}DNS validation should be turned to success immediately as soon as you correctly input the CNAME name and CNAME value in the corresponding Route 53 record name. Please try again and double confirm value of CNAME referred to Domains block in the ACM certificates.Reference: https://docs.aws.amazon.com/acm/latest/userguide/dns-validation.html -- [1]CommentShareSUPPORT ENGINEERAWS-User-Chiraganswered 8 months agorePost-User-8119204 8 months agoI'm having a similar problem.  Used Route 53 to get domain name and trying to get a certificate.  Tried 3 times with waits of 1 - 2 days each time.  The last time I copied the domain name from R53 and pasted it into the certificate text box...can't figure out the problem.  Still pending.Share"


Question: Restoring Redshift Cluster from Snapshot fails. You do not have access to node type.

"Hello,We have a Redshift Cluster ds2.xlarge running on us-east-1, that have KMS encryption in place.We're aiming to create a clone of it for testing a node upgrade using the console.To do so, we created a manual snapshot. For the next step, we're selecting the snapshot and "Restore to provisioned cluster".In the configuration screen, assigning a new name to cluster identifier and keeping all other parameters the same. That is:Node type: ds2.xlarge (all other options grayed out)Number of nodes: 1 (Only allows 1)Database name & port: Same as original clusterCluster Permissions: Associating same IAM roles as original clusterAdditional Configurations: Using default VPC, subnet and Security Group and Configuration  (Same as original cluster)Upon selecting the above "Restore cluster from snapshot" throws the following error:You do not have access to node type ds2.xlarge. Choose another node typeWe're using the same admin account both for KMS and the Redshift Cluster.Wondering if the issue could be using the same VPC, encryption or something else?ThanksFollowComment"

Answer: "0Figured creating nodes of DS2 is no longer allowed in efforts to encouraging adoption of newer node types such as RA3. Hence, I could not create the instance earlier. A more explicit error message would clarify this confusion. Also, as a side effect snapshots of legacy type clusters become useless.CommentSharerePost-User-0820218answered 10 months ago"