Question: Encryption by default (Storage Gateway - Volume)

"Hello,I was reading the docs again and noticed it says the data stored on the Storage Gateway (Volume) is encrypted by default.Did AWS just recently have this feature added/turned on?  I remember a while back there was a checkbox for encryption.If that is the case, if any volume created before the encryption was added, does it get automatically encrypted too?Thanks,TTEdited by: trackstar2000 on Mar 5, 2020 2:22 PMFollowComment"

Answer: "0Hi,Great question, Storage Gateway has always supported encryption by default using S3"By default, all data stored in S3 is encrypted server-side with Amazon S3-Managed Encryption Keys (SSE-S3)", from the FAQ https://aws.amazon.com/storagegateway/faqs/The new change you've noticed is that we now support customer managed keys with KMS see: https://docs.aws.amazon.com/storagegateway/latest/userguide/encryption.html for more information on how to set that upThanksEdited by: ianoataws on Mar 6, 2020 10:59 AMadded FAQ linkCommentShareAWS-User-4017914answered 3 years ago0Answered questionCommentShareAWS-User-4017914answered 3 years ago0Thanks.  I was looking at the snapshots and noticed the column that reads "Not Encrypted" under Encryption.CommentSharetrackstar2000answered 3 years ago0That's some great feedback, I'll pass that along to see if there's clarifications we can give here to not confuse others.Just in case anyone else is reading: Yes, all volumes are encrypted by default, the "Not Encrypted" refers to whether or not this is encrypted with a customer managed KMS key as opposed to Amazon S3-Managed Encryption Keys (SSE-S3)CommentShareAWS-User-4017914answered 3 years ago"


Question: Delay while connecting outbound campaign Calls with agent.

"Hello Folks, we have created outbound voice campaign using pinpoint and amazon connect, when a API Call is initiated customer receives the Call asap customer answers the Call customer is on Call for 15-20 Secs prior to the Call is connected with available agent but there is no delay from agent side when they answer the Call . customer complains when they answer the call there is a delay of 20-30 secs prior to is connected with agent. Any advise or solution why this is getting delayed in connecting in agents.FollowComment"

Answer: "0Accepted AnswerHi,Can i ask some questions:1- what is the amazon connect instance region?2- where does the agent located?3- where does customer located?4- which country you are using to dial the customer numberYou can as well use the below link for measuring any delayshttps://aws.amazon.com/blogs/contact-center/measure-latency-for-validation-testing-and-troubleshooting-in-amazon-connect/Best Regards,Ramy HusseinCommentShareRamyHanswered 2 months ago0Hi Ramy,thanks for showing the interest  !here are the details you requested1- what is the amazon connect instance region? -- US-west-oregon2- where does the agent located? US and Canada3- where does customer located? Canada4- which country you are using to dial the customer number- USCommentSharerePost-User-5854940answered 2 months ago0Hi Ramy, if possibly you can review and address , this will be very helpful thanks !CommentSharerePost-User-5854940answered 2 months ago0Hi,From the answers you provided, its hard to say root cause for the 15/20 seconds delay since agents and customers are within the same region. The only thing i can think of is if the agents using VPN can be a reason.Best Regards,Ramy HusseinCommentShareRamyHanswered 2 months ago0Hi Ramy,agents are not using any VPN , when ever we test any US phone num it works with super speed and connects the agents and customer in 3-4 secs Max. but when Canada num is dialed this seems problematic only and takes sometimes 20-30 Secs, sometimes , 40-50 Secs and sometimes 8-10 Secs. not sure how is this happening .CommentSharerePost-User-5854940answered 2 months ago0Hi Ramy, when customer say hello and answers the Call , there is a silence of 4-5 secs and then Call is getting connected with the agent , so how this works is --Call placed by amazon pinpoint journey -->customer answers the Call and says Hello -->silence of 4-5 Secs-->welcome prompt-->call connected with agent.This silence we want to remove and not sure how this is coming to customer.CommentShareAjay Vashishthaanswered 2 months ago"


Question: Some of my domains set in SES didn't send notifications to my SNS topic.

"As title, I have 3 domains in SES, both were all verified and enable for sending, and all of them were set to send notifications to a SNS topic that I've set up with a notification and it was confirmed. However, the SES actions that 3 domains have didn't correctly send notifications out, only the last domain I have successfully sent the notifications, others were failed, which meant I never received anything of the first two domains at all. I've also tried configuration set but didn't work either, the documents didn't talk a lot with such problem, this was nearly drew me crazy.FollowComment"

Answer: "0Finally found the solution at https://aws.amazon.com/tw/premiumsupport/knowledge-center/ses-resolve-sns-bounce-notifications/"If you have bounce notifications configured for a verified domain, but there are email addresses within the domain that are verified separately, then you don't receive bounce notifications for the separately verified email addresses."The ones that didn't receive notification is because I had email address individually verified.Edited by: LZong on Jan 2, 2021 1:13 AMCommentShareLZonganswered 2 years ago"


Question: "API Gateway body template mapping to retain valid json data-structure of data-element, while still allow for base64-encoding"

"I have the exact same issue as an older question and there was even an accepted solution, but it has been deleted!The thread is: https://repost.aws/questions/QUm3sz-dEESBiezvcnxrnwRQ/api-gateway-body-template-mapping-to-retain-valid-json-data-structure-of-data-element-while-still-allow-for-base-64-encodingThe deleted answer is: https://forums.aws.amazon.com/thread.jspa?threadID=233060Could someone please help me with this? This is a very frustrating issue.Thanks.FollowComment"

Answer: "0This is kinda hacky, but you need to work in strings a little further as once you are in json objects there doesn't seem a way to re-stringiify...Here is my snippet...       { "StreamName": "event-stream-qa", "Records": [#set($datakey = ".data")#set($partitionkey = ".key")#foreach($elem in $input.path('$.records'))    #set($pathBegin = "$.records[")    #set($pathEnd = "]")    #set($currentIndex = $foreach.index)    #set($dataPath = "$pathBegin$currentIndex$pathEnd$datakey")    #set($partitionPath = "$pathBegin$currentIndex$pathEnd$partitionkey")    #set($dataJson = $input.json($dataPath))     #set($partitionJson = $input.json($partitionPath))   {     "Data": "$util.base64Encode($dataJson)",    "PartitionKey": $partitionJson  }    #if($foreach.hasNext),#end#end    ]}CommentShareecordoanswered a month ago"


Question: creating codecommit with sso credentials

I have aws organization setup and using the former sso credential to access all members account. How do i setup a codecommit user for the group that my sso user is part of? should i use credentials helper setup. what do you advice?FollowComment

Answer: 0The following sites appear to be similar to your request and we refer you to them. [1] [2] [3][1] Federated multi-account access for AWS CodeCommit | AWS DevOps Bloghttps://aws.amazon.com/jp/blogs/devops/federated-multi-account-access-for-aws-codecommit/[2] Connecting to a CodeCommit repository with AWS SSO - Paul Swailhttps://notes.serverlessfirst.com/public/Connecting+to+a+CodeCommit+repository+with+AWS+SSO[3] Accessing Codecommit using AWS SSOhttps://www.linkedin.com/pulse/accessing-codecommit-using-aws-sso-ike-dik%C3%A9I hope this is helpful.CommentSharemn87answered 9 months ago


Question: AWS Config Query Editor - Retrieve EC2 Instance Name and Network Interface Id

"Hi all,Tricky one here, but seems possible.I am attempting to create an AWS EC2 inventory csv file across our AWS Organization.Requirements are to include the EC2 Instance Name and the ENI Network Interface Id's.Using the AWS Config Query editor appears to be the fastest method in a multi-account Organization.Here is my query so far:SELECT  resourceId,  resourceName,  resourceType,  accountId,  configuration.instanceType,  configuration.state.name,  tags,  configuration.networkInterfaces,  configuration.publicIp,  configuration.privateIpAddressWHERE  resourceType = 'AWS::EC2::Instance'  AND configuration.state.name = 'running'Questions:How can I get the tags.key "Name" property to display in the output?How can I get the configuration.networkInterfaces "networkInterfaceId" property to display in the output?Screenshot attached for reference illustrating the problem.Here is a link for reference.https://www.virtualbonzo.com/2022/08/08/a-quick-and-easy-ec2-inventory-using-aws-config/FollowComment"

Answer: "1Accepted AnswerUnfortunately both of these properties are nested structures which can't be unpacked by Config queries at this time. That's documented here under the Limitations section.No support for nested structures (such as tags) to be unpacked with SQL queries.CommentSharezsewellanswered 5 months ago0Ahh, thank you. It was buried under the documentation. ...And AWS really needs to populate the resourceName field with the hostname value. That is essential info.CommentSharerePost-User-8378905answered 5 months ago"


Question: EKS control plane didn't recover after AWS outage

"We had EC2 instances and it seems our control plane impacted by a euw2-az1 outage. AWS indicated the issue was resolved but our control plane carried on giving intermittent access denied errors and failing to connect to worker nodes. We're in 3 zones and the control place should be highly available but it seems at least 1 node in the control plance was behaving badly.Is there a way to restart the services in the control plane?We ended up fixing this by upgrading the kubernetes version, but this won't always be an option available.FollowCommentRodney Lester a year agoPlease enter a support ticket.Share"

Answer: 0The solution in this event is to contact AWS Support since the control plane of an Amazon EKS cluster is part of EKS being a managed service.CommentShareAWS-Harrisonanswered a month ago


Question: ECS Fargate - How to get IP Address

"Hi All,I am running an ECS Cluster for our Kafka Connect Images and have a working configuration deployed. To scale up Kafka Connect one of the things you need to do for each container is ensure that the Kafka Connect Rest Hostname is set to prevent a 409 Conflict when adding tasks (if you are running as part of a cluster). Using localhost is fine for a single node - but not for multiple.Since I am running ECS in Fargate awsvpc mode. I didn't see a way to get the IP of the Container (per AWS docs not supported in awsvpc mode).To work around this problem I added a custom command for the container on startup to call the container metadata service and set it that way e.g.JSON=$(curl ${ECS_CONTAINER_METADATA_URI}/task)TASK=$(echo $JSON | jq -r '.Containers[0].Networks[0].IPv4Addresses[0]')CONNECT_REST_ADVERTISED_HOST_NAME=$TASKIs there a more native way to do this?Best,WayneFollowComment"

Answer: 1Accepted AnswerThe container metadata URI is the AWS native way to get node ENI IP.CommentShareJason_Sanswered a year agoEXPERTmreferrereviewed a year agoxathras a year agoThank you for feedback.Share


Question: AWS ElasticBeanstalk issue while creating an environment.

"Hello,I am trying to create a new elasticbeanstalk application in us-east-1 region. using eb create commandeb create optimization-appI have also tried to specify a service-roleeb create optimization-app --service-role aws-elasticbeanstalk-service-roleI am getting an exception ERROR: AlreadyExistsError - Cannot exceed quota for PoliciesPerRole: 10I have tried creating a new service role with only 2 policies on that role and tried to create the application but i still get the same error.This used to work till a few days ago. I am not sure what is the reason. I am not getting any other message to check the reason for this.Any help is appriciated.Best,PavanFollowComment"

Answer: "1Hi,It appears that same service role is being used when you execute the EB creation. You can either reduce the policies attached to the role or see if an increased quota can be applied.Refer - https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_iam-quotas.htmlNote: For IAM quotas to increase, you need to select the region US East (N. Virginia)CommentShareAWS-CSinghanswered 4 months agopavanavap 4 months agoThank you for your answer. As a work around, we have raised a request to increase the quota of the permissions per role. I was able to create the application.My earlier service roles had 10, 9 and 2 policies on them respectively. I am not sure why it was giving me that.Share"


Question: Can I change voices with SSML tags in AWS Polly?

"I know how to use SSML tags in AWS Polly. For example: <speak> <prosody rate="85%">Hello</prosody></speak>But I wonder if I could change voices, for example:<speak> <voice id Joanna> <prosody rate="85%">Hello, I'm Joanna.</prosody></speak><speak> <voice id Joey> <prosody rate="85%">And I'm Joey.</prosody></speak>FollowComment"

Answer: "1Currently we are unable to change the voice id using SSML. For the fully list of supported SSML tag,  Please refer to the documentation at https://docs.aws.amazon.com/polly/latest/dg/supportedtags.htmlCommentShareronald_lanswered 7 months agomaicart 7 months agoOk, thanksShare"


Question: "Route 53 Active-Passive Failover Goes Back And Forth Between Primary and Secondary Due To Unstable Primary, i.e. Does Not Settle"

"Hi community!I'm seeking suggestions to improve my Route 53 active-passive failover setup. On a couple of occasions where my primary web server was unstable, my Route 53 active-passive failover went back and forth between the primary and secondary A records and did not settle on the seconday. To make it settle on the seconday, I had to stop by hand the web server process on the primary server.At present my heathcheck for the failover is:URL https://numeric.ip.address.primary:443/Request interval 30 secondsFailure threshold 3Thank you in advance!TatsuoFollowComment"

Answer: "0Accepted AnswerFor Route53 failover routing to work properly, it is absolutely critical that your health checks work properly.There are three different types of Active-Passive failover that can be set-up as mentioned in this doc - https://docs.aws.amazon.com/Route53/latest/DeveloperGuide/dns-failover-types.htmlactive-passive failover with one primary and one secondary resourceactive-passive failover with multiple primary and secondary resourcesactive-passive failover with weighted recordsIn your case, which one have you configured?Note: Please accept my answer if you like it. ThanksCommentShareEXPERTIndranil Banerjee AWSanswered a year ago0thanks Indranil. In my case it is 1. active-passive failover with one primary and one secondary resourceCommentShareTatsuoanswered a year agoIndranil Banerjee AWS EXPERTa year agoDid you notice problems under heavy load? If under load, the health check URL takes time to respond, because the machine is heavily loaded, it could lead to a failover. You should run performance tests and use vertical scaling or even better horizontal scaling (put an ALB in front of your EC2 machines) in each region, to better scale.Another change to look at is to use containers and use either ECS or EKS for container orchestration. That would involve significant re-architecture though but in the end may be worth the effort.ShareTatsuo a year agoyou are right Indranil:my primary web server experiences a heavy load and becomes slow to respondthe healthcheck against my primary web server failsRoute 53 fails over the name server A record to my secondary web servermy primary web server no longer experiences a heavy load because it's not dealing with a lot of trafficthe healthcheck against my primary web server succeedsRoute 53 brings my primary web server back to servicenow it is back in service, it again experiences a heavy loadthe healthcheck against my primary web server failsthe process continues!ShareTatsuo a year agoIndranil, I will explore your scaling suggestions!Share"


Question: How do you track initialization metrics for a Lambda function?

"We configured provisioned concurrency for our Java Lambda function to reduce its startup time. Part of the function's startup time is the Java code initializing itself though, which isn't reduced by provisioned concurrency.We'd like to know how long it takes for our code to initialize before it starts processing a request, so we can assess if it's worth the time and effort to optimize. I created a test system with a Java Lambda function, and activated AWS X-Ray with Active tracing, but I don't see a breakdown for initialization, invocation, and overhead.What's the best way to track initialization metrics for a Lambda function?FollowComment"

Answer: "0Accepted AnswerWhen you turn on active tracing in AWS X-Ray, a trace automatically records information on the following subsegments of requests processed by the Lambda service that involve a cold start: Initialization, Invocation, and Overhead. If you're not seeing these subsegments in an AWS X-Ray trace, the request was likely made on a warmed instance.For information on how to improve your Java Lambda function's performance, see How do I reduce initialization and invocation duration latency for my Java Lambda function?CommentShareAWS-User-5223056answered 3 years ago"


Question: "In Postgres RDS my tables take around 500MB, but it says I am using 17GB?"

"Why does it say I am using so much more space?I did a bit of searching, and it might be the temporary files. Can you tell me how to clear them? I haven't found a way to connect to RDS to view or clear those files.FollowComment"

Answer: "0I would look into VACUUM: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Appendix.PostgreSQL.CommonDBATasks.Autovacuum.html.It is a PostgreSQL feature that cleans up space caused by deleted or updated rows.As an example, you can try to run SQL query to see if your tables need vacuuming:SELECT datname, age(datfrozenxid) FROM pg_database ORDER BY age(datfrozenxid) desc limit 20;CommentShareEXPERTalatechanswered 4 months agorePost-User-6685172 4 months agoI ran VACUUM FULL and it says 0 rows were updated.I am suspecting that the problem is with temporary files, as I had the flag remove_temp_files_after_crash switched off by default, so a lot of garbage accumulated over time. Is there a way to clear those temporary files? I believe this is a managed DB so I can't access the files directly...Share"


Question: Issue with Step Function Creation

"I was trying to create a Step Function and I have used the existing execution role.It just throws the below error each time I try to create it."An error occurred while creating your state machine, please try again."FollowCommentmaksim_tereshin a year agoHave you created execution role manually?Have you ever started State Machine with this execution role?Is it possible to share the execution role?Share"

Answer: "0Hi RajkumarFrom the note I understand you trying to create Step Function and you have the existing execution role and it throws an error each time you try to create  it?First verify that the IAM role that your state machine assumes still exists If not create a new one[1]. Please note some of the issues that might cause the error;1.State machine definition issues (for example, no matching rule in a Choice state)2.Task failures (for example, an exception in a Lambda function)3.Transient issues (for example, network partition events).And by default, when a state reports an error, AWS Step Functions causes the execution to fail entirely.I hope the above information is helpful.References:1.https://aws.amazon.com/premiumsupport/knowledge-center/step-functions-iam-role-troubleshooting/2.https://docs.aws.amazon.com/step-functions/latest/dg/concepts-error-handling.htmlCommentShareNonkululekoanswered a year ago"


Question: Upgrading Aurora MySQL 5.6 to 5.7 on cross region replica stuck in pre-upgrade checks and reboots every 30 minutes

"We have a two-region Aurora MySQL cluster. In order to upgrade from MySQL 5.6 to 5.7, the process indicated the cross-region replica must be upgraded first. After initiating that process, the cluster took a snapshot and then has only sent the event "Upgrade in progress: Performing online pre-upgrade checks."The single reader instance in the cross-region cluster has been recording an event every 30 minutes of "DB instance shutdown". In viewing the log, the reader instance log keeps recording a single line of "/bin/cat: /etc/rds/huge_page_size.dat: No such file or directory".This process has continued for 10 hours. A previous "trial run" migration with a cloned copy finished in 20 minutes.I am unable to stop the upgrade process. I cannot remove the replica as it is in the middle of upgrading and the "Promote" option is disabled, so I cannot remove the lone reader instance that is rebooting. So I am stuck unable to remove the rebooting cross-region replica cluster in order to upgrade our primary cluster...Is there any way to stop the upgrade process or force it to be promoted or otherwise remove this malfunctioning cluster? Or perhaps is there some way to address the "no such file or directory" error that may be preventing the upgrade from continuing?FollowComment"

Answer: "0I was able to remove the "stuck" upgrading cross-region replica by making an AWS CLI call to promote the read replica to be stand-alone. The CLI was required as the "Promote" menu option was disabled.aws rds promote-read-replica-db-cluster --db-cluster-identifier my-cross-region-cluster-nameOnce this completed, I was then able to delete the reader instance which then allowed the cluster to delete as well.I can now upgrade the origin cluster to MySQL 5.8 and then create a new cross-region replica AFTER the primary cluster has finished upgrading.This does not technically tell how to "fix" the stuck upgrade, but is a work-around. If this had been our primary cluster that was stuck then it would require restoring from a snapshot.CommentSharePromotionPodanswered a year ago"


Question: How to add launch type to an ecs service from ecs-cli?

"I'm deploying a service to an ecs from ecs-cli, but I couldn't find any attribute to specify the value of "LAUNCH TYPE" to use "capacity provider strategy". default is set to EC2. Is it possible to do it from ecs-cli or some attribute in the yml file or ecs-params?docker-compose.ymlversion: '3'services:  task_auth:    environment:      AWS_API_VERSION: "2016-04-19"      AWS_CONTAINER_CREDENTIALS_RELATIVE_URI: /creds      BACKURL: http://XXXXXXX    image: XXXX.dkr.ecr.us-east-1.amazonaws.com/XXXXXX    ports:      - "8004:8000"    logging:      driver: awslogs      options:        awslogs-group: logscompose        awslogs-region: us-east-1        awslogs-stream-prefix: auth ecs-params.ymlversion: '3'services:  task_auth:    environment:      AWS_API_VERSION: "2016-04-19"      AWS_CONTAINER_CREDENTIALS_RELATIVE_URI: /creds      BACKURL: http://XXXXXXX    image: XXXX.dkr.ecr.us-east-1.amazonaws.com/XXXXXX    ports:      - "8004:8000"    logging:      driver: awslogs      options:        awslogs-group: logscompose        awslogs-region: us-east-1        awslogs-stream-prefix: authResultFollowComment"

Answer: "0Please take a look at https://github.com/aws/amazon-ecs-cliIt mentions the following**ECS now offers two different launch types for tasks and services: EC2 and FARGATE. With the FARGATE launch type, customers no longer have to manage their own container-instances.In the ECS-CLI, you can specify either launch type when you bring up a cluster using the --launch-type flag (see: Creating an ECS Cluster). You can also configure your cluster to use a particular launch type with the --default-launch-type flag (see: Cluster Configurations).You can also specify which launch type to use for a task or service in compose up or compose service up, regardless of which launch type is configured for your cluster (see: Starting/Running Tasks).**CommentShareEXPERTIndranil Banerjee AWSanswered 8 months ago0I referred the documentation [1] to check whether we can change the value of "LAUNCH TYPE" to use "capacity provider strategy” while deploying a service. According to the doc[1] by using --default-launch-type to your cluster configuration we can set the launch type to EC2 or FARGATE. But there is no mention of using "capacity provider strategy”.I went ahead and checked the similar use case AWS Command Line Interface (AWS CLI). The AWS Command Line Interface (AWS CLI) is a unified client for AWS services that provides commands for all public API operations. These commands are lower level than those provided by the Amazon ECS CLI. Using the AWS CLI commands we can configure the “--capacity-provider-strategy” attribute while creating the cluster [2].The details of a capacity provider strategy. A capacity provider strategy can be set when using the RunTask or CreateCluster APIs or as the default capacity provider strategy for a cluster with the CreateCluster API.Only capacity providers that are already associated with a cluster and have an ACTIVE or UPDATING status can be used in a capacity provider strategy. The PutClusterCapacityProviders API is used to associate a capacity provider with a cluster.If specifying a capacity provider that uses an Auto Scaling group, the capacity provider must already be created. New Auto Scaling group capacity providers can be created with the CreateCapacityProvider API operation.You can check more details details related to this in the documentation[2].Reference:[1] https://github.com/aws/amazon-ecs-cli#amazon-ecs-cli-commands[2] https://docs.aws.amazon.com/cli/latest/reference/ecs/create-service.html[3] https://docs.aws.amazon.com/cli/latest/reference/ecs/update-service.html[4] https://awscli.amazonaws.com/v2/documentation/api/latest/reference/ecs/put-cluster-capacity-providers.htmlCommentShareTushar_Manswered 8 months ago"


Question: SQS VPC interface endpoint and it's usage via AWS SDK v1

"I have an AWS SQS VPC Interface endpoint with private DNS enabled.However, while using the SQS via AWS SDK v1 (java), I am providing the SQS url like belowe.g https://sqs.us-east-1.amazonaws.com/<account_id>/<my_queue_name>so, will my AWS SDK v1 will use the VPC endpoint provided I haven't configured the SQS client with any endpoint and my SQS doesn't have any policy other than the default one ?FollowComment"

Answer: "1In order to use Interface Endpoints you must specify the endpoint name in your code. If you don't specify it then the connection will be made to the default endpoint (for the region you've configured), not the private endpoint you've created.CommentShareEXPERTBrettski-AWSanswered 10 months agorePost-User-1056683 10 months agookay, does the endpoint can be deduced from the SQS URL? If I use for e.g https://sqs.us-east-1.amazonaws.com/<account_id>/<my_queue_name> in SDK v1 and sqs.us-east-1.amazonaws.com is my Private DNS name for the VPC endpoint. Does that mean I don't have to set the endpoint in the SQS client of SDK and it can be deduced from the SQS URL itself? and it will not use the default service endpoint although it's same as the private DNS nameShareBrettski-AWS EXPERT10 months agoI can't say how individual libraries will determine the endpoint even if it can be determined from the service URL (other services don't work that way). In general private endpoints have to be explicitly specified to the library.Share"


Question: AWS ElasticBeanstalk NodeJS Application version cannot be uploaded/deployed/reverted "Unable to create the application version:" / "Validation error"

"I have a NodeJS application running via ElasticBeanstalk, have deployed 59 previous application versions via the "upload and deploy" button in the EBS dashboard for the application environment. Before, I uploaded a zip file and the environment updated successfully (all at once strategy), never had issues.Trying to upload a zip file the last 2 days (for the first time in some months) fails, after uploading the "Upload and deploy" popup shows only a red X icon with text "Unable to create the application version: ", without further information.The "Application versions" page of the environment shows errors on loading like "Validation error" and "Error Unable to retrieve default rolling update values, leave the options blank to retrieve the defaults:", but is otherwise functional.Reverting to a previous application version via the "Application versions" page also no longer works. Just like when uploading a new version, when reverting the "Deploy Application Version" popup shows "Unable to create the application version: ", without further information.Deleting previous application versions errors out frequently, but does succeed after several attempts, I've deleted most of my old versions to make sure I'm under the limit.Is there a problem with the service currently, or has something changed in the past months requiring changes on my end? Is there any way I could debug this, as the "Upload and deploy" popups provide no information about problems?I also cannot create a new (NodeJS) application environment via EBS dashboard, when creating a new environment from an application or from the environments page, it fails and shows only "Validation error". Update: After trying multiple times, it does succeed eventually.FollowComment"

Answer: "0Turned out to be a Firefox issue, Edge works fine.CommentShareAWS-User-4502449answered a year ago"


Question: Does eks use latest AMI version on termination of any node on restart of the node

"Recently I got a doubt about my eks node os update, i wanted to check if eka is capable to relaunch node with latest version of os when any of its running terminated?For eg there are 5 node running and min 5 is required and set in autoscaling group and they were running from long time, so when I manually terminate one of the node so does it restart that node again with the latest version/patches of specificied AMI ? Or does it launch node with latest ami every time it restarts the node?Please let me know,FollowComment"

Answer: "0Which version of the operating system is used is based on what is stored with the AMI of the underlying launch template of the Managed Node Group. No changes will be made to that process automatically without taking one of the steps below. AMIs are immutable. They can not receive OS updates without creating a new AMI. Managed Nodes Groups can be updated if a new version is available (https://docs.aws.amazon.com/eks/latest/userguide/update-managed-node-group.html). You can also customize the launch template (and therefore the AMI) of your managed node group (https://docs.aws.amazon.com/eks/latest/userguide/launch-templates.html). If you will customize, a common better is to link EC2 Image Builder with your Launch Template: https://docs.aws.amazon.com/imagebuilder/latest/userguide/dist-using-launch-template.html.CommentShareAWS-Harrisonanswered a month ago"


Question: Cloudformation Stack Stuck in UPDATE_IN_PROGRESS

"Hi,I have a stack stuck in UPDATE_IN_PROGRESS I dont know what resource is getting it stuck. I have tried many ways of deleting it.The stack isarn:aws:cloudformation:ap-southeast-2:208344528594:stack/ArkistoStackExpertNation2020oni04B958FB/ca885760-f42d-11ea-8ab3-065724e5a374Can you help?Thanks,MoisesFollowComment"

Answer: 0was able to do this with the aws cliaws --region REGION cloudformation cancel-update-stack --stack-name NAMEand then delete the stack.CommentSharemoisessacalanswered 3 years ago


Question: Creating and Managing Cognito UserPool from within CodePipeline with Cloudformation Template

"Hi all,I am currently facing a weird issue with my cloudformation template execution in my codepipeline.Goal:I want to create and "manage" a Cognito UserPoolPrecondition:For executing my cloudformation template with the Cognito UserPool Stuff inside I have added the respective permission to the corresponding role which executes the pipeline/template step (This role is of course NOT inside of the template I want to execute).  CFNRole:    Type: AWS::IAM::Role    Properties:      RoleName:        Fn::Sub: CloudFormationRole-${AWS::StackName}      AssumeRolePolicyDocument:        Statement:        - Action: ['sts:AssumeRole']          Effect: Allow          Principal:            Service: [cloudformation.amazonaws.com]        Version: '2012-10-17'      Path: /      Policies:        - PolicyName: CloudFormationRole          PolicyDocument:            Version: '2012-10-17'            Statement:            [...]              -                Effect: "Allow"                Action:                  - "cognito-idp:CreateUserPool"                  - "cognito-idp:*"                Resource:                  - "arn:aws:cognito-idp:*:*:userpool/*"When I run my template I know receive the following error:User: arn:aws:sts::*******:assumed-role/CloudFormationRole-*****/AWSCloudFormation is not authorized to perform: cognito-idp:CreateUserPool on resource: * because no identity-based policy allows the cognito-idp:CreateUserPool actionWhat can I do to grant the corresponding permission to my Pipeline/Cloudformation Role?Thanks in advance,bestFollowComment"

Answer: "1Your PolicyDocument looks correct to me, but IAM permissions are sometimes a real PITA to get right.  Looking more closely at the error, it seems to indicate that it's complaining about the resource not being "*".  Maybe Cognito doesn't support resource-level permissions and you have to use the wildcard; I looked in the Cognito docs but I can't find a clear answer.Suggestion: changeResource:   - "arn:aws:cognito-idp:*:*:userpool/*"toResource:   - "*"CommentShareRNHurtanswered 6 months agohakanson 5 months ago"Actions defined by Amazon Cognito User Pools" documented at https://docs.aws.amazon.com/service-authorization/latest/reference/list_amazoncognitouserpools.html where the row for "CreateUserPool" indicates no value in Resource types column, meaning you must specify all resources ("*") in the Resource element of your policy statement.Share"


Question: Applying credits to reserved capacitys

Is it possible to apply AWS credits that expire within a few months on DynamoDB reserved capacity that lasts 3 years? Also do the provisioned capacity units refer to unit-months or unit-hours. ThanksFollowComment

Answer: 1AWS credits are only for normal usage. Credits can’t be used for any part of reserved capacity.Provisioned capacity units are billed “per-hour".CommentShareKirk-AWSanswered 3 years ago


Question: What is a typical lead time for EC2 scheduled event?

"We are responding to a RFP.Customer would like to know what is a typical lead time for EC2 Scheduled Events?https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/monitoring-instances-status-check_sched.htmlAzure has a lead time of 30 days unless it is urgent.==  Source: https://docs.microsoft.com/en-us/azure/virtual-machines/maintenance-and-updates  ===If maintenance requires a reboot, you're notified of the planned maintenance. Azure also provides a time window in which you can start the maintenance yourself, at a time that works for you. The self-maintenance window is typically 30 days unless the maintenance is urgent. Azure is investing in technologies to reduce the number of cases in which planned platform maintenance requires the VMs to be rebooted.FollowComment"

Answer: 0Accepted AnswerOur typical lead time is 14 days for non-critical scheduled events this includes instance reboots and retirements. Customers can also use the Flexible Maintenance feature to reschedule their scheduled maintenance events 14 days after the scheduled event. So all in all it will be 4 weeks window if they decide to use flexible maintenance.There are certain critical events when the notice period might decrease and flexible maintenance won’t be available.Customers can also automate responses to types of events: https://docs.aws.amazon.com/health/latest/ug/cloudwatch-events-health.html#automating-instance-actionsCommentShareAWS-User-9200322answered 3 years ago


Question: t3.micro ec2 instance dropped off network

"I have an Ubuntu t3.micro instance which dropped off the network this morning, from the system logs it suggests a DHCP timeout..Aug 16 07:11:25 my-hostname systemd[1]: snapd.service: Watchdog timeout (limit 5min)!Aug 16 07:08:59 my-hostname systemd-timesyncd[1111]: Synchronized to time server 91.189.89.199:123 (ntp.ubuntu.com).Aug 16 07:08:44 my-hostname systemd-timesyncd[1111]: Network configuration changed, trying to establish connection.Aug 16 07:08:42 my-hostname systemd-networkd[1099]: ens5: Could not set DHCPv4 route: Connection timed outAug 16 07:07:52 my-hostname systemd-networkd[1099]: ens5: FailedAug 16 07:07:52 my-hostname systemd-timesyncd[1111]: Synchronized to time server 91.189.89.199:123 (ntp.ubuntu.com).Aug 16 07:07:50 my-hostname systemd-networkd[1099]: ens5: Could not set DHCPv4 route: Connection timed outAug 16 07:07:46 my-hostname systemd-timesyncd[1111]: Network configuration changed, trying to establish connection.Aug 16 07:06:46 my-hostname systemd-timesyncd[1111]: Synchronized to time server 91.189.89.199:123 (ntp.ubuntu.com).Aug 16 07:06:42 my-hostname systemd-networkd[1099]: ens5: FailedAug 16 07:06:41 my-hostname systemd-networkd[1099]: ens5: Could not set DHCPv4 address: Connection timed outAug 16 07:06:40 my-hostname systemd-timesyncd[1111]: Network configuration changed, trying to establish connection.A network issue seems unlikely and I have seen stuff in the past when similar issues occur due to either CPU or disk burst credits depleting and the instance becoming throttled. In this case my instance (i-01d287e240ebc8e5f if any AWSers are here :)) did show a reduction in CPU credits but only by around 50%, they did not hit zero. Nobody was logged onto the box during the time and it came up fine after a reboot so the config is good.Any thoughts where I might look next?FollowComment"

Answer: "1I've hit a very similar problem on two of my instances in the last week.First on instance i-0daac824ee4991919:Aug 20 17:00:40 process systemd-networkd[62536]: ens5: DHCPv6 address 2600:1f16:216:7c64:ab39:691d:992f:3817/128 timeout preferred 150 valid 450Aug 20 17:01:50 process systemd-networkd[62536]: ens5: Could not set DHCPv6 address: Connection timed outAug 20 17:03:33 process systemd-networkd[62536]: ens5: FailedAnd then on instance i-0fbfc3151b977c780:Aug 23 13:00:10 process systemd-networkd[58373]: ens5: DHCPv6 address 2600:1f16:216:7c80:abdb:db3c:fcfd:20fd/128 timeout preferred 150 valid 450Aug 23 13:01:37 process systemd-networkd[58373]: ens5: Could not set NDisc route or address: Connection timed outAug 23 13:03:59 process systemd-networkd[58373]: ens5: FailedIn both cases, the problem seems to be two fold: The first is that the instance is getting very slow, there seem to be many different things that can trigger this, including running out of CPU credits, running out of EBS burst credits, and possibly either running out of memory or running very close to out of memory.The second case for me looks at least somewhat like the running out of memory situation, but I have no clue on the first case.The second part of the problem is that it looks like systemd-networkd never tries to recover from the interface going into a Failed state, this is very confusing to me, and I'd really like to get AWS support to give us an answer on how we can resolve that.  I'd also love to get some guidance on getting things like memory pressure in the instance metrics.CommentShareZephaniahanswered 2 years ago"


Question: AWS EC2 hosted service without curl response from outside access

"Hi,I deploy a Metabase instance by following the steps:build an EC2 instance;log in and run the commands available on this tutorial 1;Consult Docker logs that "Metabase initialization COMPLETE".Added a specific rule on my security group to TCP port 3000.I receive HTML response by curl from inside the EC2 instance. However, when I access it through the browser, there is none. The URL is the link ec2-44-201-76-229.compute-1.amazonaws.com:3000Regardless of the question "why is software engineering so hard?", what may it be? :-/FollowComment"

Answer: "0Use the following to start your containerdocker run -d -p 80:3000 --name metabase metabase/metabaseThen follow this document to open HTTP port 80 on the Security Group on your EC2 to allow you to connect from your browser - https://aws.amazon.com/premiumsupport/knowledge-center/connect-http-https-ec2/CommentShareEXPERTIndranil Banerjee AWSanswered 7 months agorePost-User-0682160 7 months agoGreat: by typing http://ec2-44-201-76-229.compute-1.amazonaws.com:80/, anyone with the URL may access the login landing page. I was able in the past to host and access a metabase instance from URL numeric_DNS_IP:3000. Can you explain the reason? I cannot. :-SShareIndranil Banerjee AWS EXPERT7 months agoYou can use any port. In that case when opening up the security group, use TCP instead of HTTP and you should be able to specify the port. If your intention is to make this accessible only by your machine, you can specify the IP of your machine instead of 0.0.0.0/0.Share"


Question: Unable to read orc file using glue context or Spark

"Hi,I am trying to read an orc file from an S3 bucket. I tried using Glue Catalog which gives the same schema as below. I am able to query the data via athena without any issues but when using Glue dynamic frame and catalog or spark dataframe to read or manipulate the orc file it is giving the below error.Using Spark 2.4Glue Context code -datasource0 = glueContext.create_dynamic_frame.from_catalog(database = "<database>", table_name = "<table>", transformation_ctx = "datasource0")datasource0_df = datasource0.toDF()datasource0_df = datasource0_df.drop("operation", "originaltransaction", "bucket", "rowid", "currenttransaction")Spark code -df = spark.read.format('orc').load('<S3 File path')df.printSchema()df.show()The printSchema shows the schema as follows -root|-- operation: integer (nullable = true)|-- originalTransaction: long (nullable = true)|-- bucket: integer (nullable = true)|-- rowId: long (nullable = true)|-- currentTransaction: long (nullable = true)|-- row: struct (nullable = true)| |-- _col0: string (nullable = true)| |-- _col1: string (nullable = true)| |-- _col2: string (nullable = true)| |-- _col3: timestamp (nullable = true)| |-- _col4: timestamp (nullable = true)| |-- _col5: string (nullable = true)| |-- _col6: string (nullable = true)| |-- _col7: boolean (nullable = true)| |-- _col8: timestamp (nullable = true)| |-- _col9: timestamp (nullable = true)| |-- _col10: string (nullable = true)| |-- _col11: string (nullable = true)| |-- _col12: timestamp (nullable = true)| |-- _col13: string (nullable = true)| |-- _col14: timestamp (nullable = true)| |-- _col15: string (nullable = true)| |-- _col16: string (nullable = true)| |-- _col17: string (nullable = true)| |-- _col18: string (nullable = true)| |-- _col19: string (nullable = true)| |-- _col20: string (nullable = true)| |-- _col21: timestamp (nullable = true)| |-- _col22: timestamp (nullable = true)| |-- _col23: string (nullable = true)| |-- _col24: string (nullable = true)| |-- _col25: string (nullable = true)| |-- _col26: string (nullable = true)| |-- _col27: string (nullable = true)| |-- _col28: string (nullable = true)| |-- _col29: string (nullable = true)| |-- _col30: string (nullable = true)| |-- _col31: string (nullable = true)| |-- _col32: integer (nullable = true)| |-- _col33: integer (nullable = true)| |-- _col34: integer (nullable = true)| |-- _col35: integer (nullable = true)| |-- _col36: integer (nullable = true)| |-- _col37: integer (nullable = true)However when I am trying to do any operation on the dataframe it is giving the below error.ERROR [Executor task launch worker for task 0] executor.Executor (Logging.scala:logError(91)) - Exception in task 0.0 in stage 0.0 (TID 0)java.lang.IllegalArgumentException: Include vector the wrong length: {"category": "struct", "id": 0, "max": 44, "fields": ["operation": {"category": "int", "id": 1, "max": 1},"originalTransaction": {"category": "bigint", "id": 2, "max": 2},"bucket": {"category": "int", "id": 3, "max": 3},"rowId": {"category": "bigint", "id": 4, "max": 4},"currentTransaction": {"category": "bigint", "id": 5, "max": 5},"row": {"category": "struct", "id": 6, "max": 44, "fields": ["_col0": {"category": "string", "id": 7, "max": 7},"_col1": {"category": "string", "id": 8, "max": 8},"_col2": {"category": "string", "id": 9, "max": 9},"_col3": {"category": "timestamp", "id": 10, "max": 10},"_col4": {"category": "timestamp", "id": 11, "max": 11},"_col5": {"category": "string", "id": 12, "max": 12},"_col6": {"category": "string", "id": 13, "max": 13},"_col7": {"category": "boolean", "id": 14, "max": 14},"_col8": {"category": "timestamp", "id": 15, "max": 15},"_col9": {"category": "timestamp", "id": 16, "max": 16},"_col10": {"category": "string", "id": 17, "max": 17},"_col11": {"category": "string", "id": 18, "max": 18},"_col12": {"category": "timestamp", "id": 19, "max": 19},"_col13": {"category": "string", "id": 20, "max": 20},"_col14": {"category": "timestamp", "id": 21, "max": 21},"_col15": {"category": "string", "id": 22, "max": 22},"_col16": {"category": "string", "id": 23, "max": 23},"_col17": {"category": "string", "id": 24, "max": 24},"_col18": {"category": "string", "id": 25, "max": 25},"_col19": {"category": "string", "id": 26, "max": 26},"_col20": {"category": "string", "id": 27, "max": 27},"_col21": {"category": "timestamp", "id": 28, "max": 28},"_col22": {"category": "timestamp", "id": 29, "max": 29},"_col23": {"category": "string", "id": 30, "max": 30},"_col24": {"category": "string", "id": 31, "max": 31},"_col25": {"category": "string", "id": 32, "max": 32},"_col26": {"category": "string", "id": 33, "max": 33},"_col27": {"category": "string", "id": 34, "max": 34},"_col28": {"category": "string", "id": 35, "max": 35},"_col29": {"category": "string", "id": 36, "max": 36},"_col30": {"category": "string", "id": 37, "max": 37},"_col31": {"category": "string", "id": 38, "max": 38},"_col32": {"category": "int", "id": 39, "max": 39},"_col33": {"category": "int", "id": 40, "max": 40},"_col34": {"category": "int", "id": 41, "max": 41},"_col35": {"category": "int", "id": 42, "max": 42},"_col36": {"category": "int", "id": 43, "max": 43},"_col37": {"category": "int", "id": 44, "max": 44}]}]} with include length 45Please let me know what needs to be done to fix this.Edited by: amit94ece on Oct 23, 2019 8:48 PMEdited by: amit94ece on Oct 23, 2019 9:08 PMEdited by: amit94ece on Oct 24, 2019 1:15 AMFollowComment"

Answer: "0Found out the issue with this. Spark currently doesn't support reading Hive ACID transactional tables. Since I am trying to read Hive ACID tables it was not working. Where as Athena used Presto ORC and can read Hive ACID tables hence it was able to read the same file. So, I am doing a 2 hop approach (Hive ACID ORC to Normal ORC format using Athena CTAS and then using Glue and able to convert the files). hope this helps others.CommentShareamit94eceanswered 4 years ago"


Question: How can we reconcile the number of records which AppFlow for SAP pulls using oData?

How can we reconcile the number of records which AppFlow for SAP pulls from our SAP system? We would like to automate the reconciliation of number of records SAP is sending vs. the number of records ingested (landed in S3) for each data load using AppFlow?NOTE: This is a common question asked by AWS customers. The AWS team is posting it to provide an answer that can benefit everyone.FollowComment

Answer: "1Accepted AnswerIt should be possible to automate “the reconciliation of number of records SAP is sending vs. the number of records ingested (landed in S3) for each data load”, this can be done through the means of lambda with the following methods :To get the SAP OData record extraction:1/ Non-ODP Based Extraction : use $count as per https://blogs.sap.com/2013/03/20/using-odatas-top-skip-and-count/2/ ODP Based Extraction : use $inlinecount as per  https://help.sap.com/doc/saphelp_nw75/7.5.5/en-US/50/f4ee6253134d3cafa25b9444f0c5a9/frameset.htmTo get the Appflow execution records:3/ https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/appflow.html#Appflow.Client.describe_flow_execution_recordsHope this helps.CommentShareferrymulanswered 8 months ago"


Question: Send Messages from SQS to SES

"Hi Team, Is it possible to send messages from SQS to SES, is there any configurations in the console. Currently I am working in the ireland region, and have created a topic, while subscribing the only option i have found is Amazon SQS, but I want to send an email. So please help me if there is a way to send messages from SQS to SES in consoleFollowComment"

Answer: "2Accepted AnswerThere is no direct integration betweenSQS and SES. You can trigger a Lambda function from SQS to send the message to SES, or you can use EventBridge Pipes to trigger a Step Functions state machine that will use an SDK integration with SES (if you do not want to write any code).CommentShareEXPERTUrianswered 4 months agoEXPERTAWS-User-Nitinreviewed 4 months agoPavithra B 4 months agoOkay,thanks for letting me know:)Share0Hi  Pavithra, thanks for sharing your question. The AWS Specialized Solutions Architect team maintain a list of reference architectures in GitHub that you can use as reference for your scenario.Please check if this architecture fits your needs: https://github.com/aws-samples/communication-developer-services-reference-architectures/tree/master/SES_Pinpoint_Messages_QueuingBest.CommentSharebruno_ganswered 2 months ago"


Question: Migrating partitioned table from postgres to Redshift with pglogical

"I've created a DMS task of CDC and Full Load, migrating data from postgres 14 to Redshift. According to the documentation, when using pglogical and creating postgres publication with 'publish_via_partition_root' parameter of my partitioned table, changes should be published to the parent table and to to child tables. However, the data is still migrated to the child tables in Redshift and not to the parent table. Am I missing something thats needs to be configured or is it just not possible in DMS?FollowComment"

Answer: "0Hi,There are currently some points that should be taken into consideration when using PostgreSQL as a source database in DMS. For the moment, when a partitioned table is detected, the following occurs:The endpoint reports a list of parent and child tables.AWS DMS creates the table on the target as a regular table with the same properties as the selected tables.If the parent table in the source database has the same primary key value as its child tables, a "duplicate key" error is generated.You can find the full list of limitations when using PostgreSQL as a DMS source on https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.PostgreSQL.html#CHAP_Source.PostgreSQL.LimitationsThanks.CommentShareZiadanswered 8 months ago"


Question: Package not getting updated on AML2 through yum or Patch Manager

"Hello,We have a custom AMI baked from Amazon Linux 2 and we have been trying to update packages on the instances that are running this AMI. We found that, for example, the python package is currently at 2.7.18-1.amzn2.0.2 whereas 2.7.18-1.amzn2.0.4 is the latest available according to documentation. However, we cannot get yum to update python to version 2.7.18-1.amzn2.0.4When running yum update python we see "No packages marked for update".We have also been trying to update the packages through AWS Systems Manager - Patch Manager but the python package does not get updated after performing a Scan and Install. We have also created a custom patch baseline including all available patches, but the package was not updated with this either.This is despite us finding CVEs related to the python package that we expected would require an update from the current version 2.7.18-1.amzn2.0.2. Examples: https://alas.aws.amazon.com/AL2/ALAS-2021-1611.html  and https://alas.aws.amazon.com/AL2/ALAS-2021-1669.htmlHow do we allow instances running our AMI to update to the latest versions of packages? And why are these updates not been captured by the patch baseline?Thanks and regards.FollowComment"


Question: EC2 Instance reachability check failed after yum upgrade

"Instance id: i-096ae05732c55de39AMI ID: amzn2-ami-hvm-2.0.20190228-x86_64-gp2 (ami-0de7daa7385332688)I tried to reboot, stop and start, detach and attach the volume but nothing works. I tried creating a new instance and attach the problematic instance volume to the new instance and I'm getting the same issue with the same logs (see below).I really hope you can help me log back to the instance or recover the current code and crontab.Thank you,IdoSystem logs:[    6.515568] cloud-init[2107]: Cloud-init v. 19.3-2.amzn2 running 'init' at Sun, 12 Jan 2020 14:50:46 +0000. Up 6.49 seconds.[    6.531320] cloud-init[2107]: ci-info: +++++++++++++++++++++++++++Net device info++++++++++++++++++++++++++++[    6.531553] cloud-init[2107]: ci-info: ---------------------------------------------------------------+[    6.531687] cloud-init[2107]: ci-info: | Device |   Up  |  Address  |    Mask   | Scope |     Hw-Address    |[    6.531814] cloud-init[2107]: ci-info: ---------------------------------------------------------------+[    6.531938] cloud-init[2107]: ci-info: |  eth0  | False |     .     |     .     |   .   | 06:0a:56:c4:72:d4 |[    6.532090] cloud-init[2107]: ci-info: |   lo   |  True | 127.0.0.1 | 255.0.0.0 |  host |         .         |[    6.532209] cloud-init[2107]: ci-info: |   lo   |  True |  ::1/128  |     .     |  host |         .         |[    6.532326] cloud-init[2107]: ci-info: ---------------------------------------------------------------+[    6.532442] cloud-init[2107]: ci-info: +++++++++++++++++++Route IPv6 info+++++++++++++++++++[    6.532565] cloud-init[2107]: ci-info: -----------------------------------------------[    6.532683] cloud-init[2107]: ci-info: | Route | Destination | Gateway | Interface | Flags |[    6.532797] cloud-init[2107]: ci-info: -----------------------------------------------[    6.532912] cloud-init[2107]: ci-info: -----------------------------------------------[    6.643586] cloud-init[2107]: Jan 12 14:50:46 cloud-init[2107]: DataSourceEc2.py[WARNING]: Calling 'http://169.254.169.254/latest/api/token' failed [0/1s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a89684d0>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][    7.646859] cloud-init[2107]: Jan 12 14:50:47 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964b10>: Failed to establish a new connection: [Errno -2] Name or service not known',))[    7.666755] cloud-init[2107]: Jan 12 14:50:47 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [0/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964a50>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][    8.670012] cloud-init[2107]: Jan 12 14:50:48 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964790>: Failed to establish a new connection: [Errno -2] Name or service not known',))[    8.690271] cloud-init[2107]: Jan 12 14:50:48 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [1/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964650>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][    9.693515] cloud-init[2107]: Jan 12 14:50:49 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964810>: Failed to establish a new connection: [Errno -2] Name or service not known',))[    9.713765] cloud-init[2107]: Jan 12 14:50:50 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [2/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a89645d0>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   10.716931] cloud-init[2107]: Jan 12 14:50:51 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964850>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   10.737123] cloud-init[2107]: Jan 12 14:50:51 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [3/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964e90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   11.740529] cloud-init[2107]: Jan 12 14:50:52 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964710>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   11.760948] cloud-init[2107]: Jan 12 14:50:52 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [4/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964550>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   12.764088] cloud-init[2107]: Jan 12 14:50:53 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964310>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   12.785413] cloud-init[2107]: Jan 12 14:50:53 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [5/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964590>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   14.789780] cloud-init[2107]: Jan 12 14:50:55 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964fd0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   14.809967] cloud-init[2107]: Jan 12 14:50:55 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [7/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964850>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   16.814238] cloud-init[2107]: Jan 12 14:50:57 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964650>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   16.834230] cloud-init[2107]: Jan 12 14:50:57 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [9/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964e10>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   18.838605] cloud-init[2107]: Jan 12 14:50:59 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964a50>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   18.859101] cloud-init[2107]: Jan 12 14:50:59 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [11/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964c90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   20.863487] cloud-init[2107]: Jan 12 14:51:01 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964a90>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   20.890368] cloud-init[2107]: Jan 12 14:51:01 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [13/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964b50>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   22.894642] cloud-init[2107]: Jan 12 14:51:03 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964710>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   22.916020] cloud-init[2107]: Jan 12 14:51:03 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [15/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964850>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   25.921482] cloud-init[2107]: Jan 12 14:51:06 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a89642d0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   25.942292] cloud-init[2107]: Jan 12 14:51:06 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [18/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964e50>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   28.947641] cloud-init[2107]: Jan 12 14:51:09 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964ed0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   28.980291] cloud-init[2107]: Jan 12 14:51:09 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [21/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964c90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   31.985667] cloud-init[2107]: Jan 12 14:51:12 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964790>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   32.006417] cloud-init[2107]: Jan 12 14:51:12 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [24/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964350>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   35.011882] cloud-init[2107]: Jan 12 14:51:15 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964750>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   35.032071] cloud-init[2107]: Jan 12 14:51:15 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [27/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964850>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   38.037589] cloud-init[2107]: Jan 12 14:51:18 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a89643d0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   38.058474] cloud-init[2107]: Jan 12 14:51:18 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [30/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964ad0>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   42.064758] cloud-init[2107]: Jan 12 14:51:22 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a89646d0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   42.084761] cloud-init[2107]: Jan 12 14:51:22 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [34/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964c90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   46.091063] cloud-init[2107]: Jan 12 14:51:26 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964b90>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   46.111536] cloud-init[2107]: Jan 12 14:51:26 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [38/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964d90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   50.117923] cloud-init[2107]: Jan 12 14:51:30 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964310>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   50.139248] cloud-init[2107]: Jan 12 14:51:30 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [42/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964850>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   54.145806] cloud-init[2107]: Jan 12 14:51:34 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a89645d0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   54.165882] cloud-init[2107]: Jan 12 14:51:34 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [46/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964610>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   58.172140] cloud-init[2107]: Jan 12 14:51:38 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964d50>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   58.191955] cloud-init[2107]: Jan 12 14:51:38 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [50/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964c90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   63.199313] cloud-init[2107]: Jan 12 14:51:43 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964550>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   63.220255] cloud-init[2107]: Jan 12 14:51:43 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [55/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a89644d0>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   68.227799] cloud-init[2107]: Jan 12 14:51:48 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964590>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   68.248621] cloud-init[2107]: Jan 12 14:51:48 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [60/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964850>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   73.255912] cloud-init[2107]: Jan 12 14:51:53 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964990>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   73.275464] cloud-init[2107]: Jan 12 14:51:53 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [65/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964f50>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   78.282771] cloud-init[2107]: Jan 12 14:51:58 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964e10>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   78.303398] cloud-init[2107]: Jan 12 14:51:58 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [70/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964c90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   83.310696] cloud-init[2107]: Jan 12 14:52:03 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964810>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   83.341005] cloud-init[2107]: Jan 12 14:52:03 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [75/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964e90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   89.349505] cloud-init[2107]: Jan 12 14:52:09 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964b50>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   89.370090] cloud-init[2107]: Jan 12 14:52:09 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [81/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964850>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][   95.378513] cloud-init[2107]: Jan 12 14:52:15 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964fd0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[   95.399052] cloud-init[2107]: Jan 12 14:52:15 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [87/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964950>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][  101.407361] cloud-init[2107]: Jan 12 14:52:21 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964e50>: Failed to establish a new connection: [Errno -2] Name or service not known',))[  101.429123] cloud-init[2107]: Jan 12 14:52:21 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [93/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964c90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][  107.437417] cloud-init[2107]: Jan 12 14:52:27 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964bd0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[  107.460035] cloud-init[2107]: Jan 12 14:52:27 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [99/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964510>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][  113.468430] cloud-init[2107]: Jan 12 14:52:33 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964ad0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[  113.488680] cloud-init[2107]: Jan 12 14:52:33 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [105/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964d90>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][  120.498447] cloud-init[2107]: Jan 12 14:52:40 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964dd0>: Failed to establish a new connection: [Errno -2] Name or service not known',))[  120.519135] cloud-init[2107]: Jan 12 14:52:40 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [112/120s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964e10>: Failed to establish a new connection: [Errno 101] Network is unreachable',))][  127.528455] cloud-init[2107]: Jan 12 14:52:47 cloud-init[2107]: DataSourceEc2.py[WARNING]: Unable to get API token: None/latest/api/token raised exception HTTPConnectionPool(host='none', port=80): Max retries exceeded with url: /latest/api/token (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f07a8964850>: Failed to establish a new connection: [Errno -2] Name or service not known',))[  127.548962] cloud-init[2107]: Jan 12 14:52:47 cloud-init[2107]: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [119/120s]: unexpected error [Attempted to set connect timeout to 0.0, but the timeout cannot be set to a value less than or equal to 0.][  134.556546] cloud-init[2107]: Jan 12 14:52:54 cloud-init[2107]: DataSourceEc2.py[CRITICAL]: Giving up on md from ['http://169.254.169.254/2009-04-04/meta-data/instance-id'] after 126 seconds[  OK  ] Started Initial cloud-init job (metadata service crawler).Edited by: idogrady on Jan 12, 2020 8:40 AMFollowComment"

Answer: "0Hi Ido,On the log that you have provided, it can be seen, that networking (eth0) has not been configured correctly.To troubleshoot this kind of issue, I would recommend you to launch a new instance from the same AMI, and to attach the root volume from the broken instance i-096ae05732c55de39 to it. Then mount that root volume and compare its network configuration files with the configuration files of the working instance. As both instances are based on the same AMI, you should be able to find where the network is misconfigured easily.Regards,awstomasCommentShareAWS-User-3892169answered 3 years ago0Hi Tomas,Thank you for your help, however, I tried mounting the root volume to a similar instance which resulted in the new instance to have the same reachability error. I've also tried to add the root volume as an additional volume to a similar instance which and mount it which showed the newly mounted volume as "lost+found" which as I understand means that the volume is corrupted? In any case, I couldn't reach the mount volume data.Any help will be much appreciated.CommentShareidogradyanswered 3 years ago"


Question: CreateTransformJob batching

"I'm using CreateTransformJob to submit a sagemaker inference task. I have a single input file to process consisting of 25k jsonl records, the total filesize is 2.5MB and the model is a simple PyTorch text classifier.I just want to confirm my understanding of how transform jobs work. I've configured the job to use Line batching. It seems though that because MaxPayloadInMB is an integer, setting it to 1 will result in 3 (not so mini) batches (i.e. each batch is 10k records)?So assuming I use an instance with 4 vCPU's and MaxConcurrentTransforms=4 then it should run all 4 batches in parallel? But there doesn't seem to be any reason to use a larger instance / more instances to increase throughput since if my understanding is correct there's no way to explicitly set the minibatch size any smaller than MaxPayloadInMB // size_of_file_in_mb?Am I correct? If I want smaller mini-batches do I need to manually split the file myself and then manually reassemble it?"MaxConcurrentTransforms": max_concurrent_transforms, "MaxPayloadInMB": max_payload,"BatchStrategy": "MultiRecord","TransformOutput": {    "S3OutputPath": batch_output,    "AssembleWith": "Line",    "Accept": "application/jsonlines",},FollowComment"

Answer: "0Hello Dave,From the AWS documentation they mentioned that you can control the size of the mini-batches by using the BatchStrategy and MaxPayloadInMB parameters [1]. With BatchStrategy you can specify the number of records to include in a mini-batch for an inference request [2]. Where each record is a single unit of input data that inference can be made on. For example, a single line in a CSV file is a record. If the input data is very large you can set the value of the MaxPayloadInMB to 0 to stream the data to the algorithm. However, this feature is not supported for  Amazon SageMaker built-in algorithms.Moreover, to split input files into mini-batches when you create a batch transform job, set the SplitType parameter value to Line [1]. If SplitType is set to None or if an input file can't be split into mini-batches, SageMaker uses the entire input file in a single request. Please note that Batch Transform doesn't support CSV-formatted input that contains embedded newline characters. If you set SplitType to Line, you can then set the AssembleWith parameter to Line to concatenate the output records with a line delimiter. Thus, you do not need to manually reassemble the output. If you don't specify the AssembleWith parameter, by default the output records are concatenated in a binary format.I hope that this information will be helpful.References:https://docs.aws.amazon.com/sagemaker/latest/dg/batch-transform.html#batch-transform-large-datasetshttps://docs.aws.amazon.com/sagemaker/latest/APIReference/API_CreateTransformJob.html#API_CreateTransformJob_RequestParametersCommentShareCebianswered 3 months ago"


Question: Why can't I install an app on a T3.small instance if it works fine for me on the t2.micro Free Tier?

"I´m using the Metatrader 5 app on the free tier t2.micro instance and it works perfectly. Now I need to install it on a t3.small instance with windows server 2019 base because I need more capacity and it won't let me install it. When starting the MT5 installer, a message appears asking me for a proxy address, a username and a password. This app is installed directly without asking for any proxy. I've already tried disabling the instance's firewall and it doesn't work either. I tried to disable Defender but I guess I couldn't disable it completely (I'm not a computer expert) and it didn't work either. I understand that there is something that prevents the installation of the app but I don't know what it can be. ThanksFollowCommentFernando Bueno 4 months agoHello how are you?I'm not able to run the MT5 on the t2-micro when I go to put the brokerage account on it hangs and stops responding to the MT5...Did you need to make any special adjustments to be able to run the MT5 on the t2-micro?Thanks...Share"

Answer: "0Hi Fernando,I didn't have any problems with MT5 on t2.micro. I recommend that you try to uninstall the current MT5 and download another MT5 application from another broker or the generic metatrader one and try again.CommentShareRUAanswered 4 months agoFernando Bueno 4 months agoHello how are you? Thanks for the answer but unfortunately I already did that and several other attempts to find happiness hehehe... I don't know what else to do if I install the default version of MetaQuotes and leave their default account that DEMO works but when I try to add the account of a Of the two brokerages I use, it crashes and stops responding..Life isn't good in that regard.Share"


Question: Working with Grpc in AWS ECS

"Hi, I have deployed 2 applications in AWS ECS by using Grpc to communicate with each other. However, everytimes the client tried to connect to the server, it complains that the connection is refused. I am using DNS(Route 53) and NettyChannelBuilder to build the connection. I have exposed the client and server port when creating the task.Another thing that I have tried is to create ALB in the server, I also got the same error (Connection refused. No further information). Tried deploying appMesh, it stucks at PRE_INITIALIZING state. May I know what should I do to fix the issue?Note; There is no problem when I deployed the 2 applications in company VM.FollowComment"


Question: Is it possible to pass SqlParameters to Redshift Data API ExecuteStatement from Step Functions?

"I have a Step Function that uses the ExecuteStatement integration from the Redshift Data API. I want to execute a SQL statement that includes named parameters, which I want to use JSONPath to pass in to the API.According to the API reference, the Parameters should look like this:{   "Parameters": [       {          "name": "string",         "value": "string"      }   ]}However, when I try to pass parameters in this way, the Step Function refuses to start the task:..."Parameters":[{"name":"foo","value":"bar"},{"name":"baz","value":"bat"}] ...could not be used to start the Task: [The field "name" is not supported by Step Functions]Is there any way to pass parameters in without using the field "name"?FollowComment"

Answer: "0Hello,In this context, please note that, you can control the SQL text submitted to the database engine by calling the Data API operation using parameters for parts of the SQL statement.[+] - https://docs.aws.amazon.com/redshift/latest/mgmt/data-api.html#data-api-calling-considerations-parametersTherefore, it looks like an issue from the Step functions.However, please note that, if you are using Redshift Serverless the above method is not compatible with it and there is an existing Feature Request currently in place regarding this issue.Since features are required to be tested and pre-configured as per the existing ecosystem because of which I unfortunately would not be able to provide an ETA/timeline for the same.That being said, to further look into this issue more closely, if you would like to do a resource based troubleshooting, please raise a support case with AWS for further information. If a support case has already been created please be assured that we will get back to you and assist you in the best way possible.Thankyou!CommentShareSakshi_Janswered 2 months ago-1According to Using the Amazon Redshift Data API it should work - you are right. However, maybe it is not the Redshift API problem but rather Step functions(error is coming from it).Did you try passing parameters as a list(no named parameters) to confirm if this way it will work?like this:{   "Parameters":[      "string1",      "string2"   ]}and if SQL statement that looks like this you can use JSONPath to map each string to the appropriate parameter in your SQL statement.:SELECT * FROM YOUR_TABLE WHERE column1 = :param1 AND column2 = :param2You can use JSONPath to map the first parameter to ":param1" and the second parameter to ":param2". Here's an example of what the JSON might look like:{   "Parameters":[      "foo",      "bar"   ],   "SqlStatement":"SELECT * FROM YOUR_TABLE WHERE column1 = :$.Parameters[0] AND column2 = :$.Parameters[1]"}Let me know if this something that will work for you.CommentShareNikoanswered 2 months agoDavid 2 months agoI'm pretty skeptical of this answer. Firstly, in order to do substitution into a string in Step Functions, you would need to name the SqlStatement "SqlStatement.$". Next, when you DO use JSONPath, it doesn't just substitute in to a larger string; it expects a JMESPath expression. You would need to pass "States.Format('select * from ...', $.Parameters[0], ...)". Finally, the entire point of getting parameters sent to the Redshift Data API is so that the SQL engine interprets the parameters itself and handles the potential quoting issues. Maybe give it a shot in the Step Functions console and test your theory?Share"


Question: Is it possible to tap into a Multi-AZ DB cluster read replica binlog?

"Hi folks,I'm wondering if it is possible in a Multi-AZ DB cluster to tap into the read replica binlog? Or to enable backup of the replica?FollowCommentphilaws MODERATOR6 months agoYou can setup a binlog server that will pull binlogs from a Mutli-az Cluster.https://aws.amazon.com/blogs/database/setting-up-a-binlog-server-for-amazon-rds-mysql-and-mariadb-using-mariadb-maxscale/Share"

Answer: "0Before, a MySQL DB instance can serve as a replication source, make sure to enable automatic backups on the source DB instance. To do this, set the backup retention period to a value other than 0.NOW This requirement also applies to a read replica that is the source DB instance for another read replica. Automatic backups are supported for read replicas running any version of MySQL. You can configure replication based on binary log coordinates for a MySQL DB instance.[+] For More Information, see: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_MySQL.Replication.ReadReplicas.html#USER_MySQL.Replication.ReadReplicas.ConfigurationRDS for MySQL supports cascading read replicas. With cascading read replicas, your RDS for MySQL DB instance sends data to the first read replica in the chain. That read replica then sends data to the second replica in the chain, and so on. The end result is that all read replicas in the chain have the changes from the RDS for MySQL DB instance, but without the overhead solely on the source DB instance.On RDS for MySQL version 5.7.23 and higher MySQL 5.7 versions and RDS for MySQL 8.0.26 and higher 8.0 versions, you can configure replication using global transaction identifiers (Global transaction identifiers (GTIDs) are unique identifiers generated for committed MySQL transactions. You can use GTIDs to make binlog replication simpler and easier to troubleshoot.)[+] For Setting Up GTIDs, see: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/mysql-replication-gtid.htmlCommentSharerePost-User-0820170answered 6 months ago"


Question: Max number of EBS volumes attachments per instance types

"Hello,We are trying to figure out what the maximum number of EBS volumemounts we can have for different instance types.The documentation is extremely spotty:https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/volume_limits.htmlThe documentation did not list out popular instance types like:m5.4xlarge, m6a.4xlarge, r5, r6.Can you help in pointing out the documentation of  max number ebsvolumes that can be attached to different instance types like:m5.4xlarge or m6a.4xlarge or r6.xlarge or r6a.xlarge ?It will not be fun if we need to spin up instances and volumes to figure out what the number is.Thanks,RobFollowComment"