Question: Stack in Cloud formation (Beginner level)

"Hi, I'm trying to implement cloud stack using template designer using the components to implement VPC, subnets, Route table and IG without using yaml or jason codes . Please could someone assist on this. Much Appreciated!FollowComment"

Answer: "0This may provide you guidance - https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/working-with-templates-cfn-designer-walkthrough-createbasicwebserver.htmlIf my answer helps resolve your issue, please upvote and accept my answer. ThanksCommentShareEXPERTIndranil Banerjee AWSanswered a year agorePost-User-7658035 a year agoThank you for the directions, is there anyway could implement template, just mapping the components manually?ShareIndranil Banerjee AWS EXPERTa year agoSorry did not get your question. Are you looking for a ready-made template that does this instead of you having to create it manually? If so, then you can look at this - https://github.com/awslabs/aws-cloudformation-templates/blob/master/aws/services/VPC/VPC_With_Managed_NAT_And_Private_Subnet.yamlShare0I would not expect a lot from the designer feature ,,not helpfulInvest sometime in docs will not regret it specially the template anatomy part and then use the vscode cloud formation plugin will help u initially populate the template.Cloud formation is great but designer is uselessCommentShareYasserAlhawaryanswered 10 months ago"


Question: Is 'CodeDeployDefault.OneAtATime' a 'Zero Downtime deployment'?

"If I set the deployment configurations for the deployment group of CodeDeploy to CodeDeployDefault.OneAtATime and deploy to two servers, does the deployment to the other server start when the deployment to one server is completed? (Is it a Zero Downtime Deployment?)Page for reference : https://docs.aws.amazon.com/codedeploy/latest/userguide/deployment-configurations.htmlFollowComment"

Answer: "0Hi,As far as I know, CodeDeployDefault.OneAtATime minimizes downtime but it does not completely eliminate them, as there might be a short period of time when some instances have the new application revision and some do not, causing little downtime.CommentShareEXPERTalatechanswered 3 months ago"


Question: CannotPullContainerError in public VPC/Subnet. What am I missing/doing wrong?

"I have created a brand new AWS account (just to troubleshoot this issue) and the default VPC and subnets of every region in this account are left pristine and unmodified.Here's the default VPC in us-east-1:$ aws ec2 describe-vpcs{    "Vpcs": [        {            "CidrBlock": "172.31.0.0/16",            "DhcpOptionsId": "dopt-095a7873b289557a1",            "State": "available",            "VpcId": "vpc-08ba51697a37c5ad9",            "OwnerId": "...",            "InstanceTenancy": "default",            "CidrBlockAssociationSet": [                {                    "AssociationId": "vpc-cidr-assoc-0dba5df7b176877b7",                    "CidrBlock": "172.31.0.0/16",                    "CidrBlockState": {                        "State": "associated"                    }                }            ],            "IsDefault": true        }    ]}Here's the route table for this VPC:$ aws ec2 describe-route-tables --filters Name=vpc-id,Values=vpc-08ba51697a37c5ad9{    "RouteTables": [        {            "Associations": [                {                    "Main": true,                    "RouteTableAssociationId": "rtbassoc-08e6f9833f341f6c4",                    "RouteTableId": "rtb-000d61d5d0236d276",                    "AssociationState": {                        "State": "associated"                    }                }            ],            "PropagatingVgws": [],            "RouteTableId": "rtb-000d61d5d0236d276",            "Routes": [                {                    "DestinationCidrBlock": "172.31.0.0/16",                    "GatewayId": "local",                    "Origin": "CreateRouteTable",                    "State": "active"                },                {                    "DestinationCidrBlock": "0.0.0.0/0",                    "GatewayId": "igw-0b7ed209f5cd38fa6",                    "Origin": "CreateRoute",                    "State": "active"                }            ],            "Tags": [],            "VpcId": "vpc-08ba51697a37c5ad9",            "OwnerId": "..."        }    ]}As you can see, the second route permits egress to the internet:{    "DestinationCidrBlock": "0.0.0.0/0",    "GatewayId": "igw-0b7ed209f5cd38fa6",    "Origin": "CreateRoute",    "State": "active"}So I assume if I deploy an ECS Fargate task in this VPC, it should be able to pull amazoncorretto:17-alpine3.15 from docker.io.Despite that, whenever I deploy my CloudFormation stack, ECS fails to run the scheduled task as it cannot fetch the images from DockerHub and prints this error:CannotPullContainerError:inspect image has been retried 5 time(s):failed to resolve ref "docker.io/library/amazoncorretto:17-alpine3.15":failed to do request: Head https://registry-1.docker.io/v2/library/amazoncorretto/manifests/17-alpine3.15: dial ...Here's my CloudFormation template (I have intentionally given wide open permissions to all the roles involved to make sure this issue is not due to insufficient IAM permissions):AWSTemplateFormatVersion: "2010-09-09"Description: ECS Cron TaskParameters:  AppName:    Type: String    Default: CronTask  AppImage:    Type: String    Default: amazoncorretto:17-alpine3.15  AppLogGroup:    Type: String    Default: ECS  AppLogPrefix:    Type: String    Default: CronTask  ScheduledTaskSubnets:    Type: List<AWS::EC2::Subnet::Id>    Default: "subnet-0031a6eaf7e52173c, subnet-01950a0d2d1e04dc1, subnet-0a1aa70f0421e2025, subnet-036abb95995a86c73, subnet-0f8b5043babfb9a7e, subnet-07cb2210ce2d5bb8f"Resources:  Cluster:    Type: AWS::ECS::Cluster  TaskRole:    Type: AWS::IAM::Role    Properties:      AssumeRolePolicyDocument:        Version: "2012-10-17"        Statement:          - Action: sts:AssumeRole            Effect: Allow            Principal:              Service: ecs-tasks.amazonaws.com      Policies:        - PolicyName: AdminAccess          PolicyDocument:            Version: "2012-10-17"            Statement:              - Action: "*"                Effect: Allow                Resource: "*"  TaskExecutionRole:    Type: AWS::IAM::Role    Properties:      AssumeRolePolicyDocument:        Version: "2012-10-17"        Statement:          - Action: sts:AssumeRole            Effect: Allow            Principal:              Service: ecs-tasks.amazonaws.com      Path: /      ManagedPolicyArns:        - arn:aws:iam::aws:policy/service-role/AmazonECSTaskExecutionRolePolicy      Policies:        - PolicyName: AdminAccess          PolicyDocument:            Version: "2012-10-17"            Statement:              - Action: "*"                Effect: Allow                Resource: "*"  TaskScheduleRole:    Type: AWS::IAM::Role    Properties:      AssumeRolePolicyDocument:        Statement:          - Action: sts:AssumeRole            Effect: Allow            Principal:              Service: events.amazonaws.com      Path: /      Policies:        - PolicyName: AdminAccess          PolicyDocument:            Statement:              - Action: "*"                Effect: Allow                Resource: "*"  TaskDefinition:    Type: AWS::ECS::TaskDefinition    Properties:      Cpu: 256      Memory: 512      NetworkMode: awsvpc      TaskRoleArn: !Ref TaskRole      ExecutionRoleArn: !Ref TaskExecutionRole      Family: !Ref AppName      RequiresCompatibilities:        - FARGATE      ContainerDefinitions:        - Name: !Ref AppName          Image: !Ref AppImage          Command: ["java", "--version"]          Essential: true          LogConfiguration:            LogDriver: awslogs            Options:              awslogs-create-group: true              awslogs-group: !Ref AppLogGroup              awslogs-region: !Ref "AWS::Region"              awslogs-stream-prefix: !Ref AppLogPrefix  TaskSchedule:    Type: AWS::Events::Rule    DependsOn:       - TaskScheduleRole      - DeadLetterQueue    Properties:      Description: Trigger the task once every minute      ScheduleExpression: cron(0/1 * * * ? *)      State: ENABLED      Targets:        - Arn: !GetAtt Cluster.Arn          Id: ClusterTarget          RoleArn: !GetAtt TaskScheduleRole.Arn          DeadLetterConfig:            Arn: !GetAtt DeadLetterQueue.Arn          EcsParameters:            LaunchType: FARGATE            TaskCount: 1            TaskDefinitionArn: !Ref TaskDefinition            NetworkConfiguration:              AwsVpcConfiguration:                Subnets: !Ref ScheduledTaskSubnets  DeadLetterQueue:    Type: AWS::SQS::Queue    Properties:      QueueName: "CronTaskDeadLetterQueue"  DeadLetterQueuePolicy:    Type: AWS::SQS::QueuePolicy    Properties:      Queues:        - !Ref DeadLetterQueue      PolicyDocument:        Statement:          - Action: "*"            Effect: Allow            Resource: "*"What am I missing here? Why despite running the task in a public subnet/VPC (below), AWS cannot pull the image from docker.io? Is something missing in my TaskSchedule resource?TaskSchedule:    Type: AWS::Events::Rule    ...    Properties:        ...        Targets:            - ...                EcsParameters:                LaunchType: FARGATE                TaskCount: 1                TaskDefinitionArn: !Ref TaskDefinition                NetworkConfiguration:                    AwsVpcConfiguration:                        Subnets: !Ref ScheduledTaskSubnetsThanks in advance.FollowComment"

Answer: 1Accepted AnswerYour Task is unable to communicate with the Internet due to not being assigned a public IP address. You need to add AssignPublicIp: ENABLED in your AwsVpcConfiguration. See also https://docs.aws.amazon.com/eventbridge/latest/APIReference/API_AwsVpcConfiguration.html.CommentShareSMPanswered a year ago


Question: CodeDeploy for AppStream

Can we use AppStream as a target for CodeDeploy?FollowComment

Answer: "0Accepted AnswerCodeDeploy supports EC2/on-premises, ECS, and AWS Lambda as deployment targets.You can see here in the documentation the list of compute platforms supported by CodeDeploy: https://docs.aws.amazon.com/codedeploy/latest/userguide/primary-components.htmlCommentShareAWS-User-1324499answered 3 years ago"


Question: Can AWS glue bookmark column (for jdbc)have null value?

"Hi, just wanted to know if aws glue bookmark columns can have null values - if null value is not supported, can anyone point to appropriate aws documentation for that?Thank you!FollowComment"

Answer: "0The condition is that the column (or columns) must be monotonically increasing, a column with NULL values doesn't meet that condition because a NULL cannot be compared to other number and define which is higher or lower.https://docs.aws.amazon.com/glue/latest/dg/monitor-continuations.htmlCommentShareGonzalo Herrerosanswered 3 months ago"


Question: Why Codepipeline Generated Role is Missing Granting Access Rights to Logs?

I have created Codepipeline before without issues but since we migrated to AMZ Linux 2 latest ROR platform for Beanstalk we encountered errors and we were instructed by Support to edit the auto generated role to allow access to Logs. Why isn't Codepipeline correctly creating the right policy? Is this being fixed?Currently we have to manually change the policy to enable log access when we create new pipelines.FollowComment


Question: Cannot find unreal plugin

"According to the documentation: https://docs.aws.amazon.com/gamelift/latest/developerguide/integration-engines-setup-unreal.html The plugin is inside the Getting started managed servers SDK, download. But I only see "GameLift-Cpp-ServerSDK-5.0.0" and "GameLift-CSharp-ServerSDK-5.0.0"FollowComment"

Answer: "-3You should be able to build the plugin on your local machine by following the instructions here https://docs.aws.amazon.com/gamelift/latest/developerguide/integration-engines-setup-unreal.html . Give it a go and let us know please if you have any issues.UPDATE1I've tested myself and indeed there is a problem. I'm raising the issue internallyUPDATE2The team is working with urgency to fix the problem. In the meanwhile please use the previous version https://gamelift-release.s3-us-west-2.amazonaws.com/GameLift_06_03_2021.zipCommentShareTolisanswered 6 months agoIan Tolmay 6 months agoPoint 3 of this documentation:Add the binaries to the GameLift plugin files. Open the directory for the plugin version of UE4 that you are working with (for example, GameLift-SDK-Release-3.3.3\GameLift-Unreal-plugin-3.3.3\UE4.25\GameLiftServerSDK). Copy the binary files that you created in Step 2 into the ThirdParty directory of the Unreal plugin:There is no plugin.When I run cmake -G "Visual Studio 16 2019" -A x64 -DBUILD_FOR_UNREAL=1 ..   and thenmsbuild ALL_BUILD.vcxproj /p:Configuration=Release'Then I get  267 Errors of LNK2019, unresolved external symbolSharejyorke_ses 6 months agoIt actually appears that two different links on https://aws.amazon.com/gamelift/getting-started/ link to two different places currently. The "Download Now" button links to https://gamelift-release.s3-us-west-2.amazonaws.com/GameLift-SDK-Release-5.0.0.zip which has 5.0.0 and does not contain the Unreal plugin, like OP said.The box title "GameLift Managed Servers SDK" links to https://gamelift-release.s3-us-west-2.amazonaws.com/GameLift_06_03_2021.zip, which contains the 4.0.2 release of the SDK and 3.4.0 of the Unreal plugin.However, version 3.4.0 of the plugin won't link with 5.0.0 binaries.ShareTolis 6 months agoSorry for the trouble... we are taking a look internallyShareDB_ofm 6 months agoI am also experiencing this issue currently. Is there an update on a possible solution or work around?Thankyou kindlyShareIan Tolmay 6 months agoThank you @TolisShareShow 2 more comments"


Question: AWS DMS Migration task from source MongoDB and target RDS Postgres

"My multiple migration tasks were successfully running for few weeks then for one of the collection/table I had to include more columns so, I reloaded the table again by adding more rules to the transformation rules,But now the task is failing and premigration task also fails saying.Couldn’t fetch the table definition for table ******* in schema prod__v5_schemaAll the connections were working and now also many tables are replicating but for one table showing this error.FollowComment"


Question: CodeArtifact Push Timing Out

Starting today all code deploys to codeartifact in us-east-1 started failing. SBT AetherDeploy gives an error saying there was no response from the server after a couple seconds. Pulls from codeartifact seem to work. I tried to create a new domain and repo with the same outcome. Is anyone else having issues pushing to code artifactFollowComment

Answer: "0We have been investigating an issue that causes maven publishes to codeartifact to return the error:Failed to deploy artifacts: Could not transfer artifact ... from/to ... (https://....d.codeartifact.....amazonaws.com/maven/... ): ....d.codeartifact.....amazonaws.com:443  failed to respondWe believe this is a bug in Maven and will be submitting an issue to the Maven project shortly. The bug is triggered by a long list of unusual circumstances. Removing any one of these masks the bug and allows publishing to work.First off, this bug only occurs when there is reasonably high network latency. If the Maven client and CodeArtifact instance are reasonably close to each other, say on the same continent, the bug does not occur.Second, it seems to be more common when sending a checksum. The mvn command line argument -Daether.checksums.algorithms= makes the bug very rare.Third, this bug occurs when using the newer native transport in maven. The new protocol is the default in 3.9.x releases. It can be opted out of with the command line argument -Dmaven.resolver.transport=wagon. The native transport is also known as aether, as in the name SBT AetherDeploy.Fourth, it only happens when a connection is reused from a pool. Connection pooling is the default behavior in the new native transport. It can be opted out of by upgrading to Maven 3.9.2 and passing the command line argument -Daether.connector.http.reuseConnections=false.Lastly, it only happens when using TLSv1.3. This can be opted out of by using the command line argument -Dhttps.protocols=TLSv1.2. CodeArtifact will be releasing a change to disable TLS1.3 to mitigate the issue for all customers. Expect that to be rolled out next week.In the meantime any of the command line flags described above are expected to mitigate the issue. If they are all effective for you we would recommend using -Dmaven.resolver.transport=wagon until the CodeArtifact rollout is completed next week.I am not familiar enough with the SBT tool to know how these options are passed to it. JAVA_OPTS environment variable may be relevant. I am sorry. If you could test the various mitigations and let us know which were effective for you it would make our investigation significantly better. If you would like help with a deep dive on your particular account and situation please open a support ticket.CommentShareJFinkelmanswered 18 days ago"


Question: AWS Cognito and empty device list

"Hello,I am using Cognito with TOTP. I have registered devices, TOTP functionality works, I get the TOTP popup with registered device which is linked to the user account, but I can't list devices registered during activation process. When I execute command to list devices, command returns empty list.Can You advise how this information can be collect ?... $ aws cognito-idp list-devices --access-token e...2g{"Devices": []}https://docs.aws.amazon.com/cli/latest/reference/cognito-idp/list-devices.htmlbrJackoFollowComment"

Answer: "0Does your CLI user have sufficient IAM access to view the needed Cognito resources?CommentSharekyageranswered 9 months agoJacko 9 months agoHello,As far I see my account should have permission to list devices under defined user pool. I have permissions for all cognito-idp , as follows."Statement": [{"Effect": "Allow","Action": [...."cognito-idp:*",Is it possible that my issue is related to the following topic, where devices list supported only under SDK ?https://repost.aws/questions/QUBLMX7pNpR2ayKpP1VRCTLQ/remember-device-to-suppress-mfa-challenge-using-cognito-hosted-uiShare0Hello,I don't' get any errors regarding permissions issue, so I didn't considered it may be the problem. Just in case which IAM access should be valid for these operations ?brJackoCommentShareJackoanswered 9 months agokyager 9 months agoAWS is pretty bad at giving permission errorsand sometimes doesn't even tell you you're missing them.  I don't know if thats the actual issue in question, but it's usually the first place I check when troubleshooting things like this.I would check to see if you have cognito-idp:ListDevices there may be other permissions that are needed, that may require some research on your end, such as cognito-idp:AdminListDevices.Share0Please confirm if you have device tracking enabled in your user pool. YOu can use it to suppress MFA on remembered. This is not enabled by default.Please see below:https://aws.amazon.com/blogs/mobile/tracking-and-remembering-devices-using-amazon-cognito-your-user-pools/CommentSharePravoanswered 9 months agoJacko 9 months agoYes I do have user's devices set Always remember, but device list is not updated either after successful TOTP device registration or after TOTP successfull authentication.I just wonder at this point if this feature is actually limited only to track devices from the MFA using SMS option ?Has anyone got an example of the User pool setup where devices list is working and device key is saved under devices .Share"


Question: Environment variables for a Node app running on an EC2 Instance

I have set up a CI/CD pipeline for my project. On git commits there is a trigger which runs the CodePipeline -> CodeDeploy -> EC2 setup. The EC2 instance runs an Nginx web server and Node cluster using PM2. I am using a package called dotenv to load env vars like API keys and secrets. Since we don't commit it there is no way these vars load into the Node app on EC2. I have heard about secrets manager but I am not sure. Can someone guide me on this?FollowComment

Answer: "0Good question!There are a few different AWS-native ways you can pull env vars into your Node app on EC2.AWS Secrets ManagerAWS System Manager Parameter StoreFor secrets, AWS Secrets Managers offers more features that help with protecting and managing those secrets.In this case, you could configure the EC2 instance to pull those variables from AWS Secrets Manager.  A couple things you would need to do:Store the secrets in AWS Secrets ManagerUpdate the EC2 Instance Profile IAM Role to have permissions to pull from AWS Secrets ManagerEncrypt the secrets in AWS Secrets Manager and ensure the instance has access to use the KMS Key.Now for Secret Retrieval:The instance can pull the secret by either the secret name or value.  If you're looking at runtime for Node: https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/SecretsManager.htmlAWS Guide: https://docs.aws.amazon.com/secretsmanager/latest/userguide/retrieving-secrets.htmlAdditional:Caching Secrets to Improve Performance: https://docs.aws.amazon.com/secretsmanager/latest/userguide/use-client-side-caching.htmlSecurity of Secrets Manager: https://docs.aws.amazon.com/secretsmanager/latest/userguide/security.htmlIf you're looking to do things on the EC2 instance launch, check out user-data: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/user-data.htmlFor more in-depth AWS guides, check out: https://docs.aws.amazon.com/secretsmanager/latest/userguide/intro.htmlCommentSharejsoncanswered a year ago"


Question: Aurora PostgreSQL upgrade 11.13 -> 12.8 failed

"Hello!Then we try to upgrade 11.13 cluster to 12.8 it fails, in logs I can find only errors like this:2021-12-08 06:55:26.080 GMT [7934] LOG: background worker "plans update worker" (PID 8004) exited with exit code 1command: "/rdsdbbin/aurora-11.13.11.13.0.8865.0/bin/pg_ctl" -w -D "/rdsdbdata/db_old" -o "--config_file=/rdsdbdata/config_old/postgresql.conf" -m fast stop >> "pg_upgrade_server.log" 2>&1waiting for server to shut down....2021-12-08 06:55:31.615 GMT [7934] LOG: received fast shutdown request2021-12-08 06:55:31.619 GMT [7934] LOG: aborting any active transactions2021-12-08 06:55:31.622 GMT [7934] LOG: background worker "logical replication launcher" (PID 8005) exited with exit code 12021-12-08 06:55:31.623 GMT [8000] LOG: shutting down.............sh: /rdsdbbin/aurora-12.8.12.8.0.5790.0/bin/curl: /apollo/sbin/envroot: bad interpreter: No such file or directory2021-12-08 06:55:44.671 GMT [7934] FATAL: Can't handle storage runtime process crash2021-12-08 06:55:44.671 GMT [7934] LOG: database system is shut downdoneserver stoppedPlease, help me to solve it.FollowComment"

Answer: "0Hello, I have been checking various sources about this problem, usually it is a low resource problem.I recommend you create a clone of your database in production, in this clone increase the instance size and launch the upgrate to test if you still have the same problem.CommentShareMaxCloudanswered a year ago0Hi,The error shared seems lack some info. Have you noticed something similar to:"ERROR:  could not access file""ERROR: cache lookup failed for database 1""FATAL: database "template1" does not exist"I would recommend share a full picture of the log here. Otherwise, double check the major steps mentioned in https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_UpgradeDBInstance.PostgreSQL.html#USER_UpgradeDBInstance.PostgreSQL.MajorVersionFor example:--> Any extensions need to be upgraded first?--> Any extensions need to be dropped? (chkpass, tsearch2)CommentShareSUPPORT ENGINEERKevin_Zanswered a year ago"


Question: AWS IoT Device Tester for AWS IoT Greengrass V2 Test failed with error: failed to validate lambda publish: timed out

"I am using IDT v4.5.3 with test suite GGV2Q_2.3.1 with Greengrass nucleus v2.5.5. When running the lambdadeployment test I am getting the following error, "Test failed with error: failed to validate lambda publish: timed out". Any suggestions for debugging this issue?FollowComment"

Answer: "1If you set up  folder permission as recommended in above comment sudo chmod 755 folder-name, you can also try with --timeout-multiplier command, which also can be found in the troubleshooting page.CommentShareAWS-User-9452211answered a year ago0I've seen this error reported before for older GG nucleus versions. Besides the error you reported, I think you may also have a Error: Could not find or load main class in your idt-ggv2-lambda-function-idt.log file. If so, I think the root cause may be folder permissions.https://docs.aws.amazon.com/greengrass/v2/developerguide/idt-troubleshooting.html#test-timeoutIf the MQTT or Lambda component logs contain Access denied errors, your Greengrass installation folder might not have the correct file permissions. Run the following command for each folder in the installation path that you defined in your userdata.json file. sudo chmod 755 folder-nameCommentShareEXPERTGreg_Banswered a year ago"


Question: Requesting AWS to add a RDS (Oracle) Time zone which is missing

"Hello. We have come across a situation where we need to use the local timezone in the RDS Oracle database. We need to set it to Jamaica Timezone which is America/Jamaica.Jamaica's time zone is different from the rest of the region. It is currently not available in AWS as we checked here [https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Appendix.Oracle.Options.Timezone.html#Appendix.Oracle.Options.Timezone.Zones]Using other nearby timezones or central or eastern timezones is not feasible as DST is observed there. There are some timezones e.g. Bogota and Lima which are the same as Jamaica and could be an option to use but there is a risk due to the following ;The countries might all of a sudden start to observe DST. Although they have not done it in the past 15 to 20 years.We cannot change the timezone in RDS more than once.One Workaround is to use America/Lima or Bogota timezone which is exactly the same as Jamaica, but in the worst case, there is a chance that they start observing DST someday. (may be next month or after 10 years).Please suggest, how we can request AWS to add America/Jamaica which has the below properties.Time Zone: America/JamaicaCurrent Date and Time in America/Jamaica: Thu 11-Aug-2022 04:41 P.M.Country: JamaicaDaylight Saving Time (DST) in effect?         :  NoMost Recent DST Transition:  DST ended on Sun 30-Oct-1983 at 02:00:00 A.M. when local clocks were set backward 1 hourNext Scheduled DST Transition: There are no future Daylight Saving Time rules for this time zoneFollowComment"

Answer: "0America/Lima Timezone shares the same time as America/Jamaica. Hope that will help.CommentShareVetrivelanswered 9 months agokhalidmehmoodawan 9 months agoThanks, this is a workaround, but in the worst case, there is a chance that they start observing DST someday. (maybe next month or after 10 years).Share"


Question: How to user ECR Public Gallery images with CDK

"I'm trying to deploy SonarQube community edition with CDK. Image seems to available in ECR Public Gallery (public.ecr.aws/docker/library/sonarqube:community) , but how to use it in CDK as ContainerImage.fromRegistry seems to point to docker.io by default?    const container = new ContainerDefinition(this, 'container',{      image: ContainerImage.fromRegistry("docker/library/sonarqube:community")With this, ECS tries to pull image from docker.io/docker/library/sonarqube:community and fails as it cant' be resolvedFollowComment"

Answer: 0From the CDK documentation:Type: ContainerImageThe image used to start a container.This string is passed directly to the Docker daemon. Images in the Docker Hub registry are available by default. Other repositories are specified with either repository-url/image:tag or repository-url/image@digest. TODO: Update these to specify using classes of IContainerImageAnother alternate is to check if you can use - fromEcrRepository as defined here--SydCommentShareSydanswered 6 months ago


Question: Updating an ECS service automatically using the CLI via Lambda

"I have a multi-container application that runs a service on ECS. The images are hosted on ECR, configuration files are pulled from a S3 bucket during container startup via script. The application sits behind a network loadbalancer with EIP. The loadbalancer is in a public subnet and reachable, the app itself is inside a private subnet.My ultimate goal is to automatically update the service when either a.) a new image is checked in or b.) a new configuration file is uploaded.I figured the best way to do this behind a network load balancer (which supports rolling update) is to use the AWS ECS CLi inside a lambda function that triggers upon update. If I did not misread the docs, the CLI should trigger a rolling update. To test the CLI, I tried:aws ecs update-service --cluster mycluster --service myservice --force-new-deploymentHowever, this was not successful. A new task was created, but was stopped before deployment was finished with log message:Essential container in task exitedParameters for the service are min. 100 % and max. 200 %. I also tried to set the lower bound of running tasks to 0 %. This resulted in the successful exit of the old task, but the new tasks failed to deploy with the same error. This makes me think that I probably configured something incorrectly.Questions:1.) Is using a lambda function a smart choice here? Or is there a better way?2.) How can I troubleshoot the failing rolling update?I appreciate any help! If you need more information, please let me know.Best regards,SebastianFollowComment"

Answer: "1Accepted AnswerThis seems like it would work, specifically this makes sense from a config file on S3 perspective, as you can trigger the Lambda on upload. I would recommend checking out the docs here about creating requests to modify ECS[1]. It also contains reference requests in multiple languages using the AWS SDK.Eg here is a link for Javascript[2].For troubleshooting the failed deployment, I'd recommend looking into CloudWatch logs[3][4].[1]https://docs.aws.amazon.com/AmazonECS/latest/APIReference/API_UpdateService.html[2]https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/ECS.html#updateService-property[3]https://docs.aws.amazon.com/AmazonECS/latest/developerguide/using_cloudwatch_logs.html[4]https://docs.aws.amazon.com/AmazonECS/latest/developerguide/ecs-logging-monitoring.htmlCommentShareDylan Souvageanswered 6 months agoSebastian 6 months agoThanks for the quick answer. After some experimentation, I was able to solve the issue.Share"


Question: "Loading data into DynamoDB by using Glue Studio, resulting in Provided list of item keys contains duplicates"

"Hi,I have to load a file containing some postal codes (around 200.000, CSV), stored onto S3, to a DynamoDB table. I'm following two approaches, on based on Lambda, one based on Glue Studio.In the Glue Studio case, the graph is pretty simple, based on two nodes, where the first one loads the data from S3 and the second one specifies the writing option into a custom node ; the primary key being the postal code, without sorting key. As following :glueContext.write_dynamic_frame_from_options(frame=dfc,connection_type="dynamodb",connection_options={"dynamodb.output.tableName": "postalCodes"})Moreover, the run fails systematically after inserting the first 50 entries and with the error: Provided list of item keys contains duplicates. But, the original list doesn't contain any duplicate.So, what is the point I've missed?Thanks in advance,FredFollowComment"

Answer: "2Accepted AnswerHi Fred,As you may know Glue Connection to DynamoDB is an abstraction on BatchWriteItems API call for DynamoDB, wherein it writes in batches of 25 items per request. As you are using postal_code as the partition key, if two items in a batch of 25 items contain the same postal_code, then you will receive this exception.Before writing out to sink, you could convert your DynamicFrame to a Dataframe and call either distinct or dropDuplicates on the postal_code column.  You must then convert back to DynamicFrame to make use of DynamoDB as a sink.df  .select("postal_code")  .distinct  .withColumn("postal_code","other", "other1"))  .show()Another thing worth checking is that you are not reading in CSV headers, this could also be the cause of having duplicates in the same batch. You can set the option when reading the CSV with the following param:'withHeader': FalseCommentShareEXPERTLeeroy Hannigananswered a year ago0Hi Leeroy,thanks for the point. So, we realized the deduplicate stage doesn't work well under certain conditions. We reinforced it and our Glue process works well now.Best regards,FredCommentShareAWS-User-4131049answered a year ago"


Question: "Verified SES entity (out of sandbox), unable to send production e-mails on deployed website (amplify). Works fully in local dev env. AWS-SDK NodeJS"

"Hello,I've searched on re:Post but could not find a similar case. I am using AWS-SDK together with NodeJS to send automated mails upon form submit on my website. The e-mail address and domain are verified and out of sandbox. The mailing works when I execute in development mode locally, but not online on production. I have ensured that the env variables are included on Amplify. The code prior to sending the SendMail:  let AWS = require("aws-sdk");  AWS.config.update({    accessKeyId: process.env.KEY_ID,    secretAccessKey: process.env.KEY_SECRET,    region: process.env.REGION_ID,  });I have applied the ses:Sendmail allow policy in IAM to the user linked to above key/secret. Am I missing something? The shared credentials file is not needed for deployed production if I have the above .config.update right? The policy:{    "Version": "2012-10-17",    "Statement": [        {            "Sid": "VisualEditor0",            "Effect": "Allow",            "Action": [                "ses:SendRawEmail",                "ses:SendEmail"            ],            "Resource": "*"        }    ]}Thank you so much.FollowComment"

Answer: 0Accepted AnswerI solved it.. in a different way. Responding to this in case anybody has a similar issue. I was not able to get it working using NodeJS directly. I made a lambda function that gets triggered with an API gateway. The button on the website sends a call to the API route which in turn triggers the lambda function with the same code as above. This way it worked and actually separated the mailing functionality nicely from the website.CommentSharemoes__91answered 9 months ago


Question: EC2 Windows Server 2016 Rebooted in Safe Mode with Networking

"My Windows 2016 Server was rebooted with Safe Boot /Network Chosen on the System Configuration.Luckily the Firewall is all off as is Defender. I need to somehow get to a command prompt to sendbcdedit /deletevalue {current} safebootTo the machine. Any help would be greatly appreciated.I cant figure out the Serial Console as I connect and just get black screen.Please help,MillerFollowComment"

Answer: "0I found the solution by following these instructions for going into DSRM but simply change to fix safe mode:https://docs.aws.amazon.com/AWSEC2/latest/WindowsGuide/common-issues.htmlTo boot an offline instance into DSRMOpen the Amazon EC2 console at https://console.aws.amazon.com/ec2/.In the navigation pane, choose Instances.Locate and select the affected instance. Choose Instance state, Stop instance.Choose Launch instances and create a temporary instance in the same Availability Zone as the affected instance. Choose an instance type that uses a different version of Windows. For example, if your instance is Windows Server 2008, then choose a Windows Server 2008 R2 instance.ImportantIf you do not create the instance in the same Availability Zone as the affected instance you will not be able to attach the root volume of the affected instance to the new instance.In the navigation pane, choose Volumes.Locate the root volume of the affected instance. Detach the volume and attach it to the temporary instance you created earlier. Attach it with the default device name (xvdf).Use Remote Desktop to connect to the temporary instance, and then use the Disk Management utility to make the volume available for use.Open a command prompt and run the following command. Replace D with the actual drive letter of the secondary volume you just attached:bcdedit /store D:\Boot\BCD /set {default} safeboot dsrepairIn the Disk Management Utility, choose the drive you attached earlier, open the context (right-click) menu, and choose Offline.In the EC2 console, detach the affected volume from the temporary instance and reattach it to your original instance with the device name /dev/sda1. You must specify this device name to designate the volume as a root volume.Start the instance.After the instance passes the health checks in the EC2 console, connect to the instance using Remote Desktop and verify that it boots into DSRM mode.(Optional) Delete or stop the temporary instance you created in this procedure.I changed the command tobcdedit /store D:\Boot\BCD /deletevalue {default} safebootSaved my behind as I thought I lost the instance...MillerCommentShareMaximoMilleranswered 2 years ago"


Question: RDS READ REPLICAS GENERAL QUESTION

"RDS databases have DNS names. The primary DB and read replicas have different DNS names.Does my code need to have access to the read replicas and if yes then in what way?2)Once I have created my read replicas, is it automatic that my read throughput will be scaled out or does one make other configurations?FollowComment"

Answer: "1Although read replicas are not necessary required for your code to access them, it is strongly advised that you use them to divert read traffic away from the main database. You can enhance the functionality of your program and lighten the load on your main database by doing this.You can use the read replicas' DNS names to connect to them straight from your code in order to reach read replicas. For example, the MySQL command-line client or JDBC/ODBC drivers can be used to link to the read replicas.Your read throughput will be scaled out automatically once your read replicas have been made. To guarantee that your application can benefit from the read, there are a few things you can do.Update your application code to use the DNS names of the read replicas.Distribute read traffic across the read replicas to avoid overloading any single read replica.Use a load balancer to distribute read traffic across multiple read replicas.Use read-only transactions to ensure that read traffic goes to the read replicas and not the primary database.CommentShareAWS_Guyanswered 2 months ago"


Question: Unable To login using ENI static Ip

I have a redhat instance on which i have attached a Network interface at index 1.That network interface is having a static ip . when i am trying to connect the ec2 with the static ip of netwrok interface it is giving connection timeout error.FollowComment

Answer: "0If you can't connect to an Amazon EC2 instance or an elastic network interface that has an attached Elastic IP address, be sure that:Security group rules for inbound traffic allow connection to the port or protocol.Inbound and outbound network access control list (network ACL) rules allow connection to the port or protocol.The route table for the subnet of the elastic network interface has a route to send and receive traffic from the internet.The OS firewall on the Amazon EC2 instance allows traffic to the port or protocol.CommentSharerePost-VivekPophaleanswered 9 months agorePost-VivekPophale 9 months agoCan you check NACL and route table entries.SharerePost-User-3154014 9 months agoi can see the route table subnet associations is having the subnet definedmy ec2 is having 2 eni attached .i am able to login using the IP of ENI placed at eth0unable to login using the IP of ENI placed at eth1i tried adding it to the routeip route add default via 10...* dev eth0 proto dhcp metric tab 1Now i am getting a prompt for login as on my another static Ip but after giving login as it is giving connection timed outShare0If you try to connect to your instance and get an error message Network error: Connection timed out or Error connecting to [instance], reason: -> Connection timed out: connect, try the following:Check your security group rules.You need a security group rule that allows inbound traffic from your local computer's public IPv4 address on the proper port.CommentSharerePost-VivekPophaleanswered 9 months agorePost-User-3154014 9 months agoHi , I checked the security group it is having the port and cidr defined but still gettingNetwork error:Network error: Connection timed outShare0After you assign a secondary private IPv4 address to your instance, you need to configure the operating system on your instance to recognize the secondary private IP address. If you are using Amazon Linux, the ec2-net-utils package can take care of this step for you. It configures additional network interfaces that you attach while the instance is running.If you are using another Linux distribution, see the documentation for your Linux distribution.Make sure to mark the answer as accepted once your issue is resolved.CommentSharerePost-VivekPophaleanswered 9 months ago0Can you confirm if your issue is resolved ?CommentSharerePost-VivekPophaleanswered 9 months ago"


Question: Report Greengrass Component External Facing IP Address

"Use-case:Automatically build AWS Security groups by reporting the external-facing IP address of an edge device running AWS Greengrass V2. Is there an AWS provided component that does this ?I see that the IoT Device Defender Component posts some information regarding how many bytes over which ports. We are looking for a component that can report:External facing IPBandwidth usage (or at least, bandwidth used by the Greengrass software)Does such a public component exist, or would it have to be a custom-built component ?FollowComment"

Answer: "0IPDetector component might be of interest to you: https://docs.aws.amazon.com/greengrass/v2/developerguide/ip-detector-component.htmlCommentSharevaibhavmurkuteanswered a year agoAWS-User-9962534 a year agoDoes this component report the external ip address of the edge device to the cloud, or just to the local log ?All I can see is that it writes the local IP address on the local network, as opposed to the external-facing ip address .2022-05-25T14:17:20.372Z [INFO] (pool-1-thread-2) com.aws.greengrass.detector.IpDetectorManager: Acquired host IP addresses. {IpAddresses=[/192.168.1.11]}Sharevaibhavmurkute a year agoIt reports local connectivity information of Greengrass Core to the cloud, so that client-devices can discover and connect to the core. (For more information: https://github.com/aws-greengrass/aws-greengrass-ip-detector)There is no AWS provided component that reports external IP address.Share0We also had a need to know the external-facing (i.e public) IP address.  We achieved it by just publishing it to the device's twin, where it's easily looked up.   Here's how we did it:mosquitto_pub -h $GG_HOST --cert $GG_HOME/thingCert.crt --key $GG_HOME/privKey.key --cafile $GG_HOME/rootCA.pem -t '$aws/things/'$GG_THING'/shadow/update' -m "$jsonString"The $jsonString needed to look like so:{"state":{"reported":{"key1":"val1" ...  "IP": $IP }}}'with $IP looked up easily with a call to:curl -4 ifconfig.coAll bash, and worked for us.  Hope this helps.CommentSharepmuelleranswered a year ago"


Question: Using an stsclient assumed role with cognito in java

"I am using Java.I have an aws user (sts client) on which I do an "assume role" before trying to call cognito "list users".The assume role seem to be working fine. However, the "list users" is throwing an error ("The security token included in the request is invalid") and I don't know why. Here is the full error trace:software.amazon.awssdk.services.cognitoidentityprovider.model.CognitoIdentityProviderException: The security token included in the request is invalid. (Service: CognitoIdentityProvider, Status Code: 400, Request ID: XXX-XXX-XXX)at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handleErrorResponse(CombinedResponseHandler.java:125)at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handleResponse(CombinedResponseHandler.java:82)at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handle(CombinedResponseHandler.java:60)at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handle(CombinedResponseHandler.java:41)at software.amazon.awssdk.core.internal.http.pipeline.stages.HandleResponseStage.execute(HandleResponseStage.java:40)at software.amazon.awssdk.core.internal.http.pipeline.stages.HandleResponseStage.execute(HandleResponseStage.java:30)at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206)at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:73)at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:42)at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:78)at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:40)at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:50)at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:36)at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:81)at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:36)at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206)at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:56)at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:36)at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.executeWithTimer(ApiCallTimeoutTrackingStage.java:80)at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:60)at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:42)at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:48)at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:31)at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206)at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206)at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:37)at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:26)at software.amazon.awssdk.core.internal.http.AmazonSyncHttpClient$RequestExecutionBuilderImpl.execute(AmazonSyncHttpClient.java:193)at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.invoke(BaseSyncClientHandler.java:103)at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.doExecute(BaseSyncClientHandler.java:167)at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:82)at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:175)at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:76)at software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45)at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:56)at software.amazon.awssdk.services.cognitoidentityprovider.DefaultCognitoIdentityProviderClient.listUsers(DefaultCognitoIdentityProviderClient.java:6504)at EC.myClass.listUsersFilter(myClass.java:107)at EC.myClass.myMainFunction(myClass.java:62)Here is my code in Java:import software.amazon.awssdk.auth.credentials.AwsBasicCredentials;import software.amazon.awssdk.auth.credentials.AwsCredentialsProvider;import software.amazon.awssdk.auth.credentials.ProfileCredentialsProvider;import software.amazon.awssdk.auth.credentials.StaticCredentialsProvider;import software.amazon.awssdk.regions.Region;import software.amazon.awssdk.services.cognitoidentityprovider.model.*;import software.amazon.awssdk.services.sts.StsClient;import software.amazon.awssdk.services.sts.model.AssumeRoleRequest;import software.amazon.awssdk.services.sts.model.StsException;import software.amazon.awssdk.services.sts.model.AssumeRoleResponse;import software.amazon.awssdk.services.sts.model.Credentials;import software.amazon.awssdk.services.cognitoidentityprovider.CognitoIdentityProviderClient;public class myClass{public static void myMainFunction(String role, String envRole, String userPoolId, String clientEmail){String roleArn = "arn:aws:iam::"+envRole+":role/"+role;String roleSessionName = "AssumeRoleSession1";Region region = Region.EU_WEST_1;StsClient stsClient = StsClient.builder().region(region).credentialsProvider(ProfileCredentialsProvider.create()).build();Credentials myCreds = assumeGivenRole(stsClient, roleArn, roleSessionName);AwsBasicCredentials awsCreds = AwsBasicCredentials.create(myCreds.accessKeyId(), myCreds.secretAccessKey());CognitoIdentityProviderClient cognitoClient = CognitoIdentityProviderClient.builder().region(region).credentialsProvider(StaticCredentialsProvider.create(awsCreds)).build();String username = listUsersFilter(cognitoClient, userPoolId, clientEmail);}public static Credentials assumeGivenRole(StsClient stsClient, String roleArn, String roleSessionName) {AssumeRoleRequest roleRequest = AssumeRoleRequest.builder().roleArn(roleArn).roleSessionName(roleSessionName).build();AssumeRoleResponse roleResponse = stsClient.assumeRole(roleRequest);Credentials myCreds = roleResponse.credentials();return myCreds;}// Shows how to list users by using a filter.public static String listUsersFilter(CognitoIdentityProviderClient cognitoClient, String userPoolId, String email) {String filter = "email = \""+email+"\"";ListUsersRequest usersRequest = ListUsersRequest.builder().userPoolId(userPoolId).filter(filter).build();ListUsersResponse response = cognitoClient.listUsers(usersRequest);response.users().forEach(user -> {System.out.println("User with filter applied " + user.username() + " Status " + user.userStatus() + " Created " + user.userCreateDate() );});return response.users().get(0).username();}I don't know why my code isn't working. Especially since I have the exact same code in Python where it's working just fine (though in Python, I explicitly give the sessionToken to cognito, but it doesn't seem to be possible in Java?).Any idea on what I'm doing wrong?For comparison, here is the same code in Python which is working:sts = boto3.client('sts')assumed_role_object=sts.assume_role(RoleArn="arn:aws:iam::"+env_role+":role/"+role,RoleSessionName="AssumeRoleSession1")credentials=assumed_role_object['Credentials']cognito=boto3.client(    'cognito-idp',    region_name="eu-west-1",    aws_access_key_id=credentials['AccessKeyId'],    aws_secret_access_key=credentials['SecretAccessKey'],    aws_session_token=credentials['SessionToken'],)getUser = cognito.list_users(UserPoolId=userPoolId,AttributesToGet=[],Limit=10,Filter='email="'+email+'"')FollowComment"

Answer: 0Your Python version is providing the session token to the Cognito client but your Java version is not. Use AwsSessionCredentials instead of AwsBasicCredentials.CommentSharedevelopmentalAppleSauceanswered 9 months ago


Question: LightSail instance down every 2 or 3 days

"I signed up an AWS 1GB LightSail plan less than two months ago with WordPress installed, did a test run for a few weeks, and everything seems fine. So I moved my WordPress website there about two weeks ago. Ever since then the instance just keeps down every two or three days.https://imgur.com/ewaGlJUThis graph shows my CPU usage and remaining burst capacity. The CPU usage stays inside the sustainable zone most of the time, the remaining burst capacity stays at 100%, and the dips are caused by rebooting. When the instance is down (The site is not accessible, and I can't SSH to it via putty or web either), I have to stop and start the instance, then the remaining capacity drops to 20% and slowly climbs to 100% and stays there, till the next cycle.https://imgur.com/TnHTNunThis is the last 24 hours memory usage chart. During the normal time, the memory usage is below 40%. The high sparks are caused by me when I remotely connected to it via Visual Studio Code. When my site was down (reported down time at 5:50am CST), the memory usage dropped to 27% (at the end of chart around 12:00UTC).https://imgur.com/OVwRieuThis morning after I received the site down message (around 5:55am CST), I tried to connect to the instance. The remaining burst capacity stayed at 100%, CPU usage was around 1%, and memory usage was around 27%.Around 6:40am, (the CPU usage is still 1%, burst capacity 100%, memory usage 27% at the time), I gave up, so I stopped and started the instance. When the instance was up around 6:45am, the CPU usage was around 2%, burst capacity dropped to 20%, memory usage jumped to 35%.Can anyone help me to figure out what's going on here? and what are other ways to troubleshot this problem?ThanksFollowComment"

Answer: "1Accepted AnswerJust want to give an update here.  I end up with a cron job which restarts the apache every morning around 5am, and also ipv6 is disabled.  And it's been working for a week now.  No other changes were made.CommentShareAWS-User-7823150answered a year ago0Hi,same here, 2 new instances (Ubuntu 22.04) with 1 website and 1 mysql server 8 without any load (CPU 2% all the day).First at 6:30, second at 7:30 start use 100% of CPU and i need to restart because i can't SSH into.No cronjobs or other operations at those times, so there is no reason to start using the resources.Have you found any solution?CommentSharerePost-User-7457536answered 9 months ago0I had the same issue, instance freezes after a few minutes without any traffic  (webserver). So I went back to my old VPS.CommentSharememanswered 2 months ago"


Question: Filename length when saving documents to WorkDocs

"Hello,When trying to upload from my MacBook a fairly large Powerpoint document (20Mb) to Workdocs directory, using either drag and drop or the upload button I receive a generic error Message 'Your file xxxx.pptx didn't upload successfully. Please try again.' : trying various things I finally shortened the filename length and was able to upload the document.I tried a word doc with the same name but could not reproduce the problem.Then I tried to copy the powerpoint file name to the word document locally and then get an error message from the macOS finder ' The name xxxx can't be used Try using a name with fewer characters or with no punctuation marks.I have kept the file in its original form which reproduces the problem for troubleshooting purposes!Feel free to let me know if more info is needed.Best regards!PAFollowComment"

Answer: "0Hi,I understand you are having problems with the WorkDocs file naming requirements  ,  please consult the attached document[1] for naming limitations to files or folders you intend to upload on your Amazon WorkDocs to avoid several mistakes when naming.Thank you for your efforts on how to reproduce the issue.I hope this helpsResources:-[1] https://docs.aws.amazon.com/workdocs/latest/userguide/client_add_files.htmlCommentShareAsisiphoanswered a year ago"


Question: Sometimes Spam - Sometimes Not

"I'm facing a strange problem where some of my emails land-up in SPAM and some go to inbox. Allow me to explain my current setup -I've about 250,000 email Ids in my cleaned-up list. If I send mails to them; we'd get < 0.5% average bounce rate. This is much below the limits set by AWS-SES.Mails are sent using 'Mailcoach' newsletter software hosted on '.email' domain. My main domain '.com' is different. While my approved sending rate is 500 mails/sec; I send mails at 50 mails/sec. The email ID from which mail is sent is '.com'. I've verified that both .com and .email domains are NOT in any blacklist.I recently moved away from DigitalOcean to AWS.During my initial trials; all mails to (~50-100 volunteers) were delivered to inbox.However, as I sent more mails; the mails got delivered into spam for most of the users. Content was not altered; and no other changes were made. The bounce / complaint and even unsubscribe rates are < 0.7% overall.The mails do not contain spam words (AFAIK) and do not resemble marketing mails. The main domain is DKIM verified; but not the '.email' domain. I'm getting it verified anyway; but I don't think that matters.Can someone help me figure out how do I ensure correct email delivery?FollowComment"

Answer: "0Dear Amazon SES Customer,There are a few reasons that can lead your messages to land in a SPAM box or even to Bounce:Lack of authentication - DKIM/SPF/DMARC signaturesHigh bounce/complaint rate (Not in your case)Domain reputation/Blacklisted IP address (Not in your case)Multiple emails being marked as SPAMEmail Content and Recipient MTA's algorithm to decide what is spam and what is not.You can refer this AWS Knowledge Article as a guide on why emails being sent from SES are being flagged as spam - https://aws.amazon.com/premiumsupport/knowledge-center/ses-email-flagged-as-spam/Sincerely,The Amazon SES TeamEdited by: ruhisarAtAWS on Aug 18, 2021 10:55 PMEdited by: ruhisarAtAWS on Aug 18, 2021 10:57 PMCommentShareSUPPORT ENGINEERRuhisar_Tanswered 2 years ago0I've managed to solve the problem. Although - I'm not 100% sure about what's worked. Here's what I did -Added DMRAC recordAdded DKIM recordAdded SPF record (but I'm not sure if I've got it right)I then sampled my list in parts of 5000 emails. I wrote my newsletter in a casual tone; with no 'buttons' or 'images'. I sent to to all 5K subscribers. The mail was received in the inbox.I then sent another mail after waiting for ~3 days; and then I got it delivered to inbox as well.It looks like the problem has been solved. I'll update if I find anything relevant or useful.CommentShareTheBigKanswered 2 years ago"


Question: Bug: SNS Confirmation JSON POST request sent as text/plain

SNS confirmation emails are sent out with a JSON body but the content-type is 'text/plain' where it should be application/json so the body can be parsed by built-in parsers.Eg. in Python Flask if you try to use request.get_json() on the confirmation request it returns a 400 Bad Request as Flask won't parse the body if the content-type is wrong.Please fix!FollowComment


Question: E2C instance unreachable - Rebuilding question

An EC2 instance has become unreachable and support has note responded to impairment status request as of yet (> 24 hours)Question is : the instance is a MS Server 2012 and If I took this opportunity to start another instance with Server 2022 could I attach the volume from the unreachable instance as a second drive in the 2022 instance so I can get whatever files I may need as I migrate?  Perhaps clone the volume first in case Amazon Support can restore the EC2 instance to a bootable state.FollowComment

Answer: "0Yep - create a snapshot (https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-creating-snapshot.html) of the volume, then you can restore the snapshot and attach it as a secondary volume to a new server.CommentShareBrian_Danswered 13 days ago"


Question: Amazon.Rekognition.AmazonRekognitionException: Missing Authentication Token

"Hello guys,I've integrated my app with Amazon Rekognition last year but now I'm getting this exception.I've updated my project with the latest version of the AWSSDK.Rekognition nuget package but it didn't solve it.Here is the code:public async Task<CompareFacesResponse> CompareAsync(byte[] photo1, byte[] photo2)    {        var client = new AmazonRekognitionClient(awsAccessKeyId, awsSecretAccessKey, Amazon.RegionEndpoint.EUWest1);        return await client.CompareFacesAsync(new CompareFacesRequest        {            SimilarityThreshold = 80.0f,            SourceImage = new Image { Bytes = new MemoryStream(photo1) },            TargetImage = new Image { Bytes = new MemoryStream(photo2) }        });    }Then I got this exception:Amazon.Rekognition.AmazonRekognitionException: Missing Authentication Token ---> Amazon.Runtime.Internal.HttpErrorResponseException: Exception of type 'Amazon.Runtime.Internal.HttpErrorResponseException' was thrown.   at Amazon.Runtime.HttpWebRequestMessage.GetResponseAsync(CancellationToken cancellationToken) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\HttpHandler\_mobile\HttpRequestMessageFactory.cs:line 539   at Amazon.Runtime.Internal.HttpHandler`1.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\HttpHandler\HttpHandler.cs:line 175   at Amazon.Runtime.Internal.Unmarshaller.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.ErrorHandler.InvokeAsync[T](IExecutionContext executionContext)   --- End of inner exception stack trace ---   at Amazon.Runtime.Internal.HttpErrorResponseExceptionHandler.HandleException(IExecutionContext executionContext, HttpErrorResponseException exception) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\ErrorHandler\HttpErrorResponseExceptionHandler.cs:line 60   at Amazon.Runtime.Internal.ErrorHandler.ProcessException(IExecutionContext executionContext, Exception exception) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\ErrorHandler\ErrorHandler.cs:line 212   at Amazon.Runtime.Internal.ErrorHandler.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\ErrorHandler\ErrorHandler.cs:line 104   at Amazon.Runtime.Internal.CallbackHandler.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.EndpointDiscoveryHandler.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.EndpointDiscoveryHandler.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\Handlers\EndpointDiscoveryHandler.cs:line 79   at Amazon.Runtime.Internal.CredentialsRetriever.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\Handlers\CredentialsRetriever.cs:line 98   at Amazon.Runtime.Internal.RetryHandler.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.RetryHandler.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\RetryHandler\RetryHandler.cs:line 137   at Amazon.Runtime.Internal.CallbackHandler.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.CallbackHandler.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.ErrorCallbackHandler.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.MetricsHandler.InvokeAsync[T](IExecutionContext executionContext)   at Test.Main.CompareAsync(Byte[] photo1, Byte[] photo2)...UPDATEAfter enabling the logs I could find more details below... which raises a question: Is the latest nuget package compatible with .NET Core? Because I'm running this code in a Mac and I plan to deploy it in a docker container.UserCrypto 1|2019-03-18T16:33:47.043Z|INFO|UserCrypto is not supported.  This may be due to use of a non-Windows operating system or Windows Nano Server, or the current user account may not have its profile loaded. Unable to load shared library 'Crypt32.dll' or one of its dependencies. In order to help diagnose loading problems, consider setting the DYLD_PRINT_LIBRARIES environment variable: dlopen(libCrypt32.dll, 1): image not foundAmazonRekognitionClient 2|2019-03-18T16:33:47.820Z|ERROR|An exception of type HttpErrorResponseException was handled in ErrorHandler. --> Amazon.Runtime.Internal.HttpErrorResponseException: Exception of type 'Amazon.Runtime.Internal.HttpErrorResponseException' was thrown.   at Amazon.Runtime.HttpWebRequestMessage.GetResponseAsync(CancellationToken cancellationToken) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\HttpHandler\_mobile\HttpRequestMessageFactory.cs:line 539   at Amazon.Runtime.Internal.HttpHandler`1.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\HttpHandler\HttpHandler.cs:line 175   at Amazon.Runtime.Internal.Unmarshaller.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.ErrorHandler.InvokeAsync[T](IExecutionContext executionContext)AmazonRekognitionClient 3|2019-03-18T16:33:47.875Z|ERROR|AmazonRekognitionException making request CompareFacesRequest to https://rekognition.eu-west-1.amazonaws.com/. Attempt 1. --> Amazon.Rekognition.AmazonRekognitionException: Missing Authentication Token ---> Amazon.Runtime.Internal.HttpErrorResponseException: Exception of type 'Amazon.Runtime.Internal.HttpErrorResponseException' was thrown.   at Amazon.Runtime.HttpWebRequestMessage.GetResponseAsync(CancellationToken cancellationToken) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\HttpHandler\_mobile\HttpRequestMessageFactory.cs:line 539   at Amazon.Runtime.Internal.HttpHandler`1.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\HttpHandler\HttpHandler.cs:line 175   at Amazon.Runtime.Internal.Unmarshaller.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.ErrorHandler.InvokeAsync[T](IExecutionContext executionContext)   --- End of inner exception stack trace ---   at Amazon.Runtime.Internal.HttpErrorResponseExceptionHandler.HandleException(IExecutionContext executionContext, HttpErrorResponseException exception) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\ErrorHandler\HttpErrorResponseExceptionHandler.cs:line 60   at Amazon.Runtime.Internal.ErrorHandler.ProcessException(IExecutionContext executionContext, Exception exception) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\ErrorHandler\ErrorHandler.cs:line 212   at Amazon.Runtime.Internal.ErrorHandler.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\ErrorHandler\ErrorHandler.cs:line 104   at Amazon.Runtime.Internal.CallbackHandler.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.EndpointDiscoveryHandler.InvokeAsync[T](IExecutionContext executionContext)   at Amazon.Runtime.Internal.EndpointDiscoveryHandler.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\Handlers\EndpointDiscoveryHandler.cs:line 79   at Amazon.Runtime.Internal.CredentialsRetriever.InvokeAsync[T](IExecutionContext executionContext) in D:\JenkinsWorkspaces\trebuchet-stage-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\Handlers\CredentialsRetriever.cs:line 98   at Amazon.Runtime.Internal.RetryHandler.InvokeAsync[T](IExecutionContext executionContext)Edited by: cleytonT on Mar 18, 2019 8:35 AMFollowComment"

Answer: "0Well, I've updated all nuget packages and set the required environment variables and now it is working. However, I had to use a workaround described in the link below to make it work.https://github.com/aws/aws-sdk-net/issues/494CommentSharecleytonTanswered 4 years ago"


Question: SageMaker Studio Enterprise Deployment guidelines

"Do we have guidelines on requirements gathering/designing the provisioning of SageMaker Studio domains across large global enterprises with many business units?I've seen discussions where topics like number of users/domain, org/team structure, collaboration patterns, resource needs, classes of ML problems, framework/library usage, security and others were raised when defining requirements and boundaries. Customer is starting their first Studio deployment and they are asking for guidance on how to scope and design that so that they can have a scalable process.FollowComment"

Answer: "0Accepted AnswerYou should guide your customer based on the general principles of multi account best practices that we provide for other services.Here are some high level boundaries.One studio domain per account and region. No cross region AWS SSO configuration provided.Maximum numbers of users allowed in studio vary between 60 - 200 users. Although AWS SSO can support many more users, there are some considerations around other dependencies such as EFS among others.If you need to isolate any model artifacts produced by SageMaker, you may want to have them use a separate account. Even if you use tag based access control, you can still technically list those artifacts.SageMaker feature store should follow the data lake pattern closely. As a general rule, you want to write in one account and can read from many other accounts perhaps using Lake formation to expose datasets into other accounts. Teams can create their own offline / online feature store for non production use cases.CommentShareAWS-User-5655775answered 2 years ago"


Question: MSCK REPAIR TABLE returns FAILED org.apache.hadoop.hive.ql.exec.DDLTask. nu

"Hi,I am trying to execute MSCK REPAIR TABLE but then it returnsFAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. nullThe query ID is 956b38ae-9f7e-4a4e-b0ac-eea63fd2e2e4FollowComment"

Answer: "0Curious if you ever were able to get the root cause for this. We had the same problem (very intermittent).Thanks-BillCommentShareBillMan2answered 5 years ago0SET mapred.input.dir.recursive=true;SET hive.mapred.supports.subdirectories=true;ALTER TABLE table_name RECOVER PARTITIONS;CommentShareksapelakanswered 5 years ago0I had same error, but resolved it to attach "s3:ListBucket" permission for underlying bucket on execution role. If you run the query from Lambda function or other AWS services, please try to add following policy on execution role. Athena needs to traverse folders to load partitions.{    "Version": "2012-10-17",    "Statement": [        {            "Action": [                "s3:ListBucket"            ],            "Resource": "arn:aws:s3:::{YOUR_BUCKET_NAME}",            "Effect": "Allow"        }    ]}CommentShareskitazakianswered 5 years ago0I had the same issue until I added permissions for action glue:BatchCreatePartition. Found that here https://aws.amazon.com/premiumsupport/knowledge-center/athena-aws-glue-msck-repair-table/CommentSharePlzHalpanswered 3 years ago0Hi BillMan2,Did you ever get to the bottom of your issues? I am also getting this error intermittently.CheersBenCommentShareBenBMLLanswered 3 years ago"


Question: get_connection timeout in AWG Glue job

"I am following the articale below for doing update in MySQL using pymysql - https://awstip.com/aws-etl-glue-job-insert-update-support-7a396db832b. However, it looks like the job is timing out on below line -connection = glue_client.get_connection(Name="<My Connection>")I do not see any exception in the logs.Test connection works fine.Also, the same connection worked when I used it in another job for insert-only created from Visual editor.FollowComment"

Answer: "1To identify the exact error messages, searching through the ERROR logs with GlueExceptionAnalysisListener typically would lead me to the exact line that errors and the Error message. Please try that and let us know if you are still unable to identify the errorCommentShareAnanth Tirumanuranswered 8 months agorePost-User-0629761 8 months agoHi,I only see that the GlueExceptionAnalysisListener was registered in the error logs. No other exception is logged until the job times out.2022-10-03 21:44:07,711 INFO [Thread-12] spark.SparkContext (Logging.scala:logInfo(57)): Registered listener com.amazonaws.services.glueexceptionanalysis.GlueExceptionAnalysisListener.Also, note that I am using MySQL v8.I started fresh with a new job where the script was generated by Glue Studio. It ran fine without any issues. However, as soon as I added get_connection() call, the job started timing out.ShareAnanth Tirumanur 8 months agoPlease refer to Glue connection page where it mentions how to use the Glue Connection https://docs.aws.amazon.com/glue/latest/dg/connection-properties.html#connection-properties-jdbcNote that MySQL connections are possible for Amazon RDS instances only. If you are using other MySQL  database, you dont have to use Glue Connections. You would need to upload the JDBC driver to S3. In the AWS Glue job console, Choose the AWS Glue job and edit the Job details tab, under Libraries > Referenced File Path and enter the S3 URI of JDBC file.If you are able to get the job to work without connections and the data looks right, you do not have to add a Glue connection.Share"


Question: "SageMaker - All metrics in statistics.json by Model Quality Monitor are "0.0 +/- 0.0", but confusion matrix is built correctly for multi-class classification!!"

"I have scheduled an hourly model-quality-monitoring job in AWS SageMaker. both the jobs, ground-truth-merge and model-quality-monitoring completes successfully without any errors. but, all the metrics calculated by the job are "0.0 +/- 0.0" while the confustion matrix gets calculated as expected.I have done everything as mentioned in this notebook for model-quality-monitoring from sagemaker-examples with very few changes and they are:I have changed the model from xgboost churn to model trained on my data.my input to the endpoint was csv like in the example-notebook, but output was json.i have changed the problem-type from BinaryClassfication to MulticlassClassification wherever necessary.confustion matrix was built successfully, but all metrics are 0 for some reason. So, I would like the monitoring job to calculate the multi-classification metrics on data properly.All LogsHere's the statistics.json file that model-quality-monitor saved to S3 with confustion matrix built, but with 0s in all the metrics:{  "version" : 0.0,  "dataset" : {    "item_count" : 4432,    "start_time" : "2022-02-23T03:00:00Z",    "end_time" : "2022-02-23T04:00:00Z",    "evaluation_time" : "2022-02-23T04:13:20.193Z"  },  "multiclass_classification_metrics" : {    "confusion_matrix" : {      "0" : {        "0" : 709,        "2" : 530,        "1" : 247      },      "2" : {        "0" : 718,        "2" : 497,        "1" : 265      },      "1" : {        "0" : 700,        "2" : 509,        "1" : 257      }    },    "accuracy" : {      "value" : 0.0,      "standard_deviation" : 0.0    },    "weighted_recall" : {      "value" : 0.0,      "standard_deviation" : 0.0    },    "weighted_precision" : {      "value" : 0.0,      "standard_deviation" : 0.0    },    "weighted_f0_5" : {      "value" : 0.0,      "standard_deviation" : 0.0    },    "weighted_f1" : {      "value" : 0.0,      "standard_deviation" : 0.0    },    "weighted_f2" : {      "value" : 0.0,      "standard_deviation" : 0.0    },    "accuracy_best_constant_classifier" : {      "value" : 0.3352888086642599,      "standard_deviation" : 0.003252410977346705    },    "weighted_recall_best_constant_classifier" : {      "value" : 0.3352888086642599,      "standard_deviation" : 0.003252410977346705    },    "weighted_precision_best_constant_classifier" : {      "value" : 0.1124185852154987,      "standard_deviation" : 0.0021869336610830254    },    "weighted_f0_5_best_constant_classifier" : {      "value" : 0.12965524348784485,      "standard_deviation" : 0.0024239410000317335    },    "weighted_f1_best_constant_classifier" : {      "value" : 0.16838092925822584,      "standard_deviation" : 0.0028615098045768348    },    "weighted_f2_best_constant_classifier" : {      "value" : 0.24009212108475822,      "standard_deviation" : 0.003326031863819311    }  }}Here's how couple of lines of captured data looks like(prettified for readability, but each line has no tab spaces as shown below) :{    "captureData": {        "endpointInput": {            "observedContentType": "text/csv",            "mode": "INPUT",            "data": "0,1,628,210,30",            "encoding": "CSV"        },        "endpointOutput": {            "observedContentType": "application/json",            "mode": "OUTPUT",            "data": "{\"label\":\"Transfer\",\"prediction\":2,\"probabilities\":[0.228256680901919,0.0,0.7717433190980809]}\n",            "encoding": "JSON"        }    },    "eventMetadata": {        "eventId": "a7cfba60-39ee-4796-bd85-343dcadef024",        "inferenceId": "5875",        "inferenceTime": "2022-02-23T04:12:51Z"    },    "eventVersion": "0"}{    "captureData": {        "endpointInput": {            "observedContentType": "text/csv",            "mode": "INPUT",            "data": "0,3,628,286,240",            "encoding": "CSV"        },        "endpointOutput": {            "observedContentType": "application/json",            "mode": "OUTPUT",            "data": "{\"label\":\"Adoption\",\"prediction\":0,\"probabilities\":[0.99,0.005,0.005]}\n",            "encoding": "JSON"        }    },    "eventMetadata": {        "eventId": "7391ac1e-6d27-4f84-a9ad-9fbd6130498a",        "inferenceId": "5876",        "inferenceTime": "2022-02-23T04:12:51Z"    },    "eventVersion": "0"}Here's couple of lines from my ground-truths that I have uploaded to S3 look like(prettified for readability, but each line has no tab spaces as shown below):{  "groundTruthData": {    "data": "0",    "encoding": "CSV"  },  "eventMetadata": {    "eventId": "1"  },  "eventVersion": "0"}{  "groundTruthData": {    "data": "1",    "encoding": "CSV"  },  "eventMetadata": {    "eventId": "2"  },  "eventVersion": "0"},Here's couple of lines from the ground-truth-merged file look like(prettified for readability, but each line has no tab spaces as shown below). this file is created by the ground-truth-merge job, which is one of the two jobs that model-quality-monitoring schedule runs:{  "eventVersion": "0",  "groundTruthData": {    "data": "2",    "encoding": "CSV"  },  "captureData": {    "endpointInput": {      "data": "1,2,1050,37,1095",      "encoding": "CSV",      "mode": "INPUT",      "observedContentType": "text/csv"    },    "endpointOutput": {      "data": "{\"label\":\"Return_to_owner\",\"prediction\":1,\"probabilities\":[0.14512373737373732,0.6597074314574313,0.1951688311688311]}\n",      "encoding": "JSON",      "mode": "OUTPUT",      "observedContentType": "application/json"    }  },  "eventMetadata": {    "eventId": "c9e21f63-05f0-4dec-8f95-b8a1fa3483c1",    "inferenceId": "4432",    "inferenceTime": "2022-02-23T04:00:00Z"  }}{    "eventVersion": "0",    "groundTruthData": {        "data": "1",        "encoding": "CSV"    },    "captureData": {        "endpointInput": {            "data": "0,2,628,5,90",            "encoding": "CSV",            "mode": "INPUT",            "observedContentType": "text/csv"        },        "endpointOutput": {            "data": "{\"label\":\"Adoption\",\"prediction\":0,\"probabilities\":[0.7029623691085284,0.0,0.29703763089147156]}\n",            "encoding": "JSON",            "mode": "OUTPUT",            "observedContentType": "application/json"        }    },    "eventMetadata": {        "eventId": "5f1afc30-2ffd-42cf-8f4b-df97f1c86cb1",        "inferenceId": "4433",        "inferenceTime": "2022-02-23T04:00:01Z"    }}Since, the confusion matrix was constructed properly, I presume that I fed the data to sagemaker-model-monitor the right-way. But, why are all the metrics 0.0, while confustion-matrix looks as expected?EDIT 1:Logs for the job are available here.FollowComment"


Question: Workmail error 0x80040201

"Hello,When I send emails from especific account only from Workmail web any send show the error:Unfortunately the system was unable to deliver your mail, Conversion error 0x80040201 No error details specified.When I use the mobile email I can send correctly, only in the web I get that error for any emails I send.What can I do?Thank you for yours response.Best regards.FollowCommentAWS-User-1602477 a year agoI'm having the same issue.I googled in and most results talk about an issue with outlook autocomplete which is not the case, but I deleted the contacts I sent the email to from my contacts and resent the message and it went through once. Then the problem came back. (Hope this helps. I also need this fixed.)For reference here's the full response:Unfortunately, the system was unable to deliver your mail.The error given was:2022-02-17 16:37:58 : Conversion error: 0X80040201. No error details specified.You may need to contact your e-mail administrator to solve this problem.Sharerobinkaws MODERATORa year agoHello,I received an update from the service team this issue should be resolved. Thank you for reporting this.Kind regards,RobinSharetmow 6 months agoI've got the same error, when changing the from address and using one that is saved in the address book.Deleting the contact and sending again, it fixes the problem.I change the from address because I use aliases, so if my main user is admin@domain.com, and I want to send with dev@somain.com, this alias MUST not be in the address book.Share"

Answer: "0Hi,I'm sorry to hear you're experiencing issues with sending email via the webmail. I will forward this to the service team for investigation.Kind regards,RobinCommentShareMODERATORrobinkawsanswered a year ago0I experiend the exact same problem/behavior, today. Maybe it's a regression bug?CommentShareHOKanswered 8 months ago"


Question: MWAA metrics export for data analytics

"Apart from the Cloudwatch monitor we use tableau to report the ETLs processess stats.So, is there a way to export the metrics (DAG start time, DAG End time, DAG task start time, endtime, status, last run etc)  from MWAA as a file or any other format?FollowComment"

Answer: "0There are methods to query the metadata in the back-end database used by Amazon MWAA.I recommend reviewing this blog, but not utilizing the AWS CloudFormation template as it will create an Amazon MWAA Enviroment.https://aws.amazon.com/blogs/big-data/persist-and-analyze-metadata-in-a-transient-amazon-mwaa-environment/By utilizing AWS Glue along with the example DAGs, your metadata will existing within Amazon S3 and can then be downloaded or queried by Amazon Athena.If you decide to utilize Amazon Athena, then you can then connect from Tableau by following this blog post example: https://aws.amazon.com/blogs/big-data/building-aws-data-lake-visualizations-with-amazon-athena-and-tableau/CommentShareCurtis_Danswered 9 months ago"


Question: SES E-Mails not delivered to T-Online Emails

"Hi,since about one week I encounter an issue with delivering emails to @t-online.de email addresses using SES.I have checked the bounce notifications and the only message I got is for example the following:[messageId] => 01020184092980ec-79a3fe86-7664-4ef3-b886-fdeb373443a3-000000[diagnosticCode] => smtp; 550 4.4.7 Message expired: unable to deliver in 840 minutes.<451 4.0.0 Unknown>According to t-online mailserver-support this is not a t-online specific message. However there are far more messages that are not delivered which do not get any bounce feedback. So according to SES delivery is fine but the message still do not appear in the customers inboxes.My system was sending emails successfully in the past 12 months to t-online but all of the sudden it stopped working, without any change on my side. I made many tests by sending mails from another FROM addresses and systems that use the same SES account, checked SPF and DKIM settings etc. and all seems to be fine.I contacted the t-online mailserver-support and they can only help if I can provide an IP address or error message.This issue seems to be online related to t-online mails as all other mail providers work fine.BTW: when I send the exact same mail via Mailgun it seems to work. So somehow this is related to SES + t-online.Any help would be really appreciated!Thanks a lot!FollowComment"

Answer: "1We have the same issue. I already wrote to T-Online support and the just respond that AMAZON has to contact them. So please Amazon support Team solve this issue. Some of your SES servers are blocked from the German provider @t-online.de421 IP=69.169.224.8 - No more parallel connections from your address allowedCommentSharerePost-User-9948703answered 7 months agorePost-User-9824861 7 months agoOk, then I am 'glad' that I am not the only one. However, I wonder why this issue can be "ignored" for such a long time? Did you already report this to the Amazon Support? Or is it enough to post it here?Share"


Question: "CloudWatch: Posted custom metric data successfully, but can't find the data"

"Using this code: https://github.com/awsdocs/aws-doc-sdk-examples/blob/main/javav2/example_code/cloudwatch/src/main/java/com/example/cloudwatch/PutMetricAlarm.javaI was able to put a custom metric data successfully:Successfully put data point 123.000000However, I'm unable to find the data, cloudwatch metric screenshot:https://www.screencast.com/t/RI3pq8KWmwwI've double checked the regionMy scala code:object TestClass extends App {  PutMetricData.main(123)}object PutMetricData {  def main(args: Integer): Unit = {    val dataPoint = args.toDouble    val region = Region.US_WEST_2    val cw = CloudWatchClient.builder.region(region).credentialsProvider(ProfileCredentialsProvider.create).build    putMetData(cw, dataPoint)    cw.close()  }  def putMetData(cw: CloudWatchClient, dataPoint: Double): Unit = {    try {      val time = ZonedDateTime.now(ZoneOffset.UTC).format(DateTimeFormatter.ISO_INSTANT)      val instant = Instant.parse(time)      val datum = MetricDatum.builder.metricName("PAGES_VISITED1").unit(StandardUnit.NONE).value(dataPoint).timestamp(instant).build      val request = PutMetricDataRequest.builder.namespace("SITE/TRAFFIC1").metricData(datum).build      cw.putMetricData(request)    } catch {      case e: CloudWatchException =>      System.err.println(e.awsErrorDetails.errorMessage)      System.exit(1)    }    System.out.printf("Successfully put data point %f", dataPoint)  }}Context: I'm new to AWS, I didn't create any metricNames or nameSpace in AWS, I'm assuming I can change the MetricName & namespace in the code and it'll create it in AWS. Do I have to specify an existing namespace or metricName?FollowComment"

Answer: "0I'm not a Scala expert but the code looks good. No need to specify an existing namespace or metric name.Usually problems like this are caused by timestamp being incorrect, e.g. being in seconds instead of milliseconds - those would get silently dropped and not generate an error. Your code seems to follow the Java SDK exactly though. 🤔CommentShareAmazon-CloudWatch-01answered a year ago"


Question: Magento 2.4.6 Port must be configured within host parameter (like localhost:3306

"I have a Magento 2.4.6 website built using Amazon Lightsail, which is auto-configured. I’m installing MinimogMG theme, but I’m having trouble.Port must be configured within host parameter (like localhost:3306https://prnt.sc/lYTjNjn9-DGkI followed the steps of the official tutorial. https://docs.bitnami.com/aws/apps/magento/configuration/install-theme/ https://www.youtube.com/watch?v=gpPJTfQoA0c&list=PLGgVZHi3XQNl2T8Q1RMfgLIop3TIFwVad&t=3sHow can i solve?bitnami@ip-172-00-00-01:~/minimog_theme$ sudo /opt/bitnami/magento/bin/magento-cli setup:upgradeCache types config flushed successfullyPort must be configured within host parameter (like localhost:3306In Abstract.php line 144:                                               SQLSTATE[HY000] [2002] Connection refused                                               In Abstract.php line 128:                                               SQLSTATE[HY000] [2002] Connection refused                                               bitnami@ip-172-00-00-01:~/minimog_theme$ FollowComment"

Answer: "0Are there any env.php or other files placed in app/etc/?Edit the host parameter of the file to something like "localhost:3306".CommentShareEXPERTRiku_Kobayashianswered 2 months agoAngelo 2 months agoYes, I've tried editing app/etc/env.php, but the problem still doesn't work.https://prnt.sc/Tbr6D8Yq8a-kShareRiku_Kobayashi EXPERT2 months agoHow about running the following command to remove the cache?sudo rm -rf /opt/bitnami/magento/var/cache/*sudo rm -rf /opt/bitnami/magento/var/page_cache/*sudo rm -rf /opt/bitnami/magento/generated/*ShareAngelo 2 months agoI executed your code, but the problem is still not solved.I provide more server info at this link. https://github.com/bitnami/vms/issues/849Share"


Question: How to delete recorded events for user-interactions dataset ?

"I have been trying to delete the user-item interactions dataset, but the data imported with putevents(recorded events with event tracker) still remain, only bulk data gets deletedAny solutions?FollowComment"

Answer: "0Accepted AnswerHey hsakadude,I do not believe you can remove interaction entries via a putevents call. To do this you would need to manually change your interactions dataset and do a new reimport.In general, I do not think you can remove any data via the putUsers/putEvents/putItems calls. You can, however, filter out recommendations via a filter expression. An example here would be to have a status field every item or user, and when they are removed, you update this field via a putItems/putUsers call, and then filter out those that have  "STATUS == DELETED". This solution, however, still keeps this data in your model, it doesnt actually remove it. Its just filtering out the data from your recommendations.Hope this helps,law-dwgCommentSharelaw-dwganswered 2 years ago"


Question: [Announcement] Extending end-of-life process for Amazon RDS for MySQL 5.6

"Amazon Relational Database Service (Amazon RDS) is extending the end-of-life process for MySQL major version 5.6. Amazon RDS customers can continue to create new MySQL 5.6 instances until February 1, 2022, and Amazon RDS will begin automatic upgrades of MySQL 5.6 instances starting March 1, 2022. This does not apply to Aurora Clusters.We previously communicated in the MySQL 5.6 End-of-Life forum post [1] that we would begin automatic upgrades starting August 3, 2021, and upgrade remaining instances on September 1, 2021. We have decided to extend the end-of-life process for all customers.We strongly encourage customers to upgrade their MySQL 5.6 instances to MySQL 5.7 or greater as soon as possible, ahead of this end-of-life schedule. The MySQL community discontinued support for MySQL 5.6 on February 5, 2021 [2], and the community will no longer produce bug fixes or security patches for this version. MySQL 5.7 contains major innovations including native support for JSON data type, GIS with native InnoDB spatial indexes and Performance Schema for new and improved performance metrics with the new SYS Schema [3]. MySQL 8.0 contains Window Functions, Common Table Expressions and also offers 2x higher performance compared to MySQL 5.7 [4]. Both versions contain numerous fixes to various software bugs in earlier versions of the database.The following is a summary of the new extended timeline for the end-of-life schedule for MySQL 5.6:• Currently, Customers can initiate upgrades of Amazon RDS for MySQL 5.6 instances to MySQL 5.7 and 8.0 at any time. Customers can also continue to restore MySQL 5.6 snapshots, and create read replicas with version 5.6.• Starting February 1, 2022, Customers will no longer be able to create new RDS instances using MySQL 5.6 from the AWS Console or CLI.• Starting March 1, 2022, Amazon RDS will begin automatically upgrading MySQL 5.6 instances to version 5.7. If a customer restores MySQL 5.6 database snapshots, Amazon RDS will automatically upgrade the restored database to MySQL 5.7.To avoid any unplanned unavailability when upgrading your database, we recommend that you first test the upgrade process using a database snapshot. To learn more about upgrading MySQL major versions in Amazon RDS, review the Upgrading Database Versions topic in the RDS User Guide [5]. Another common technique for reducing downtime from version upgrades is described in the AWS Best Practices blog post [6].Should you have any questions or concerns, the AWS Support Team is available on the community forums and via Premium Support [7].References[1] https://forums.aws.amazon.com/ann.jspa?annID=8498[2] https://www.mysql.com/support/eol-notice.html[3] https://aws.amazon.com/about-aws/whats-new/2016/02/amazon-rds-now-supports-mysql-5-7/[4] https://aws.amazon.com/about-aws/whats-new/2018/10/amazon-rds-now-supports-mysql-8/[5] https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_UpgradeDBInstance.Upgrading.html#USER_UpgradeDBInstance.Upgrading.Manual[6] https://aws.amazon.com/blogs/database/best-practices-for-using-a-mysql-read-replica-to-upgrade-an-amazon-rds-for-mysql-database/[7] https://aws.amazon.com/supportFollowCommentSrikanth_N SUPPORT ENGINEERa year agoThis is an announcement migrated from AWS Forums that does not require an answer.Share"

Answer: 0[Announcement] Does not require an answer.CommentShareEXPERTIsraa-Nanswered 18 days ago


Question: Amazon SageMaker Local Mode raised boto3.exceptions.RetriesExceededError: Max Retries Exceeded

I try to run the SageMaker local mode example without any modification at https://github.com/aws-samples/amazon-sagemaker-local-mode/tree/main/pytorch_nlp_script_mode_local_model_inference on my local machine.However I encountered the **boto3.exceptions.RetriesExceededError: Max Retries Exceeded** exception when the example tries to deploy the inference endpoint to 'local' instance type.I checked withdocker images -a command and it does not pull the expected pre-built SageMaker deep learning container image from ECR. The code example is using a dummy role for the local SageMaker session. I need help as I am blocked at this point as the exception error message is not helpful to pinpoint the actual root cause of this issue. Thanks in advance.Below are my configurations:Ubuntu: 20.04.3 LTSAWS CLI version: 2.4.7Python: 3.8.12Docker: 20.10.12Docker Compose: 1.29.2boto3: 1.20.26sagemaker: 2.72.1FollowComment

Answer: "0Hi, if you aren't able to pull the expected pre-built SageMaker deep learning container image, I would check your network settings.  From the local mode sample documentation, "you'll need to be able to access a public Amazon ECR repository from your local environment."For more detailed information from boto3, you can enable logging and debug mode as well, which could help pinpoint the exact cause of the error.  More information on Boto3 Retries: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/retries.html.CommentSharejsoncanswered a year ago"