Question: Line magic error in SageMaker Studio

"Hi AWS, I am trying to create virtual environment in SageMaker Studio but while doing so I am experiencing a line magic function error. Also I am not able to import the libraries. I am attaching the error screenshot for the same.ThanksFollowCommentrePost-User-3199525 10 months agoHey, someone from the SageMaker community how to resolve this issue?Share"

Answer: "0As far as I can tell, %virtualenv and %import are not standard line magics in IPython - and from a quick search around, I couldn't see what package implements them?But I think you might want to consider more fundamental changes to your workflow and will try to make a case for it...In SageMaker Studio, as the other answer noted already, kernel environments are containerized - rather than conda-based. This is nicely consistent with how SageMaker job environments (training, deployment, processing, etc) are also container-based.As a result, my usual environment management suggestions would be:For quickly and interactively experimenting with different library installations in the notebook, simply use !pip shell commands to install/edit packages directly in the running container. (e.g. !pip install abc==x.y.z, !pip show abc, and so on). You could even save these dependencies in a requirements.txt and !pip install from that file (which would be nice because SageMaker script-mode jobs can accept a requirements.txt).For formalizing an environment to be standard, repeatable, and shareable between users without them having to re-run the install commands: set up a custom kernel container image.As outlined here, all your open notebooks with the same kernel and instance type selected will share a running container. When you delete/restart the "app" (container), these changes will be lost. Keeping running/customized kernel environments as disposable as possible, and trying to use SageMaker jobs (training, processing, etc) early in the workflow instead of sticking everything in notebook, helps to prevent reproducibility problems.Because they're containerized, I find I don't really need to worry about environment management/virtualization technologies: In notebook experimentation, my different kernels are fully separated anyway and I can just restart the container ("app") to reset. In SageMaker jobs there's only one task being run in the container, so it doesn't need to play nice with other workloads. It's different, and actually quite nice, compared to working on my local laptop where I have to carefully manage separate project environments and fix things if they break!Edit to add: The following works for me... Perhaps your problem was that the code folder didn't exist yet? os.makedirs() or !mkdir or UI actions can fix that:%%writefile src/main.pyimport osCommentShareEXPERTAlex_Tanswered 10 months agorePost-User-3199525 10 months agoI have created code folder using !mkdir code command and afterthat I have ran that writefile command. I will give it a shot again and let you know.SharerePost-User-3199525 10 months agoI am still experiencing the same error unfortunately.ShareAlex_T EXPERT10 months agoI think it may be worth raising a separate question (or even a support ticket?) about the %%writefile issue if you're still not able to get that working? Because that one should work, and I know it gets used in some of our official samples. To try and fix it I could maybe suggest to restart your kernel, JupyterServer + KernelGateway apps... And to unblock you could maybe suggest to just create the file through GUI file editor (just create text file and rename to .py, if you don't see a create py file option)... But somebody might be able to help better in a dedicated question for it!Share0Hi,When running a notebook on SageMaker Studio you can select the default environment you want by clicking on the top right corner on the kernel you currently have enabled (Default should be Data Science) and select the one you want from the dropdown.In the case you want to install more/custom packages, then you can install those straight from your notebook using one of the valid magic cell commands.These are %conda install and %pip install (see doc: https://docs.aws.amazon.com/sagemaker/latest/dg/studio-notebooks-add-external.html)Alternatively you can open a terminal and use your tool of choice to manage the python packages installed.In terms of importing packages, the correct syntax for that is without the %. So please instead of %import <package_name> try import <package_name>.Let us know if this solved your issue,have a nice dayCommentSharegeorgios_sanswered 10 months agorePost-User-3199525 10 months agoHi, I am still facing the issue while setting up virtual environment in the SageMaker Notebook. If I am running the command virtualenv venv I am getting invalid syntax error and when I ran the command %virtualenv venv the line magic  function %virtualenv not found error is coming.Please respond as I need to fix it ASAP.ThanksSharerePost-User-3199525 10 months agoWhen I was trying to create the file using the command %%writefile code/inference.py I am still experiencing the line magic function error.Please let me know how to resolve this issue.ThanksShare"


Question: SSH connection from my local terminal to EC2 ubuntu instance is timed out.

"Hello, I created an EC2 ubuntu instance and connect that instance through SSH from my local command prompt and connection was successfully. After sometime i close my terminal, reopen my local terminal again and try to connect the same instance but this time it gives timed out error. if i create new instance and connect to it it connects successfully. Mean each instance is connected through ssh connection only once. if i close connection and try to reconnect it gives timed out error.  I set the security rule to permit SSH connection from anywhere. Can you please help me in this regard thank you.FollowComment"

Answer: "0Hello Muhammad,This resource may help:https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/TroubleshootingInstancesConnecting.html#TroubleshootingInstancesConnectionTimeoutPlease consider to provide more details, how did you launched the instance, which AMI, have you a keypair configured, other relevant details.Thanks,LuisCommentShareluisanswered 6 months ago"


Question: Streaming multiple independent streams through a single channel?

"I would like to provide our users a way to stream their sport events to the rest of their team using our app (available Live and available as VOD).  At any time, there will be between zero and 100+ users streaming their events.  Can this be accomplished using a single channel, or would a new channel need to be created for each user that wants to stream, with the channel being destroyed afterwards?FollowComment"

Answer: "0Hi scott_tl,You'll need as many MediaLive channels as you expect to have concurrent content creators. In other words, if you have 1000 users producing livestreams, but only 50 are active at any given time, you would need 50 channels. The channels can be started and stopped as needed. Once the event is completed, you can use the VOD harvesting capability in MediaPackage to convert the livestream into a VOD asset for later replay.You have a choice as to whether you want to create and destroy the channels as needed, or keep the channels in IDLE state between uses and re-use the same ones over and over. Creating and destroying does have the advantage of slightly lower cost due to avoiding MediaLive idle charges, at the expense of slightly higher complexity for operation. It also makes it easier to change the input endpoint for each end user, reducing the risk of multiple users trying to send to the same input endpoint at once.Regards,SteveCommentShareSteve_Wanswered a year agoscott_tl a year ago@Steve_W, Thanks for the response.  Is there a a different approach I could take to this problem, using other AWS products?  Or is creating MediaLive channels a common solution for this use case?Share"


Question: Use Dockerfile for Lambda running ARM64 Architecture

"I have a function that I wrote and am trying to get it to run on the ARM64 version of Lambda. It works fine on the x86 version. I have not been able to find anything online regarding needing to do something special for an ARM64 Dockerfile.My Dockerfile is:FROM public.ecr.aws/lambda/python:3.8COPY requirements.txt .RUN pip install -r requirements.txt && rm requirements.txtCOPY lambda_function.py ./COPY values.txt ./CMD [ "lambda_function.lambda_handler" ]I am coding/building the Dockerfile on a Lenovo Laptop running Ubuntu if that matters.When I try to test the function, it exits nearly immediately and gives an error:{  "errorMessage": "Error: fork/exec /lambda-entrypoint.sh: exec format error",  "errorType": "Runtime.InvalidEntrypoint"}Do I need to add an Entrypoint to my Dockerfile?Thanks in advanceFollowComment"

Answer: 2See here: Just append -arm64 to the base image name.CommentShareEXPERTUrianswered a year agoAWS-User-5311484 a year agoThank you. I am trying to build the image and I get an error when it tries to install the PIP packages:[Warning] The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requestedstandard_init_linux.go:228: exec user process caused: exec format errorI tried running the build command like:docker build -t IMAGENAME . --platform linux/arm64But it still gives me the same error.Is there a special way I have to build the image?Share0Yes you could append the host platform on it. But the issue is a difference between where you build the image and the Architecture setting on the lambda.Example: if you build the image on an m1 mac push to ECR and set the Architecture setting to x86_64 then you will get this error.You can either change the setting in lambda or if you are working with multiple people on different systems Id suggest using CodePipeline with a CodeBuild step and you can define the system the pipeline builds on so every-time the build is consistent with a buildspec.yaml like this.version: 0.2  phases:   install:     runtime-versions:       docker: 18   pre_build:     commands:       - echo Logging in to Amazon ECR...       - aws --version       - $(aws ecr get-login --region $AWS_DEFAULT_REGION --no-include-email)       - REPOSITORY_URI=$EcrRepo      - COMMIT_HASH=$(echo $CODEBUILD_RESOLVED_SOURCE_VERSION | cut -c 1-7)      - IMAGE_TAG=${COMMIT_HASH:=latest}  build:     commands:       - echo Build started on `date`       - echo Building the Docker image...       - docker build -t $REPOSITORY_URI:latest .      - docker tag $REPOSITORY_URI:latest $REPOSITORY_URI:$IMAGE_TAG  post_build:    commands:      - echo Build completed on `date`      - echo Pushing the Docker images...      - docker push $REPOSITORY_URI:latest      - docker push $REPOSITORY_URI:$IMAGE_TAG      - aws lambda update-function-code --function-name [YOUR_FUNCTION_NAME] --image-uri $REPOSITORY_URI:$IMAGE_TAGCommentShareAWS-User-1087373answered a year ago


Question: Failed to retrieve MediaPackage credentials for channel ID

"I cant seem to get MediaLive to Connect to MediaPackage.I start off with a:Failed to retrieve MediaPackage credentials for channel ID fullstack-3MPEGTS muxer for mediaID [1] unable to open output or stream [mediapackage://fullstack-3/channel_output_720p60.m3u8].MPEGTS muxer for mediaID [1] unable to close output or stream.and the list goes on for a while repeating.I am using the default "MediaLiveAccessRole" which had the update button once, and I clicked it, but it didn't fix anything.  My guess is that the policy needs to be updated, but it doesn't say anywhere what that policy should be.Only info I can find is:https://docs.aws.amazon.com/medialive/latest/ug/role-and-remember-arn.htmlThe policy I have is:{    "Version": "2012-10-17",    "Statement": [        {            "Effect": "Allow",            "Action": [                "s3:ListBucket",                "s3:PutObject",                "s3:GetObject",                "s3:DeleteObject"            ],            "Resource": "*"        },        {            "Effect": "Allow",            "Action": [                "mediastore:ListContainers",                "mediastore:PutObject",                "mediastore:GetObject",                "mediastore:DeleteObject",                "mediastore:DescribeObject"            ],            "Resource": "*"        },        {            "Effect": "Allow",            "Action": [                "logs:CreateLogGroup",                "logs:CreateLogStream",                "logs:PutLogEvents",                "logs:DescribeLogStreams",                "logs:DescribeLogGroups"            ],            "Resource": "arn:aws:logs:*:*:*"        },        {            "Effect": "Allow",            "Action": [                "mediaconnect:ManagedDescribeFlow",                "mediaconnect:ManagedAddOutput",                "mediaconnect:ManagedRemoveOutput"            ],            "Resource": "*"        },        {            "Effect": "Allow",            "Action": [                "ec2:describeSubnets",                "ec2:describeNetworkInterfaces",                "ec2:createNetworkInterface",                "ec2:createNetworkInterfacePermission",                "ec2:deleteNetworkInterface",                "ec2:deleteNetworkInterfacePermission",                "ec2:describeSecurityGroups"            ],            "Resource": "*"        }    ]}and an ssm policy:{    "Version": "2012-10-17",    "Statement": [        {            "Sid": "VisualEditor0",            "Effect": "Allow",            "Action": [                "ssm:GetParameters",                "ssm:GetParameter"            ],            "Resource": "arn:aws:ssm:*:*:parameter/medialive/*"        },        {            "Sid": "VisualEditor1",            "Effect": "Allow",            "Action": "ssm:DescribeParameters",            "Resource": "*"        }    ]}I dont have direct access to edit the policy, but I can request it.  I assume I just need to add a section on mediapackage or something.FollowComment"

Answer: "0Hi rbalhorn,You are correct, the following needs to be added to the MediaLiveCustomPolicy:        {            "Effect": "Allow",            "Action": [                "mediapackage:DescribeChannel"            ],            "Resource": "*"        },I've reported the issue with the "update" button on the console to the engineering team.Thanks,SteveCommentShareSteve_Wanswered 4 years ago0That did the trick.  Thanks!CommentSharerbalhornanswered 4 years ago"


Question: Network Firewall sometimes connection failed.

"HelloOur service use network firewall for checking outbound traffic(http, https).Sometimes http connection failed(timeout) and cannot recover connection before restart service(using ecs fargate).So I tried empty firewall policies like below but cannot fix the problem.[Routing]private subnet -> NAT GW -> Firewall -> Internet GW[Firewall Setting]Stream Exception Policy : ContinueStateless Default Action : Forward to stateful rulesStatefull Default Action : All PassCould you tell me something wrong with my settings?FollowCommentCarlosGP-AWS 4 months agoHi there,Can you provide more details on how your route tables are configured?You need to make sure the forwarding and return traffic are both going through the firewall.Share"


Question: How to understand why CloudFront returns 301?

"I posted it earlier here, but didn't receive a response: https://stackoverflow.com/questions/75640175/how-to-understand-why-cloudfront-returns-301I have a distribution in CloudFront pointing to a custom origin. It worked just fine for more than five years and just a few weeks ago started to return 301 for all requests. The origin works as before, SSL certificates are valid both at the CloudFront endpoint and at the origin. The configuration of the "behavior" I didn't change in CloudFront. What could be the problem and how can I understand where is it?If it helps, here is the URL: https://djk1be5eatcae.cloudfront.net/?u=https://www.yegor256.com/index.html. The origin that it points to is relay.jare.io. Thus, the URL to be used to fetch the content is this: https://relay.jare.io/?u=https://www.yegor256.com/index.html (works for me). All information is public, no sensitive information is revealed.FollowComment"

Answer: "0https://djk1be5eatcae.cloudfront.net/?u=https://www.yegor256.com/index.html for me returns:Please, submit this stacktrace to GitHub and we'll try to help: https://github.com/yegor256/jare/issuesjava.lang.IllegalStateException: [GET https://relay.jare.io/] failed in 0ms: [400] Parameter "u" is mandatory in https://relay.jare.io/...as if I hadn't passed "?u=...".  Have you set a cache policy on your CF distribution that excludes this or all query string params from the cache & being sent to the origin? https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/controlling-the-cache-key.htmlCommentShareEXPERTskinsmananswered 3 months agoyegor256 3 months agoDear expert, please try to use curl -v instead of a browser. You will understand what I'm talking about in the question above. Yes, I configured the caching policy to use all query arguments (NOT exclude them).Share0There was a problem with the version of TLS/SSL. I set it to SSLv3 and now it works.CommentShareyegor256answered 3 months ago"


Question: How to locate pii information reported in Macie json file ?

"Hello everyone,I am having difficulty in locating pii information reported in Macie json file ...The only indicated locator I have is the following:"detailedResultsLocation": "s3://[export-config-not-set]/AWSLogs/account-id/Macie/us-east-1/filename.jsonl.gzHow do I access this file and its contents ?  Thanks in advance.Kind regards--osmanFollowComment"

Answer: 0Hi you can find the PII information in the Findings Section on Amazon Macie console.References:Findings : https://docs.aws.amazon.com/macie/latest/user/findings.htmlReview findings : https://docs.aws.amazon.com/macie/latest/user/findings-view.htmlTo locate sensitive data through JSON format : https://docs.aws.amazon.com/macie/latest/user/findings-locate-sd.html#findings-locate-sd-schemaCommentShareHarshil_Sanswered a year agoAWS-User-4481319 a year agoThanks for the information..   I have already generated a Json file and exported it ... But it does not tell me where the location of pii data is ...Only have the  "detailedResultsLocation"  entry as mentioned above ... and I do not know how to access the .gz  file ..ShareHarshil_S a year agoThe file will be placed in the s3 bucket in your account. You can download this .gz file from there and unzip it on your local machine. Are you having any access issues to that object?Or are you not seeing this bucket at all in your account?Share0Thanks for getting back ... I have checked  .. but I do not see the "export-config-not-set"  bucket in my account ...  Is there anything else I can do to locate the bucket ?Thanks--osmanCommentShareAWS-User-4481319answered a year agoHarshil_S a year agoOne way to find the bucket name is through the Settings tab in Macie console. Goto Amazon Macie -> Settings -> Discovery results -> Repository for sensitive data discovery results.I reproduced this JSON in my local account and it shows the bucket that was scanned and number of counts of PII in those objects.If you are using AWS CLI please use : https://docs.aws.amazon.com/cli/latest/reference/macie2/get-classification-export-configuration.html API to get the bucket information where the results are stored.Share


Question: Writing Data Directly from EMR into DynamoDB

"A customer has explored writing data directly from EMR into DynamoDB.  It works fine with one issue.  In order to run the DynamoDBStorageHandler, they have to change the hive engine to use MR instead of TEZ.  While we can do this it does mean that we'd need to run two EMR clusters.  Can we confirm that their understanding is correct, they think it is as when they tested against TEZ they saw failures but did not see failures when using MR.  And can we find out if there's a better way to do this without requiring 2 EMR clusters.FollowComment"

Answer: "0Accepted AnswerThe emr-dynamodb-connector 's DynamoDBStorageHandler is used by EMR when Hive/Spark/MR is used to interact with DynamoDB tables. It determines a property maxParallelTasks based on a dynamodb.throughput.write.percent config among other parameters. The maxParallelTasks property is a function of MR engine (since connector was implemented when Hive on MR was default), hence if Tez/Spark engines are chosen for Hive, the writes and functioning of the connector doesn't change, however the Iops can no longer be controlled/estimated and the write rate majorly depends on the input size and EMR cluster capacity. This could lead to throttling on the table (not sure if those are the errors you refer to).As long as Hive on MR is available, current suggestion to be able to control throughput while writing would be to use the MR engine and set it at runtime ( add "set hive.execution.engine=mr;" before anything in the hive script that interacts with DynamoDB). This would not require 2 EMR clusters until at a point the customer starts using a higher release of EMR (all releases of EMR today have it, so if these were continued to be used, no issues) that doesn't ship Hive with MR.PS: Even with Hive on MR interacting with DynamoDB, EMR cluster capacity could be a secondary factor that determines how quickly the writes can be made, but the max will always be respected as per the dynamodb.throughput.write.percent config set.CommentShareAman Dhingraanswered 2 years ago"


Question: Failed to convert 'Body' to string S3.InvalidContent arn:aws:states:::aws-sdk:s3:getObject step function

"I am a newbie so pardon my ignorance.I am writing a very simple step function state machine that uses the AWS SDK to retrieve a file from S3.Every time I run it the task that gets the file from S3 fails with an "S3.InvalidContent" error with "Failed to convert 'Body' to string" as the cause.The full definition of my state machine is:{  "Comment": "A description of my state machine",  "StartAt": "GetAudioFile",  "States": {    "GetAudioFile": {      "Type": "Task",      "Parameters": {        "Bucket": "11123",        "Key": "test.wav"      },      "Resource": "arn:aws:states:::aws-sdk:s3:getObject",      "End": true    }  }}The full text of the TaskFailed event is:{  "resourceType": "aws-sdk:s3",  "resource": "getObject",  "error": "S3.InvalidContent",  "cause": "Failed to convert 'Body' to string"}The full text of the CloudWatch log entry with the error is:{    "id": "5",    "type": "TaskFailed",    "details": {        "cause": "Failed to convert 'Body' to string",        "error": "S3.InvalidContent",        "resource": "getObject",        "resourceType": "aws-sdk:s3"    },    "previous_event_id": "4",    "event_timestamp": "1651894187569",    "execution_arn": "arn:aws:states:us-east-1:601423303632:execution:test:44ae6102-b544-3cfa-e186-181cdf331493"}What am I doing wrong?How do I fix it?What additional information do you need from me?Most importantly, where can I find answers to these stupid questions so I don't have to post these stupid questions on re:Post again? (I have spent nearly a day scouring AWS docs and Googling without finding anything.)FollowComment"

Answer: "0Accepted AnswerSorry you ran into this trouble. Step Functions needs the response from that API call to be serializable as JSON. State payload (what's passed between states in your State Machine) If you have a file in S3 that contains such data, you will get that back in the response payload and it will be used (after output processing) as state output from that Task. In this case, your file is a binary .wav file can't. See the link below for more on the State Machine data in the Developer Guide for Step Functions:https://docs.aws.amazon.com/step-functions/latest/dg/concepts-state-machine-data.htmlGiven this, I'm curious what you were looking to accomplish with your workflow that involved the .wav file? Builders often use Step Functions to manage such data, but do it using "pointers" (i.e. S3 keys) in their workflow rather than loading data into the workflow state.CommentShareJustin Callisonanswered a year agorossmpersonal a year agoIs there a way I can retrieve the binary .wav encoded in a format that is serializable as text such as base64 or UTF-8?What I am trying to do is build a serverless, codeless solution that sends an email with the body from one file an S3 bucket with a wav file (which can be very large) from another S3 bucket attached. I see the following challenges:a. The SendEmail Action in the SES V2 API does not accept S3 keys as input.b. The SendEmail Action in the SES V2 does not provide an easy way to add an attachment. The only way is to manually build a properly formatted and encoded MIME message.c. There is no AWS service that I can find that codelessly handles building and encoding MIME messages.d. The size of some of the WAV file attachments exceed the 262,144 byte maximum input/output size of a step function task.What is your advice about addressing the challenges?Is my only option to use Lambda and forget about it being codeless?Share"


Question: Greengrass V2 # Token Exchange Service # Lambda Invoke

"Hi there!We want to make Lambda, SNS service calls from Greengrass V2 custom component. Issue we are am facing here is, from where we can get the secret_key and access_key.  We do have gone through token exchange service. We have added this service as dependency in custom component.Following is the method of custom component which make Lambda call.public String invokeLambda(String functionName, JsonObject payload) {InvokeRequest lmbRequest = new InvokeRequest().withFunctionName(functionName).withPayload(payload.toString());LOGGER.info("AWS_CONTAINER_AUTHORIZATION_TOKEN  :: " + System.getenv("AWS_CONTAINER_AUTHORIZATION_TOKEN"));LOGGER.info("AWS_CONTAINER_CREDENTIALS_FULL_URI :: " + System.getenv("AWS_CONTAINER_CREDENTIALS_FULL_URI"));lmbRequest.setInvocationType(InvocationType.RequestResponse);AWSLambda lambda = AWSLambdaClientBuilder.standard().withRegion(Regions.US_WEST_2).withCredentials(new EC2ContainerCredentialsProviderWrapper()).build();InvokeResult lmbResult = lambda.invoke(lmbRequest);String resultJSON = new String(lmbResult.getPayload().array(), Charset.forName("UTF-8"));LOGGER.info("Result from Lamdaexecution:::" + resultJSON);return resultJSON;}Log is printing Token and Credential URI which you can refer in following logs.Error : com.amazonaws.SdkClientException: Failed to connect to serviceLogs of the application is as below2023-04-12T09:41:56.208Z [WARN] (Copier) DatabaseManager: stderr. 04-12 09:41:56.208     47 W/CouchbaseLite/QUERY: [JAVA] End of query enumeration. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}2023-04-12T09:41:56.258Z [WARN] (Copier) DatabaseManager: stderr. 04-12 09:41:56.257     47 W/CouchbaseLite/QUERY: [JAVA] End of query enumeration. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}2023-04-12T09:41:56.327Z [WARN] (Copier) DatabaseManager: stderr. 04-12 09:41:56.326     47 W/CouchbaseLite/QUERY: [JAVA] End of query enumeration. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}2023-04-12T09:41:56.336Z [INFO] (Copier) DatabaseManager: stdout. 2023-04-12 09:41:56.336  INFO 2832 --- [nio-8081-exec-6] c.s.service.impl.UpdateServiceImpl       : Type:::OS Version:::00.00.02. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}2023-04-12T09:41:56.379Z [INFO] (Copier) DatabaseManager: stdout. 2023-04-12 09:41:56.379  INFO 2832 --- [nio-8081-exec-6] com.softacuity.util.LambdaUtil           : AWS_CONTAINER_AUTHORIZATION_TOKEN  :: DNVCLW02DA54UUZX. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}2023-04-12T09:41:56.379Z [INFO] (Copier) DatabaseManager: stdout. 2023-04-12 09:41:56.379  INFO 2832 --- [nio-8081-exec-6] com.softacuity.util.LambdaUtil           : AWS_CONTAINER_CREDENTIALS_FULL_URI :: http://localhost:41333/2016-11-01/credentialprovider/. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}2023-04-12T09:41:59.323Z [INFO] (Copier) DatabaseManager: stdout. 2023-04-12 09:41:59.321 ERROR 2832 --- [nio-8081-exec-6] c.s.controller.UpdateController          : Exception !. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}2023-04-12T09:41:59.324Z [INFO] (Copier) DatabaseManager: stdout. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}2023-04-12T09:41:59.324Z [INFO] (Copier) DatabaseManager: stdout. com.amazonaws.SdkClientException: Failed to connect to service endpoint:. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}2023-04-12T09:41:59.324Z [INFO] (Copier) DatabaseManager: stdout. at com.amazonaws.internal.EC2ResourceFetcher.doReadResource(EC2ResourceFetcher.java:112) ~[aws-java-sdk-core-1.12.445.jar!/:na]. {scriptName=services.DatabaseManager.lifecycle.Run, serviceName=DatabaseManager, currentState=RUNNING}FollowCommentMichaelDombrowski-AWS EXPERT2 months agoReview the greengrass log for errors at the same time /greengrass/v2/logs/greengrass.log.SharerePost-User-7846458 2 months agoHey Michael,on same event greengrass.log prints following.2023-04-13T04:44:00.775Z [INFO] (pool-2-thread-1229) com.aws.greengrass.tes.CredentialRequestHandler: Received IAM credentials that will be cached until 2023-04-13T05:39:00Z. {iotCredentialsPath=/role-aliases/GreengrassCoreTokenExchangeRoleAlias/credentials}SharerePost-User-7846458 2 months agoHey Michael,It seems that in second attempt application able to make a call to lambda. First time only its giving mentioned error. Is there retry logic required to be implement ??Regards,NalayShareMichaelDombrowski-AWS EXPERT2 months agoYes you should certainly implement retries. Please also ensure you are using the latest version of Greengrass Nucleus 2.9.5Share"


Question: Crawler cannot be started. Verify the permissions in the policies attached to the IAM role defined in the crawler.

"Hi there,I am trying to run Glue Crawler against a JDBC data source, which is actually an RDS PostgreSQL instance in the same account as my Glue crawler.My crawler won't start - it fails with the following error reported in CloudWatch:Crawler cannot be started. Verify the permissions in the policies attached to the IAM role defined in the crawler.I have given the crawler the IAM role of AWSGlueServiceRoleDefault, which has the following permission policies:AmazonRDSFullAccessAmazonS3FullAccessAWSGlueServiceRoleAdministratorAccessAWSGlueConsoleFullAccessThe role's trusted entities are as follows:{    "Version": "2012-10-17",    "Statement": [        {            "Effect": "Allow",            "Principal": {                "Service": "glue.amazonaws.com"            },            "Action": "sts:AssumeRole"        }    ]}I fully expected the crawler to work just with AmazonS3FullAccess and AWSGlueServiceRole permissions - adding AdministratorAccess is obviously a desperate measure, but even that is not working, which makes me think the error being reported in CloudWatch by the crawler is not the actual problem.I've set up the Data Connection already, and the RDS instance it points to is publicly accessible, and also known to be working via other access methods.Has anyone seen this problem before, or know what else I might check?FollowComment"

Answer: "3The resolution for this problem was to configure VPC, Subnet and Security groups for the Connector, which I had not done.I was mislead by two things:The 'Create connection' wizard which describes Network options as optional ("If your AWS Glue job needs to run on Amazon Elastic Compute Cloud (EC2) instances in a virtual private cloud (VPC) subnet").The error message above which suggests the problem is with IAM role permissions.The page that unlocked things for me was here.Testing an AWS Glue connectionhttps://docs.aws.amazon.com/glue/latest/dg/console-test-connections.htmlTo others who encounter this problem, I would suggest testing your AWS Glue connection and making sure that works before worrying about what AWS Crawler is telling you.CommentSharebendalby82answered 6 months ago"


Question: Failed to prepare the table for validation

"Hi all,Has anyone come across the DMS migration task returning "Failed to prepare the table for validation"?I've been finding it very hard to find out what the problem is. The migration task doesn't provide detailed errors, even with the log level set to "debug".https://ibb.co/ZGRmLtkRegards,Vinny OsiroFollowComment"

Answer: "0Hi all,The issue has been sorted out.It turns out the DMS replication instance was running out of memory, and this is what was coming out in the CloudWatch logs: "Failed to run load command. Cannot allocate memory."The solution was to scale the DMS instance up to something more memory-efficient, e.g.: dms.r5.2xlargeRegards,Vinny OsiroCommentSharevosiroanswered 2 years ago"


Question: Textract - Word counter implementation in wordpress

"I need to add word counter to my wordpress site basing on uploaded file (png, jpg, pdf, doc, etc.). Like on the example: translated.com.The purpose is to also create quotation basing on number of characters in the uploaded file (image or text).I'd be grateful if you can help me understanding how to achieve it.FollowComment"

Answer: "1You can achieve this in the following manner. I am assuming Python language being used in your project. To get the text from a document you can use Amazon Textract DetectDocumentText API for single page documents, or for multi-page documents use StartDocumentTextDetection API to execute an async job. Once you get the response from the API calls you can get the character count in the following manner.Assuming response is the JSON response from Amazon Textract API, to get all the lines from it you can do something like this in python-for single page documents using DetectDocumentTextdef get_word_count(response):    words = [ k for k in response['Blocks'] if k['BlockType'] == 'WORD']    total_word_count = len(words)    return total_word_countFor multi-page document, using StartDocumentTextDetectiondef get_word_count(response, page_num):    words = [ k for k in response['Blocks'] if k['BlockType'] == 'WORD' and  k['Page'] == page_num]    total_word_count = len(words)    return total_word_countNote: for multi-page documents, the StartDocumentTextDetection may generate multiple JSON outputs. The function above expects a combined JSON output. To combine multiple JSONs from an asynchronous job started using StartDocumentTextDetection, you can use textract-caller by installing it-python -m pip install amazon-textract-callerusage -from textractcaller import get_full_json_from_output_configfrom textractcaller.t_call import OutputConfigimport boto3s3 = boto3.client('s3')op_config = OutputConfig(s3_bucket=<bucket>, s3_prefix=<s3Prefix>)full_json = get_full_json_from_output_config(output_config=op_config, job_id=<job_id>, s3_client=s3)Where <bucket> is your Amazon S3 bucket where the Async job's output is stored, <s3Prefix> is the prefix, and <job_id> is the async "Job ID" returned by StartDocumentTextDetection API call.For example: s3://my-bucket/my-prefix/43d6d8af4a2b7c850e20c8b135ad2c4d8a04eadb44874a2cada98aa61c/. bucket is my-bucket, prefix is my-prefix and the "Job ID" is 43d6d8af4a2b7c850e20c8b135ad2c4d8a04eadb44874a2cada98aa61c.Hope this helps!CommentShareEXPERTAnjananswered 6 months ago0use detect-document-text apihttps://docs.aws.amazon.com/textract/latest/dg/detecting-document-text.htmlor it's async counterpart https://docs.aws.amazon.com/textract/latest/dg/api-async.htmlIn the Blocks section of result, count entries with "BlockType": "WORD"CommentSharerePost-User-7333104answered 6 months ago"


Question: How to set Max number of replies in lambda elicitSlot

"HII created a lex bot in which i ask the user to enter a 9 digit ID as a slot. I use lambda to validate that slot and if the user has entered invalid number of digits (say 7 digit number) , I return an elicitslot from my lambda function with a message "ID should be 9 digit"  and the slotToElicit as ID.All that works well , however the issue is that though the max no of retries for the ID slot is set to 2 , when the validation is being done through lambda , it does not stop at 2 retries , it  keeps asking the same question again and again if the user keeps send invalid value.How can we stop that from happening.FollowComment"

Answer: "0Hi,Thank you for your interest in Lex. If the lambda function gives a particular dialog action, Lex honors it regardless of the default max retries set in the bot.One way to workaround this issue would be to maintain a counter in the session attributes that is incremented in lambda every time the user enters invalid input and then on the nth turn (n being the maximum retry attempts), lambda should give a dialog action such as Close to finish up a conversation.Please let us know if there's anything else we can help you with.Regards,NikhilCommentShareAWS-User-9523788answered 4 years ago0Hi TeamI too had same requirement, Could you show any sample reference to add in session attributes, as i am new to lex v2 , I need to implement this logic in java language.Thanks in AdvanceCommentSharerePost-User-3335515answered 10 months ago"


Question: Lightsail custom domain Certificate region and assignment problem

"Hello,REF Amazon Lightsail, Distribution, Custom Domains - CertificatesI have created a Distribution in the Ireland region and have no option to select the region when I create a new certificate. For some bizarre reason it keeps on defaulting the certificate to VIRGINIA region.I cannot attach the certificate as it says its assigned in a different region.What I have also done is under ACCOUNT - CERTIFICATES deleted it and re-created one there in the Ireland region for the same domain but I cannot assign it to any Distribution from there nor does it allow me to in the distribution itself as it does not show up as an option to attach.It would be great if anyone can assist. Thank you in advance.FollowComment"

Answer: "0thank you for the responseso I need to create a distribution in the Virginia (us-east-1) regtion BUT, I cannot attach the origin/source as its in Ireland or should I be able to? "You have no available origins in Virginia (us-east-1)."So I will need to literally move the instance to Virginia otherewise its impossible to use a distribution. What is the point then of giving an option to select the other regions for the distribution?CommentSharerePost-User-2571759answered 4 months agoAWS-SUM 4 months agoThe distribution created in Virginia (us-east-1) AWS Region WILL BE able to have origin from other AWS Region attached to it.If you are trying to attach an instance from Ireland region, please make sure the instance has a Static IP attached to it and the site/application on it loads with that Static IP correctly before you would be able to make it the origin of the Distribution.Docs:Create and attach a Static IP - https://lightsail.aws.amazon.com/ls/docs/en_us/articles/lightsail-create-static-ipDistribution setup in Lightsail - https://lightsail.aws.amazon.com/ls/docs/en_us/articles/amazon-lightsail-creating-content-delivery-network-distributionShare0Lightsail Distributions use Lightsail Certificates in the Virginia ( us-east-1 ) AWS Region only. This is because Lightsail Distributions are a global resource. The AWS Region such as Ireland of the origin/source for the Distribution such as an Instance with Static IP or a Load Balancer, is not the AWS Region for the Distribution or change the AWS Region needed for the Certificate.Some docs to help :https://docs.aws.amazon.com/lightsail/2016-11-28/api-reference/API_AttachCertificateToDistribution.htmlOnly certificates created in the us-east-1 AWS Region can be attached to Lightsail distributions. Lightsail distributions are global resources that can reference an origin in any AWS Region, and distribute its content globally. However, all distributions are located in the us-east-1 Region.https://lightsail.aws.amazon.com/ls/docs/en_us/articles/amazon-lightsail-create-a-distribution-certificateCommentShareAWS-SUManswered 4 months ago"


Question: DNS address could not be found. Diagnosing the problem. DNS_PROBE_POSSIBLE | Non-Existent Domain

"Hi,Have my website hosted on EC2 on 3000 portBought new domain from awsAdded route with record type A to point to EC2 IP (tried with www. and without prefix)Even tried with CNAME (www) pointing to AWhile launching website it says "DNS address could not be found. Diagnosing the problem. DNS_PROBE_POSSIBLE "There is option to Test Record it says "Non-Existent Domain"Verified registered domain name and hosted zone name are sameAlso found that no named server are assigned to my domain that was registeredFollowComment"

Answer: "1Please add NS records to your domain, you can follow the guide here: https://docs.aws.amazon.com/Route53/latest/DeveloperGuide/domain-name-servers-glue-records.htmlthe name servers you will add are the ones listed in your public hosted zone for the same domain.Please feel free to comment if this does not resolve your issue so we can further troubleshoot.CommentSharehameedullahanswered a year ago0Issue was my registered domain does not had a named server, so have copied named server from hosted zone to registered domain and it worked.CommentShareAWS-User-8856985answered a year ago"


Question: Can't create application from BitBucket repo anymore

"Hello,Since 4 days, I can't connect a BitBucket repo from the Amplify Console anymore.I select BitBucket, then I have to login to BitBucket and grant the access, then I select the repo and the branch, and at the end I get this error:Houston, there's a problemThere was an issue setting up your repository. Please try again later.({"type": "error", "error": {"message": "Your credentials lack one or more required privilege scopes.", "detail": {"granted": ["webhook", "repository:admin", "repository:write", "team", "account"], "required": ["pullrequest"]}}})I already have 6 other Amplify applications from BitBucket repos currently running, and I have never faced this error.But none of them is working anymore, the build of the existing applications (which always worked in the past) now also fail with:2019-09-25T13:54:13.109Z [INFO]: Git SSH Key acquired2019-09-25T13:54:13.210Z [INFO]: # Cloning repository: git@bitbucket.org:****.git2019-09-25T13:54:13.370Z [INFO]: Agent pid 712019-09-25T13:54:13.380Z [INFO]: Identity added: /root/.ssh/git_rsa (/root/.ssh/git_rsa)2019-09-25T13:54:13.420Z [INFO]: Cloning into '***'...2019-09-25T13:54:13.872Z [INFO]: Warning: Permanently added the RSA host key for IP address '18.205.93.2' to the list of known hosts.2019-09-25T13:54:14.233Z [INFO]: Permission denied (publickey).2019-09-25T13:54:14.234Z [INFO]: fatal: Could not read from remote repository.                                 Please make sure you have the correct access rights                                 and the repository exists.I also tried to revoke the Amplify OAuth key in the Bitbucket settings and try to connect again, I see the new OAuth key added in BitBucket settings, but I get the same deployment problems.How can I solve this ?We are currently blocked as we cannot deploy anything.Thanks !Edited by: leclercb on Sep 25, 2019 7:01 AMEdited by: leclercb on Sep 25, 2019 7:01 AMFollowComment"

Answer: "0Ditto, I'm in the same boat. Not able to deploy anything. Also tried creating new app after revoking permissions - same problem.CommentShareiSyndicateanswered 4 years ago0We just fix issue. Can you try again?Thanks,GaryCommentShareAWS-User-0568200answered 4 years ago0We just fix the issue. Can you try again?Thanks,GaryCommentShareAWS-User-0568200answered 4 years ago0Hi Gary.The fix works for new applications, i.e. if I add brand new application and connect it to Bitbucket branch it works.For existing apps, even if I try to connect another branch, it doesn't work. I wonder if there is a setting that's attached to application configuration that needs to be updated? Now, technically I could remove and re-add all applications, but it would be better to fix the underlying issue instead. Please let us know if that's possible.Thanks!KirillCommentShareiSyndicateanswered 4 years ago0Thanks for fixing the connection of new apps.However, the existing apps are still failing during the build.Having to remove them and connect them again would be a long process but also create down times so it's not an option for us.ThanksCommentShareleclercbanswered 4 years ago0I would like to add that I have had this issue as well. I was able to deploy to amplify fine yesterday, but today the branch is failing at the beginning of the build phase.The error I get is:[INFO]:fatal: Could not read from remote repository.           Please make sure you have the correct access rights           and the repository exists.[ERROR]: !!! Unable to clone repository.I also got a redirect to grant access on bitbucket when connecting a new branch.Any feedback would greatly appreciatedCommentSharejoshpottertonanswered 4 years ago0We are currently experiencing issues building and deploying apps that are connected to BitBucket repositories. We are actively working on a fix to give users the ability to reauthenticate with Bitbucket. We apologize for any inconvenience caused and will update this issue with an ETA shortly.CommentShareAWS-User-0568200answered 4 years ago0We are testing a fix currently and should roll something out shortly. Please track https://github.com/aws-amplify/amplify-console/issues/157 for updates.CommentShareAWS-User-4611311answered 4 years ago0The fix has been rolled out. Can you please go to General > App settings and choose Re-authenticate. After this is done trigger a new build which should fix the issue.CommentShareAWS-User-4611311answered 4 years ago0It's working, thanks !CommentShareleclercbanswered 4 years ago"


Question: Need a Public Roadmap for Lumberyard & Tools/Tutorials Development

"We need a public Roadmap for Lumberyard (for engine and tool development, as well as Tutorials/Documentation development). The Roadmap for cryengine is currently public and it's very easy to see what is currently being worked on, and the direction that CryEngine is headed. It's very difficult to see (or even predict) where or what is going on with Lumberyard.We need a Public Roadmap for Lumberyard (and Tools/Tutorial development). I really like the "concept" of Lumberyard (CryEngine with added AWS, updated netcode and Twitch support), but we need a "Public Roadmap" (with monthly releases) for Lumberyard to see where Lumberyard is currently headed.Many of the things that CryEngine has done (and is currently working on) for CryEngine V is extremely interesting, and hopefully these same features will make their way into Lumberyard.Another area that I'm concerned with (that CryEngine is terrible at doing) is Tutorials, Documentation, and sample games/assets (and weekly videos) like Unreal Engine's weekly twitch tutorial videos. We need a public Roadmap (with monthly releases) for Lumberyard Engine, Tools, Tutorials and AAA-Game samples! (like a sample version of "Star Citizen" Game, with tools, assets, source code, tutorials, etc.)The most important thing is "openness" and "community management". We need sample AAA-Games (i.e. "Sample version of Star Citizen Game", "StarEngine Gems", development tools, tutorials, etc.) that currently use Lumberyard. So users can learn the development pipeline, learn the tools, modify existing sample assets, and help learn (and create) content and AAA game creation (like Star Citizen or No Man's Sky) in Lumberyard.Please work with CIG/Chris Roberts and bring these same tools/tech that CIG/Star Citizen is working on, and using (in their games) and bring these same tools/tech to Lumberyard. Work with CIG developers to make these tools/code/assets available as a "Amazon Gem" in Lumberyard.Openness and Community Management definitely "make or break" a game engine's success. We need more "openness" and a large community that works together for Lumberyard to succeed.Games can "easily" be created in Unreal Engine, and Unity (they both have extremely good resources, tutorials, source code, demo games/assets, and very large communities that develop assets/tools/code/samples that you can use in your own game.It is extremely easy to find "volunteer talent" (interns/students) and "community assets" to help with the development of a Unity or UE4 game. These engines are very easy to "learn" and "start" development with. Weekly YouTube and twitch tutorial videos are also very nice.For Lumberyard, we need "turn-key" AAA-Game Tutorials and full AAA-Game Samples (that users can download, and are FULL AAA-games with assets, code samples, vehicles, etc.)[Similar game/assets/tools/editors to Star Citizen] along with accompanying YouTube videos/tutorials from Amazon and the Lumberyard Community on how to create (and modify/use) content from the Sample packs/games for Lumberyard game development.That type of dedication to Lumberyard would really "push" Lumberyard forward. We need more AAA-Game samples (and full AAA-game pipeline/tools/tutorials) to help content creators get started with and learn Lumberyard.Unity and UE4 are the best at this sort of "community" and therefore are the most popular choices for game development. There is a wide range of books, classes and community content and games available for both Unity and Unreal Engine. We need the same for Lumberyard!Follow"

Answer: "0Hey @REDACTEDUSERWith each Lumberyard release we publish quite a few tutorials with written and video examples to help with the development and learning process. We are working on getting more content and tutorials released on a quicker cadence and we've been fortunate enough to see the community start to step up and create tutorial content as well. You can find links all throughout the forums for that. Not sure if you saw some of the GDC coverage, but we do have a couple of new sample sets that we will be releasing soon (just doing some polish on them) that will be a good starting point and a lot more up-to-date than the current samples.As for the roadmap, I hear you loud and clear and it is something that we plan to do, but we aren't quite ready yet. Trust me, I cannot wait to release the roadmap. I think it will help illustrate how much work the team actually does between updates and shows how the community feedback and input (like this post) matters in our decisions and planning.And the Cloud Imperium comments I cannot really discuss as it is a business partnership with confidential terms. They do have some amazing tech and tools and Star Citizen is shaping up to be one amazing game.Thank you so much for the feedback. Please keep it coming! It is feedback like this that helps us get better and drives the things we do.SharerePost-User-8353690answered 6 years ago0Hi!Indeed, the roadmap will be very usefull for all of Lumberyard followers to understand when and what functionality will be depreciated and how it will be replaced.Can we expect any update in this direction in near future?SharerePost-User-3339242answered 6 years ago0honestly, we probably wont get a roadmap, atleast not while we are still in beta...to many thing in the engine are constantly changing..I remember asking about a roadmap like day one of the engine release(or somewhere around that time) but from the response i got, ^ this is what i gathered.SharerePost-User-9018410answered 6 years ago0Has a Public Roadmap been released yet? Also can you please add Visual Studio 2017 support, as well as 3ds Max 2018, 3ds Max 2017, and Maya 2018, and Maya 2017 tools support to Lumberyard? The development tools are really lagging behind 3-4 years, and it's extremely difficult to teach students (current tools) or create current curriculum, when the tools are so far behind. I'm hoping that 3ds Max 2018, and Maya 2018, and 3ds Max 2017, and Maya 2017, as well as Visual Studio 2017 support can be added to Lumberyard fairly quickly.SharerePost-User-9149768answered 6 years ago0Star Citizen and Squadron 42 are in EARLY ALPHA (not even Beta) and they still have PUBLIC ROADMAPS!This is something that ALL DEVELOPERS expect!  Especially from a game engine!  Also how long are you going to HIDE BEHIND the "beta" nomicker?  Lumberyard has been in Alpha/Beta for 6+ years already, and has no intentions of EVER leaving "beta".  It will NEVER be a PRODUCTION READY game engine, and not a single game has EVER been released based on Lumberyard!The Lumberyard project is like a "herd of cats" with NO DIRECTION, and NO PUBLIC ROAD MAP, and NO CLUE what they are even doing, or even where they are heading.  Just completely LOST, and aimless!If you want to see CLEAR DIRECTION, then look at EPIC GAMES - Unreal Engine Public Roadmap:https://trello.com/b/TTAVI7Ny/ue4-roadmapIt's very clear what EPIC GAMES is working on with their Unreal Engine 4, and Unreal Engine 5!Amazon and the Lumberyard Team are completely clueless and completely LOST!  The whole community has NO CLUE what Amazon is even doing, and Amazon doesn't even know what Amazon is doing!  This whole Lumberyard project has been a complete MESS for 6+ years already, and NOTHING IS GETTING ADDED/FIXED/UPDATED and we still have NO VISION and NO PUBLIC ROADMAP!Where are our AAA-quality cinematic/photorealistic game sample projects?  Global Illumination?  Software-based Real-time Ray Tracing and Path Tracing?  Virtual Textures?  One-click builds?  Build time improvements (get game builds down to one-click and builds down to under a minute like Unreal Engine 4.25)?  RTGI?  OpenXR Plugin?  Translucency Improvements? (Colored Tint / Tinted Windows / Clear coat on vehicles)  Clear Coat Shading Model Improvements (Clear coat on vehicles/aircraft/objects, etc.)  Support for Anisotropic Materials? (Raster & Ray Trace)  GTAO SSAO on Consoles and Windows?  ARKit 3.0 Upgrade?  Native Soundfield Ambisonics Rendering?  Animation Streaming?  Screen Space Global Illumination? Virtualized Geometry similar to UE's "Nanite" or NVIDIA's Asteroids Demo?Amazon's Lumberyard Team seems like a large herd of "aimless cats" wandering around for 5-6 years wasting Jeff Bezo's money!  We still don't have anything!  You are working on a Game Engine from 2012 (CryEngine v3.8.1) in the year 2020!  In 5+ years nothing has come of this project!  Not even ONE single good photorealistic cinematic AAA-quality sample demo project that we can download or use!I don't think anyone at Amazon/Lumberyard even knows the direction that Lumberyard is headed or even HOW to create a AAA-quality game engine or even use Atlassian or JIRA or even Trello!We can see what EPIC GAMES (and Unreal Engine) are doing!  Amazon is about 10-15 years BEHIND Epic Games!See here:https://www.youtube.com/watch?v=qC5KtatMcUwIt's time to knock that rust off, and let's get it together!  We need a production quality game engine (not an early Beta from 5+ years ago) that is still filled with bugs, and doesn't have any of the features of a modern engine like Unreal Engine 4.25 or Unreal Engine 5!When are we going to see a nice cinematic quality game sample project such as this one above from the Lumberyard Team?  Any ideas?  2050?  2075?  2095?  Year 3000?From what I can tell, NOBODY at Amazon is capable of producing a AAA-quality game sample (using Quixel Megascans and Quixel high-poly assets).  When are photorealistic and cinematic 4K, 8K and 16K Brushify tools going to work with Lumberyard?SharerePost-User-9149768answered 3 years ago0[quote="Binky_LMBR, post:2, topic:2449"]Not sure if you saw some of the GDC coverage, but we do have a couple of new sample sets that we will be releasing soon (just doing some polish on them)[/quote]3+ years later, and the Lumberyard team is STILL "putting polish" on things, and NOTHING has ever been released yet!  We still don't have ANY of the sample projects from GDC released, and still don't have ANY type of AAA-quality photorealistic/cinematic game project that we can download, and use (and learn from) with sample assets/project file.We still don't have GI (Global Illumination) [similar to "Lumen"], we still don't have Virtual Texturing, and we still don't have any type of 8K texture and truly virtualized geometry (high-poly dynamic LOD) similar to NVIDIA's Asteroids demo, or Unreal Engine's "Nanite".Something like this here:https://www.youtube.com/watch?v=qC5KtatMcUwWe NEED the features in Lumberyard!  Why is it taking the Lumberyard developers so long to add features?  They can't even keep up with Epic Games or Unreal Engine!  Lumberyard is falling lightyears behind, and is not even in the same class or league of engine as Unreal Engine anymore!SharerePost-User-9149768answered 3 years ago0Hi Mark,Thank you for your continued interest in Lumberyard and your valuable feedback. I understand the desire for sharing more info regarding future developments on Lumberyard from you and the rest of the community, and I am actively pushing for this.  To be sure, the dev team is aware and understands that need.We are currently working on a more detailed overview of our plans for Lumberyard developments to share with the community so please keep an eye out for future announcements!SharerePost-User-8164888answered 3 years ago0It takes 12+ days to get a response, and the only thing you do is BLOCK our posts and censor everything, huh?Still no public roadmap?  Still no decent game samples?  Still don’t even have the 2016 GDC game sample released?You just delete our posts and continue to IGNORE everything that we’ve been asking for?  For 6 years?SharerePost-User-9149768answered 3 years ago0REMOVEDUPLOADIs ANY of this stuff listed above on a current public roadmap that WE can actually see?  Any ideas as to when we will actually see the above features in a production ready build of the Lumberyard game engine?  Does ANYONE in Amazon Lumberyard leadership team have any clue when we will see a PUBLIC ROADMAP?  Will it be this decade?  2030? 2050?  Does anyone have ANY ideas?SharerePost-User-9149768answered 3 years ago0[quote="Mark.Malewski, post:9, topic:2449"]The build times are completely ridiculous and Lumberyard is definitely not “one click build” like Unreal Engine. We have NONE of the features or content (Quixel Megascan Assets) and Amazon doesn’t seem to be focusing on photo realism, or Arch Viz or cinematic quality games or rendering.Lumberyard just seems “completely LOST” with no clue what direction they are headed and no guidance, no leadership and just a big 6 year catastrophic FAILURE!In 3 years we can’t even get a game sample from the 2016 GDC released, and we keep hearing “sometime later” and “maybe next year” or maybe even a decade or two from now we’ll see a GDC game sample released.[/quote]Any ideas when we will see the 2016 GDC Game Sample released?REMOVEDUPLOADAny ideas when we will see a AAA-quality game sample (similar to the original Crytek Game sample?) with working vehicles, working boats, destructible buildings, destructible vegetation?  Destructible vehicles that you can drive, crash, damage and blow up?Cars, trucks, planes, tanks, buses, boats?It shouldn’t take more than SIX MONTHS for ONE good Environment Artist and ONE Level Designer to make a sample game level/project with ALL of the items mentioned above in photorealistic quality that we can use/re-use in our own games and to learn from.Does Amazon just not have the talent or anyone that can make a AAA-quality game level?Would love to see something, and in 6+ years we still have nothing!  Any ideas as to what is going on?  We still don’t have a public roadmap and nobody seems to have ANY clue as to what is going on or what is happening at Amazon Lumberyard.  Any ideas?  Can we expect to see anything anytime soon?  Is this Amazon Lumberyard project completely dead?SharerePost-User-9149768answered 3 years ago0When will we see Virtualized Geometry?  When will we be able to IMPORT CINEMATIC quality assets (like Quixel Megascans cinematic quality assets) into Lumberyard without creating ANY LODs, and import 8K and 16K textures directly into Lumberyard and have nice photo realistic cinematic quality games that are rendered in real-time?Look at Unreal Engine 5 here:https://youtu.be/qC5KtatMcUwWhen can we see ALL of these SAME EXACT FEATURES in Lumberyard?  Anytime soon?  This year?  When are we going to see a consistently updated PUBLIC ROADMAP on Trello that we can look at?SharerePost-User-9149768answered 3 years ago0[quote="Binky_LMBR, post:2, topic:2449"]With each Lumberyard release we publish quite a few tutorials with written and video examples to help with the development and learning process. We are working on getting more content and tutorials released on a quicker cadence and we’ve been fortunate enough to see the community start to step up and create tutorial content as well. You can find links all throughout the forums for that. Not sure if you saw some of the GDC coverage, but we do have a couple of new sample sets that we will be releasing soon (just doing some polish on them) that will be a good starting point and a lot more up-to-date than the current samples.[/quote]Unfortunately I haven’t seen ANY decent game samples in several years now.  We are still waiting for the 2016 GDC samples to get released and all we hear is “waiting on polish” but NOTHING seems to EVER get released!We keep waiting and waiting and waiting, but another 3 1/2 years have passed and absolutely NOTHING ever gets released and NOTHING seems to come to fruition!  We still don’t even have the GDC game samples!We’re still waiting on these game samples to be released!It’s been 6+ years already and it’s been over 3 1/2 years since this original post, and we still don’t see any high quality cinematic quality game samples.  It would be great to see a GDC trailer/game sample get released, but in 3+ years (since the last GDC demo) we still don’t have ANYTHING released to us and we still don’t have these game samples that we can look at, use and learn from!Three years is a VERY VERY VERY LONG TIME, and it seems like NOBODY IS LISTENING!Still no road map.  Still no cinematic quality game samples!The only game sample available looks like a 2-year old created it (in under a day) and doesn’t look like anything AAA-quality like the CryTek game samples or even many of the Unreal Engine game samples!When will we see a working game sample with photorealistic cinematic quality tanks, cars, buses, trucks, aircraft, helicopters, spacecraft and tanks/APCs that can demonstrate what Lumberyard is capable of?  That we can use and learn from?Will we see anything this year?  This decade?  Is the Lumberyard project scrapped?Should we just move back to Unreal Engine and focus our efforts on using a well-supported “production ready” game engine (like Unreal Engine) with cinematic quality assets and textures like Quixel Megascans?Has Amazon completely given up on Lumberyard?  In 6+ years we haven’t seen ANYTHING come of this Lumberyard project and it’s still not stable or production ready and doesn’t seem to have ANY of the features that Epic Games Unreal Engine has.  Any ideas as to what is going on?  Still no road map?  Still no cinematic quality game samples that we can download and use?SharerePost-User-9149768answered 3 years ago04 different community managers have come and gone over the past 6 years, and ALL of them have been saying the same exact thing, that they are “pushing for this”, but over 6 years... we still have NOTHING.  Same exact problems and nothing seems to change.The problems are AT THE TOP and the Lumberyard leadership team needs to be COMPLETELY FIRED, and Amazon needs NEW LEADERSHIP that is going to LISTEN to it’s developers.  In 6+ years absolutely NOTHING has come of this silly Lumberyard “experiment”.  It’s been a BIG WASTE of Jeff Bezos’ money, but outside of that we have nothing!Just a buggy early alpha, and in 6 years we still don’t have a “production ready” game engine that can even compare to Unreal Engine 4.25!The build times are completely ridiculous and Lumberyard is definitely not “one click build” like Unreal Engine.  We have NONE of the features or content (Quixel Megascan Assets) and Amazon doesn’t seem to be focusing on photo realism, or Arch Viz or cinematic quality games or rendering.Lumberyard just seems “completely LOST” with no clue what direction they are headed and no guidance, no leadership and just a big 6 year catastrophic FAILURE!In 3 years we can’t even get a game sample from the 2016 GDC released, and we keep hearing “sometime later” and “maybe next year” or maybe even a decade or two from now we’ll see a GDC game sample released.The current game sample looks like a 2-yr old created it, and if we ask for a better game sample that is comparable to the original CryTek CryEngine game sample (from 6+ years ago), the Lumberyard team claims that they are CLUELESS and incapable of making a good quality photorealistic game sample with working vehicles, working boats, helicopter, aircraft, a train, cars, a bus, a taxi and just give us a good sample that we can use to look at, learn from and assets that we can use/re-use.You should see some of the Amazing game samples available for Unreal Engine, and then look at what is available for Lumberyard, and you’ll see that Lumberyard has NOTHING!No community. No marketplace. No monthly free assets!  Just a garbage sample that looks like a 2-yr old created it!  The older game samples (from 4-6 years ago were NEVER maintained or kept current, everything was deprecated and now we have NOTHING).Just a garage “alpha” game engine that still isn’t production ready (after 6+ years) and we still don’t have any photorealistic game samples (like the original Forest/woodlands with boats, vehicles, destructible vegetation, helicopters, trains, cars, jeeps, trucks, tanks, etc).  Give us an incredible working game sample that we can look at, and use!  (And learn from).After 6+ years we still don’t have anything anywhere close to what Unreal Engine is doing!  Just a big waste of money, and still don’t have a production ready game engine after 6+ years, no AAA-quality game samples are available, no marketplace, no monthly free game assets, and we still don’t even have a public roadmap (3-4 different community managers later, and Lumberyard has gone no where).  We’re still dealing with the same FAILED AMAZON LUMBERYARD LEADERSHIP!Jeff Bezos NEEDS to FIRE EVERYONE (starting at the top) and get us some REAL LEADERSHIP like what we see over at EPIC GAMES and with Unreal Engine!  REAL LEADERS that can develop a production ready game engine and release AAA quality games (like PUBG and Fortnite).It’s amazing that in 6 years we still have NOTHING!  5 years we have been demanding a roadmap and good game samples and we still have NOTHING!We just keep hearing the same thing “maybe next year” and community managers just keep “kicking the can” down the road, with NOTHING ever coming of this project or game engine.  We still have no marketplace.  We still don’t have a photorealistic game engine with a AAA-quality photorealistic game sample.EPIC GAMES and Unreal Engine whips a new one out every few months and we still have NOTHING from the Lumberyard team!I guess we’ll look back at this 3+ year old post in another 3 years from now, and be in the same exact position that we are today.  With NOTHING!  This is a systemic problem with FAILED LEADERSHIP and the ONLY WAY to FIX the problem is FIRE ALL OF THE LUMBERYARD LEADERSHIP!  EVERYONE!It’s the ONLY way to FIX the problem!  6 years and we still have NOTHING!??  What are you guys doing with Jeff Bezos’ money?No clue... no direction, NO LEADERSHIP!We still don’t even have Global Illumination, Virtual Textures, or ANY of the features that Unreal Engine already has!  What is the Lumberyard team doing?  Sleeping?  Taking 13 hour naps?  Is anyone even AWAKE at Amazon?This whole team needs to be fired, and Jeff Bezos probably needs to just hire Tim Sweeney and learn from EPIC GAMES and Unreal Engine, as to HOW to create a game engine, HOW to create games and HOW to LISTEN to developers and give developers what they want and develop a strong community around a production ready game engine and great game samples and amazing photorealistic game assets and textures (like Quixel Megascans and Quixel Game Assets) which are FREE TO USE for anyone using Unreal Engine!Look at where we are at with Lumberyard, and try not to laugh!  Nobody is even taking this project seriously!  NOBODY!  6 years and still NO PUBLIC ROADMAP?  Just as clueless NOW as we were SIX years ago!  #FailedLeadershipSharerePost-User-9149768answered 3 years ago"


Question: codepipeline.putJobSuccessResult() Hanging when Invoking a Lambda from VPC

"After much trial and tribulation, I have determined that the code below (nodejs8.1 runtime), which is a basic CodePipeline setup with no additional code, works fine when one invokes a Lambda normally, but if one tries to invoke the Lambda from within a VPC, the codepipeline.putJobSuccessResult() hangs and the Lambda times out.  Any code that comes before the call runs fine, but it just won't run codepipeline.putJobSuccessResult() and give a proper return value back to CodePipeline despite both codepipeline and the Lambda having a role that has all kinds of policies and trust relationships and the VPC has lots of endpoints as well as a NAT Gateway and Internet Gateway.  This results in CodePipeline continually retrying until the timeout period (~15 minutes).Note also that prior to adding the Lambda to CodePipeline and adding an endpoint that I was running the Lambda manually and successfully utilizing a static IP through a NAT => Internet Gateway (https://medium.com/@matthewleak/aws-lambda-functions-with-a-static-ip-89a3ada0b471) and again, even within the CodePipeline, the Lambda runs fine until it utilizes the AWS SDK aws.CodePipeline.putJobSuccessResult()/aws.CodePipeline.putJobFailureResult() functions; all other code is successfully executed.In theory, to reproduce, one need only take the code below and create a Lambda, set up a VPC as described in the article above, set up a basic CodePipeline and invoke the Lambda as part of the pipeline.  The first run through should work fine.  Then assign the Lambda to the VPC and subnets, then run the pipeline again and see if it doesn't hang when it tries to putJobSuccessResult.The hanging behavior implies it is a networking issue, but if CodePipeline has an endpoint to the VPC and successfully is able to invoke the Lambda, why would the Lambda not be able to talk back to CodePipeline to putJobSuccessResult/putJobFailureResult?  My guess is that either I'm missing something in terms of the VPC or CodePipeline isn't working correctly and/or utilizing its endpoint correctly -- but I'd like to figure it out.It's looking more and more to me like an endpoint issue.  I found this thread while digging: https://forums.aws.amazon.com/thread.jspa?threadID=293780 – If I enabled the endpoint in the VPC, have the internet gateway, the route table points to the internet gateway, and the subnet uses the internet routable route table, and there's no security group or ACL denying traffic it is supposed to work.// Working Base response code for CodePipeline    'use strict';  const aws = require('aws-sdk');  const codepipeline = new aws.CodePipeline();    let environment = 'dev';  let callback;  let context = {      invokeid: ''  }    exports.handler = async (event, context, callback) => {      context = context;      callback = callback;      console.log('Inside deploy-website Lambda');      if (!('CodePipeline.job' in event)) {          return Promise.resolve();      }      // Retrieve the Job ID from the Lambda action      let jobId;      if (event\["CodePipeline.job"]) {          jobId = event\["CodePipeline.job"].id;            // Retrieve the value of UserParameters from the Lambda action configuration in AWS CodePipeline, in this case the environment          // to deploy to from this function          environment = event\["CodePipeline.job"].data.actionConfiguration.configuration.UserParameters || environment;      }        console.log(`Envrionment: ${environment}`);          console.log('Copy Successful');      console.log('Entering Results');      return await putJobSuccess('Copy Successful', jobId);  }    // Notify AWS CodePipeline of a successful job  async function putJobSuccess(message, jobId) {      console.log(`Post Job Success For JobID: ${jobId}`);      const params = {          jobId: jobId      };      console.log(`Job Success Params: ${JSON.stringify(params)}`);      await codepipeline.putJobSuccessResult(params).promise();      console.log('Job Success: Successfully reported hook results');      return callback(null, 'Job Success: Successfully reported hook results');  }FollowComment"

Answer: "0It turns out it was indeed a networking issue.  It seems that the VPC route tables are what got me.  When you create a route table, it has you choose a name and a VPC to associate it to.  What I forgot to do was go to the subnets and associate them to the proper route table under the Route Table tab and/or I didn't choose the right one on one of them because when you choose a route table to associate it to, it doesn't show the logical name, just the route table ID, which makes it more prone to error.  So, while it was definitely a "Newb" mistake, I think there is something left to be desired in terms of user experience in associating route tables.CommentSharemaplionanswered 4 years ago"


Question: "How do I get clients to access the source server from the other side of peering? If I want to establish a peering connection in an ipv6 environment with a friend who is not using AWS, what can I do."

"Right now I've got an ipv6 address block from California in the US through a sit tunnel, and I want to use it to build my service. But since the client is located in China, the client's access needs to go around a long route to reach it. So I want to build a server in China and use tunneling protocol to get the address that EC2 got through sit tunnel and use peering to shorten the line, I don't know if it is feasible?China due to the policy and operator's strategy, resulting in the acquired address can not provide the service properly, or even directly can not provide the service. This makes me have to think about other methods because of it, but I don't have ASN if I say get BGP.FollowComment"

Answer: "4Accepted AnswerAWS DirectConect can be a good option for this one So before start please readhttps://aws.amazon.com/about-aws/whats-new/2019/11/aws-direct-connect-enables-direct-connect-gateway-for-aws-china-regions/andhttps://docs.aws.amazon.com/directconnect/latest/UserGuide/Welcome.htmlIf you want to create a peering connection between your AWS VPC and a friend's network, you can use the AWS Direct Connect service to create a private, dedicated network connection between your AWS VPC and your friend's network. This allows you to bypass the public internet by routing traffic directly between your AWS VPC and your friend's network.You'll need to work with an AWS Direct Connect partner or a colocation provider that offers Direct Connect access to set up a Direct Connect connection. Once the connection is established, you can establish a VPC peering connection between your VPC and your friend's network. This will allow you to use private IP addresses to route traffic between your VPC and your friend's network.CommentShareEXPERTsdtslmnanswered a month agorePost-User-1933391 a month agoThanks for your answer, but it doesn't seem to solve my problem. For a friend, I can set up a GRE tunnel and it costs nothing extra, but I'm not sure how to get clients outside the tunnel to also connect to the source server through an existing connection.Sharesdtslmn EXPERTa month agoSet up a proxy server in China that forwards traffic to your source server through the GRE tunnel. Clients outside the tunnel can connect to the proxy server, which will forward their requests through the GRE tunnel to the source server. This solution allows you to manage client access to the source server without requiring the clients to set up VPN connections.To set up a proxy server, you can use open-source solutions like Nginx, HAProxy, or Squid.SharerePost-User-1933391 a month agoIf I want to let the client just make traffic through the existing connect into the GRE tunnel, connect to the source server and get all the services provided by the source server (Web, GRE Tunnel, Minecraft and others). Will it be able to do this? Looking forward to your answer.If a client connects to the source server using the ipv6 address on the source server, how do I get the proxy server to proxy traffic for it?Share"


Question: Policy Based Site to Site VPN-VGW

"At times AWS documentation is so poor which makes simple stuff more complicated.Dear Expert - As per AWS doc it VGW does support policy based site to site VPN, however while creating connect on AWS side, you only see option to create dynamic routing and static. Technically you do not need tunnels and any sort of routing on policy based VPN. Will those tunnel IP's will still be generated on AWS side, even though remote is configured just for policy based ? and has no significance ?Technically speaking options should be little different from use point of view since same options comes even if you want to configure route-based VPN with static routes.FollowComment"

Answer: "1Accepted AnswerThe answer to this question is Yes, even if CGW has Policy based implementation, the AWS side (VGW or TGW) will still have 2 Tunnels as well as the Tunnel Outside IPs (169.254.x.x/30) that is because AWS Site-Site VPN is a Route based VPN implementation.Will those tunnel IP's will still be generated on AWS side, even though remote is configured just for policy based ?That being said, if your CGW only supports Policy based VPN you can still implement it and it will work; the only issue being only 1 SA (Security Association) will be supported so that would mean 1 single Policy. This is described in this KC article.If however your CGW does supports Route based VPN then it is recommended to use Route based instead of Policy based VPN, with this you will not run into SA limitation, you can choose to use Static or BGP based VPN.CommentShareEXPERTTushar_Janswered 10 months agorePost-User-1687975 10 months agoAs per AWS only remote should initiate traffic to bring  policy based VPN tunnel, not sure how that's handled from AWS side having said that there are two public IP's ? Anyways thanks Tushar for responding my queries.Share0Hello,As mentioned in the documentation below, AWS Site-Site VPN is a Route based VPN solution. So to put it in simple words, AWS Site-Site VPN does NOT support multiple policies and hence is not a policy based solution.If you are using a policy-based configuration, you must limit your configuration to a single security association (SA). Static and Dynamic are routing options depending on whether or not, your CGW device supports BGP or not. It is always recommended to use Dynamic routing with BGP.Hope this helps clear out your confusion.Link- https://docs.aws.amazon.com/vpn/latest/s2svpn/your-cgw.htmlCommentShareSUPPORT ENGINEERAWS-User-Chiraganswered 10 months ago"


Question: Redshift Serverless API reference to restore from Redshift Provisioned Cluster snapshot

I'm looking for the correct API reference to restore a provisioned cluster snapshot to a serverless namespace.I tested the following already with no success:redshift.restore_from_cluster_snapshot() - only works for restoring snapshots from cluster to cluster moderedshift-serverless.restore_from_snapshot() - only works for restoring snapshots from namespace to namespace modeThe only way I was able to do was via console.Please advice.RegardsFollowComment

Answer: "0Hello,In order to restore a provisioned cluster into a serverless workgroup using one of the language-specific Amazon Redshift APIs, please see the documentation on the RestoreFromClusterSnapshot API call for a list of supported languages and the API references for each.One way to restore a provisioned cluster snapshot to a serverless namespace is using the following command in the AWS CLI (See API reference for the AWS CLI API call ):aws redshift-serverless restore-from-snapshot \--namespace-name '<namespace-identifier>' \--snapshot-arn arn:aws:redshift:us-east-1:<account-id>:snapshot:<cluster-identifier>/<snapshot-identifier> \--workgroup-name '<workgroup-identifier>'CommentShareYolisa_Nanswered 3 months agoSamir Palma 3 months agoHi Yolisa, thanks for the reply.  I tested it already (as I mentioned). This API only identifies Redshift Serverless snapshots to be restored, which doesn't work for me since I need to restore a provisioned cluster snapshot into a namespace.Share"


Question: "I keep getting this error message in CodeBuild, how do I fix it?"

Error calling startBuild: Cannot have more than 0 builds in queue for the account (Service: AWSCodeBuild; Status Code: 400; Error Code: AccountLimitExceededException; Request ID: e811aae3-bc14-4991-b920-91cf1fd80688; Proxy: null)FollowComment

Answer: 0See the response to this question from Dmitry. It explains the steps to take to resolve this error.https://repost.aws/questions/QU3XROHIXJRO6_rKsoIfu4fQ/how-do-i-resolve-unexpected-code-build-account-limit-exceeded-exception-errorCommentSharetherealdakotalanswered 7 months ago


Question: How can I solve the problema while receive de message "Diagnostic-Code: smtp; 550 4.4.7 Message expired: unable to deliver in 840 minutes.<421 4.4.1 Failed to establish connection>"?

"Hello. I'm having trouble sending emails to certain domains using SES. I receive the following error message:"Diagnostic-Code: smtp; 550 4.4.7 Message expired: unable to deliver in 840 minutes.<421 4.4.1 Failed to establish connection>"In my company I have an instance of Zimbra for managing local mailboxes, and when I send a message through it, the message is forwarded normally. However, I noticed in my Postfix logs that the destination domain introduces a delay in the connection time, and precisely the domains that take more than 5 seconds to establish the connection are the ones that are not delivered. How do I solve this problem?FollowComment"

Answer: "0Hi,Your SES configuration may be set to enforcing a policy of sending only when a TLS connection can be established to receiving server (and message is encrypted) all the way to the end-user. Depending on how sensitive your emails are, this may be the desired behavior.However, if you want to continue to send the mail, even when unencrypted, you can disable the require TLS setting. SES will still use TLS when possible, according to documentation -https://docs.aws.amazon.com/ses/latest/DeveloperGuide/security.htmlCommentShareDidier_AWSanswered 8 days agorePost-User-2796092 8 days agoGot it, and I followed these steps, after created a configuration set with the option TLS obrigatory:Amazon SES to receiverAmazon SES supports TLS 1.2, TLS 1.1, and TLS 1.0 for TLS connections.By default, Amazon SES uses opportunistic TLS. This means that Amazon SES always attempts to make a secure connection to the receiving mail server. If Amazon SES can't establish a secure connection, it sends the message unencrypted.You can change this behavior by using configuration sets. Use the PutConfigurationSetDeliveryOptions API operation to set the TlsPolicy property for a configuration set to Require. You can use the AWS CLI to make this change.To configure Amazon SES to require TLS connections for a configuration setAt the command line, enter the following command:aws sesv2 put-configuration-set-delivery-options --configuration-set-name MyConfigurationSet --tls-policy REQUIREIn the preceding example, replace MyConfigurationSet with the name of your configuration set.When you send an email using this configuration set, Amazon SES only sends the message to the receiving email server if it can establish a secure connection. If Amazon SES can't make a secure connection to the receiving email server, it drops the message.Share0In my use case I've found the solution instructions following these instructions https://docs.aws.amazon.com/ses/latest/dg/vdm-get-started.html.  I turned off "optimized shared delivery" option in virtual deliverability manager settings the emails are delivered immediately.CommentShareaccasoftwareanswered 6 days agorePost-User-2796092 5 days agoNot worked too.....Share0Sorry but it didn't work. The emails keep returning with the same error message. Any other suggestions?CommentSharerePost-User-2796092answered 7 days ago"


Question: Best practice for cross account S3 bucket access

"We are trying to turn on access log for a load balancer following this page https://docs.aws.amazon.com/elasticloadbalancing/latest/application/enable-access-logging.html, the problem here is that the load balancer and S3 bucket are in different AWS accounts.Would like to know the best practice to achieve this, should we turn on ACL in the S3 bucket or there are some preferred ways, thank you!FollowComment"

Answer: "0Hi,You can use policies to manage cross account access. You might find this document useful - https://docs.aws.amazon.com/AmazonS3/latest/userguide/example-walkthroughs-managing-access-example2.htmlCommentShareSydanswered 2 months ago0AWS started to say in their documentation, try not to use ACL's Granting access to the S3 log delivery group using your bucket ACL is not recommended. Here is an example Bucket policy I use to allow cross Account Access.. Replace [bucketname] with the bucket name this policy is being applied too and replace the account number 111111111111 with the account(s) that need to write their logs from to this bucket.Note, the AWS Account 652711504416 is for EU-west-2. Reference can be seen here depending on which region your ELB Logs are being delievered from so may need updating. https://docs.aws.amazon.com/elasticloadbalancing/latest/application/enable-access-logging.html{    "Version": "2012-10-17",    "Statement": [        {            "Sid": "ELBRegionEu-West-2",            "Effect": "Allow",            "Principal": {                "AWS": "arn:aws:iam::652711504416:root"            },            "Action": "s3:PutObject",            "Resource": "arn:aws:s3:::[bucketname]/*"        },        {            "Sid": "AWSLogdeliveryWriteELB",            "Effect": "Allow",            "Principal": {                "Service": "logdelivery.elasticloadbalancing.amazonaws.com"            },            "Action": "s3:PutObject",            "Resource": "arn:aws:s3:::[bucketname]/*",    "Condition": {"StringEquals": {                        "aws:SourceAccount": [                        "111111111111"                    ]                }}        },        {            "Sid": "AWSLogDeliveryWrite",            "Effect": "Allow",            "Principal": {            "Service": "delivery.logs.amazonaws.com"            },            "Action": "s3:PutObject",            "Resource": "arn:aws:s3:::[bucketname]/*",            "Condition": {                "StringEquals": {"aws:SourceAccount": [                        "111111111111"                    ],                    "s3:x-amz-acl": "bucket-owner-full-control"                }            }        },        {            "Sid": "AWSLogDeliveryAclCheck",            "Effect": "Allow",            "Principal": {            "Service": "delivery.logs.amazonaws.com"            },            "Action": "s3:GetBucketAcl",            "Resource": "arn:aws:s3:::[bucketname]",    "Condition": {"StringEquals": {                    "aws:SourceAccount": [                        "111111111111"                    ]                }}        },        {            "Sid": "DenyInsecureTransport",            "Effect": "Deny",            "Principal": "*",            "Action": "s3:*",            "Resource": [                "arn:aws:s3:::[bucketname]/*",                "arn:aws:s3:::[bucketname]"            ],            "Condition": {                "Bool": {                    "aws:SecureTransport": "false"                }            }        }    ]}CommentShareGary Mcleananswered 2 months ago"


Question: encrypted db snapshot restore  from S3 not working AWS RDS(mysql) console in an S3 bucket.

"Hello, I've an encrypted db snapshot thats generated through AWS RDS console in an S3 bucket. When I attempted to restore the dB snapshot from S3, I received an error saying "Files from the specified Amazon S3 bucket are encrypted. Restoring from encrypted S3 object is not available". If restoring from an encrypted backup from S3 isn't allowed, why did AWS gave us option of backing up with an encryption key?Is there a way to recover the data from the S3 bucket to a new database? Please provide me recommendations on how to restore this encrypted database?FollowCommentAWS-ADolganov a year agoDo you mean you created a snapshot and then exported it to s3?Share"

Answer: "0It is not possible to restore a snapshot back to RDS from an S3 bucket. The "Export to Amazon S3" feature, does not copy the snapshot itself. When you export a DB snapshot, Amazon RDS extracts data from the snapshot and stores it in an Amazon S3 bucket in your account. The data is stored in an Apache Parquet format that is compressed and consistent.After the data is exported, you can analyze the exported data directly through tools like Amazon Athena or Amazon Redshift Spectrum [1]. The feature of export to S3 is to analyze the exported data directly through tools like Amazon Athena or Amazon Redshift Spectrum, and it cannot be used with "Restore from S3" option.You can't restore from an encrypted backup in the Amazon S3 bucket.[2].Reference:[1] Exporting DB snapshot data to Amazon S3 - https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_ExportSnapshot.html[2] Restoring a backup into a MySQL DB instance - https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/MySQL.Procedural.Importing.htmlCommentShareVetrivelanswered a year ago"


Question: Not able to connect with Tableau Desktop to Amazon Athena. Error: AA76601F

"Hi community,I keep on getting the following error when trying to connect to Athena with Tableau Desktop:An error occurred while communicating with Amazon AthenaBad Connection: Tableau could not connect to the data source.Error Code: AA76601Fcom/amazonaws/auth/AWSCredentialsUnable to connect to the Amazon Athena server "athena.eu-central-1.amazonaws.com". Check that the server is running and that you have access privileges to the requested database.This is what I tried so far:I installed an updated version of java and verified that it's at the location:C:\Program Files\Java\jre1.8.0_311I downloaded the update drivers for Athena and copied them to:C:\Program Files\Tableau\Drivers\AthenaJDBC41_2.0.25.1002.jarC:\Program Files\Tableau\Drivers\AthenaJDBC42_2.0.25.1002.jarI created a new user environment variable and system environment variable on my Windows machineVariable name: JAVA_HOMEVariable value: C:\Program Files\Java\jre1.8.0_311On AWS:I created a new user using IAM and gave him the following privileges for testing purposesAmazonS3FullAccessAmazonAthenaFullAccessI copied the user "Access Key ID" and "Secret Key" provided to use in the Tableau application.Verified the Query Result location path on the Athena settingsVerified that my account location is set to Frankfurt (eu-central-1) meaning that the endpoint is:athena.eu-central-1.amazonaws.comThen I tried to establish the connection from Tableau Desktop using the following parameters, but I keep on getting the same error reported at the beginning on the post.Server: athena.eu-central-1.amazonaws.comPort: 443S3 Staging Directory: Query Result location path from the Athena settingsAccess Key ID: ACCESS KEY COPIED FROM IAMSecret Access Key: SECRET KEY COPIED FROM IAMThanks in advance for your help.FollowComment"

Answer: 0I managed to fix the issue.On the Amazon download page for the Athen JDBC drivers:https://docs.aws.amazon.com/athena/latest/ug/connect-with-jdbc.htmlit's possible to download JDBC Driver with AWS SDK and without AWS SDK. I erroneously download the latter one.I downloaded  now the JDBC Driver with AWS SDK and the connection works fine.CommentSharelmajellaroanswered 2 years ago0I fixed the issue.CommentSharelmajellaroanswered 2 years ago


Question: Shortcode Migration

We are in the process of moving from US-WEST-2 to US GovCloud.  We have an active and current PinPoint/SNS shortcode that we need to move as well.  How do we do so?FollowComment

Answer: "0Hi thereYou will need to create a Support Case with the Amazon SNS or Amazon Pinpoint team (depending on which AWS Service you are leveraging), and provide a detailed description of your Use Case on the Support Case. The Amazon SNS/Amazon Pinpoint team will confirm the possibility of migrating the Short Code to the US GovCloud region based on your Use Case.In order to open a Technical Support Case, you will need to have a Developer, Business or Enterprise Support Plan. If you do not have a Support Plan in place, please kindly visit the link provided below on how to sign up for one:https://aws.amazon.com/premiumsupport/knowledge-center/sign-up-support/CommentShareSUPPORT ENGINEERTheLichanswered 9 months ago"


Question: Weird exception of AWS JDK: "AmazonDynamoDBException: User not found"

"I am working on adding a new library that depends on AWS JDK to my project, however, some other untouched existing component querying DynamoDB throws the exception:Caused by: com.amazonaws.services.dynamodbv2.model.AmazonDynamoDBException: User not found: the_user_key (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: UnrecognizedClientException; Request ID: null; Proxy: null)the_user_key works well before I add the new library, but it suddenly says the user was not found.I am using com.amazonaws:aws-java-sdk-dynamodb:1.11.704, "com.amazonaws:aws-java-sdk-core:1.11.704", and there are also a bunch of software.amazon.awssdk with version 2.16.87.I am wondering if anybody encountered similar issues before, or if anybody could give any advice.FollowComment"

Answer: "0If updating to the latest version of the AWS SDK does not resolve the issue, you may want to check your AWS credentials and ensure that the user associated with "the_user_key" has the appropriate permissions to access DynamoDB. You can also try testing your credentials and permissions with the AWS CLI to ensure that they are working properly.CommentSharerePost-User-5208427answered 2 months ago"


Question: Lost User Login Credentials

"Hello,I hope someone can help us out.  We have an employee who handles our AWS account but regarding the billing it is always charged using the company credit card. This employee already quit and cannot be contacted anymore. How can we regain access to the AWS account using our Credit Card that was used for payments and not using the email address?Regards,Marie.FollowComment"

Answer: "0You cannot use your credit card information to log in to AWS.If you have lost or misplaced the email address you use to log in, you will need to follow the instructions in the following document.https://docs.aws.amazon.com/accounts/latest/reference/troubleshooting_root-user.html#troubleshoot_general_lost-root-credsIf you own the domain for the email address, you can restore a deleted email address. Alternatively, you can set up a catch-all for your email account, which "catches all" messages sent to email addresses that no longer exist in the mail server and redirects them to another email address.If the email address on the account is part of your corporate email system, we recommend that you contact your IT system administrators. They might be able to help you regain access to the email.If you're still not able to sign in to your AWS account, you can find alternate support options at Contact us. Expand I cannot login to my AWS account and choose Request Support for AWS account Credentials. Provide the information in the form and choose Submit.CommentShareEXPERTRiku_Kobayashianswered 12 days agomarie 12 days agoHi Riku,Thanks for the reply. The email address belongs to a former employee that cannot be contacted anymore for some reason. But this AWS account belongs to the company that pays the credit card. Is this still possible to regain access?ShareRiku_Kobayashi EXPERT12 days agoyou cannot log in with just your credit card information.I suggest you contact support through the following links shared by other respondents.https://support.aws.amazon.com/#/contacts/aws-account-supportShare0If you have issues you can also contact AWS support using the link below. They can help in regaining access to the account.https://support.aws.amazon.com/#/contacts/aws-account-supportCommentSharerePost-User-4757411answered 12 days ago"


Question: Sudden increase in emails marked as SPAM

"Dears.We've been using the SES service for a long time and we send out a Newsletter every Friday.Always with the same amount of people.We've always had a SAPM rate of 0.03% on average.Last Friday, 12/17/2021 we'd an absurd increase in SPAM, **It's almost reaching 0.50%. **An increase of more than 10 times.Has there been any change in the SES algorithm? Is this a mistake? Why such a sudden increase if our newsletter is exactly the same a few years ago.RegardsFollowComment"

Answer: "0Does the newletter contain HTML content from remote servers?   If so, it is possible the a content repository URIs have landed on URI blocklists.   There are a ton of sites to check status.   Here's one: https://antispamsniper.com/uribl.phpCommentSharemdibellaanswered a year agoAWS-User-4349889 a year agoThere is no remote content. And as I informed, the content is always the same. There is no difference from the last few years. The content is default: Text + Link to articles.The title is standard.Content is standardThe amount of images is standardThe number of words is standard.The action is human, there was an increase in messages marked as SPAM. Messages are not falling into the SPAM box.Our domain is not listed on any blocklist at all. Tested daily at https://mxtoolbox.com/Share"