Question: aws cloudformation deploy stuck REVIEW_IN_PROGRESS

"I'm trying to run aws cloudformation deploy to create an EMR cluster.Parameters in this command:-region us-west-1  --stack-name xxx  --template-file xxx.yaml  --no-fail-on-empty-changeset   --parameter-overrides   Application=xxx   AutoScalingRole=xxx    CoreInstanceType=xxx   Environment=dev      EbsRootVolumeSize=xxx     Env=dev   JobFlowRole=xxx     LogBucket=xxx    MasterInstanceType=xxx    Owner=xxx     PipelineName=xxx     ReleaseLabel=emr-6.9.0                         SecurityConfiguration=xxx      ServiceRole=xxx    Stack=xxx    SubnetId=xxx     TerminationProtected=false      TaskInstanceTypeMin=xxx    TaskInstanceTypeMax=xxx      IcebergEnabled=false     Version=1.0And it creates a stack, the status is REVIEW_IN_PROGRESS. There is one change set under the stack, I should execute the change set to proceed the cluster creation process.Is there some way to let it execute the change set automatically? probably add some parameters or set it in the template-file. Thank you!FollowComment"

Answer: "1Accepted AnswerThe aws cloudformation deploy command by default creates a changeset and then executes it if the changeset creation is successful. This is typically the behavior you would expect when you're deploying a CloudFormation stack. However, when you see the status of REVIEW_IN_PROGRESS, it suggests that the changeset was created but not executed.If your CloudFormation stack is creating IAM resources, you'll need to explicitly acknowledge that your template is creating these resources. You can do this by adding the --capabilities CAPABILITY_IAM CAPABILITY_NAMED_IAM CAPABILITY_AUTO_EXPAND parameters to your aws cloudformation deploy command.The role you're using to execute the CloudFormation stack might not have the necessary permissions to create and execute changesets. Check your IAM permissions to ensure your role has the cloudformation:CreateChangeSet, cloudformation:DescribeChangeSet, cloudformation:ExecuteChangeSet, and cloudformation:DeleteChangeSet permissions.Check the AWS CloudFormation console to see if there are any stack events that might give you a clue as to why the changeset isn't executing. Sometimes a changeset won't execute if there are errors with the stack or the resources it's trying to create.If your stack contains nested stacks, make sure that the nested stack templates are accessible (i.e., the S3 URLs are correct) and that they don't contain any errors.CommentShareEXPERTsdtslmnanswered 6 days agorePost-User-6533490 5 days agoadded cloudformation:ExecuteChangeSet and it continues, thank you!Share"


Question: Email Billing for AWS should & how do I cancel if its not needed??

Hi Guys Im unsure what AWS is or how I'm registered. Im a bit concerned because an email askes about billing so that I don't cancel something I need can you help clear my confusion.regardsMick.I am a amazon userI am a amazon affiliateI don't recall registering for AWS?FollowComment

Answer: "0AWS is a cloud service operated by Amazon.If you do not remember registering with AWS, please use the contact form below to tell AWS.https://support.aws.amazon.com/#/contacts/aws-account-supportCommentShareEXPERTRiku_Kobayashianswered 8 days ago"


Question: CDK IoT createJob not working for documentParameters and AWS managed templates

"Hi,This CLI command to create a job from an AWS managed template works:$ aws iot create-job --targets 'arn:aws:iot:region:account:thing/thingname' --job-id 'test-aws-job' --job-template-arn 'arn:aws:iot:region::jobtemplate/AWS-Run-Command:1.0' --document-parameters '{"command": "ls","runAsUser": "root"}'but this seemingly equivalent CDK custom resource doesn't. CDK deploy returns Message returned: Document parameters are only supported for managed job templates.:const testAwsJobUuid = 'test-aws-job' + uuidv4();const testDocumentParameters = new Map<string, string>([  ["command", "ls"],  ["runAsUser", "root"]]);const testAwsJob = new cr.AwsCustomResource(this, 'test-aws-job', {  onCreate: {    service: 'Iot',    action: 'createJob',    parameters: {      targets: [`arn:aws:iot:${process.env.CDK_DEFAULT_REGION}:${process.env.CDK_DEFAULT_ACCOUNT}:thing/thingname`],      jobTemplateArn: `arn:aws:iot:${process.env.CDK_DEFAULT_REGION}:${process.env.CDK_DEFAULT_ACCOUNT}:jobtemplate/AWS-Run-Command:1.0`,      documentParameters: testDocumentParameters,      jobId: `${testAwsJobUuid}`    },    physicalResourceId: cr.PhysicalResourceId.of(Date.now().toString()),  },  policy: cr.AwsCustomResourcePolicy.fromSdkCalls({    resources: cr.AwsCustomResourcePolicy.ANY_RESOURCE,  }),});Many thanks, GaryFollowComment"

Answer: "1Accepted AnswerHi Gary. I'm not sure it's the issue but in the CDK you have an account number in the jobTemplateArn and I don't think it should be there.CommentShareEXPERTGreg_Banswered 3 months agogary 2 months agoHi Greg, I removed ${process.env.CDK_DEFAULT_ACCOUNT} from the CDK and it made a difference! There was also an issue with how I defined testDocumentParameters. I changed it to const testDocumentParameters = { "command": "cd", "runAsUser": "root" }; and it's all good now! Thanks for your support.ShareGreg_B EXPERT2 months agoGlad to hear that Gary. Thanks for the feedback.Sharegary 2 months agoYou are welcome Greg. Maybe a different error message would help, otherwise, it's all good.Share"


Question: Bulk removal of Shared Link folders and files

Is there a way to remove "share a link" from the existing folder and all subfolders in the hierarchy? My org has shared many folders by link without realizing that these folders and subfolders are viewable by anyone with an account on our WorkDocs. This is a big security issue and would like to resolve it by turning off all the link-shared files and folders without having to go in every single folder to hunt down shared links.FollowComment

Answer: "1This is clearly a flaw with WorkDocs and needs visibility from AWS to:enable bulk removal of "Share a Link" in all subfoldersstop files/folders that have been "Shared a Link" from being searchable if the user does not have permission access to the parent folderOption #2 being preferred.CommentSharehahnmhanswered 3 years ago0Deprecating this thread and starting a new threadCommentSharehahnmhanswered 3 years ago0DId not actually get solved, but I have started a new threadCommentSharehahnmhanswered 3 years ago"


Question: "account move in different OU, impact on TGW or Subnets"

"A customer has the following question:In linked account x I have a VPC which subnets are shared with specific OUs and TGW which also shared with specific OUs. Now account x right now is in OU a and I want to move it to OU b .My question: is there any risk of performing such move of account x from a to b OU?Reason why I am asking is because these subnets, and TGW has business critical apps running in it.In docs I didn't find any notes that would warn about any issues, but can some please confirm if such move is a safe thing to do for the customer.FollowComment"

Answer: "0Accepted AnswerGenerally low-risk, but check the below notes.  I've done this in the past with 0 impact to the accounts.The longer answer is: "it depends".  Remembering the primary goal of Organizational OUs as a way to group, manage, and apply policies on that organized accounts, you'll need to make sure that you don't have any organization policies on the new OU you plan on moving the account to.Take a look at the doc example and think about the accounts under the OU at the bottom right inheriting multiple policies that the account on the far left does not have applied.  Ie: Make sure you don't have org policies that will impact the account in its new OU home.CommentShareJeremyAWSanswered 3 years ago"


Question: error An HTTP Client raised an unhandled exception: check_hostname requires server_hostname - accessing through CLI

"Hello,context: I am doing a simple POC exercise running a few lines of python code in the CLInote: I am using a proxy serverUpon doing so this error is thrown:An HTTP Client raised an unhandled exception: check_hostname requires server_hostnameWhich raises my question- is it possible to execute code in the CLI with my proxy server? Or is the only way to do this successfully by turning-off the Proxy server? If so, why??Following this from docs (https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-proxy.html) didn't prove successfull. Whether setting the proxy address, running the lines of code to embed/authenticate against the proxy with the user name and password, or setting the NO PROXY, neither of which produced any positive results.Just wondering how to get around this obstacle.FollowComment"


Question: Troubleshoot Unable to get table definition for table '0' cause by a DDL command (cant find the DDL in the logs)

HelloIm currently using DMS and got the following message2022-10-30T09:40:03 [SOURCE_CAPTURE  ]E:  Unable to get table definition for table '0' [1021802]  (oracle_endpoint_capture.c:759)and found the following infohttps://community.qlik.com/t5/Official-Support-Articles/SOURCE-CAPTURE-E-Unable-to-get-table-definition-for-table-0/ta-p/1809603I was looking towards enabling source capture for DDL commands in SOURCE_CAPTUREIm looking towards a way to enable trace only for ddl commands (traceDdlChanges?) to dump the exact command which failed.Activating full debug trace for SOURCE_CAPTURE is not an option at all.Too much verbose for an event that may happen very occasionallyI couldnt find any further informationhttps://docs.aws.amazon.com/dms/latest/userguide/CHAP_Tasks.CustomizingTasks.TaskSettings.Logging.htmlhttps://docs.aws.amazon.com/dms/latest/userguide/CHAP_Tasks.CustomizingTasks.TaskSettings.DDLHandling.htmlhttps://docs.aws.amazon.com/dms/latest/userguide/CHAP_Tasks.CustomizingTasks.TaskSettings.ErrorHandling.htmlThanksFollowComment


Question: Does S3 Strong Consistency mean disabling EMRFS Consistent Views?

"Customer is using EMR FS consistent view because S3 was eventually consistent. Post-Re:Invent 2020, with Amazon S3 Strong Consistency, they no longer need EMR FS Consistent View. Can customer start disabling EMR FS consistent view for their clusters? Any other changes/settings we can share with customers to be aware of?FollowComment"

Answer: "0Accepted AnswerAs Jeff Barr mentions in his blog post that EMRFS Consistent Views is not longer needed , and so I think it is safe to advise the customer they can disable it.No other changes/setting would be impacted. EMRFS it is obviously still needed.Here's the documentation on S3 consistency, which includes reads after deletes ( a delete is a type of write)Amazon S3 data consistency model Amazon S3 provides strongread-after-write consistency for PUTs and DELETEs of objects in yourAmazon S3 bucket in all AWS Regions. This applies to both writes tonew objects as well as PUTs that overwrite existing objects andDELETEs.CommentShareEXPERTFabrizio@AWSanswered 2 years ago"


Question: AWS-GLUE encoding utf-8

"I have a problem when I submit a job in glue. My data in s3 contain ñ and accents, this causes that the job fails: unable to parse fail s3://...If i edit my job with the python header:# -- coding: utf-8 --   the jobs fail too.Any idea? Thank you beforehand.Edited by: anaP on Jan 24, 2018 4:10 AMEdited by: anaP on Jan 24, 2018 4:10 AMFollowComment"

Answer: "0Hi,I am facing the same problem. Are you able to get a fix for this? I really do not want to use Spark DataFrame API at this point after spending so much time making the Glue data catalog perfect.CommentSharebtiwabagw1answered 5 years ago0Specify the encoding at the top of your script:import sys reload(sys)sys.setdefaultencoding("utf-8")I used this in my job and it resolved the error.CommentShareSABEResPODERTechanswered 4 years ago0I have discussed this with AWS technical support and there is no solution using DynamicFrames - you need to rewrite I'm afraid...CommentSharechrisklanswered 4 years ago0I've tried this and it doesn't work...CommentSharechrisklanswered 4 years ago0I have the same problem. Is this still in the works? Anybody found a working solution?CommentSharedatazillaanswered 3 years ago0Currently Glue DynamicFrame supports custom encoding in XML, but not in other formats like JSON or CSV.If your data includes non-UTF characters, you can use DataFrame to read the data, write back to S3 with UTF8.You can refer some samples in below repository.https://github.com/aws-samples/aws-glue-samples/blob/master/examples/converting_char_encoding.mdCommentShareAWS-User-6283168answered 3 years ago0my glue job is getting failed to with an error unable to parse when trying to process ANSI formatted file.Any solution?CommentShareAdarshanswered 3 months ago"


Question: SES over Pinpoint? - Transactional Emails

"A customer needs to send transactional emails based on account opening. They also require basic tracking on deliveries, opens, bounces etc. Estimating approx 5 mill emails a month.Based on quick reading of the doco both SES and Pinpoint would be able to meet this requirement. Pinpoint appears to also support the transactional email use case but has a broader range of features as well. Is there ever a situation in which we should be recommending SES over Pinpoint to a customer?FollowComment"

Answer: "1Accepted AnswerAmazon SES is the AWS' email service and it is not being phased out. in fact, we are launching SES in new regions (5+ regions in the last 6 months) and adding more features (recently launched VPC endpoint support). We are continuing to invest and grow SES.To answer this specific question: if the customer is looking to send emails programmatically and build it into an application, our recommendation is to use Amazon SES. If the customer is looking to schedule campaigns and send multi-step orchestration for mass marketing communications, please use Amazon Pinpoint. Though transactional APIs are available on Amazon Pinpoint, it is designed for lightweight multi-channel communication and does not provide features such as dedicated IPs, IP pools, open/click, etc. Additionally, it also does not support suppression management and other common email use cases features.CommentShareAWS-User-3417439answered 3 years ago"


Question: Request to Support .quest TLD on Route53

"Hi Aws Team,Checking in to see if there is any plan to add .quest Top Level Domain on Route53. If yes would appreciate if you could provide an ETAThanksFollowComment"

Answer: 0Probably better to open a support ticket in your AWS account for this type of information.CommentShareIsaac Behrensanswered a year ago


Question: What Type of EC2 Instance Should I Use?

"Currently I am on the free plan. I am running a python web scraping on a windows script that could be refreshing potentially every minute for tracking several different (20-50 instance requests at a time. Hopefully expanding to more. What infrastructure should I be using, looking for cheapest possible option. Also the web scraping instances are tracking elements on a site that could potentially ban or timeout requests. My python script is connected to a proxies.txt, I am wondering what the best proxies or way to generate proxies is?FollowComment"

Answer: "0Hi,Given above I d start simple with t2 or t3 (small/medium) and then vertical scale from there.You can also consider spot instances if you accept some level of interruption in exchange for cost saving - or evaluate a SpotFleet to mitigate that but pay a bit morehttps://aws.amazon.com/ec2/instance-types/t2/https://aws.amazon.com/ec2/instance-types/t3/https://aws.amazon.com/ec2/spot/https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fleet.htmlHope it helps ;)CommentShareEXPERTalatechanswered 2 months ago"


Question: Java 2.X Lambda RequestHandler and Context documentation

Hi thereI am using AWS Java SDK version 2.17  for dynamodb access and creating lambda functions to be called from API Gateway. The challenge I have is that I cannot find any documentation pertaining to how to write the actual Java for the lambda function. There is plenty of documentation on Java SDK version for 1 using the RequestHandler interface and the Context object but there is no documentation on the equivalent in Java SDK version 2.X. All the Java 2.X lambda documentation pertains to creating/registering/listing/deleting lambda functions in AWS but not to the actual writing of the Java based request handler.Would anyone know where this documentation can be found and/or sample code for a Java 2.X lambda function?ThanksFollowCommentAshutosh a year agoHave you tried thishttps://github.com/awsdocs/aws-doc-sdk-examples/tree/main/javav2/usecases/creating_first_projectShare

Answer: 0See if below article helps.https://apurvsheth.medium.com/spring-boot-serverless-aws-lambda-with-api-gateway-258f48b7f22fCommentShareshethapanswered a year ago


Question: CloudFormation stack CREATE_FAILED because of "Internal Error"

"Hey folks,I was trying to replicate the service I work on to a separate burner account. I was able to replicate all the other stacks except the ECS Service stack (the main one for the service). I get an error while running bb cdk deploy <ECSServiceStackName> which says:Received response status [FAILED] from custom resource. Message returned: Internal Error (RequestId: f67e9cec-b153-47fa-8bf6-8c1ac962394c)I believe it is due to other resources that failed to create:The following resource(s) failed to create: [LoadBalancerBE9EEC3A, LambdaCanary44B53221, SslCertificateArnSsmParameterFBC7F579]. Rollback requested by user.Based on the events and time stamps I can see that the SslCertificateArnSsmParameter resource failed first (also started creating first) due to which the other 2 are failing. Is this Certificate resource an issue with regards to a burner account? Is it okay that I am trying to replicate this resource in a separate AWS account apart from the original Alpha account (Yes, I am replicating all the resources from the alpha account)?If anyone is curious about why I am replicating everything to a burner account- The goal is to get the service up and running in a separate AWS account and for that I am trying it on a burner account first before going ahead with a new permanent Conduit account.TIA :)Attached 1 images 1) the CloudFormation ConsoleCW logs associated with the resource.{     "Status": "FAILED",     "Reason": "Internal Error",     "PhysicalResourceId": "2022/09/13/[$LATEST]<id>",     "StackId": "arn:aws:cloudformation:us-west-2:<aws_accountID>:stack/IhmPrimsDecouplerEcsService-<aws_accountID>/<some_ID>,     "RequestId": "<RequestID>",     "LogicalResourceId": "SslCertificateArnSsmParameterFBC7F579",     "NoEcho": false,     "Data": {} }INFOParameterNotFound: null     at Request.extractError (/tmp/node_modules/aws-sdk/lib/protocol/json.js:52:27)     at Request.callListeners (/tmp/node_modules/aws-sdk/lib/sequential_executor.js:106:20)     at Request.emit (/tmp/node_modules/aws-sdk/lib/sequential_executor.js:78:10)     at Request.emit (/tmp/node_modules/aws-sdk/lib/request.js:686:14)     at Request.transition (/tmp/node_modules/aws-sdk/lib/request.js:22:10)     at AcceptorStateMachine.runTo (/tmp/node_modules/aws-sdk/lib/state_machine.js:14:12)     at /tmp/node_modules/aws-sdk/lib/state_machine.js:26:10     at Request.<anonymous> (/tmp/node_modules/aws-sdk/lib/request.js:38:9)     at Request.<anonymous> (/tmp/node_modules/aws-sdk/lib/request.js:688:12)     at Request.callListeners (/tmp/node_modules/aws-sdk/lib/sequential_executor.js:116:18) {   code: 'ParameterNotFound'FollowComment"

Answer: "1Hi,Below is the article to go through for the same. It states all the possible reasons for the internal error which look quite similar to what you are facing.Link- https://aws.amazon.com/premiumsupport/knowledge-center/cloudformation-internal-failure-error/ -- [1]CommentShareSUPPORT ENGINEERAWS-User-Chiraganswered 9 months ago"


Question: No (Audio) Device Output / remote audio only

"HiI have Windows Datacenter 2019.I have a problem where I can't instal audio drivers to have (audio) device output.I can only use remote audio but as soon as I disconnect the RDP my streming sound turns off.So I tried a lot of different ways to turn on like in ”Service” play with ”Wondows AUDIO” but still nothing.Also tried to install lot of different virtual audio devices like VB-cable, voicemeeter, realtek drivers, Aus drivers, morphVOX.But non of it made a virtual audio output.So is there maybe somehow I can switch this option on? Or whats going on with this RDP?How have had this issue, can you give some tips?FollowComment"

Answer: "0I will maybe have a fix.If yes I will update.But still if someone already know, you can write it here.CommentShareGigaGuruanswered 3 years ago0I know this is an old thread - But I recently ran into this problem --The solution is to change the RDP client sound settings to "Leave at remote computer"CommentShareIamLegacyOneanswered 2 years ago"


Question: Get Online/Offline status for iot thing using iot device client sdk

"Hello, I was wondering if there's any easy and fast implantation way to get online/offline status in the console as soon as a iot thing comes online or goes offline. Any help is appreciated.FollowComment"

Answer: "1Accepted AnswerHi Subham. You may be interested to enable fleet indexing, particularly thing indexing and thing connectivity: https://docs.aws.amazon.com/iot/latest/developerguide/managing-index.htmlWith that enabled, you can then do searches within the console (Manage->Things->Fleet Indexing->Search). Example queries: https://docs.aws.amazon.com/iot/latest/developerguide/example-queries.htmlYou can use FleetHub so you have a GUI reporting connection status and last disconnection reason:https://docs.aws.amazon.com/iot/latest/fleethubuserguide/aws-iot-monitor-user-queries-dashboard.htmlhttps://www.youtube.com/watch?v=WIUZ-aBSRzsFleet Hub works on top of fleet indexing, so fleet indexing needs to be enabled.Please also be aware of Lifecycle Events; you can enable these and have AWS IoT Rules that actionthese events: https://docs.aws.amazon.com/iot/latest/developerguide/life-cycle-events.htmlCommentShareEXPERTGreg_Banswered a year ago1Another option is to use lifecycle events and subscribe with the MQTT test client in the AWS IoT console (or any other MQTT client)  to $aws/events/presence/connected/# and $aws/events/presence/disconnected/#. If you want to get messages for a certain client only replace # with the clientId.KR,PhilippCommentSharePhilipp Sanswered a year ago0Hey Greg and Phillip, thank you so much for the answer, it helped a lot. However when i used lifecycle event of connected or disconnected i found that only when the rpi is shutting down i am getting the mqtt message but when the device loses the connectivity  i am not. Can you tell me if there's a way to implement this?CommentShareSubham Agrawalanswered a year agoGavin_A a year agoThere is a keep_alive_secs that can be provided to reduce the time a session is reported as disconnected for situations such as losing connectivity. This can be set during the creating of the base MQTT connection object. Which SDK are you using, we can provide a link to the SDK docs.ShareGreg_B EXPERTa year agoI think Subham is using Device Client. This uses the CPP V2 SDK default keep alive, which appears to be 20 minutes: https://github.com/awslabs/aws-c-mqtt/blob/main/source/client.c#L40.Subham, I think this would be the line to change in device client: https://github.com/awslabs/aws-iot-device-client/blob/main/source/SharedCrtResourceManager.cpp#L346For example, to have a keep alive of 30s:if (!connection->Connect(config.thingName->c_str(), false, 30))If you CRTl-C to quit Device Client, it will send a Disconnect and the keep alive won't matter.Share0Thanks all for the inputs, the keep_alive_secs works when the device client is being run via a service. Couple more doubtsI want to use lifecycle events to notify me via SNS which isn't working it keeps saying invalid sql statement when i did `SELECT * from '$aws/events/presence/connected/+'.The whole implementation seems very very tedious and it would be great to have tutorials for things like this.CommentShareSubham Agrawalanswered a year agoSubham Agrawal a year agoThanks for the help, the rule for notification workedShare"


Question: AWS AppStream is unable to push session script logs to s3

"I have configured session scripts to log stdout and stderr to s3 bucket as described in https://docs.aws.amazon.com/appstream2/latest/developerguide/use-session-scripts.html#enable-S3-bucket-storage-session-script-logs & https://docs.aws.amazon.com/appstream2/latest/developerguide/create-session-scripts.html .The log files are created successfully on a running appstream instance at /opt/appstream/SessionScripts/logs , but they are not pushed to s3 buckets.Based on the article above, we do not need to perform any additional settings to make this happen.I assigned a policy to the fleet that has full access to s3 (AmazonS3FullAccess).There is no error about permissions or failure etc logged in CloudWatch or in /var/logs/ on a running instance.What could be causing this issue? Anything else to be checked?FollowComment"

Answer: "1Hi,If you are experiencing issues with AWS AppStream not being able to push session script logs to Amazon S3, there are a few troubleshooting steps you can take:Verify IAM Role Permissions: Ensure that the IAM role associated with your AppStream fleet or stack has the necessary permissions to write logs to the specified S3 bucket. The role should have permissions for the s3:PutObject action on the target S3 bucket and appropriate access to the relevant S3 resources.Confirm S3 Bucket Configuration: Double-check the configuration of the S3 bucket you are trying to push the session script logs to. Make sure the bucket exists, is accessible, and has the correct permissions configured to receive the logs. Confirm that the bucket name and region are accurate.Check AppStream Fleet Configuration: Review the fleet settings in AppStream. Ensure that the correct S3 bucket and path are specified for the session script logs. Verify that the logging configuration is enabled and properly configured for the desired fleet.Verify Network Connectivity: Check the network connectivity between the AppStream instances and the S3 service. Ensure that the instances have the necessary outbound internet access or VPC endpoint connectivity to communicate with S3. Network configurations or security group rules may need to be adjusted to allow the necessary traffic.Check Session Script Logs: Review the session script logs generated by AppStream instances for any error or warning messages related to the log delivery. These logs can provide insights into any specific issues encountered during the log upload process.Monitor CloudWatch Metrics: Monitor the CloudWatch metrics related to your AppStream fleet, such as LogStreamingFailure and LogStreamingSuccess. These metrics can help identify any patterns or anomalies that may be affecting the log delivery process.Let me know if this works out or helps you out.Otherwise we can check together on the issue.CommentSharehimanshustallongmailcomanswered 13 days agorePost-User-0424427 13 days agoThanks Himanshu. I have verified all of the above without any further luck. A running instance is able to successfully ping s3.amazonaws.com & curl -O https://s3.amazonaws.com/<bucket-name>/<file-name>Share"


Question: Migrate data from Couchbase to DynamoDB using AWS DMS

"Hello,We are trying to migrate data from Couchbase instances that run in EC2 to DynamoDB using AWS Data Migration Service (DMS).First question: is this supported? I dont see it listed here: https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Introduction.Sources.htmlSecond question: what steps would you suggest for migrating such dataFollowComment"

Answer: 2Accepted AnswerI dont believe Couchbase is a supported source of DMS. You could probably export your tables in CSV format to S3 using cbtransfer then using DynamoDB ImportTable to import the CSV data to DynamoDB.CommentShareEXPERTLeeroy Hannigananswered 9 months ago


Question: AWS Lambda to on-premise via direct connect and AWS PrivateLink?

"Hi,I'd like to understand if traffic from AWS Lambda functions to an on-premise environment is allowed, if the functions are placed outside the VPC but leveraging AWS PrivateLink with an Lambda Endpoint? (see image below)I believe from on-premise to Lambda is possible but i'm looking for confirmation if the other way around is possible.Thanks for any thoughts in advance.FollowComment"

Answer: "1Accepted AnswerHi Mart,I understand you are looking to connect your Lambda functions to your on-premises environment that is connected to your VPC via Direct Connect, as follows:Lambda -> VPC -> DX -> on-premises environmentAnd you would like to know if using PrivateLink is required so the Lamba function uses a Lambda endpoint to connect to your VPC, then DX, then on-premises. Please, let me know if my assumption is incorrect.Do note that Lambda endpoints are inbound endpoints meaning you use them to call your Lambda functions without using the internet hence all your traffic remains private, as in:HTTP client -> Lambda endpoint -> Lambda service -> Lambda functionSo Lambda endpoints are not outbound endpoints.From a networking perspective, all Lambda functions (whether yours or other’s) are located, or deployed, inside Lambda service’s VPC. In order for your Lambda function to access your own VPC, what’s happening under the hood is that the Lambda service is using PrivateLink to connect its own service VPC to your own VPC, as in:Lambda service VPC -> PrivateLink -> your own VPC -> resources hosted in your VPCTherefore, once you have configured your Lambda to be deployed (or connected) to your VPC [1], as long as your VPC has connectivity to your data center, it will be allowed to route the traffic towards it - whether it uses Direct Connect or other connections, like VPN.In case my answer doesn’t address your question or you have any follow-up, please let me know.Hope it helps,RockyReferences:[1] Configuring a Lambda function to access resources in a VPC - https://docs.aws.amazon.com/lambda/latest/dg/configuration-vpc.htmlCommentShareAWS-Rockyanswered 4 months agoEXPERTTushar_Jreviewed 4 months agoEXPERTBrettski-AWSreviewed 4 months agoMart 4 months agoHi Rocky,I appreciate your in-depth answer and thanks for taking the time to follow-up.I think its most clear, and we'll take this into consideration for our next architectural decicions.Thanks.Share"


Question: How to load large amount of data from S3 onto Sagemaker?

"I have a notebook on Sagemaker Studio, I want to read data from S3, I am using the code bellow:s3_client = boto3.client('s3')bucket = 'bucket_name'data_key = 'file_key.csv'obj = s3_client.get_object(Bucket=bucket, Key=data_key)df = pd.read_csv(io.BytesIO(obj['Body'].read()))df.head()It works for small datasets but fails along the way with the dataset I'm trying to load which is 15GB.I changed the instance to ml.g4dn.xlarge ( accelerated computing, 4vCPU + 16GiB + 1 GPU), still fails. what am I missing here? Is is about the instance type, or about the code? What is the best way to import large datasets from S3 to sagemaker?Thank youFollowComment"

Answer: "1What is the need to load large dataset onto the notebook? If you are pre-processing then there are better ways to do this - Sagemaker Spark processing job, or have your own spark cluster and process or even possibly Glue. If you are exploring the data, you should just use a smaller data set. If you are loading the data for training, Sagemaker supports different modes to read the data and data doesnt have to be downloaded on the notebook.CommentShareAWS-cm-1462515answered a year agoEXPERTHrushi_Greviewed a year ago1If you want to download the data onto the notebook so that you don't have to load it from S3 each time you want it in Pandas, you should confirm that the volume size is sufficient for the data. It is set to 5 GB by default, which lines up with your scenario.To change this, you'll need to edit your notebook instance, expand the "additional configuration" drop down and look for the "Volume size in GB" field.CommentShareBen_Fanswered a year ago0I have used a much simpler approach to reading a single data file into S3 using pandas.For example:import pandas as pdbucket = 'bucket_name' data_key = 'file_key.csv' df = pd.read_csv( 's3://{}/{}'.format(bucket,data_key) ) df.head()Maybe this will perform better?CommentShareDennis_Aanswered a year agoAWS-User-2055875 a year agotried it, this is the error Im getting:AttributeError: 'AioClientCreator' object has no attribute '_register_lazy_block_unknown_fips_pseudo_regions'ShareTulio Alberto a year agoThis error is a mismatch between pandas and s3fs, try %pip install -U pandas s3fs, then restart kernel and run again. But even faster, I'd try AWS Data Wrangler and replace pd.read_csv with wr.s3.read_csv: https://aws-data-wrangler.readthedocs.io/en/stable/ShareHrushi_G EXPERTa year agoan example of reading in chunks is illustrated here - https://github.com/data-science-on-aws/oreilly_book/blob/workshop/04_ingest/05_Query_Data_With_AWS_DataWrangler.ipynbShare"


Question: AWS CLI ECS WAIT Command in Jenkinsfile

"Hi guys,I've pipeline for creating ecs services. As you know, when you use 'aws ecs run-task' the command does not wait for running process it gives output immedeately. You could use sleep 300 command etc to wait updating ecs status to running state.I found this command on cli aws ecs wait tasks-running --cluster ${clusterName} --tasks ${TASK_ID}But it givesWaiter TasksRunning failed: Waiter encountered a terminal failure stateORWaiter TasksRunning failed: Waiter encountered a terminal failure state: For expression "tasks[].lastStatus" we matched expected path: "STOPPED" at least onceAny idea?FollowComment"


Question: fips-us-east-2.quicksight.aws.amazon.com refused to connect.

"Hi All,I use Quicksight Embed for my customers. Everything has been working perfectly, but all customers are down as of this morning and receiving this error message "fips-us-east-2.quicksight.aws.amazon.com refused to connect."Is there a way for me to test to see if the issue with with the API?FollowComment"

Answer: 0Please contact AWS Support and share details so that you can get faster diagnosis and resolution.CommentShareVijayanswered a year ago


Question: Using External Python Packages on AWS Glue.

"I zipped my custom created python script to my S3 bucket. I updated the bucket path in my job configuration. Even after doing this I am not able to import my script to my Glue Job.Below is error displayed:Traceback (most recent call last):File "/tmp/runscript.py", line 211, in <module>runpy.run_path(temp_file_path, run_name='main')File "/usr/local/lib/python3.6/runpy.py", line 263, in run_pathpkg_name=pkg_name, script_name=fname)File "/usr/local/lib/python3.6/runpy.py", line 96, in _run_module_codemod_name, mod_spec, pkg_name, script_name)File "/usr/local/lib/python3.6/runpy.py", line 85, in _run_codeexec(code, run_globals)File "/tmp/glue-python-scripts-fer1ln57/DocumentDB-Glue-ETL.py.py", line 2, in <module>ModuleNotFoundError: No module named 'test'During handling of the above exception, another exception occurred:Traceback (most recent call last):File "/tmp/runscript.py", line 230, in <module>raise e_type(e_value).with_traceback(new_stack)File "/tmp/glue-python-scripts-fer1ln57/DocumentDB-Glue-ETL.py.py", line 2, in <module>ModuleNotFoundError: No module named 'test'My code details:It is just a function which is printing a string.This is my test script.My main goal is to use external packages to achieve my ETL needs.I tried zipping python files folder which contain python files even uploaded single python file as well but, nothing seem to work for me.FollowComment"

Answer: "0Hi @Nihal-Rainu,Refer the following links to resolve the error - the first link is related to AWS Glue 2.0 and the second link helps address the problem for AWS Glue 1.0 or .9...https://aws.amazon.com/premiumsupport/knowledge-center/glue-version2-external-python-libraries/https://aws.amazon.com/premiumsupport/knowledge-center/glue-job-use-external-python-libraries/Also, the following link describes how AWS Glue lets you install additional Python modules and libraries for use with AWS Glue ETL...https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-python-libraries.htmlAnd finally the following link talks about how you can use a Python shell job to run Python scripts (that are compatible with Python 2.7 or Python 3.6) as a shell in AWS Glue...https://docs.aws.amazon.com/glue/latest/dg/add-job-python.htmlHope this helps.CommentShareamanbajwanswered a year agoEXPERTFabrizio@AWSreviewed a year ago"


Question: Can't install latest cloudhsm-client alongside cloudhsm-pkcs11 or cloudhsm-cli

"On the AWS Linux 2 instances, when I try to run the latest cloudhsm-client, I am getting the following error:Transaction check error:   file /opt/cloudhsm/run from install of cloudhsm-client-3.4.4-1.el6.x86_64 conflicts with file from package cloudhsm-pkcs11-5.7.0-1.el7.x86_64   file /opt/cloudhsm/run from install of cloudhsm-client-3.4.4-1.el6.x86_64 conflicts with file from package cloudhsm-cli-5.7.0-1.el7.x86_64 Why are these conflicting? They all seem to be needed to do what I want.FollowCommentrePost-User-8815139 5 months agoThis seems to be a big problem. Is cloudhsm really early and not ready for use? Each binary is a separate utility, yet you cannot install them on the same machine? Yet the docs routine reference them all.Share"


Question: A KMS key is required to generate data key pair?

I am trying to generate a data key for us to use outside of KMS. Looking at the documentation for this api - https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/kms/client/generate_data_key_pair.htmlIt is showing that KeyId is a required parameter. I am bit confused since the reason why we are generating an asymmetric ECC key pair this way to begin with because we could not create the correct key/usage within standard KMS. Does anyone know what this parameter is referring to?FollowComment

Answer: "1Hi!Data keys are used for Envelope Encryption, where you have a primary key and you create different cryptographic keys to encrypt files, that are related to that primary key. The article linked explains it very well.I think you may be trying to implement asymetric encryption, for that read this article on Asymmetric keys in AWS KMS that explains the usage of asymmetric keys in AWS KMS.If neither of these two answer matches your problem, I ask that you create a new question with a more detailed description of the scenario you are trying to solve, what you tried that didn't work, and any other details that could help us understand and guide you in your architecture.Bests!CommentSharePablo Guzmananswered 2 months agoEXPERTkentradreviewed 2 months ago"


Question: What does logical replication for MySQL mean

"In the documentation regarding blue/green deployments on RDS MySQL it says:The staging environment stays in sync with the current production environment using logical replication.Source: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/blue-green-deployments-overview.htmlIt is not clear for me what does logical replication mean. I was unable to find more information in AWS documentation nor in the official MySQL documentation. Is it statement-based, row-based or mixed? Does it use GTID or is "standard" binlog replication? Are there any pitfalls (e.g. triggers) in using this replication. What schema changes can be tolerated on the green environment? Any further information will be helpful.FollowComment"

Answer: "0RDS supports both physical and logical replication. For MySQL, MariaDb, Aurora MySql Blue Green Deployments RDS uses logical binlog replication. And it will use the binlog_format that is specified for the source database. It will only use GTID if your source database is configured with GTID. And yes you can make schema changes to green but it is your responsibility to not introduce breaking changes to the binlog replication to green. For example you cannot drop a column from a table on the green side because that might break binlog replication.https://dev.mysql.com/doc/mysql-replication-excerpt/8.0/en/replication-features-differing-tables.htmlCommentShareMODERATORphilawsanswered 5 months ago0It's not an easy question to answer in a post like that so I will try to include references to respond where applicable.I know its not your question, but for awareness, the PostgreSQL logical replication is detailed in our documentation [1]. It is native in PG10 or one can use pgLogical.For MySQL, logical replication approaches include Cross-Region Read Replicas, MySQL binlogs, and tools like AWS Database Migration Service (which uses binlogs under the hood).This re:Post article describes how you would set this up [2]. The MySQL documentation details the binlog replication advantages and disadvantages [3].If you use DMS, the documentation describes limitations and best practices worth knowing to plan a migration correctly [4].Finally, this blog post details how to manage a breaking schema change in Amazon Aurora [5].For reference and because you ask about blue-green deployment specifically, this blog post describes the recently released Blue-Green feature in RDS [6] that links to the documentation link you posted. I recommend to go through this blog post [7] as well to understand how the replication works behind the scene.Hope that helps.JonReferences:[1] https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/AuroraPostgreSQL.Replication.Logical.html#AuroraPostgreSQL.Replication.Logical.PostgreSQL-Example[2] https://aws.amazon.com/premiumsupport/knowledge-center/rds-mysql-cross-region-replica/[3] https://dev.mysql.com/doc/mysql-replication-excerpt/5.6/en/replication-formats.html[4] https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html[5] https://aws.amazon.com/blogs/database/upgrade-amazon-rds-for-mysql-or-mariadb-database-schemas-with-minimal-downtime/[6] https://aws.amazon.com/blogs/aws/new-fully-managed-blue-green-deployments-in-amazon-aurora-and-amazon-rds/[7] https://aws.amazon.com/blogs/database/performing-major-version-upgrades-for-amazon-aurora-mysql-with-minimum-downtime/CommentShareEXPERTJonathan_Danswered 5 months ago"


Question: On AWS RDS for Oracle how to install Oracle Database Gateway for SQL Server

"Hello,I need to connect my RDS for Oracle (Managed DB service)  instance with a MS-SQL DB instance hosted on-premise.  Can you please advise how can I proced to  install the " Oracle Database Gateway for SQL Server " inside the RDS  for Oracle  (Managed DB service) .ThanksFollowComment"

Answer: "0Hi,Amazon RDS for Oracle doesn't allow customization of the underlying operating system and databases. But you can use RDS Custom for Oracle to customize the underlying operating system and databases. By using RDS Custom for Oracle, you take benefits of RDS automation with the access needed for legacy, packaged, and custom applications.Please refer to https://aws.amazon.com/rds/custom/CommentShareEXPERTIRONanswered 6 months ago"


Question: KMS policy for cross account cloudtrail

"Hi,i have cloudtrail enabled for the organization in the root account. An s3 bucket in a security account (with kms enabled). All logs from all accounts are hitting the bucket!I know need to enable KMS for cloudtrail, im trying to follow the below guide in terraform:https://docs.aws.amazon.com/awscloudtrail/latest/userguide/create-kms-key-policy-for-cloudtrail.htmlUsing the below code:resource "aws_kms_key" "cloudtrail" {  description             = "KMS for cloudtrail"  deletion_window_in_days = 7  is_enabled              = true  enable_key_rotation     = true  policy                  = <<POLICY{  "Sid": "Enable CloudTrail Encrypt Permissions",  "Effect": "Allow",  "Principal": {    "Service": "cloudtrail.amazonaws.com"  },  "Action": "kms:GenerateDataKey*",  "Resource": "${aws_kms_key.cloudtrail.arn}", # THIS IS THE LINE THAT FAILS!  "Condition": {    "StringLike": {      "kms:EncryptionContext:aws:cloudtrail:arn": [        "arn:aws:cloudtrail:*:xxx:trail/*",        "arn:aws:cloudtrail:*:xx:trail/*",      ]    },    "StringEquals": {        "aws:SourceArn": "arn:aws:cloudtrail:eu-west-2:xxx:trail/organization_trail"    }  }}POLICY}But getting an error that theError: Self-referential block│ │   on kms-cloudtrail.tf line 16, in resource "aws_kms_key" "cloudtrail":│   16:   "Resource": "${aws_kms_key.cloudtrail.arn}",│ │ Configuration for aws_kms_key.cloudtrail may not refer to itself.Im guessing i get the error because the KMS doesnt exist yet so it cant reference it? So is the document wrong? or am miss understanding something regarding it?Any help would be great!FollowCommentemned a year agoCould you try the following in your code: "Resource": "*"Keep in mind (https://docs.aws.amazon.com/kms/latest/developerguide/key-policy-overview.html)NoteDo not set the Principal to an asterisk (*) in any key policy statement that allows permissions unless you use conditions to limit the key policy. An asterisk gives every identity in every AWS account permission to use the KMS key, unless another policy statement explicitly denies it. Users in other AWS accounts just need corresponding IAM permissions in their own accounts to use the KMS key.Share"

Answer: "1Merged the 2 options together with updating the resource as well.for our specific case, it still failed until i added the standed role for admin on it and then access to all the s3 buckets as well.Thanks for the help!CommentSharerePost-User-1319306answered a year ago0Hello, I agree that it is probably because because KMS does not exist. Problem here is within terraform, because when i did a proper configuration I get the following error: Error: Cycle: aws_kms_key.cloudtrail, data.aws_iam_policy_document.kmspolicy It gets a Cycle error as the resources are referencing each-other.So what I suggest you do is that if you want these resources reference each-other (policy and kms resource), you need to create them separately. If you want to do it in an automated way you can create the KMS resource in one module then reference it in another. The policy can not be deployed as it needs a resource to reference.There is nothing wrong with the AWS documentation, however, in this case is it not as easy when dealing with IaC tools like terraform.Here is what i tried to deploy when getting the Cycle Error:resource "aws_kms_key" "cloudtrail" {  description             = "KMS for cloudtrail"  deletion_window_in_days = 7  is_enabled              = true  enable_key_rotation     = true  policy                  = data.aws_iam_policy_document.kmspolicy.json}data "aws_iam_policy_document" "kmspolicy" {  statement {    sid    = "Enable CloudTrail Encrypt Permissions"    effect = "Allow"    principals {      type        = "Service"      identifiers = "cloudtrail.amazonaws.com"    }    actions   = ["kms:GenerateDataKey*"]    resources = ["${aws_kms_key.cloudtrail.arn}"]    condition {      test = "StringEquals"      variable = "aws:SourceArn"      vaclues   = ["arn:aws:cloudtrail:eu-west-2:xxx:trail/organization_trail"]    }  }}CommentShareemnedanswered a year agorePost-User-1319306 a year agoHey, im getting the cycle error with this│ Error: Cycle: data.aws_iam_policy_document.cloudtrailkms, aws_kms_key.cloudtrailShare0Hello,Try setting the following on the line that fails: "Resource": "*"Since this is (presumably) a KMS key policy and refers only to the key that the policy is associated with, it is standard practice to use a wildcard for the resource field. You can see here that the CloudTrail documentation uses a wildcard in their KMS key policy too:https://docs.aws.amazon.com/awscloudtrail/latest/userguide/create-kms-key-policy-for-cloudtrail.html#create-kms-key-policy-for-cloudtrail-encryptYou'll also want to update the policy resource statement to be a "aws_kms_key_policy" resource as per this documentation:https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/kms_key_policyCommentShareKosolanswered 22 days ago"


Question: I need help with Lua scripting in terms of spawning and deleting objects as well as providing an impulse and detecting collision!

I'm just starting in Lua and I'm struggling with the APIs and finding a lack of information the actions I need to implement. I managed to do all this with flowgraph but can't even figure out where to start with Lua.Follow

Answer: "0Accepted AnswerHey @REDACTEDUSERWe should have more Lua documentation soon.SharerePost-User-8353690answered 6 years ago0I have looked at that tutorial. The biggest problem is just lack of API documentation makes things really difficult to get things started. The only other resource seems to be looking at the Lua scripts attached with the samples.SharerePost-User-0525835answered 6 years ago0I understand for sure. Hopefully the LUA API docs will be out before too long. Sorry for the frustrations.SharerePost-User-8353690answered 6 years ago0Hi.Thanks for checking out my previous tutorial, but unfortunately it's pretty basic and out of date as of 1.8. I'm actually planning to make a new one that goes over some of the stuff you're asking about. Kind of like a 'here's lots of cool stuff to do in lau' video.I'll post a link in a few days, but for now, try this: I made a small little script that demonstrates how to add an impulse to a physics object:REMOVEDUPLOADAnd here's a demo of it running:REMOVEDUPLOADOpen a new script, Save the lua file in the dev/Projects folder, this will make it compile and give you a .luac file that you can attach via a lua script component..local luatest = {Properties ={-- properties are editable in the editorSpeed = {default = 10.0},},}---- connect the tick bus when the script activates--function luatest:OnActivate()-- need to connect the tickbus for the ontick functionself.tickBus = TickBus.Connect(self, 0);end---- on tick is called every frame (if the tickbus is connected)--function luatest:OnTick()-- use the physics component bus to add an impulse. Notice the use of self.Properties.SpeedPhysicsComponentRequestBus.Event.AddImpulse(self.entityId, Vector3(self.Properties.Speed,0,0));end---- this will be called when the stops running--function luatest:OnDeactivate()-- disconnect the tick busself.tickBus:Disconnect();endreturn luatestSharerePost-User-5499201answered 6 years ago0Hi @REDACTEDUSERI know you asked the question a while ago and probably already have a solution, but I thought I would add to the solutions provided above for those who come along later.To spawn a dynamic slice (it has to be a dynamic slice), you add a spawner to the entity where you want the object to spawn and add the dynamic slice by dragging it from the Asset Browser to the Dynamic slice field listed in the Spawner.To call the Spawner in Lua script (after you have your bindings):function shoot:OnPressed()SpawnerComponentRequestBus.Event.Spawn(self.entityId)endTo remove the dynamic slice, use:GameEntityContextRequestBus.Broadcast.DestroyDynamicSliceByEntity(self.entityId)I have the Destroy command in a Lua script that is associated with the a dynamic slice projectile.Here is the full projectile script. This also includes a SetVelocity to move the projectile in the forward direction:local shot = {Properties = {force = {default = 1000.0, description = "force applied to shot"},timer = {default = 3.0, description = "timer for projectile"},},}function shot:OnActivate()self.tickBusHandler = TickBus.Connect(self)local shotDir = TransformBus.Event.GetWorldTM(self.entityId)local forwardV = shotDir:GetColumn(1) --returns direction facingPhysicsComponentRequestBus.Event.SetVelocity(self.entityId, forwardV * self.Properties.force)self.tickBusHandler = TickBus.Connect(self) self.timer = self.Properties.timerendfunction shot:OnTick(deltaTime)if self.timer > 0.0 then self.timer = self.timer - deltaTimeelse-- remove projectileGameEntityContextRequestBus.Broadcast.DestroyDynamicSliceByEntity(self.entityId)endendfunction shot:OnDeactivate()self.tickBusHandler:Disconnect()endreturn shotSharerePost-User-1395243answered 5 years ago0Idk if it helps but someone had question on how to spawn player : https://forums.awsgametech.com/t/i-am-having-a-difficult-time-trying-to-get-a-character-to-spawn-and-i-really-need-some-help/4936/1#answer-70030SharerePost-User-7620461answered 5 years ago"


Question: Where does AWS Backup store the EC2/RDS snapshoots it runs?

"Hi Fellows,I have a question that is making me noise:where does AWS Backup store the EC2/RDS snapshoots it runs?that is, where the AWS Backup physically stores that datatnks a lot in advance for your anwser!FollowComment"

Answer: "0The answer is S3 - see this blog. " Backup backs up EBS volumes, EFS file systems, RDS databases, DynamoDB tables, and Storage Gateway volumes to Amazon Simple Storage Service (Amazon S3), with the ability to tier older backups to Amazon Glacier"CommentShareEXPERTPeter_Ganswered a year ago"


Question: Why Lightsail Service Can't Access with RDP ?

"Why Lightsail Service Can't Access with RDP , still stuck in "Connecting to instance"FollowComment"

Answer: 0I can access the Lightsail service with Mozilla Firefox.But not with Chrome.Still stuck on "Connect to instance"CommentShareLuis Ganswered a year ago


Question: ML Training Models - Estimate cost

"How can I estmate the cost for a training model for a small data set, that runs on a continuous basis ? What size comes under a small data set?FollowCommentVictor Ghadban EXPERT3 months agoAmazon SageMaker Instance Recommender will help.  It will recommend the type of instance to use for your job as well as estimates such as cost per hour and many more.   You can get samples on how to use it and more information on it in the link below.https://docs.aws.amazon.com/sagemaker/latest/dg/inference-recommender-recommendation-jobs.htmlShare"

Answer: "0Amazon SageMaker makes it easy to train machine learning (ML) models by providing everything you need to train, tune, and debug models. You are charged for usage of the instance type you choose based on the duration of use.Reference : https://aws.amazon.com/sagemaker/pricing/#On-Demand_PricingIt depends but relatively small  data set can be for example, less than 50–100 GB. See this blog https://aws.amazon.com/blogs/machine-learning/choose-the-best-data-source-for-your-amazon-sagemaker-training-job/ for Choose the best data source for your Amazon SageMaker training job.CommentShareEXPERTAWS-User-Nitinanswered 3 months ago"


Question: Customer looking to migrate current site to Wordpress

"My customer is looking to migrate their current site to wordpress so that it can be updated by non-engineers for example to add new customer testimonials, upload pictures etc. The wrinkle is that their public website also handles shortcuts to their customer systems and also hosts an alternate way for their customers to log in to their system, so it handles a fair amount of traffic by their standards - roughly 500K-1M pages per monthDoes AWS offer a fully managed WordPress solution? There are AMIs in the Marketplace but customer is looking for a hands-off system, where their interaction with WP is via its console.FollowComment"

Answer: "0Accepted AnswerNo. We do not have a "fully managed WordPress solution". Marketplace solutions such as this quickstart https://aws-quickstart.s3.amazonaws.com/quickstart-bitnami-wordpress/doc/wordpress-high-availability-by-bitnami-on-the-aws-cloud.pdf might be of some help. We also offer a tutorial for setting up a site using AWS Elastic Beanstalk: https://aws.amazon.com/getting-started/projects/build-wordpress-website. We also published a whitepaper on Wordpress Best Practices on AWS: https://d0.awsstatic.com/whitepapers/wordpress-best-practices-on-aws.pdfNone of these, however, amount to the kind of "fully managed" solution that it sounds as if your customer requires. In that event they may be better served by seeking out a partner.Hope that helpsCommentShareEXPERTJDBanswered 3 years ago"


Question: Unknown messages

"I'm trying to create an amplify project,We are unable to process your request. Please reach out to your support representative.How to fix it?FollowComment"


Question: Intermittent errors while pushing a pdf to S3 bucket

"Hi,We are using .NET 4.5 to put pdf objects on a S3 bucket. The code is working fine but we are getting intermittent errors for many pdf files. The errors seem random and are not related to file size.Below is the error message:{"ClassName":"System.AggregateException","Message":"One or more errors occurred.","Data":null,"InnerException":{"ClassName":"Amazon.Runtime.AmazonServiceException","Message":"A WebException with status ConnectFailure was thrown.","Data":null,"InnerException":{"ClassName":"System.Net.WebException","Message":"Unable to connect to the remote server","Data":null,"InnerException":{"NativeErrorCode":10060,"ClassName":"System.Net.Sockets.SocketException","Message":"A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond","Data":null,"InnerException":null,"HelpURL":null,"StackTraceString":"   at System.Net.Sockets.Socket.InternalEndConnect(IAsyncResult asyncResult)\r\n   at System.Net.Sockets.Socket.EndConnect(IAsyncResult asyncResult)\r\n   atAny pointers on how to debug this would be great.Thanks,PMFollowComment"

Answer: "0Could be throttling, or other "rare, normal use" errors as described here? - https://aws.amazon.com/premiumsupport/knowledge-center/s3-intermittent-500-internal-error/CommentShareEXPERTskinsmananswered 6 months ago"


Question: Amazon Work Mail DNS settings configuration

"Hi,we are currently using Google Workspace for our emails and and have the DNS settings (MX records etc) in our domain providers accordingly. We want to use Amazon Work Mail for a specific email only. We dont not want to transfer our complete domain to Amazon Work Mail. How do we achieve that? There is a Workmail Configuration MX and CNAME but that Amazon says will transfer all domain. I just tried to set the specific email MX, TX and CNAME but MX is giving error 'Invalid value'FollowComment"


Question: permissions issue with Sagemaker endpoint deployment

"Hi there,I am having permission issue deploying a SageMaker Endpoint, if someone could help me out here.If I run this code in Sagemaker's Jupyter Notebook without providing credentials for boto3 client, it works. However if I try to invoke it with my credentials on my local machine, it gives me permission error, even though my account already was given all Sagemaker permissions.ClientError: An error occurred (AccessDeniedException) when calling the InvokeEndpoint operation: User: arn:aws:iam::XXXXXXXXXXXX:user/jenny.lien is not authorized to perform: sagemaker:InvokeEndpoint on resource: arn:aws:sagemaker:us-east-1:249707424405:endpoint/XXXXXXXX with an explicit denyThis stackoverflow post has exactly the same issue as what I've experienced, I tried disable MFA for my IAM user but it is still not working...does it mean I will also have to create a special IAM  user to make it work? thank youhttps://stackoverflow.com/questions/54172907/amazon-sagemaker-accessdeniedexception-when-calling-the-invokeendpoint-operatioFollowComment"

Answer: "0Hey there,Odd that you are still running into this issue after turning off MFA. I usually debug issues with IAM by creating a new user that is cleared from all other settings. Have you tried that approach yet?Also, if you're looking for a no-code option to create an HTTP API for a Sagemaker endpoint, checkout https://Booklet.ai. If you point Booklet.ai to your endpoint, it will handle these invoke calls. From there, it will wrap your model endpoint in an HTTP API, provide a responsive web demo form, and more. You can bypass this invoke function.Hope this helps!CommentShareadambookletaianswered 3 years ago0just wanted to update that I didn't turn of MFA the proper way. After doing so it works now. Thanks!CommentShareawsjennyawsanswered 3 years ago"


Question: EC2 outbound bandwidth dropped on July 21st and stays very low (eu-west-1)

"Hello,In our organization, we run our CICD using gitlab. We spawn runners on demand and each runner is a EC2 instance.Since July 21st, the uploads performed by these runners got their duration multiplied by ~10.From our tests, we see that:outbound bandwidth from any instance type and any AMI we can spawn in eu-west-1 is now <2,5Mb/s (~300KB/s),we tested t3.medium and m6a.large,we tested various AMIs (ubuntu, amazon linux),this seems far from any quota/limit/advertised bandwidth,before July 21st, it was around 25Mb/s (~3MB/s) for t3.medium runners,download speed is 500Mb/s,upload/download target is the gitlab server host itself,located in Paris,can be reached through 2 different physical connections and we get very good speed from other places,all speed tests mentioned here are performed using iperf3,runners are in a VPC, routed through an Internet Gateway,if we spawn a runner in eu-west-3, outbound speed is 24Mb/s (and download is 1Gb/s),that's not great, but at least it’s 10 times what we get in eu-west-1 (and close to what we had before “the incident”).we haven’t changed a thing regarding our configuration, runners, gitlab version, code. The problem happened suddenly for pipelines run after July 21st, 4pm cest,We may consider spawning our runners in eu-west-3, or even move our gitlab server on EC2, but since 1) the problem happened suddenly without any action on our side and 2) this would require moving other resources as well, time, effort and cost, we’d rather prefer a logic explanation of what’s happening here before taking actions.We are looking for clues to understand:how to monitor this in order to identify if we actually reach a limit/quota,why this changed suddenly,why outbound bandwidth is that low (is that to be expected, or not).Any help investigating would be greatly appreciated!Best,EDIT: adding MTRHOST: runner-5nsscsoo-project-32- Loss%   Snt   Last   Avg  Best  Wrst StDev  1.|-- ip-172-17-0-1.eu-west-1.c  0.0%    10    0.0   0.1   0.0   0.1   0.0  2.|-- ec2-3-248-240-211.eu-west  0.0%    10    4.0  11.9   0.7  72.0  21.3  3.|-- 240.1.116.13               0.0%    10    0.3   0.3   0.3   0.5   0.1  4.|-- 240.1.116.30               0.0%    10    0.3   0.3   0.2   0.3   0.0  5.|-- 240.1.116.8                0.0%    10    0.3   0.3   0.3   0.3   0.0  6.|-- 240.1.108.8                0.0%    10    0.3   0.3   0.3   0.4   0.0  7.|-- 240.1.108.22               0.0%    10    0.3   0.3   0.3   0.4   0.0  8.|-- 240.1.108.3                0.0%    10    0.3   0.3   0.3   0.4   0.0  9.|-- 242.3.201.129              0.0%    10    0.7   0.7   0.3   2.1   0.5 10.|-- 100.95.19.135              0.0%    10    1.1   3.0   0.2  16.0   5.4 11.|-- 100.100.20.32              0.0%    10    0.5   2.7   0.3  13.2   4.0 12.|-- 100.91.209.9               0.0%    10   11.0  12.9  10.9  25.0   4.5 13.|-- 100.100.6.57               0.0%    10  119.7  21.6  10.5 119.7  34.5 14.|-- 100.100.81.134             0.0%    10   12.1  10.7  10.5  12.1   0.5 15.|-- 100.100.81.133             0.0%    10   11.4  14.4  11.3  41.4   9.5 16.|-- 100.100.4.104              0.0%    10   11.5  11.9  11.4  14.8   1.0 17.|-- 195.66.226.94              0.0%    10   17.9  17.8  17.7  17.9   0.1 18.|-- cbv-pa7-n5k2-core-01.cele  0.0%    10   17.7  17.7  17.6  17.8   0.1 19.|-- par-gsp-n5k1-pe-01.celest  0.0%    10   16.9  16.8  16.7  17.0   0.1 20.|-- REDACTED.in-addr.a         0.0%    10   16.3  16.4  16.3  16.5   0.0FollowCommentlp901 9 months agoAre the servers in a public subnet or in a private subnet via a NAT? If its a NAT backed by an instance is that showing any issues? If its a T class does it still have compute credits left? What does an MTR look like for the remote host you are testing against? Large hop times, packet loss, high RTT?SharerePost-User-0170059 9 months agoThanks for your answer.The subnet is configured to auto-assign public IPv4 address, and uses an IGW. Does that answer your 1st question?The CPU credit balance is 0 with only one point of measure. But instances are spawned on demand by gitlab, how can they start with 0?Note that we had the same issue with a fresh m6a.large instance (that has no compute credits, right?)MTR in next commentSharerePost-User-0170059 9 months agoNew info: the credit balance increases with time, but the upload is still slow (no change at all).SharerePost-User-0170059 9 months agoIt's impossible to post a MTR in comments (blocked by rePost), so I've added it at the end of the question.Note: it's the MTR from the instance (to the server)Share"


Question: Overview of active services

Hi!I was wondering if there is a place to find all the active services and their costs? I just launched a new instance and want to get an overview of all the associated costs.Thanks in advance!FollowComment

Answer: "2If you are looking for information about how much the services you are using cost you, there are a few tools for that, and you can choose which one works better for you, depending on the level of details you need.I'd suggest you can use Cost Explorer for this - https://aws.amazon.com/aws-cost-management/aws-cost-explorer/ - it's a free tool if you simply use it in the console... (if you decide to query it programmatically, there may be extra charges for API calls that you'd be executing). You can Launch Cost Explorer from your billing console. Play around with filters and grouping options - the interface is quite intuitive. You can, for example, group by service; you can filter out specific services, and then group by usage types to dive deep.However, if you want to see cost associated with each individual resource (e.g. let's assume you run 100 instances, and you want to know how much each costs you), the best way to do it would be through Cost and Usage Report (CUR) - https://docs.aws.amazon.com/cur/latest/userguide/what-is-cur.html - you can create CUR with monthly, daily, or hourly granularity, and enable resource IDs column, to get to the most granular level of details about your billing.CommentShareEXPERTNataliya_Ganswered 3 months agoEXPERTTushar_Jreviewed 3 months ago-1Hi,The service costs depends on the size, tier and various factors. The best place for you to estimate your costs for all the services that you would want to use is to look at Pricing Calculator: https://calculator.aws/#/ and you can create an estimate, and also you will get a view of all the services that are available across various regions. Not all services appear on all regions - so please check the region before you search for a service.ThanksArunCommentShareArunanswered 3 months agorePost-User-8875557 3 months agoThanks! Is there some way to see everything that is active at this moment?ShareArun 3 months agoHi, can think of 2 approaches,Check it on the AWS products/Featured services public page here: https://aws.amazon.com/products/?nc2=h_ql_prod_fs_f&aws-products-all.sort-by=item.additionalFields.productNameLowercase&aws-products-all.sort-order=asc&awsf.re%3AInvent=*all&awsf.Free%20Tier%20Type=*all&awsf.tech-category=*allYou can view then ones that are GA and the ones are in previewLogin to your AWS console, and click on 'Services'. Under 'Services', click 'All Services'. In the right hand pane, click on 'View all services'. This will list down all the services available to youHope this helpsShare"


Question: Transferring files to my server

My EC2 instance is running Ubuntu. I find that AWS Instance Connect meets my needs except for transferring files between the server and my local computer where I need something like FileZilla as I find the GUI necessary for that task. Is there an alternative that I could use which does not require me to manage SSH keys? I am trying to cut down the admin involved in maintaining my server because I am 'out of my depth' with most of it and FileZilla is the only thing I need SSH keys for given that I can use Instance Connect for everything else. I think I could use a password instead of SSH keys with FileZilla but it would be even better to if there was something available from the AWS console which I do know how to sign into.FollowComment


Question: AWS Certificate Manager: Certificates won't renew "Additional verification required to request ..." .ru domains

"Hi,We have the "Additional verification required to request certificates for one or more domain names in this request."-Error on two certificates with .ru domains involved.Is there some official answer to this problem, as we are not the only ones as it seems?(No we don't have a support plan on this account, so I can't open a case)FollowComment"

Answer: "0Hello,I am sorry to hear this is happening. This doc should assist with the error you are encountering: https://docs.aws.amazon.com/acm/latest/userguide/troubleshooting-failed.html#failed-additional-verification-required— Brian D.CommentShareEXPERTAWS Support - Briananswered a year ago"


Question: What is the input/output bandwidth limits for ECS Fargate tasks?

For EC2 there are clear explanations about network bandwidth for different instances. What about ECS Fargate?I managed to find only that article with some benchmark - https://www.stormforge.io/blog/aws-fargate-network-performance/ so far.What is the guaranteed and maximum network bandwidth for Fargate tasks? Does it depend on number of vCPU/Memory?FollowComment

Answer: "0The network bandwidth limit is something which is not published as we cannot be deterministic about it. In general, more vCPU should get you greater network bandwidthCommentSharePiyushMattooanswered 2 months ago"


Question: Error when deploying an AWS example stack

"HiI am deploying the "Demo Stack" available here :https://docs.aws.amazon.com/solutions/latest/aws-service-catalog-validation-pipeline/demo.htmlParameters:Email address for SNS notifications - I provided mineOptional ARN for role - left blankError:ServicesCREATE_FAILEDEmbedded stack arn:aws:cloudformation:us-east-1:XXXXXXXXXX:stack/DEMO3-AWS-SCValidationPipeline-Demo-Services-98QRJWO5OE2/11dfbce0-32d1-11e9-93a9-0a437bda7b86 was not successfully created: The following resource(s) failed to create: GenerateReportLambda, DeployToS3Lambda, ProvisionProductsLambda.It is not clear what permissions is missing -- so I am not able to proceed from here.Any help is appreciated. Thanks!Edited by: Zoltar on Feb 17, 2019 6:09 PMFollowComment"

Answer: 0Nevermind .. I was able to overcome this. If this helps anyone:The "Events" list of this stack was not helpful but the error came from a nested/embedded stack creation.I was able to click on the corresponding stack in the "resources" tab and in turn look at the list of all events in that stack creation -- and spot the detailed error events there.It turns out there was a validation error on the LENGTH of a value that ended up becoming too long (longer than 64 characters) as it was constructed using the stack name I supplied appended with some other strings.I simply had to use a shorter name for my stack and it worked :)Turned out to be a rather trivial issue in the end.CommentShareZoltaranswered 4 years ago


Question: Storage increased but not able see in RDP

"I have increased the storage size from 30GB to 32 GBI can see in the instance, the size is increased, but in RDP,  it still show 30GBFollowComment"

Answer: "3Accepted AnswerTo make the new storage space available in your RDP session, you'll need to extend the partition on the operating system level.To do ThisAfter RDP Open Computer Management > Disk Management > Find the disk that you've resized (usually Disk 0) and look for the unallocated space next to the partition you want to extend. > Right-click on the partition you want to extend (usually the "C:" drive), and choose "Extend Volume." >It should automatically select the maximum available space for the extension. Click "Next" to continue.CommentShareEXPERTsdtslmnanswered 2 months ago"


Question: Ground Truth UI not displaying properly

"When creating a Ground Truth labelling job, some of the files in S3 are not displaying in the browser. The files (.png image and .flac audio file) are available in S3 and are able to be seen / heard when downloaded. Any ideas on what is wrong?FollowComment"


Question: Antivirus alert on mysql database connection string

"I want to create an app that can connect to a database I already created (aws). I am using visual studio (vb.net). Now the problem I have is the the connection string I am using to connect to database is blocked from my antivirus. So I need to disable antivirus to be able to run my app and that is in development.I tried different databases from other providers and I had no issue at all. Does anyone know why is this happening? I mean I am worried that I won't be able to use aws for my app if any user uses my app get's alerted from their antivirus that my app is malicious. And I am not talking about a complete app, I just started it, and even with connection string code only my antivirus goes crazy.FollowComment"

Answer: "0Which AWS database are you trying to access, and what port is blocked? Can you see whether your antivirus can be configured to allow the database port?CommentShareDavid Pallmannanswered 9 months ago0I am trying to create a vb.net app. The issue is that antivirus sees the app as malicious every time I try to run with a connection string for rds database from amazon, but I have no issue at all in different databases (not amazon). I can access rds amazon with mysql workbench with no issue, but when I try to do that with the app (which is executable) the antivirus delete the app every time its running with amazon rds connection string. If I use other database host I have no issue at all with my antivirus.CommentSharenikosthe15nanswered 9 months ago"


Question: Unrecognized text

"Is there an option for textract to return that something exist in the field like a handwritten signature even though textract can't OCR to readable text?  If there is no such option to do this, can this be added as a future enhancement?FollowComment"

Answer: "0Thank you for using Textract. Note that there’s no such option for textract to return something that exist in the field like a handwritten signature and Textract currently does not support extraction of handwritten signature feature yet.However, please note that the Textract team continuously updates the model to improve the quality and include more feature as per the users requirements.The Textract model may not be working for this use case. However, Please note the Support for signatures will be included on the roadmap for upcoming releases. Unfortunately, we can't disclose the product roadmap here.Please look out for announcements regarding our future release and launch updates that are announced on the AWS Textract public release channel.CommentSharerePost-User-2363309answered 7 months ago"


Question: ERROR:  Dist auto table is not supported.

"When I issue a CREATE TABLE with DISTSTYLE AUTO, I receive the error message "ERROR: Dist auto table is not supported." EVEN, KEY, and ALL work as expected. We are on Version 1.0.6145 in us-east-1. How can I use AUTO?FollowComment"

Answer: "0Accepted AnswerIt is not yet available in your region but you can try your test again after your next maintenance window to see if it has been enabled for you.Sorry for the confusion around this, but the feature has been enabled per region separately from the version upgrade to ensure that it can be closely monitored.We expect the feature to be fully deployed soon and we will add a note in the announcement when it is available in all regions.CommentShareAWS-User-2965899answered 4 years ago0The docs indicate AUTO should work, so you appear to have uncovered a bug.You can still use AUTO by not specifying a diststyle at all.  The default style, in the absence of a user-specified style, is AUTO.CommentShareToebs2answered 4 years ago0If I don't specify a style, the database sets it to EVEN.CommentSharecpl928answered 4 years ago0Yes.This is because (see Joe's post) this functionality is not yet active in your region.CommentShareToebs2answered 4 years ago0DISTSTYLE AUTO is now fully enabled in all regions.CommentShareAWS-User-2965899answered 4 years ago"


Question: YoY and MoM metrics up to certain day of year or month in QuickSight

"MoM (Month over Month) KPI visual in QuickSight compares this month to last month, but using all the dates available for each month. How do you compare MTD over MTD? This is, this month up to date vs. the last month up to the same date, not the full month.For example, you have all order sales with dates for October up to day13th (the most recent), and sales for September whole month. Sales for October from day 1 to 13 totals $30,000. But sales for whole September adds up to $90,000. When comparing MoM this shows that October is worst than September. Need to compare October sales from 1-13 vs September sales from 1-13, as this will show October (up to 13th) = $30,000 but September (up to 13th) = $25,000. So, in an equivalent time period October has more sales than last month.Same case for comparing this year sales (up to the current day) vs last year (up to the equivalent date), so it is really comparable.How can a KPI comparison make this calculation? Or what calculated field has to be created?FollowComment"

Answer: "1There is no direct way of doing this in QuickSight, but you can use QuickSight functions in a calculated field to accomplish what you're trying to do.  This example will target your Month-over-Month calculation, but could be used for Year-over-year as well.  These calculated fields can be part of a dataset or part of an analysis.  I suggest testing in an analysis before you alter your dataset.First you will need to create a calculated field to track the running sum for the month, using the runningSum function.  You will likely need to include other partitions if those are relevant to your dataset.  https://docs.aws.amazon.com/quicksight/latest/user/runningSum-function.htmlrunningSum(  sum({sale_amount}),   [truncDate("DD",{sale_date}) ASC],   [truncDate("MM",{sale_date}), truncDate("YYYY",{sale_date})])Now that was the easy part.  You should now have a field that is keeping track of your month-to-date value that will be used in the next field for comparison.  The MoM calculation can be done using difference or percentDifference depending on what you're trying to show.  This next calculated field is using the previous calculated field, which I named "Running Sum (Month)". https://docs.aws.amazon.com/quicksight/latest/user/difference-function.htmldifference(  {Running Sum (Month)},  [{sale_date} ASC],  -31,  [])Ok, that doesn't look so bad, but there's a problem, not all months have 31 days, so the index must be updated.That should be easily accomplished using a dateDiff function, right? https://docs.aws.amazon.com/quicksight/latest/user/dateDiff-function.htmldateDiff({sale_date},addDateTime(-1,'MM',{sale_date})However, if you give that a try QuickSight will return an error concerning the format of the "index" parameter for the difference function.  The workaround makes the final result a little more complex.  We workaround the problem by using another two functions, ifelse and avgIf, to give us a case statement depending on the MoM date comparison and the number of days in the previous month. https://docs.aws.amazon.com/quicksight/latest/user/ifelse-function.html & https://docs.aws.amazon.com/quicksight/latest/user/avgIf-function.htmlifelse(avgIf(dateDiff({sale_date},addDateTime(-1,'MM',{sale_date})),dateDiff({sale_date},addDateTime(-1,'MM',{sale_date}))=-31)=-31,difference({Running Sum (Month)},[{sale_date} ASC],-31,[]),avgIf(dateDiff({sale_date},addDateTime(-1,'MM',{sale_date})),dateDiff({sale_date},addDateTime(-1,'MM',{sale_date}))=-30)=-30,difference({Running Sum (Month)},[{sale_date} ASC],-30,[]),avgIf(dateDiff({sale_date},addDateTime(-1,'MM',{sale_date})),dateDiff({sale_date},addDateTime(-1,'MM',{sale_date}))=-29)=-29,difference({Running Sum (Month)},[{sale_date} ASC],-29,[]),avgIf(dateDiff({sale_date},addDateTime(-1,'MM',{sale_date})),dateDiff({sale_date},addDateTime(-1,'MM',{sale_date}))=-28)=-28,difference({Running Sum (Month)},[{sale_date} ASC],-28,[]),NULL)It's not pretty, but it might work for you.Lastly I wanted to make sure you were aware of QuickSight Insights Period over Period Computation and Period to Date Computation.https://docs.aws.amazon.com/quicksight/latest/user/period-over-period-function.htmlhttps://docs.aws.amazon.com/quicksight/latest/user/period-to-date-function.htmlThese might be worth investigating as well, keeping the above guidance in mind.CommentShareMatthew_Banswered 2 years ago"


Question: Parser failed with error

"Our parser written in NodeJS failed with the following error.This error occurred at around the same time that a new release of the AWS SDK waS released. Could this be the cause of our error?If yes, how can we make sure we do not face such a situation in the future?If not, what else could be the issue?P.S. let me know if I can provide further detailsFollowComment"

Answer: "0From the error, I understand that you are using a variable named 'aws' which is not declared in your code possibly. In case you are using AWS SDK for JavaScript, kindly ensure that you have declared the variable while performing any API operation. For example,var aws = require("aws-sdk");...aws.config.update({region: 'REGION'});var ddb = new aws.DynamoDB({apiVersion: '2012-08-10'});Please note that the variables are case-sensitive.As you have mentioned that this error occurred at the same time of new release AWS-SDK could you please confirm about the new version you are referring to?CommentShareSowjanya_Banswered 8 months ago"


Question: local configuration setting to sent data from local .Net to MSK cluster through SASL/SCRAM

"HiI wonder how to  send data from local .Net application to AWS MSK?(I have  enabled public access to the cluster after creating the MSK cluster, I have meet conditions to activate: Public subnet, Secure authentication and encryption are introduced in this https://docs.aws.amazon.com/msk/latest/developerguide/public-access.html)Any configuration needed to be done in the local client side?I have download kafka locally, how to send data through kafka to MSK cluster?ThanksFollowComment"


Question: Can you create AWSBehavior API calls from C++?

"Hi,Is the feature of creating api calls with the CloudGemAWSScriptBehaviors intended to only be used by Lua? I am having trouble instantiating a CloudGemAWSScriptBehaviors::AWSBehaviorAPI class to begin structuring an API call and was curious if this was a feature intended for C++ or strictly for Lua.My personal gem is currently connected to the APINotificationBus and am able to override the pure virtual functions such as GetResponse, OnError, and OnSuccess.Error when trying to instantiate an API class:Creating library c:\Amazon\Lumberyard\1.13.0.0\dev\Bin64vc140\Gem.IwMMO.de27effa01ec4b18ba00cd993b8adb63.v0.1.0.lib and object c:\Amazon\Lumberyard\1.13.0.0\dev\Bin64vc140\Gem.IwMMO.de27effa01ec4b18ba00cd993b8adb63.v0.1.0.expLoginManagerSystemComponent.cpp.162.obj : error LNK2019: unresolved external symbol "public: __cdecl CloudGemAWSScriptBehaviors::AWSBehaviorAPI::AWSBehaviorAPI(void)" (??0AWSBehaviorAPI@CloudGemAWSScriptBehaviors@@QEAA@XZ) referenced in function "protected: virtual void __cdecl IwMMO::LoginManagerSystemComponent::GetPlayerProfile(int)" (?GetPlayerProfile@LoginManagerSystemComponent@IwMMO@@MEAAXH@Z)c:\Amazon\Lumberyard\1.13.0.0\dev\Bin64vc140\Gem.IwMMO.de27effa01ec4b18ba00cd993b8adb63.v0.1.0.dll : fatal error LNK1120: 1 unresolved externalsFollow"

Answer: "0Accepted AnswerHi @REDACTEDUSERSo after digging a little more into this, you would need to add an ebus handler to the AWSScriptBehavior gem to set those variables. Given that the AWSScriptBehavior is mainly a wrapper around the AWS C++ sdk functions to make them available to Lua and Scipt Canvas you might just want to call the C++ functions rather than use the AWSScriptBehavior.Hope that helpsSharerePost-User-7982698answered 5 years ago0Hi @REDACTEDUSERAll ebuses are accessible in C++, functions that are refelcted to the behavior context are accessible in Lua and Script Canvas as wellEx: the ones reflected in void AWSBehaviorHTTP::ReflectBehaviors(AZ::BehaviorContext* behaviorContext)Just to be sure you have the CloudGemFramework and CloudCanvasCommon dependencies in your project as well right?dev\Gems\CloudGemAWSScriptBehaviors\gems.json.SharerePost-User-7982698answered 5 years ago0Hi naotoy,Thanks for posting! From my understanding that class was intended to allow developers to execute service API's directly from LUA. I'll confirm with the rest of the team and get back to you on Monday.Cheers!SharerePost-User-7717892answered 5 years ago0Hi @REDACTEDUSERI do have both of those dependencies included and have my handlers set as well as the pure virtual functions in place to receive notifications.Could you possibly explain to me how you would do the C++ equivalent of this Lua example?        local apiCall = AWSBehaviorAPI()apiCall.ResourceName = "myResource.ServiceApi"apiCall.Query = "/my/personal/api/path/"apiCall:Execute()I imagined it would have been with utilizing the 'CloudGemAWSScriptBehaviors::AWSBehaviorAPI' class from 'Gems\CloudGemAWSScriptBehaviors\Code\Source\AWSBehaviorAPI.h' looking something like this:const CloudGemAWSScriptBehaviors::AWSBehaviorAPI apiCall;apiCall.m_resourceName = "myResource.ServiceApi"apiCall.m_query = "my/personal/api/path"apiCall.m_httpMethod = "GET".. or something like that?SharerePost-User-5509042answered 5 years ago0Hi @REDACTEDUSERMakes a lot of sense! Thank you!SharerePost-User-5509042answered 5 years ago"


Question: How to efficiently retrieve tokens from Cognito while using amplify with react-native ?

"I am creating an app using Amplify with react-native. For backend, I am using Cognito token for current user using Auth.currentSession(). The issue with this approach is that every time i need to call backend server, I need to call Auth.currentSession(). Is there any other approach I can use apart from increasing token validity ?FollowComment"

Answer: "0Hello, thank you for your question. As I understand, you wish to retrieve access tokens from Cognito without needing to continuously call Auth.currentSession(). After the initial Auth.currentSession() call, JWT tokens can be retrieved from your local cache by utilizing the Cache module. Please refer to the link below for examples and additional information.https://docs.amplify.aws/lib/auth/advanced/q/platform/js/#retrieve-jwt-tokensCommentShareArthur_Vanswered 9 months ago"


Question: Aurora Postgres cluster failed to upgrade from 13.4 to 13.4.2 at maintenance window

"Hi,I am have an info in the console that upgrade is available. When I am clicking on - apply at next maintenance window. It does not work. After maintenance window time is over I still see that upgrade is available? Is it a global issue?FollowComment"

Answer: "0Accepted AnswerIssue was with stepfunction, that disables RDS at nights.CommentSharemyronix88answered 7 months ago0Hi,The issue might be that you have set your preferred maintenance window options correctly but maintenance takes place every after 7 days. I believe that it is not a global issue.There are also two types of versioning namely  minor and major version. A major engine version upgrade can introduce changes that are not compatible with existing applications. While a minor upgrade includes only changes that are backward-compatible with existing applications. A minor engine version is an update to a DB engine version within a major engine version and updates can be automatically applied by RDS.When creating you database under additional configuration navigate to Maintenance make sure that auto minor version upgrade is enable by enabling auto minor version upgrade will automatically upgrade to new minor versions as they are released. The automatic upgrades occur during the maintenance window for the database. So you need to select the period you want pending modifications or maintenance applied to the database by Amazon RDS do specify a preferred maintenance window when you create the DB instance, by selecting “choose window” and set time and duration of your choice. Then  create your database.Please kindly refer to the following documents for more Information about operating system updates for RDS for PostgreSQL : https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_UpgradeDBInstance.Maintenance.html and https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_UpgradeDBInstance.PostgreSQL.html#USER_UpgradeDBInstance.PostgreSQL.MajorVersionThank you.CommentSharePhindianswered a year ago0Hi. I raised this error with AWS team. I am waiting for a resolution.CommentSharemyronix88answered 9 months ago"


Question: Kinesis Stream Best Practices and Calculations

"A customer is looking at increasing consumers for our Kinesis Stream.Currently they have a consumer script that polls every min, which they want to add firehose to consume as well.What are the constraints and limits that they should be looking out for, and how to calculate the optimal number of shards required to support the increased number of consumers?Is this approach even correct?FollowComment"

Answer: "0Accepted AnswerI came across this Kinesis Shard Calculator which takes inputs as number of Consumers, Message Size, Throughput, Consumption speed and then recommends the number of Shards. Try it !!https://comcastsamples.github.io/KinesisShardCalculator/Amazon Kinesis Data Streams has the following stream and shard quotas and limits.There is no upper quota on the number of streams you can have in an account.The default shard quota is 500 shards per data stream for the following AWS regions: US East (N. Virginia), US West (Oregon), and Europe (Ireland). For all other regions, the default shard quota is 200 shards per data stream.To request the shards per data stream quota increase, follow the procedure outlined in Requesting a Quota Increase.A single shard can ingest up to 1 MB of data per second (including partition keys) or 1,000 records per second for writes. Similarly, if you scale your stream to 5,000 shards, the stream can ingest up to 5 GB per second or 5 million records per second. If you need more ingest capacity, you can easily scale up the number of shards in the stream using the AWS Management Console or the UpdateShardCount API.The maximum size of the data payload of a record before base64-encoding is up to 1 MB.GetRecords can retrieve up to 10 MB of data per call from a single shard, and up to 10,000 records per call. Each call to GetRecords is counted as one read transaction.Each shard can support up to five read transactions per second. Each read transaction can provide up to 10,000 records with an upper quota of 10 MB per transaction.Each shard can support up to a maximum total data read rate of 2 MB per second via GetRecords. If a call to GetRecords returns 10 MB, subsequent calls made within the next 5 seconds throw an exception.CommentShareRahul Pawaranswered 3 years ago"


Question: Error metadata loading was interrupted because of data fetching issues

"Hi there,In an attempt to migrate a local MS SQL Server 2017 database of ~40GB to AWS RDS (Aurora in Postgres mode) I am getting error at the stage where the source database metadata discovery occurs:Metadata loading was interrupted because of data fetching issues. For details, see the logThis happens fairly quickly, roughly after 20 sec. I use AWS SCT locally where the database resides using the latest JDBC drivers.FollowComment"

Answer: "0I perceive it as the SCT bug unable to proceed in case the collation of a database is different from the server instance.This is because I see this error in the log:Error executing 'get-server-config' query: com.microsoft.sqlserver.jdbc.SQLServerException: Cannot resolve the collation conflict between "SQL_Latin1_General_CP1_CI_AS" and "Latin1_General_CI_AS" in the equal to operationSo my server was on the SQL_Latin1_General_CI_AS, but the database on the Latin1_General_CI_AS collation which is a valid setup in my view. Alas, the tool can't support this simple case.Remedied byALTER DATABASE <name>COLLATE SQL_Latin1_General_CP1_CI_AS; CommentSharearthurzubarevanswered 3 years ago"


Question: Jupyter Notebook

"I want to start a Jupyter Notebook instance, then load a ipynb file I have uploaded into a bucket. How do I this? I have never been able to initiate Sagemaker as of yet.FollowComment"

Answer: 0You can follow this tutorial to start a Jupyter Notebook instance on SageMaker. Once the instance is running and you are in the notebook environment you can upload your ipynb file.CommentShareHeikoanswered 9 months ago0You can also try the free service AWS SageMaker Studio Lab https://studiolab.sagemaker.aws/CommentShareEXPERTMassimilianoAWSanswered 9 months ago


Question: Devices can't connect to IoT Core

"Hello,My devices can't establish mqtt connection to IoT Core in Oregon.  ioT Core reports connection lost.{"clientId": "","timestamp": 1639587896509,"eventType": "disconnected","clientInitiatedDisconnect": false,"sessionIdentifier": "","principalIdentifier": "","disconnectReason": "CONNECTION_LOST","versionNumber": 64}Any idea what is going on?FollowComment"

Answer: "0Accepted AnswerThis was an internal issue, and AWS IoT Core team took almost 5 hours to resolve.Very bad again, not sure what is happening to AWS lately.CommentSharegiovanianswered a year ago"


Question: S3 Public & Private Access using the JavaScript SDK

"Hi!I'm looking to implement the aws-sdk on my web application with 2 layers of security.Some images should be publicly accessible (For example company logos). This is to prevent needing to re-authorise images constantly on each page loadSome images should be private and only shown if authorised (e.g more confidential images relating to a company)Is there a better way for me to do this? If not, with my current setup it appears that even when I set CannedACL to private it always has the object set to public when in S3. I've attached my configuration and usage below, any help would be really appreciated!Thanks!FollowComment"

Answer: 0Option 1: You could do subfolders for the s3 buckets one for the public and one for private and set the bucket policy open for the public and internal for private.Option 2: You could also use two separate S3 buckets. One for public assets and one for private assets You don't pay by the bucket so no big deal to have two buckets.Note: It may be better to go with option 2 so you don't accidentally modify the S3 bucket policy to allow access to the private side. I like to separate mine so I can have public access turned off on the private one. Then I provide access to the items in the private bucket with IAM.CommentShareEvananswered 5 months ago


Question: "Learning Cloud computing, which service is for me?"

"So my development background has been backend C++ for the last 10 years, so I like to think I'm pretty proficient in coding but I have almost 0 experience in Cloud or container style projects.In an attempt to learn and do a cool project I came up with an idea to have some kind of distributed gaming experience.The idea is thus, my friends can go to my website and using HTML5 gamepad API be able to use their gamepads to send their gamepad state to a server. The server can take the avg of all these states to create an "avg" state of the controller which will then be sent to the game.The first pass is obviously going to have the game be on my own local computer so I'll need some way for the html page to talk to the server, and for the server to send the gamepad state to my local computer.I'm very new to Cloud and AWS so I just kinda need an idea of what kind of AWS services I should use to build this thing. (Also note, because I'm learning I'm still using the free tier)Note: To also learn about web development, it would be cool if my friends have to login to my website to be able to send their controller state, so some kind of credentials would be nice to have.FollowComment"

Answer: "1Accepted AnswerThere are a lot of great articles on the AWS blog detailing how you can accomplish something like this.  While they may not be exact/specific to your use-case, you can piece together multiple articles to set up a solution.[How to build online multiplayer games using Amazon GameLift, AWS Serverless, and C++](https://aws.amazon.com/blogs/gametech/online-multiplayer-amazon-gamelift-aws-serverless/)[Building a serverless multi-player game that scales](https://aws.amazon.com/blogs/compute/building-a-serverless-multiplayer-game-that-scales/)[Creating Servers for Multiplayer Mobile Games with Just a Few Lines of JavaScript](https://aws.amazon.com/blogs/gametech/creating-servers-for-multiplayer-mobile-games-with-amazon-gamelift/)While this is not a direct answer to your question, there are so many resources available to help guide you in your AWS journey.  I would recommend watching through some of the free training videos on the basics of AWS before diving in so that you have some of the fundamentals down before getting your hands dirty.Here are some good resources for getting started:AWS Getting Started GuideAWS Skill BuilderCommentShareEXPERTChris_Ganswered a year agoAWS-User-1574651 a year agoHonestly, this is all I really wanted, there's just so much breadth in terms of AWS and Cloud that I'm a little overwhelmed with where to start.I'll definitely start out with those links thanks Chris.Share"