Question: Shader Compiler unauthorized ip trying to connect add it to whitelist in config.ini

"Today wanted to try building for android , but I got stuck with shader compiler giving me this message.my phone and pc are on the same network but there seems to be some kind of protection that point to a config.ini file I didn't found.Follow"

Answer: "0Accepted AnswerHello @REDACTEDUSERThe remote shader compiler now requires that any IP addresses to be whitelisted before it will allow the device with that IP address to connect to it. This was done to improve the security of the remote shader compiler.To resolve this all you need to do is create a config.ini file in the same directory as the remote shader compiler executable you are using and add the following line:whitelist=[Ip address of device]where you add the IP address of your device. You can add multiple IP addresses using a comma to separate them or you can use CIDR notation to specify a network mask so you can specify ranges of IP addresses that are allowed to connect to the remote shader compiler.Hope this helps and if you have any other questions let me know!Thanks,ChrisSharerePost-User-1597227answered 6 years ago0You will want to write:whitelist=100.100.100.108No brackets as that will be an invalid string and the shader compiler will print that out when it starts up.SharerePost-User-1597227answered 6 years ago0Hmmm, spaces should not have done anything but I'll check that code and fix that bug. Sorry about that.As for Android support we need a device that supports OpenGL ES 3.1. We do have OpenGL ES 3.0 support but as we continue to work on it we have noticed that there are many issues with Android devices running ES 3.0 that seem to be driver related.As for the black screen - what project are you running? It is possible that the game has not loaded a map and so you would only get a black screen until a map is loaded.Feel free to attach your log file here and I'll take a look at it for you.Thanks,ChrisSharerePost-User-1597227answered 6 years ago0I did that as a test when I first had the problem with no luck, maybe I have to give it a second try.Thanks for your answer.just to be sure do I have to writewhitelist = 100.100.100.108 or whitelist = [100.100.100.108] ?SharerePost-User-7621041answered 6 years ago0I had to ask as custom parsing are always possible and makes for this kind of errors.I'm actually testing it again.I'll write the result here , maybe I forgot to shut down the process the fist time.SharerePost-User-7621041answered 6 years ago0It turned out I have some spaces at the end of the string.Now the app shows the logo but then goes in background.Maybe my phone is not good enough.I have to review the log.I have a zopo flash s 920+ with mali 720 mp3It supports opengles 3.1, but maybe drivers aren't the best.Do the team plan to implement a lighter renderer for mobile for low/ mid devices?!?Is there a cheap (under 200$) device where the engine runs reliably?SharerePost-User-7621041answered 6 years ago0it's a custom empty project just compiled with a map with a basic terrain and a camera no ocean.It compiles just 4 shader combination.map was added to autoexec.cfg in the project and load in the pc launcher.I just have default logcat and its a huge log I have to save on file and look for the relevant pieces.for the renderer having it almost the same as pc makes it very heavy on mobile specs, I would love to have also a minimum render working on es 2.0 just a basic one even with no lights or shadows to begin with.SharerePost-User-7621041answered 6 years ago0I see it compiling 4 shaders the fist time then load 4 shader from cache.3999-logs.zip|attachment (3.58 KB)logs.zipmy logSharerePost-User-7621041answered 6 years ago0Still no luck for me with android.now I just use Camera gem and have in game.xml :<Class name="DynamicModuleDescriptor" field="element" type="{D2932FA3-9942-4FD2-A703-2E750F57C003}"> <Class name="AZStd::string" field="dynamicLibraryPath" value="Gem.Camera.f910686b6725452fbfc4671f95f733c6.v0.1.0" type="{EF8FF807-DDEE-4EB0-B678-4CA3A2C490A4}"/> </Class>the same as the one reported by the catlog:$4[Error] Module Gem.Camera.f910686b6725452fbfc4671f95f733c6.v0.1.0 is missing from the current app descriptor for this project.the catlog also report wwise not loading the bank file. that should be easy to fix adding one.I always both deployed from vs 2013 and Deployment Tool with exact same results.SharerePost-User-7621041answered 6 years ago0Check that the Editor.xml and Game.xml files in the your project/config directory are writable. If they are not then the tool will fail to update them.Then open the Game.xml file and search for the gesture gem and verify that the UUID and version match with the error. If they don't then you can manually update the file or run the tool again.Deploy the assets to the Android device (you can do this through the editor Deploy Tool plugin under "Tools/Other" menu or through the command line using the deploy_android_armv7_[compiler]_[config] command for lmbr_waf.bat).That should resolve it...SharerePost-User-1597227answered 6 years ago0Ok, cool. If you have the map in autoexec.cfg it should load it but it does not sound like that is happening.You can do:adb logcat -s "LMBR"and that will filter out a lot of noise and return the Lumberyard Engine output. That would be useful to see. Also, in the remote shader compiler window you do see the game connecting and compiling shaders?SharerePost-User-1597227answered 6 years ago0Perfect! There seems to be a problem with the build:I/LMBR (25473): Module Gem.Gestures.6056556b6088413984309c4a413593ad.v1.0.0 is missing from the current app descriptor for this project. Update app descriptors by running "Bin64vc120\lmbr.exe projects populate-appdescriptors" from the dev/ folder.I/LMBR (25473): $4[Error] Module Gem.Gestures.6056556b6088413984309c4a413593ad.v1.0.0 is missing from the current app descriptor for this project. Update app descriptors by running "Bin64vc120\lmbr.exe projects populate-appdescriptors" from the dev/ folder.I/LMBR (25473): System ShutdownBasically the game engine has detected that you want to use the Gestures gem but that it is not part of our app descriptor manifest so we don't load the gem. The engine then shuts down because of the error. You can try executing this command:Bin64vc120\lmbr.exe projects populate-appdescriptorswhen you are in the /dev folder and the redeploy the assets to the Android device to see if that helps resolve the error.Looks like you are building with Visual Studio 2013 as well. You may want to switch to VS 2015 as it will provide the ability to debug the APK from within VS. I run from VS 2015 and debug the APK from there. Works fairly well though once in awhile Visual Studio and the device disagree and so I have to reboot my phone to get things working again. :)SharerePost-User-1597227answered 6 years ago0Still have the Gem.Gestures.6056556b6088413984309c4a413593ad.v1.0.0 is missing from the current app descriptor for this project. after following instructions then did a configure and a build Game clear device and install the executable.Hope I not have to do a full rebuild .. now try to disable the gem as I'm not using it yet.SharerePost-User-7621041answered 6 years ago0Yeah, we know we have a long way to go in improving this workflow, and it is driving me nuts as well! We have things planned to improve this experience and make it easier for our customers to build and run on mobile devices, just can't say what or when. :)SharerePost-User-1597227answered 6 years ago0Hmmm...Oh, I think I know what is going on. Because of the way the Android game is loaded we have to embed the application descriptor in the source code. Any time you change what gems are in your project you have to run lmbr_waf.bat configure to pick up the changes. Try doing that, then building the game and deploying to the device. That should do the trick!I have a few high priority items that I must take care of today so my responses may be slow.Thanks,ChrisSharerePost-User-1597227answered 6 years ago0I hope you can find a more straightforward workflow as this is driving me crazy.I'll try to make a game+ gems rebuild as i'm almost sure to have done both configure and incremental build yesterday.I'm working right now I'll do this test as soon as possible.if it doesn't work I'll try a full engine rebuild :(Thanks and don't worry for response times I'm not planning anything serious with Android (due to the highter specs requirements) it is just for learning purpose.SharerePost-User-7621041answered 6 years ago0config.ini should be like the following:[General]whitelist=192.168.1.xxEnsure that your mobile is connected to the same router as you PC connectedSharerePost-User-5007185answered 6 years ago"


Question: Using the Level Loading Screen Config

"I am aware of the data given here and here on creating a loading screen between levels. I have a level.cfg file at <gameproject>/Levels/<levelname>, and the UInamed "finalLevelLoadingUI.uicanvas" at the same level. The level.cfg file contains this one line:level_load_screen_uicanvas_path = "finalLevelLoadingUI.uicanvas"However, when I launch the level (from another level), all I get is a black screen (the UI is blue, with loading text) before going to the actual level. I have tried other CVars (i.e. e_Sun), and those have propagated fine. I have also verified that AZ_LOADSCREENCOMPONENT_ENABLED is 1 in code.What am I doing wrong?Follow"

Answer: "0Accepted AnswerHi @REDACTEDUSERThe level_load_screen_uicanvas_path is relative to your <gameproject> root directory. Try this path instead (substituting for the correct path names):level_load_screen_uicanvas_path = "Levels/<levelname>/finalLevelLoadingUI.uicanvas"Update: accidentally had <gameproject> in the CFG path. This isn't needed since the path itself is relative to the game project root directory.SharerePost-User-8946916answered 5 years ago0Thank you @REDACTEDUSERFollow-up question: is it possible to get the text changed on the documentation page for this content? Specifically this area (I don't want anyone else misinformed); I have already submitted feedback for this as well:level_load_screen_uicanvas_path – File path to the .uicanvas level load screen file relative to your level path.For example, if your level load canvas is at \dev\StarterGame\Levels\StarterGame\UiAnimMultiSequence.uicanvas (root of the level directory— same as level.cfg), you would type UiAnimMultiSequence.uicanvas for this parameter.<br>SharerePost-User-5780922answered 5 years ago0Hi @REDACTEDUSERSharerePost-User-8946916answered 5 years ago"


Question: Recommendations in managing large schemas

"Our team is working with ~30 domains written in Apollo Server, and we are hitting bottlenecks of autoscaling with EC2.We are looking for possibilities in migrating to either AppSync or Lambda, they both comes short in different ways.Lambda + API Gateway: We can theoretically bundle the whole thing into lambda, but subscriptions are inherently impossible by the nature of how Lambda is designed.AppSync: It is missing ways to manage large schemas. Unfortunately, with our Apollo background, we can only approach the problem with their ways. We can do schema stitching ourselves before deployment, but the lack of type extension support really hits us like a rock.I could really use some help on ways to manage large schemas.FollowComment"

Answer: "0Having the same problem regarding AppSync.+1Edited by: svenm on Jul 4, 2019 4:16 AMCommentSharesvenmanswered 4 years ago0Hi,Schema stitching is a request we've heard from many customers, and I can take this as a +1 to prioritizing that in a future release.In the meantime, have you checked out the Amplify CLI? It can help manage source control and collaboration on larger schemas.Thanks,JeffCommentShareAWS-User-4365954answered 4 years ago0Thanks for the +1, Jeff.We have done more in-depth researches on AppSync.Amplify CLI, to be honest, does not help in splitting large schemes into manageable chunks. We need to organize our schemas by business domains, which is in turn managed by individual teams.I want to add that schema stitching only makes sense when worked with type extension, such feature first appeared in the April 2016 release of the GraphQL specs. We really need these available to move on from our server caps in EC2.CommentShareiLakeanswered 4 years ago0The serverless framework's AppSync plugin  https://github.com/sid88in/serverless-appsync-plugin has now support to stich multiple schema files thanks to one of my coworkers. It got merged with MR https://github.com/sid88in/serverless-appsync-plugin/pull/227.CommentShareDigitalFabanswered 4 years ago0The underlying package merge-graphql-schemas is what we've been using in the Apollo Server source codes. Although we have already invented way to automatically map resolver templates, this PR really helps users in the future, really appreciate it.CommentShareiLakeanswered 4 years ago"


Question: User pool third-party OIDC - token request

"I am setting up a third-party OIDC provider with my Cognito user pool that is only enabled for using the Authorization code grant. I've noticed that when AWS makes the request to my token endpoint, it includes the Client ID and Client Secret as fields in the POST request body, rather than in the Authorization header. Is there any configuration that can change this behavior to the more standard use of the Authorization header?FollowComment"

Answer: "0Accepted AnswerHi,There is no configuration to change this behavior currently, Cognito uses client_secret_post when communicating with the external IdP.CommentShareEXPERTMahmoud Matoukanswered a year ago"


Question: Serverless web form

"Hey GeeksI want to build a serverless form, and this is what am thinking in, and I appreciate it if you share your commentsReactJs form hosted in S3 > lambda python to take the inputs from the form > save the form data to dynamoany comment? do you have a detailed tutorial on the same?FollowComment"

Answer: "3HI,The overall architecture you propose is sound. You can use S3 to host a static website, like a ReactJs single-page-application. To set that up, I'd recommend looking into Amplify Hosting, which helps you set up git-integration with CI/CD functionalities to automatically deploy as you commit new changes to the application.To receive data from the ReactJs application you can use the API Gateway -> Lambda -> DynamoDB pattern. If you don't want to do any server-side validation and just post the data straight into the DB, you can use the API Gateway -> DynamoDB pattern.  Both of these are available in Serverless Land.CommentShareNiklasanswered a year agoEXPERTmreferrereviewed a year ago2AWS has a walk-through of how this can be done at Create Dynamic Contact Forms for S3 Static Websites Using AWS Lambda, Amazon API Gateway, and Amazon SESCommentShareRoBanswered a year ago1AWS has a good walk-through for setting up Lambda with API Gateway:https://docs.aws.amazon.com/apigateway/latest/developerguide/getting-started-with-lambda-integration.htmlIf the use case is just a simple website with a form, I'd probably do all the validation on the front end and do direct API Gateway --> DynamoDB.If you want submitting the form to set in motion a number of events such as sending an email, notifying customer service, updating a database, etc etc, you could use API Gateway --> EventBridge. Then create rules on EventBridge to trigger these events.Check this link for API Gateway --> EventBridge integration.https://serverlessland.com/patterns/apigateway-rest-eventbridgeCommentShareJacksonanswered a year ago0I recently finished a project that addressed your requirements. I used NextJS with their Vercel hosting and SAM to manage the API and Lambda with CloudFormation. I’m using SES to send an email and then record the data in DynamoDB. My Lambda is written in Golang, but you can get the idea of things from this repo.The only thing missing from the API currently is authentication. I was planning on using Cognito and the token from an un-authenticated user, however that's proving somewhat challenging. If anyone has tips on that I'd love to hear from you.CommentSharepulpfreeanswered a year ago"


Question: Spot Fleet down scaling instance selection

"What is the method used to select candidate instances when manually scaling down a spot fleet?  I'm managing a render fleet and would like to terminate only idle instances when scaling in the fleet.  Is there the ability to choose based on Cloud Watch metrics, or the ability to insert a custom termination policy like the Auto Scaling Group has?FollowComment"

Answer: "1Yes cloudwatch metrics are available for the spot fleet.You can configure this by following the link below and choosing necessary metrics to use.https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fleet-cloudwatch-metrics.htmlSpot fleet capacity rebalance: (Scale in/out) https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fleet-capacity-rebalance.htmlHandling spot fleet interruptions:https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-interruptions.htmlCommentShareDhilipanswered 2 years ago0Custom Termination policies are only available on AutoScaling Groups (ASGs), not for SpotFleet, so you would need to migrate to use an ASG for them, so for your use case an ASG may work better.  In spot fleet, when an instance needs to be terminated it will select the instance based on the allocation strategyOn an ASG you could also use scale-in protection or terminating lifecycle hooks as options then as well.  The best option would depend on factors such as how long the renders take, and how often new jobs come in.Here's a few high level examples of when each feature might work best and how to use themCustom Termination policy[1]You have a way for the Lambda function to determine which instance is idle, such as an API/HTTP request that could be sent to itScale-In Protection[2]If each instance only runs a single job, or runs very long jobs then this might work best.  Have the setting enabled on the ASG itself so that all new instances have protection enabled, and then once a render finishes check if there's anymore in the queue; if there isn't, then disable protection to allow the instance to be scaled inTerminating lifecycle hook[3]This would work best for short jobs (max of 2 hours, since that's the max heartbeat timeout for a lifecycle hook).  Put a terminating lifecycle hook on the ASG, and in the application whenever it finishes a job, have it check to see if it is currently in the Terminating:Wait state on the ASG.  If it is, complete the lifecycle hook to finish the termination process, and if not grab a new job[1] https://docs.aws.amazon.com/autoscaling/ec2/userguide/lambda-custom-termination-policy.html[2] https://docs.aws.amazon.com/autoscaling/ec2/userguide/ec2-auto-scaling-instance-protection.html[3] https://docs.aws.amazon.com/autoscaling/ec2/userguide/lifecycle-hooks.htmlCommentShareShahad_Canswered a year ago"


Question: Connection problem between two users in a UEProject with GameLift

"Hi guys, good morning!I'm having a problem and I'm confused...When I'm trying to connect two users in a dedicated server from my build project, the message sended from amazon is this:REMOVEDUPLOADHowever, after a few seconds, it returns me to the join the game screen instead of traveling to the third person example map.REMOVEDUPLOADI went to the virtual machine to see the logs and this is what returns it...REMOVEDUPLOADWhen I made all this sequence, my game sessions are created, so I have to delete modifying scaling parameters of my fleetREMOVEDUPLOADBtw, you look that? 2 player sessions has been created and can't use them... I don't understand what's happening...FollowComment"

Answer: "0Accepted AnswerWell, apparently the problem was around the project settings. Because although I had it as the tutorial, I made one in a new project and when I imported it to the new one,the map was read it whitout any problem.I suppose that some change that I made would have left the ".ini" corrupted.Thanks for your help, Chris!CommentSharerePost-User-9077048answered a year ago0What do your client logs look like? From looking at your server logs, it seems that your clients are successfully connecting to the server but then immediately disconnecting, but not from the server kicking them out.CommentSharerePost-User-5100160answered a year ago"


Question: Redshift Session vs Connection

"Hi,  I am confused by redshift session concept. When I create a temp table, it is said it is only session-scoped. what's the exact meaning here?  suppose now we connect to the Redshift with JDBC driver, then we have a connection now.  during this connection, do we share the same session? if we connect to Redshift  and keep the connection alive for a very long time, like do some jobs frequently periodically, then the temp table created will have no chance to be deleted by Redshift?FollowComment"

Answer: "0Hello,A temporary table that is visible only within the current session. The table is automatically dropped at the end of the session in which it is created. The temporary table can have the same name as a permanent table. The temporary table is created in a separate, session-specific schema. (You can't specify a name for this schema.) This temporary schema becomes the first schema in the search path, so the temporary table takes precedence over the permanent table unless you qualify the table name with the schema name to access the permanent table.The system table STV_SESSIONS can be used to view information about the active user sessions for Amazon Redshift. For more on STV_SESSIONS, please refer to below link[1][1] https://docs.aws.amazon.com/redshift/latest/dg/r_STV_SESSIONS.htmlThe column name 'process' of STV_SESSIONS table contains the Process ID for the session.The below command [2] the gives the Process ID for the current session:[2] select pg_backend_pid();As long as the Process ID for current session is visible through result of STV_SESSIONS, then the temp table will not be deleted as STV_SESSIONS only lists the active user sessions. So, till the session is active the temp table will not be dropped. If the session is closed then the temp table will be dropped and the Process ID will not be listed in the output of STV_SESSIONS anymore.CommentSharerePost-User-2298967answered 2 months ago"


Question: App Runner Secure

How to add App runner API endpoint authentication. Link IAM Police user oath or any other author service.I need to secure my app runner.FollowComment

Answer: "1As a managed service, AWS App Runner is protected by the AWS global network security procedures that are described in the below document -https://d0.awsstatic.com/whitepapers/Security/AWS_Security_Whitepaper.pdfYou use AWS published API calls to access App Runner through the network. Clients must support Transport Layer Security (TLS) 1.0 or later. We recommend TLS 1.2 or later. Clients must also support cipher suites with perfect forward secrecy (PFS) such as Ephemeral Diffie-Hellman (DHE) or Elliptic Curve Ephemeral Diffie-Hellman (ECDHE). Most modern systems such as Java 7 and later support these modes.Additionally, requests must be signed by using an access key ID and a secret access key that is associated with an IAM principal. Or you can use the AWS Security Token Service (AWS STS) to generate temporary security credentials to sign requests.To prevent your APP runner you can Implement least privilege access, You can customize them and grant only the permissions that are required for your users and your App Runner service to perform their tasks. This is particularly relevant to user policies, where different user roles might have different permission needs. Implementing least privilege access is fundamental in reducing security risk and the impact that could result from errors or malicious intent.For brief explanation on App Runner Security and Best practices, please refer below document -https://docs.aws.amazon.com/apprunner/latest/dg/security.htmlWish you an Awesome day ahead !CommentShareSupport Engineeranswered 9 months agoFinneyCanHelp 5 months agoThis is exactly one of the things I was looking for. Thanks so much! :)Share"


Question: MWAA not sending logs to CloudWatch

We have multiple MWAA environments.All stopped sending logs to CloudWatch on the 16th Aug 2022.All environments have logging enabled.I've tried restarting the environments. I've also created a new environment. No environments are sending logs.Is anyone else seeing this?FollowComment

Answer: 0Was there any change on network or IAM configurations? I recommend reviewing your configurations and ensure that they meet the required permissions and network access.Security in your VPC on Amazon MWAAAmazon MWAA execution roleCommentShareTaka_Manswered 9 months ago


Question: Lambda MSK Event Source Unexpected Retry Behaviour

"Hi,I have an MSK topic that is an event source for a C# lambda. According to the documentation over at https://docs.aws.amazon.com/lambda/latest/dg/with-msk.htmlLambda reads the messages sequentially for each partition. After Lambda processes each batch, it commits the offsets of the messages in that batch. If your function returns an error for any of the messages in a batch, Lambda retries the whole batch of messages until processing succeeds or the messages expire.However, this is different to the behaviour I'm seeing.My lambda is currently throwing a timeout exception, and I can see from the logs that it's bubbling up to the lambda runtime as I intended. The lambda is re-invoked somewhere between 1 and 5 times, and then it isn't attempted again. I can see in CloudWatch a log likeSTART RequestId: 21b8cbda-8e66-4d1d-9812-9d2661985a73 Version: $LATESTfor each invocation - which is how I'm determining the number of times it's being retried.I was expecting the lambda to be retried indefinitely until it succeeded. Have I misunderstood the documentation or is that how it should behave?Also what is meant by "or the messages expire." - is that referring to the retention period for the topic (mine is currently 1 week)? Or is there some other message expiry mechanism specific to MSK?Thank you!FollowComment"


Question: Filebeat is not able to connect with Elasticsearch 7.10 ( aws Opensearch )

"this is the error i'm gettingcallback failed: Elasticsearch is too old. Please upgrade the instance. If you would like to connect to older instances set output.elasticsearch.allow_older_versions to true. ES=7.10.2Beat=8.6.2","service.name":"filebeat","ecs.version":"1.6.0"FollowComment"

Answer: "0The error message you are seeing indicates that Filebeat is not able to connect to Elasticsearch (in this case, OpenSearch) version 7.10 using the current version of Filebeat (8.6.2). This is because the Elasticsearch version (7.10.2) is older than the Filebeat version and is not supported.To resolve this issue, you can either upgrade your OpenSearch instance to a version that is compatible with the current version of Filebeat or downgrade Filebeat to a version that is compatible with the Elasticsearch version.To upgrade OpenSearch, you can follow the steps provided in the OpenSearch documentation. It is recommended to upgrade to the latest version of OpenSearch that is compatible with your version of Filebeat.To downgrade Filebeat, you can either download an older version of Filebeat that is compatible with your Elasticsearch version or set the output.elasticsearch.allow_older_versions option to true in your Filebeat configuration file. Note that using an older version of Filebeat may result in missing features or security vulnerabilities, so it is recommended to upgrade your Elasticsearch version to a compatible version if possible.Once you have upgraded or downgraded the appropriate component, you should be able to successfully connect Filebeat to OpenSearch without encountering the compatibility error message.CommentShareEXPERTsedat_salmananswered 2 months agorePost-User-7582881 2 months agoI want to downgrade my filebeat what is the version will compatible with ES=7.10.2Share0You might find this info useful to derive the Compatibility matrix - https://opensearch.org/docs/latest/tools/index/.Ideally you would try either version 7.10.2 , 7.11 or 7.12 of Filebeat OSS.CommentShareSydanswered 2 months ago"


Question: Does Kendra do parallel indexing?

Cab  Kendra can do parallel indexing 1. same data source parallelized to be indexed  - 2 several different data sources being indexed on same index. at teh same timeFollowComment

Answer: "0Accepted AnswerYou can have multiple data sources for the index. However you need to map document or content fields from your data source to fields in your index from those multiple data sources. You can try to run sync job in parallel using CLI but if a synchronization job is already in progress, Amazon Kendra returns a ResourceInUseException exception. At present I don't see same data source parallelized to be indexed.CommentShareEXPERTAWS-User-Nitinanswered 7 months ago"


Question: How to enable ApplianceModeSupport in a Transit GW Attachment

"I am trying to enable the applicance mode with the following CLI command as per the online documentation:C:\Users\Pablo>aws ec2 modify-transit-gateway-vpc-attachment --transit-gateway-attachment-id tgw-attach-0b6cb80499a53XXXX --options ApplianceModeSupport=enableParameter validation failed:Unknown parameter in Options: "ApplianceModeSupport", must be one of: DnsSupport, Ipv6SupportI tried changing the DnsSupport option to make sure I'm in the right region and transit gateway attach and works:C:\Users\Pablo>aws ec2 modify-transit-gateway-vpc-attachment --transit-gateway-attachment-id tgw-attach-0b6cb80499a5383e9 --options DnsSupport=disable{"TransitGatewayVpcAttachment": {    "TransitGatewayAttachmentId": "tgw-attach-0b6cb80499a53XXXX",    "TransitGatewayId": "tgw-01e5ee317cd46YYY3",    "VpcId": "vpc-02e3c21f4d7dacZZZ",    "VpcOwnerId": "95107885XXXX",    "State": "modifying",    "SubnetIds": [        "subnet-0c24bb7aae4deeXXX",        "subnet-064acc2ad5667aXXX",        "subnet-03b6351363cd1cXXX"    ],    "CreationTime": "2022-09-27T18:09:59+00:00",    "Options": {        "DnsSupport": "disable",        "Ipv6Support": "disable"    }}}It looks like this transit gateway attachment does not have this option. What am I doing wrong?FollowComment"

Answer: "1Accepted AnswerI was able to figure it out. The problem was my AWS Cli version 2.0.52. Updated to the last one 2.7.35 and voila, problem fixed.CommentSharerePost-User-0583042answered 8 months ago0Hello,Your command syntax seems to be correct; Can you try with region explicitly mentioned in the command:Example:aws ec2 modify-transit-gateway-vpc-attachment --transit-gateway-attachment-id tgw-attach-0b6cb80499a53XXXX --options ApplianceModeSupport=enable --region <YOUR REGION HERE>Then run below command to verify:aws ec2 describe-transit-gateways --filters --transit-gateway-ids tgw-attach-0b6cb80499a53XXXXCommentShareEXPERTTushar_Janswered 8 months agorePost-User-0583042 8 months agoI got the same response including the region, in fact, I tried it before. As for the second command:C:\Users\Pablo>aws ec2 describe-transit-gateway-attachments --filters --transit-gateway-attachment-id tgw-attach-0b6cb80499a53XXXX{"TransitGatewayAttachments": [    {        "TransitGatewayAttachmentId": "tgw-attach-0b6cb80499a5383e9",        "TransitGatewayId": "tgw-01e5ee317cd46c1a3",        "TransitGatewayOwnerId": "95107885XXXX",        "ResourceOwnerId": "95107885XXXX",        "ResourceType": "vpc",        "ResourceId": "vpc-02e3c21f4d7dac052",        "State": "available",        "Association": {            "TransitGatewayRouteTableId": "tgw-rtb-0854831e6d2fcc9a3",            "State": "associated"        },        "CreationTime": "2022-09-27T18:09:59+00:00",        "Tags": [            {                "Key": "Name",                "Value": "transit-gateway-inbound-qa"            }        ]    }]}Share"


Question: AWS Cost and Usage format?

HiIs there a table somewhere of the meta data for the AWS Cost and Usage report. I want to import the CSV into a MySQL database.Best regardsAndreFollowComment

Answer: "0Hi Andre,I was not able to locate a table of the meta data, however this data dictionary may help as a reference:https://docs.aws.amazon.com/cur/latest/userguide/data-dictionary.htmlIt appears you can also use Amazon Athena to analyze the data from your AWS Cost and Usage Reports in Amazon S3 using standard SQL:https://docs.aws.amazon.com/cur/latest/userguide/cur-query-athena.htmlHope this helps, but if you are still seeking a solution please update this thread with more info about your use case and I will investigate further.-Mickey N.CommentShareMickey-AWSanswered 3 years ago0Hi, thanks for that. Yes I did find that info while trying to figure out how I'm going to use the file.Another problem is that the CSV file has two different sizes (No of items) depending on where I download it from. I wrote the system to try and get accurate costs (we can't afford to burn our fingers when we go live) I used data from my own AWS account and that has one less field than the company one.I need stability somewhere, especially on billing side. I also need to know the format of the fields. At the moment Im guessing and might truncate important billing information.No, the staff can't use Athena to check costs.CommentShareandre9638answered 3 years ago0Thanks for the feedback about the CSV, Andre. I have let our Insights team know that you are looking for more stability on the billing side.If you have anything else to add, please let me know. You can also open a support case:http://go.aws/support-center-Mickey N.CommentShareMickey-AWSanswered 3 years ago0Hi Andre,Our Insights team reviewed your feedback. Are you concerned that you have a test account to create CUR-based cost monitoring tool using CSV version? If a CSV option in selected, CUR may break up the file into multiple files depending on the file size.If the concern is with different columns, that is also expected as the data provided is contextual to the individual account. There should be a CUR manifest file that provides details on each column that is available.If you're looking to ultimately use this audit mechanism on your company's account, they recommended building it based on that CUR, to avoid issues in the future.I hope this info helps, but if you have any additional feedback or questions, let me know.-Mickey N.CommentShareMickey-AWSanswered 3 years ago0Hi MickeyThanks for the feedback. CUR?I found the json file that get's generated with the csv file. It has a general description. There are no lengths so I have to guess it...At the moment I read the JSON file to get the format of the CSV file and then I read the CSV file.Here is my summary so far...String      = VARCHAR(55)Interval    = VARCHAR(55)DateTime  = DateTimeBigDecimal  =  Decimal(20,10)OptionalBigDecimal = Decimal(20,10)   Problem with NULL valuesIt would be nice to have a properly defined length and type for each Item. AWS should know this!!Is the issue with the CSV file when we add tags?Best regardsAndreCommentShareandre9638answered 3 years ago0Hi Andre,Update from our Cost & Usage Reports (CUR) team:We don't provide character lengths, and this should not be an issue when creating tables from JSON (or SQL create functions). You can have changes to the CUR file & modify the lengths from one day to the next - so if you want to parse the data to determine lengths, it's risky as it may change.For example, if we introduce a new product or service that has longer text lengths, or a new charge type that was not used before, setting fixed lengths has the risk of truncating text.I hope this addresses your concerns around this, but please let me know if there's anything else I can help with.If you had any specific account questions that may relate and need someone to take a closer look, you can also open a support case with us in the Support Center:http://go.aws/support-center-Mickey N.CommentShareMickey-AWSanswered 3 years ago0Thank you. I understand. It would be good to have a dictionary of what possible  fields could be expected, but we can work round that.My biggest problem is that I can't tag objects PUT into S3 (another forum post) so I'm unable to get costs per item. Everything is hanging at the moment...CommentShareandre9638answered 3 years ago0I'm sorry for the inconvenience. It appears that currently, you can only tag an S3 bucket:https://docs.aws.amazon.com/ARG/latest/userguide/supported-resources.html#s3If you haven't yet, have you looked at the Tag Editor yet? It might be helpful to play around with:https://docs.aws.amazon.com/ARG/latest/userguide/tag-editor.htmlAs we primarily assist with General Feedback, if you have any more questions or concerns relating to your account please open a support case in the Support Center so we can discuss in detail:http://go.aws/support-centerA support case will allow us to log your feedback on our end with your full details, securely, for effective tracking of these requests!You can also add a new comment in the thread you mentioned or start a new thread for assistance from the community of experts:http://go.aws/forums-s3-Mickey N.CommentShareMickey-AWSanswered 3 years ago0No, looks like you can tag objects too...You can add tags to new objects when you upload them, or you can add them to existing objects.https://docs.aws.amazon.com/AmazonS3/latest/dev/object-tagging.htmlOnly problem is that it is not working...CommentShareandre9638answered 3 years ago"


Question: How to isolate resources for users?

"So I am trying to prototype a service that will be backed by different aws services. What I want is, that each user in my service have a different resource group in AWS. For example, they can have different SNS pipelines, different SES configurations, etc. How can I achieve that?FollowComment"

Answer: "0It is a good idea to use IAM to divide the resources that each user can access.With the Resource policy, it is also possible to create settings to allow by user for each ARN.https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_elements_resource.htmlCommentShareEXPERTRiku_Kobayashianswered 2 months ago0If you want to keep all the resources in one account, consider isolating resources via tagging. You can use session tagging along with tagging of the resources to control access. Take a look at these:IAM tutorial: Define permissions to access AWS resources based on tagsIAM tutorial: Use SAML session tags for ABACCheck to see if the services and resources you plan to use support ABAC, AWS services that work with IAM.CommentShareEXPERTkentradanswered 2 months ago"


Question: Transit Gateway Public Prefixes

"Hello, I understand that a transit gateway can receive an advertised default route, but can it receive public prefixes that have been advertised over a direct connect?FollowComment"

Answer: "1Accepted AnswerYes, public prefixes advertised from on on-prem connection over a Direct Connect transit VIF are treated the same way as private prefixes by the transit gateway.CommentShareEXPERTThaddeus_Wanswered 3 months agoEXPERTTushar_Jreviewed 3 months agoMichael S 3 months agoWould public prefixes also be accepted on a private virtual interface attached to a VGW?Share"


Question: Gp3 low performance

"Volume restored from a snapshot has a very low slowness, it copies exactly 256 files and the copy process pauses for a minute and then continues with another 256. The disk has 402GB and had 3000iops at the beginning, it went up to 6000iops, despite the fact that it was the incident, but no performance improvement is seen, the Volume is mounted on a r5n.2xlarge inFollowComment"

Answer: 1When restoring an ebs volume If immediate I/O is a concern you should perform an EBS volume initialization.More on that here . . .https://aws.amazon.com/blogs/storage/addressing-i-o-latency-when-restoring-amazon-ebs-volumes-from-ebs-snapshots/CommentSharetedtrentanswered 6 months ago


Question: StepFunctions/Lambda and ECS

"Hello AllHere is what I am attempting to do using StepFunctions/Lambda/ECS+Fargate+python+dockerI have a job that is queuing a request and polling to see if the request is complete. Once complete, the file for the request needs to be downloaded. All the above steps, except downloading file is done using Lambda and Choices in Step functions. For the actual download I am using a container as the download can take over 15 mins.Question: What I need to do is send the Job_ID from The final "Is File Ready?" Choice to the Fargate/ECS Container so that the python script in the container downloads the file and puts it in S3. The final choice, is basically checking if the file status is Ready or Pending. If Ready, the file is ready to download, else keep looping after 10 mins sleep and check the status again.Is this the correct thought process: Somehow in the "Is File Ready?" state the output should include the json that the ECSTaskRun can consume? and this json output should have the Job_id as an evn parameter? Once this is done, the python script can read the job_id as env param, os.environ.get('job_id), and do the remaining items?Or, am I on the wrong track here.Also I am deploying everything in Python CDK.Thanks for the feedback.FollowComment"

Answer: "3To pass data from Step Functions to an ECS, you have two options:Override the command for the container; orOverride the environment for the container (i.e., declare environment variables)The values can be referenced from the state's input by referring to paths in it.Some examples are provided in the Step Functions integration documentation.To pass data from your container back to Step Functions, you need to invoke the ECS Task asynchronously (using .waitForTaskToken instead of .sync) and pass $$.Task.Token to your container, for example, via a TASK_TOKEN environment variable. After your container has finished processing, and before your container exits, it must call SendTaskSuccess with the task token and whatever output object you wish to send. This callback pattern is discussed in the documentation here.CommentShareEXPERTMichael_Fanswered a year ago"


Question: Amazon SES complaint emails

We have started getting a lot of SES complaint emails. When we send out order confirmation emails we cc in our email so the customer service team know about the orders placed. In this case the receiver at our end will be the same as the sending email address. We didn't have any issues with this before but recently all email copies we receive are getting marked as complaints. Could anyone please help with this.FollowComment

Answer: 0Please open a case with AWS Support and request to receive SES logs. The logs may include information about claims.CommentSharelinuxeranswered 6 months ago


Question: ACM and Route53

"So, I've created an SSL in ACM, domain is hosted in Route53. All appears ok, Cert is valid and is in use in CloudFront. However, when I go to the URL it's still coming up as not secure? Is this just propagation, how long does it normally take?FollowCommentGK a year agoDid you added the domain names in the CNAME in Cloud-front ? I think the ACM you have created in N.Virginia regionShare"

Answer: "0To use an ACM certificate with Amazon CloudFront, you must request or import the certificate in the US East (N. Virginia) region.ACM certificates in this region that are associated with a CloudFront distribution are distributed to all the geographic locations configured for that distribution. And it may take few minutes to hours sometimes.If your public certificate has been issued and configured correctly on CloudFront then you don't need to do anything else.Also check your dns routing using dig <your domain name> and make sure CNAME entry for correct CloudFront URL is there.e.g. dig www.example.comCommentSharemishdaneanswered a year ago0Hi, thanks for that. The cert was requested from this location. In CloudFront is shows the correct cert, in ACM it shows as valid and in use.Not sure why AWS makes this so complicated??CommentShareAlphaPodanswered a year ago0Ok, used dig and any, returned all DNS entries APART from the CNAME records that ACM added?? Is this normal? Down to propagation?CommentShareAlphaPodanswered a year ago"


Question: How to set rate limit and burst in a usage plan in api gateway?

"based on the docs, enabling throttling allows to set rate and burst in a usage plan. if burst is the number of request api will handle concurrently, so should the rate be always equal or less than the burst limit? why would we want a higher rate than we can can handle?FollowComment"

Answer: "1This is related to the token bucket algorithm.Firstly from the definition [1]: A burst limit represents the maximum number of concurrent requests at any given time, while a rate limit defines the number of requests allowed per second.Allow me to refer to the below image from [2], and assume x-axis represents 100 ms while y-axis represents the number of requests.In this case, our back-end is designed to handle 30 RPS workload, with the capability to process at most 12 (spiky) requests. Therefore, I would set the rate limit to 30 and the burst limit to 12 accordingly.Both limits protect my backend from being overloaded.[1] https://docs.aws.amazon.com/apigateway/latest/developerguide/api-gateway-request-throttling.html[2] https://www.geeksforgeeks.org/leaky-bucket-algorithm/CommentShareweidianswered 8 months agoEXPERTChris_Greviewed 8 months ago"


Question: Mediapackage and Cloudfront integration

"Hello, I am creating live streaming using medialive and mediapckage. It is said that the live must be distributed using cloudfront. In the aws console cloudfront is being created by cjecking the checkbox, but i was not able to find any api for creating cloudfront or enabling cloudfront by coding. I am using javascript sdk.FollowComment"

Answer: "0Hi, see the guide & reference (which includes CloudFront) here:https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/welcome.htmlhttps://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/index.htmlCommentShareEXPERTskinsmananswered 4 months ago"


Question: Mesh with Sphere Controller collision

"Hi, I'm trying to import a static mesh with collision, I search here but all solutions doesn't work for my case.I'm using Lumberyard 1.7, and this is the steps:1) Open FBX Importer, import Shapes from SamplesProject (samplesprojects\Objects\Tutorials\Fbx) select "all physics meshes" and Material.Put the shapes.cfg (with material - PhysicsNoDraw and the Material) and Sphere_Controller_Complete in a level. Sphere go through the mesh.Here a video: https://www.twitch.tv/videos/118917505What am I doing wrong? Thank you.Follow"

Answer: "0Accepted AnswerHey @REDACTEDUSERAfter watching your video, it does appear you are missing a few steps for your shapes.cgf asset after you drag it into the scene. By default, when you drag a static object (.cgf) into the scene, it will only have the Transform and Static Mesh components. You need to add additional components in order for the physics/collision mesh to behave correctly.Here are some steps after you've imported your FBX asset:Drag the shapes.cgf into the level from the File Browser.Open the Entity Inspector (PREVIEW) window to see the components on your entity.You should see the Transform and Static Mesh components on your object.REMOVEDUPLOADClick on the "Add Component..." button in the Entity Inspector (PREVIEW) window, located just under the name of your entity.Navigate to the Physics and click on the Physics component. This will add the Physics component to your entity so the entity will have physics response.You will need to add a Physics Behavior by clicking on the + button on the right side of the "Cry Physics Behavior (empty)" text.A window will pop up called Class to create.You can choose from Static Body or Rigid Body in the drop down menu. Click OK when you've picked which type of physics to use for your shapes.cgf.Your Physics component should look like this now.REMOVEDUPLOADYou also need to assign the collision mesh. Click on the "Add Component..." button again.Navigate to Physics > Colliders and click on Mesh Collider since you imported a specific collision mesh for your shapes.cgf. This will add the Mesh Collider component to your entity.REMOVEDUPLOADYou can add your Sphere_Controller_Complete prefab to add the robot to your level, and when you run the game, the robot should collide with your shapes.cgf.Let us know if that helps.SharerePost-User-7951591answered 6 years agoEXPERTsedat_salmanreviewed 13 days ago0Hey @REDACTEDUSERSharerePost-User-8353690answered 6 years ago0Thank you for your answer Bink_LY, but I have tried this many times as show in the video that I attached, is there another approach?SharerePost-User-9467671answered 6 years ago0Hey @REDACTEDUSERSharerePost-User-8353690answered 6 years ago0Hi @REDACTEDUSERThank you so much, it's work!!SharerePost-User-9467671answered 6 years ago0Happy to help! Glad it works for you now!SharerePost-User-7951591answered 6 years ago"


Question: How to prevent Redshift from converting boolean to varchar when creating table AS query result

"I am trying to create a new table based on a simple query that contains boolean type columns.When I run the query it gives me this error: cannot cast type character varying to boolean.Why would I want to do this?I'm trying to define the datatype of a column in my new table as a BOOLEAN but without having a value to put in it (yet). Basically the outcome i'm looking for is the equivalent of running the following DDL: create table test_table (test_bool boolean);A simple example to reproduce this is:CREATE table test_table AS (  SELECT CAST(NULL AS BOOLEAN) AS test_bool);Note: I am not using a string or casting to a varchar in this code!!Conversely, the following works as expected - ie. has the correct column types:CREATE table test_table AS (    SELECT        CAST(NULL AS VARCHAR(256)) AS test_varchar,        CAST(NULL AS TIMESTAMP) AS test_ts,        CAST(NULL AS INT) AS test_int,        CAST(NULL AS NUMERIC(10,2)) AS test_numeric);Hopefully I'm missing something fairly basic with the data implicit conversion or the conversion from a result set to a table definition.Also fwiw, this was on Redshift serverless, although I did not try on regular redshift so it could be specific to serverless, but I cannot say one way or the other.---CLARIFICATION BY EXAMPLE---Here's a more concrete example:I have source data that has people with eye_color and hair_color but nothing else. I want my target table to have the following schema: person(eye_color VARCHAR(256), hair_color VARCHAR(256), is_left_handed BOOLEAN, salary DECIMAL(10,2)).I am creating this table new each run of my pipeline, and I'm using DBT to create a table from a source table (containing the source data mentioned above). This means I don't plan on running DDL to create the table and then fill it - rather I will "CREATE TABLE AS".Since I want the destination table (person) to have all the columns (i.e. the correct schema) I need placeholders for them in my select statement. Right now it would look something like this:CREATE TABLE person AS (  SELECT    eye_color,    hair_color,    CAST (NULL AS BOOLEAN) AS is_left_handed,    CAST (NULL AS DECIMAL(10,2)) AS salary  FROM source_data);This command fails with the error about converting to varchar. My question is about determining when the boolean value is converted to a varchar and how to prevent it from happening.If I remove the offending column CAST (NULL AS BOOLEAN) AS is_left_handed it works as expected. and can be verified with this query:SELECT column_name, is_nullable, data_type, character_maximum_length, numeric_precision, numeric_scale, datetime_precisionFROM information_schema.columnsWHERE table_schema = 'my_schema' AND table_name   = 'person';FollowComment"

Answer: "0Hi,From the notes, I understand that  you are trying to cast a boolean field to varchar and encountering below error:ERROR: cannot cast type character varying to booleanIn order to replicate and troubleshoot the issue at my end, please find below the steps I followed :Created a test table and inserted some sample data in it.dev=# create table booltest(id int, flag boolean);CREATE TABLEdev=# insert into booltest values(1, true);INSERT 0 1dev=# insert into booltest values(2, true);INSERT 0 1dev=# insert into booltest values(3, false);INSERT 0 1dev=# insert into booltest values(4, false);INSERT 0 1dev=# select * from booltest;id | flag----+------1 | t2 | t3 | f4 | f(4 rows)Then, I tried using cast/convert function to convert boolean datatype to text datatype.dev=# select convert(varchar, flag) from booltest;ERROR:  cannot cast type boolean to character varyingdev=# select cast(flag as varchar) from booltest;ERROR:  cannot cast type boolean to character varyingdev=# select flag::varchar from booltest;ERROR:  cannot cast type boolean to character varying[+] CAST and CONVERT functions - https://docs.aws.amazon.com/redshift/latest/dg/r_CAST_function.htmlAs a workaround, I tried the below commands and it worked fine.dev=# select id,case flag when true then 'true'::varchar else 'false'::varchar end from booltest;id | case----+-------1 | true2 | true3 | false4 | false(4 rows)ordev=# select id,decode(flag,true,'true',false,'false') from booltest;id | case----+-------1 | true2 | true3 | false4 | false(4 rows)[+] https://docs.aws.amazon.com/redshift/latest/dg/r_DECODE_expression.htmlUnfortunately, I regret to inform you that above mentioned are the possible ways to cast a boolean field to varchar.I hope the above information helps.Thank you and have nice day !CommentSharerePost-User-4610245answered 6 months agophil 6 months agoThanks for your reply. My question is not about converting the boolean to a varchar, but rather how keep it as a boolean. I will try to update my original question to more clearly state what I am trying to do.Share"


Question: S3のセキュリティ設定について

We are using AWS S3.We have just performed a Basic Network Scan against AWS S3 using Nessus Professional and found SSL Medium Strength Cipher Suites Supported (SWEET32) as a vulnerability. Static website hosting is disabled and CloudFront is not used.We would appreciate any guidance on how to work around the vulnerability.FollowComment


Question: Auto failover between zonal VPCEndpoints

I own SaaS service on AWS. I've created service endpoint using AWS privateLink. I want to recommend consumers to create 1+ Interface endpoints in subnets that span 1+ AZs to support High Availability for their applications.The generated regional DNS will resolve to the IPs of those two VPCEndpoints. If one AZ is down and hence the local VPCEndpoint. How can applications running from other AZs still connect to my service via the remaining VPCEndpoint?We tried mucking with Route53 health checks and failover but it seems it only work with EC2 instances only...?!I get that I can configure the application to use Zonal endpoints. But failover requires application update to point to the other standing zonal endpoint.FollowComment

Answer: "0The regional DNS name provided for each PrivateLink endpoint will automatically load balance between health ENIs in the endpoint (through round-robin DNS resolution). It does health checking to ensure only health ENIs are returned. If you are using the zonal hostname, you will need to add in logic into the application for failover.CommentShareAWS-James-Devineanswered 4 months agoEXPERTTushar_Jreviewed 4 months ago"


Question: IOT Predictive Maintenance

I would like to know the AWS certification learning path to become an expert in IOT predictive maintenance. Thank you.FollowComment

Answer: 0Hi. Some resources:Skill Builderhttps://explore.skillbuilder.aws/learn/course/internal/view/elearning/391/iot-foundation-predictive-maintenanceBlogshttps://aws.amazon.com/blogs/iot/tag/predictive-maintenance/Architectures/Solutions/Whitepapershttps://aws.amazon.com/architecture/iot/?cards-all.sort-by=item.additionalFields.sortDate&cards-all.sort-order=desc&awsf.content-type=*all&awsf.methodology=*all&cards-all.q=predictive&cards-all.q_operator=ANDWorkshopshttps://catalog.us-east-1.prod.workshops.aws/workshops/8d1c3528-8abb-4674-a2b9-d15fa593c392/en-UShttps://catalog.us-east-1.prod.workshops.aws/workshops/92364b45-70ea-429e-83ff-5709a0a47d64/en-UShttps://catalog.us-east-1.prod.workshops.aws/workshops/5ecc2416-f956-4273-b729-d0d30556013f/en-UShttps://iot-sitewise.workshop.aws/https://edgecv.workshop.aws/CommentShareEXPERTGreg_Banswered 9 months agorePost-User-6928714 9 months agoThank you so much. I will go through above resources.Share


Question: Policy to restrict command and instance combinations

"Hi,we are looking at moving away from Rundeck to AWS Systems Manager, but we do not see how to restrict certain commands to certain instances. For example, in Rundeck we can allow Command1 to be sent to instances A or B and Command2 to be sent to instances B or C (but not A).We tried something like this in SSM, but the policies end up being additive and commands 1 & 2 can be executed on A, B, or C:{            "Action": [                "ssm:SendCommand"            ],            "Effect": "Allow",            "Resource": [                "arn:aws:ec2:ca-central-1:*:instance/InstanceA",                "arn:aws:ec2:ca-central-1:*:instance/InstanceB",                "arn:aws:ssm:ca-central-1:*:document/Command1"            ]        },{            "Action": [                "ssm:SendCommand"            ],            "Effect": "Allow",            "Resource": [                "arn:aws:ec2:ca-central-1:*:instance/InstanceB",                "arn:aws:ec2:ca-central-1:*:instance/InstanceC",                "arn:aws:ssm:ca-central-1:*:document/Command2"            ]        },We then tried with conditions based on resource tag, but we can only filter instances OR commands, but not both at the same time.Any tip on how to do this?Regards,BartFollowComment"

Answer: "0Thanks for reaching out.RunCommand supports conditions on a specific resource, however, combinations of different resources are not supported.A workaround is to create different policies for different users, one is to allow Command1 to be sent to instances A or B, the other one is to allow Command2 to be sent to instances B or C.Thanks!CommentShareAWS-User-4891571answered 4 years ago"


Question: Map same domain to two different AWS resources

I have a domain abc.io in my Route 53.I have a nextJS application in AWS amplify. I have my marketing website on the EC2 server.I wanted abc.io to open my nextJS application whereas abc.io/w/* opens the marketing website.How can I configure my AWS to achieve that?FollowComment

Answer: "1You can use Cloudfront Behaviors to achieve this routing. You can see an example handling a similar use case here: https://containers-cdk-react-amplify.ws.kabits.com/frontend-react-with-aws-amplify/configure-cloudfront/ - https://aws.amazon.com/blogs/networking-and-content-delivery/improve-single-page-application-spa-performance-with-a-same-domain-policy-using-amazon-cloudfront/CommentShareEXPERTThaddeus_Wanswered 3 months agorePost-User-1082667 3 months agoThanks for your answer. Why can't I find the AWS Amplify Domain name(d36lqj7033ry8p.cloudfront.net) in CloudFront distributionsShareThaddeus_W EXPERT3 months agoAmplify Console offers fully managed hosting so you don't get access to the CloudFront distribution.SharerePost-User-1082667 3 months agoIf Amplify doesn't get access to Cloudfront, How can I workaround with your suggested solution? https://containers-cdk-react-amplify.ws.kabits.com/frontend-react-with-aws-amplify/configure-cloudfront/ShareThaddeus_W EXPERTa month agounfortunately you would need to change the way you are hosting with amplify to something similar to what is described in the workshop where you explicitly configure cloudfront for a resource exposed from the AWS regionShare"


Question: Sagemaker Service

"I am using AWS Sagemaker services and delete any instances that belong to the services. However, i still get charged per day even though I dont use the service anymore. I sent the case to the customer support center but no clear explanation yet.Please any kind of help for my account to stop the cost.FollowCommentMLGuy a year agoYou need to check in different regions, and if you have model endpoints deployed or sagemaker studio apps. The billing details should point you to the right direction.Share"

Answer: "1Your Cost explorer can help you find what exactly are you being charged for. You can filter by SageMaker, and then group by 'Usage type'. In general, make sure  -No notebook instances are runningNo endpoints are being hostedIf you're using SageMaker Studio, all the apps are shut down for every user profile. There might still be EFS charges if you have data over the free tier. See this documentation for shutting down resources - https://docs.aws.amazon.com/sagemaker/latest/dg/notebooks-run-and-manage-shut-down.htmlAnd, make sure to check all regions, if you've used multiple regions. This should stop recurring costs (if you had training jobs, processing jobs etc - you only pay for the billable seconds, so you won't see recurring costs).CommentShareDurga_Sanswered a year ago"


Question: How to I troubleshoot a deploy that is forever in "IN_PROGRESS"?

"I'm using ECS with Fargate, I have a service running and it is working OK. But after I update the task definition (new deploy) and the console (ECS -> Clusters -> Tasks tab) shows that my current task is INACTIVE, which is normal, but it doesn't show any new task being created, nor any stopped task, even after an hour. It is as if ECS is not trying to run my new definition.If I use the awscli to find information about my service:aws ecs describe-services --cluster cluster-xxxxxxx  --services service-svc-xxxxxxx  --region us-east-1It has two deployments. The first is alright, it is the running deployment. The most recent one, it shows:          "desiredCount": 1,            "pendingCount": 0,            "runningCount": 0,            "failedTasks": 7,            ...            "rolloutState": "IN_PROGRESS",            "rolloutStateReason": "ECS deployment ecs-svc/XXXXXXXXXXXXXXXXXX in progress."  Again, there is nothing on the ECS console that points to failed tasks. It is as if the task is failing on a so premature state, its not even logging anything. On the "Task" tab, when I point "Desired task status:" to "Stopped" it shows an empty list with "No Results".I tried looking at CloudTrail event, but there is nothing there about failed tasks. On CloudWatch, the logs for container insights (/aws/ecs/containerinsights/cluster-xxxxxxx/performance) also don't mention failing tasks.How can I troubleshoot this situation?FollowComment"

Answer: "0Turns out AWS is applying quotas without specifying it anywhere on the console or documentation. And there seems to be a "trick", to overcome this, which is to create an EC2 instance on the same region you are trying to use ECS.https://forums.aws.amazon.com/thread.jspa?threadID=340770CommentSharediogofcanswered 2 years ago"


Question: Salesforce CDC to Data Lake

"Hello, I'm looking to push Salesforce data to a Data Lake.  This data lake table needs to hold different versions of the record.  I experimented with AppFlow, but I couldn't really get the control I wanted over the process (mainly notifying when an event came in).To cover the requirement of storing the changes I'm thinking of implementing Iceberg or Hudi.  In addition to storing the data for analytics, there are some additional requirements to push data back to Salesforce in more of a real-time nature.  Because of this, I've created an EventBridge rule to capture Salesforce CDC events in realtime.The plan is to take those events and process those back into the lake.  I was thinking of just sending the event to Lambda and then using Athena to update the Iceberg/Hudi table.  One of the difficulties is since the stream is only what changed I have to query up Athena to get the last full record and then overlay the changes.Good solution?  Bad solution?  Other things to try? We are a small company so data volume isn't huge so I'm not wanting to overengineer this process in the amount of work or $$$.  My team is primarily database developers so anything we can do to stay more sql-like is a plus.Thoughts?FollowComment"

Answer: "2Your plan to use Salesforce CDC events captured by EventBridge and process them in Lambda to update an Iceberg or Hudi table in your Data Lake sounds like a good solution. Using Athena to update the table is a good choice as well, especially if your team is primarily database developers.You mentioned that one difficulty is overlaying the changes onto the last full record, but you could consider using Delta Lake instead of Iceberg or Hudi. Delta Lake has built-in support for handling CDC and can manage the change data more efficiently. With Delta Lake, you can create a table that stores the full version of the record and a transaction log that tracks the changes. Delta Lake can apply the changes to the table and maintain its version history automatically.Overall, it sounds like you have a solid plan in place. You could start with Iceberg or Hudi and switch to Delta Lake if you find that the process of overlaying changes is too cumbersome. Keep in mind that this solution will require some ongoing maintenance and monitoring to ensure that the data is being captured correctly and that the process is running smoothly.CommentShareAWS_Guyanswered 3 months ago"


Question: How to increase Speed of a Deepracer Car?

"Hi, I have a stable model running in reInvent:2018 track it is clocking 8.1 to 8.3 secs without going off track even once (I ran the model 10 times in race). I want to get into 7 secs without going Off track. Any suggestion how can I improve the speed further?  Please note I have 25 discrete action spaces defined, hyperparameters are default except for epoch which is changed to 4.FollowComment"

Answer: "0Hello,Please note that the span of the action space is defined by the maximum speed and steering angle. We can specify the maximum speed and maximum steering angle during training in simulation. When deploying the trained model to your AWS DeepRacer vehicle for driving on a real-world track, the maximum speed and steering angle of the vehicle must be calibrated to match those used in the simulation training.Please refer to https://docs.aws.amazon.com/deepracer/latest/developerguide/deepracer-calibrate-vehicle.html for more details on the same.For any further queries or concerns, please raise a ticket with AWS Premium Support. I will be more than happy to assist you further.CommentShareSUPPORT ENGINEERDivya003answered 6 months ago0Hello IronMan,One thing to consider, as Divya has suggested, is if your action space allows your car to go faster. Another is whether your reward function incentivises  the car to go fast and the final is whether your hyperparameters are doing the same.CommentShareTomasz Ptakanswered 4 months ago"


Question: [bug] aws provisioned acm certificate validation time out in route53 registered domain

bug to reproduce:request public certificate from acmgo to add record in route53 hosted zonevalidation state: pending validationFollowComment

Answer: "0Have you double-checked the CNAME you added to the hosted zone?  Made sure you've put it in the right hosted zone, and its name & value match exactly what they should be?  Also that you haven't doubled-up on the domain part, as the way the Route 53 console fields work is the domain is added for you and you just paste in the prefix part of the CNAME's name.CommentShareEXPERTskinsmananswered 9 months agorePost-User-5260061 9 months agoso, this is a brand new hosted zone I recreated there are no other records except the one auto-generated by acm, again it is auto-generated by aws with a click of a button, I checked the records anyway, they are exact match to CNAME name/value, this must be a bug.ShareToni_S EXPERT9 months agoAnd is this Public Hosted Zone fully delegated from upstream DNS as well? ACM needs to be able to do the lookup via public DNS.Share"


Question: Enhanced Fan-Out

With Enhanced Fan-Out you can subscribe to individual shards.What happens to consumers when there is a re-sharding?FollowComment

Answer: "1Accepted AnswerThis link walks through resharding and should answer your question.https://docs.aws.amazon.com/streams/latest/dev/kinesis-record-processor-scaling.htmlResharding, Scaling, and Parallel ProcessingResharding enables you to increase or decrease the number of shards in a stream in order to adapt to changes in the rate of data flowing through the stream. Resharding is typically performed by an administrative application that monitors shard data-handling metrics. Although the KCL itself doesn't initiate resharding operations, it is designed to adapt to changes in the number of shards that result from resharding.As noted in Using a Lease Table to Track the Shards Processed by the KCL Consumer Application, the KCL tracks the shards in the stream using an Amazon DynamoDB table. When new shards are created as a result of resharding, the KCL discovers the new shards and populates new rows in the table. The workers automatically discover the new shards and create processors to handle the data from them. The KCL also distributes the shards in the stream across all the available workers and record processors.The KCL ensures that any data that existed in shards prior to the resharding is processed first. After that data has been processed, data from the new shards is sent to record processors. In this way, the KCL preserves the order in which data records were added to the stream for a particular partition key.Example: Resharding, Scaling, and Parallel ProcessingThe following example illustrates how the KCL helps you handle scaling and resharding:For example, if your application is running on one EC2 instance, and is processing one Kinesis data stream that has four shards. This one instance has one KCL worker and four record processors (one record processor for every shard). These four record processors run in parallel within the same process.Next, if you scale the application to use another instance, you have two instances processing one stream that has four shards. When the KCL worker starts up on the second instance, it load-balances with the first instance, so that each instance now processes two shards.If you then decide to split the four shards into five shards. The KCL again coordinates the processing across instances: one instance processes three shards, and the other processes two shards. A similar coordination occurs when you merge shards.Typically, when you use the KCL, you should ensure that the number of instances does not exceed the number of shards (except for failure standby purposes). Each shard is processed by exactly one KCL worker and has exactly one corresponding record processor, so you never need multiple instances to process one shard. However, one worker can process any number of shards, so it's fine if the number of shards exceeds the number of instances.To scale up processing in your application, you should test a combination of these approaches:Increasing the instance size (because all record processors run in parallel within a process)Increasing the number of instances up to the maximum number of open shards (because shards can be processed independently)Increasing the number of shards (which increases the level of parallelism)Note that you can use Auto Scaling to automatically scale your instances based on appropriate metrics. For more information, see the Amazon EC2 Auto Scaling User Guide.When resharding increases the number of shards in the stream, the corresponding increase in the number of record processors increases the load on the EC2 instances that are hosting them. If the instances are part of an Auto Scaling group, and the load increases sufficiently, the Auto Scaling group adds more instances to handle the increased load. You should configure your instances to launch your Amazon Kinesis Data Streams application at startup, so that additional workers and record processors become active on the new instance right away.For more information about resharding, see Resharding a Stream.CommentShareEXPERTiBehranswered a month agoPablo DC a month agoThanks iBehr, as I understand that doc is for KCL readers.I'm trying to use Enhanced Fan-Out, doc at https://docs.aws.amazon.com/streams/latest/dev/enhanced-consumers.html says:"If you use the API to build a consumer that uses enhanced fan-out, then you can subscribe to individual shards." so my doubt is: do I have to create more consumers when a new shard is added? what happens on auto-scaling scenario? what happens when the amount of shards is decreasing e.g. Merging Two Shards?Share"


Question: Run quick setup after tearing down first workspaces and directory ?

"I had a problem with my first workspaces setup which has been runing fine for some weeks and then, because of a mistake while deleting AWS resources, I have been unable to connect to the workspaces anymore and also unable to create new ones .So I did delete all workspaces, unregistered from my directory and deleted it to start all over again.But I foudn out that I don't have the Quick Setup option anymore. Is it possible to have the Quick Setup option again ?  My account Id is 0206-1551-4464Thanks in advance if somebody could help me out.BRChristian.Edited by: Birdie007 on May 14, 2019 12:03 PMFollowComment"

Answer: "0Accepted AnswerHey Christian,While it is not possible to create the quick setup again once you have already used it, you can choose any of the below paths to move forward.Quick set up page is region specific, therefore you should be able to see quick setup in other regions. Check if any other region where WorkSpaces are available works for you and you can use quick setup there.Since quick setup creates a simple AD for you at the back end and registers it with WorkSpaces, you can use the following resources to get started with the same.Create Simple AD: https://docs.aws.amazon.com/directoryservice/latest/admin-guide/how_to_create_simple_ad.htmlRegister directory with WorkSpaces: https://docs.aws.amazon.com/workspaces/latest/adminguide/register-deregister-directory.htmlOnce registered, you can start creating WorkSpaces as you could after quick setup. Please write back if you run into any issues.CommentShareAWS-User-9559230answered 4 years ago0Hey nityansatawsThanks for your clear explanations. I found my way out recreating and registering a simple AD in my region and I am now able to start again workspaces.So, again, a warm applause for helping me solve this issue and repair my mistake.All the best.Christian.CommentShareBirdie007answered 4 years ago"


Question: Private AWS SAR app does not include Readme

"Has anyone noticed or ran into this? After publishing an application, but not publicly sharing it, when accounts with whom the application was shared with (either via an organisation or direct accounts) will not see the Readme that is present in the app original/published account.It will simply say, in the Readme section after clicking in the app: "View on the AWS Serverless Application Repository site.".To make matter worst, that link returns a 404 when following it with the message: "The application you were looking for could not be found. Return to the applications search page.".Are Readme's not supported in privately shared apps in SAR?FollowComment"


Question: ArchiveId had hyphen; Not addressed in docs.

"I followed the instructions and used the API to delete the archives and that allowed me to delete 2 of the 3 vaults, but ran into an issue with deleting some the archives in the remaining vault.The archive ids for the remaining archives started with a hyphen. Which following the docs didn't mention or provide any guidance about.Any ideas on how to get these archives to actually go away so I can delete the vault?Updated to reflect actual cause of the problem, so this might be helpful to someone in the future.Edited by: DonalH on Feb 4, 2021 6:40 AMFollowComment"

Answer: "0Apparently, this issue is known. You just have to search GitHub's bug tracker for the CLI in order to find the information.Here is the documentation that resolved the issue: https://github.com/aws/aws-cli/issues/1319Typos, why?Edited by: DonalH on Feb 4, 2021 6:49 AMCommentShareDonalHanswered 2 years ago"


Question: ec2 status 1/2 checks

"hi, i am getting instance reachability check failed. I took an image and launched an instance from the image, I had vpc, security group, and also i associated elastic IP. In the system logs, it was showing a module not found error. until instance on, how can i install-module.FollowComment"

Answer: "0Hello,This issue occurs due to operating system-level errors such as the following:Failure to boot the operating systemFailure to mount the volumes correctlyExhausted CPU and memoryKernel panicI have found the aws blog that addresses resolution for each of the mentioned above failures.Refer to this aws blog, and let me know if you manage to resolve it.I hope this helpsCommentShareLungaanswered a year ago"


Question: Republish device status on shadow topics

"We have devices already sending status information ( firmware version, wifi connection status, etc) on custom topic. At this point, We do not want to change our device firmware to directly send updates to device shadow but still want to utilize Fleet Hub for monitoring.  In this case, Can we use rule engine and lambda function to receive status info from custom topic Convert into shadow document and republish it to device shadow topic ?FollowComment"

Answer: "0Accepted AnswerHi,Yes, you can do the transformation via IoT Rule directly.The IoT Rule SQL could look like this:SELECT { "state": { "reported": { "firwmare": firmware  , "wifi-connection-status": connection} } } FROM 'custom/topic'Where firmware and connection have to be replaced with your key-value from your topicThen you can use the republish action to send it to the shadow.CommentSharebrnabaanswered 5 months ago"


Question: Security standards in config and security hub

"I see you can enable pre defined security conformance packs like CIS, AwS foundational or PCI via both aws config and security hubis there any difference in enabling them from one or other?can we enable them via security hub only and leave the conformance pack deactivated in config?FollowComment"

Answer: "1Hi rePost-User-6703621,The AWS Config conformance packs are not needed if you are using the standard in Security Hub.The Security Hub FAQ gives a good explanation to help answer this:Q: When do I use AWS Security Hub and AWS Config conformance packs?If a compliance standard, such as PCI-DSS, is already present in AWS Security Hub, then the fully managed AWS Security Hub service is the easiest way to operationalize it. You can investigate findings via AWS Security Hub’s integration with Amazon Detective, and you can build automated or semi-automated remediation actions using AWS Security Hub’s Amazon Eventbridge integration. However, if you want to assemble your own compliance or security standard, which may include security, operational or cost optimization checks, AWS Config conformance packs are the way to go. AWS Config conformance packs simplify management of AWS Config rules by packaging a group of AWS Config rules and associated remediation actions into a single entity. This packaging simplifies deployment of rules and remediation actions across an organization. It also enables aggregated reporting, as compliance summaries can be reported at the pack level. You can start with the AWS Config conformance samples we provide, and customize as you see fit.CommentShareAdamAtAWSanswered 10 months ago0AWS Security Hub's fully managed solution is the easiest method to operationalize compliance standards like PCI-DSS. AWS Config conformance packs can help you create your own compliance or security standard, including security, operational, and cost optimization checks. AWS Config compliance packs bundle AWS Config rules and corrective actions to simplify maintenance.CommentShareRajjat Kumaranswered 5 months ago"


Question: Throttling a Client/Index from OpenSearch (ElasticSearch)

"I have the following setup for logs:Fargate Service -> Firelens/Fluent Bit -> OpenSearch (ElasticSearch) Cluster orFargate Service -> Cloudwatch -> OpenSearch (ElasticSearch) ClusterI know about Fluent Bit Throttle, but that is on client side.What would be good mechanism on OpenSearch (ElasticSearch) Cluster side to throttle that Client/Index if he pushes to much data?FollowComment"

Answer: "1Accepted AnswerOpenSearch throttles by default when the respective threadpool queues are full. High threadpool queues indicate the that the incoming request rate is greater than what the cluster is provisioned to handle.If you're going beyond this, you would have to setup a feedback mechanism by considering metrics such as CPUUtilization, JVMMemoryPressure, etc. You can set a CloudWatch alarm over the metrics to notify you via SNS as well as configure SNS to invoke a Lambda function to reduce the rate on the client side as required.CommentShareAjay Nanswered a year agoLaszlo a year agoThe client might be in another account. The Lambda should execute there and reduce the rate there or should is there a way to to set some rule in OpenSearch to limit and incoming DataStream?Share"


Question: Can I force each job to run on a dedicated instance?

"Hi folks,I have some ETL jobs that is already containerized and as of today we do all orchestration by our self's in a kind of "in house made aws-batch version".I'm considering to move to AWS Batch but in order to do so I would like to have each Job to run on a dedicate instance due to disk space requirements. By sharing an instance we risk running out space in the middle of the job execution.From what I could see in terms of how AWS Batch handle compute requirements the decisions on when to launch a new instance is based solely on vCpu and Memory. Is there a way to instruct Batch to never send two jobs to the same running instance?Thanks in advance,FollowComment"

Answer: "0Accepted AnswerThere's no way to tell AWS Batch to schedule a particular job to a dedicated instance.However, if you configure your compute environment to spawn EC2 instances that all have the same number of vCPUs, then submitting a job requesting as many vCPUs as are available on your instances will end up running on an instance dedicated to itself (basically, the job will consume all the vCPU of the instance, so batch isn't gonna schedule any additional job on it).You will loose some flexibility on the instance choice front, but that should fit your requirements.BR,ArthurCommentShareArthur-AWSanswered 4 years ago0Ok, answering my own question I managed make this work by creating a compute resource with a specific ec2 instance and always submitting jobs that fully consume the instance's memory and vcpus.I would be great if this could be achieved pragmatically (like using a flag or something).Regards.CommentShareepchavesanswered 4 years ago"


Question: Failed to creat a fleet of GameLift

"Hi, When I attempted to create my first fleet,  I got this error:"Error! Cannot create the fleet. Reason: Current limit of fleets of 0 have been reached.." I tried several ways to solve it, but failed: Change regions or reload builds doesn't work. Change Quotas of fleet doesn't work.Anyone can help?FollowCommentznnxzz a year agoHello!We are facing the same problem. AWS Support Team keeps sending the boilerplate answer, and it is not helpful at all...Did you manage to solve this issue?Share"

Answer: "-1HiPlease open a support ticket with AWS they will help you, https://us-east-1.console.aws.amazon.com/support/home?region=us-east-1&skipRegion=true#/case/createThanksGKCommentShareGKanswered a year ago"


Question: Batch download files from multiple different folders in the same S3 bucket

"I have a csv file with a column specifying the names of the files that I would like to download. These files are stored in multiple different folders in the same S3 buckets. Is there a way I could download these files by passing the file names (either in a text file or a csv column), have AWS search in all the folders inside this S3 bucket, and download those files needed? I also have configured AWS CLI already if there's an option there. Thanks!FollowComment"

Answer: "1Here is a link to download file from S3 using python. https://boto3.amazonaws.com/v1/documentation/api/1.9.42/guide/s3-example-download-file.html Try it out and see if you are able to download single files. You can then pass a text file to python program and for each filename in the text file, run the above code to download the file. Hope it helpsCommentShareSandeepVudataanswered a year agoAWS-User-4738931 a year agoThank you for your answer, Sandeep. I tried specifying my bucket, key, and filename just as what is showing in this example - s3.Bucket('mybucket').download_file('hello.txt', '/tmp/hello.txt'), but I kept running into this - ClientError: An error occurred (404) when calling the HeadObject operation: Not Found. So the 'hello.txt' in their example is a single file, stored in the folder 'tmp' inside the bucket called 'mybucket', correct? Just trying to understand the file structure here.Share"


Question: DynamoDB vs Aurora

"Dear Team,We are planning to upload approx 1.5 lakhs documents per day in S3 and planning to store its metadata in the DB(1 row/document).  We also have a search requirement on this metadata for which we are planning to use AWS OpenSearch.  So, basically the DB is going to be used as System of record only.  Wanted to check what will be the better DB to store this huge volume of data.  Dynamo DB or Aurora ?FollowComment"

Answer: "1Accepted AnswerDynamoDB can handle any throughput as long as the items are well distributed. There is a limitation on DynamoDB of 400kb per item, so if your document metadata exceeds this size then it is not the option for you.DynamoDB is suited to OLTP workloads whereas Aurora is more suited to OLAP workloads. If your use-case needs high throughput and low latency, then DynamoDB is a better option. If your use-case involves analytical queries, then Aurora is a better option.Amazon Aurora | Amazon DynamoDB---|---|---It was developed by Amazon in 2015.|It was developed by Amazon in 2012.It is MySQL and PostgreSQL compatible cloud service by Amazon. |It is hosted, scalable database service by Amazon with data stored in Amazon cloud.It provides concept of Referential Integrity. Hence, no Foreign Keys.|It does not provide concept of Referential Integrity. Hence, no Foreign Keys.Immediate Consistency is used to ensure consistency in distributed system.| Eventual Consistency and Immediate Consistency are used to ensure consistency in distributed system.Its Primary database model is Relational DBMS.|Its Primary database models are Document store and Key-value store.It supports Server-side scripting.|It does not support Server-side scripting.Partitioning can be done with horizontal partitioning.|It supports sharding as partitioning method.It supports SQL query language.|It does not support SQL query language directly, but via PartiQL API.It supports only one replication method – Master-slave replication.|It supports replication methods.It does not offers API for user-defined Map/Reduce methods. |It does not offers API for user-defined Map/Reduce methods. But maybe implemented via Amazon Elastic MapReduce.CommentShareEXPERTLeeroy Hannigananswered a year agokentrad EXPERTa year agoOne correction about SQL support: https://aws.amazon.com/about-aws/whats-new/2020/11/you-now-can-use-a-sql-compatible-query-language-to-query-insert-update-and-delete-table-data-in-amazon-dynamodb/ShareLogan 11 days agoThere are several databases that can be used with the Amazon Aurora service such as MySQL, Postgres, MariaDB, Oracle, and SQL Server but none of these should be considered for OLAP workloads. Aurora databases should be used for OLTP workloads. For OLAP, it would be best to use Amazon Redshift.Share0Thank you for the question and I just wanted to add more information in this context regarding concurrency. This will help you to take a better decision in terms of which engine to use. I do not have visibility on your application but I understand a lot IO (Write and Read) will be catered by this metadata database.Regarding AuroraMySQL/Aurora MySQL, utilize MVCC (Multi Version Concurrency Control) mechanism [1], and implements locks [2] on tables/rows with different transaction isolation levels [3]. For example, on Aurora MySQL database with the default settings such as the isolation level (repeatable read [3]), it would not allow update on a table/row/rows if there has already been a transaction writing to it.Since the write operation would require exclusive lock, so the earlier write transaction which has already acquired that lock, would block the later transaction who is trying to get that lock for the same rows or table which the query scans for. When the later transactions are blocked longer than innodb_lock_wait_timeout [5], it would abort with error like "Lock wait timeout exceeded; try restarting transaction".Therefore, the pros is the data consistency is ensured, but, the cons is there could be blocking issue happens. For reads, repeatable read isolation level ensures reads are not blocked, and, reads are consistent within the same transaction [3].To avoid blocking, there are a few options, such as review the query logic, minimize the concurrent write operations on the same records, configure retry mechanism on the application side to retry the transactions which aborted due to timeout on the lock wait.Regarding DynamoDBI have researched this for Dynamodb as well, can see for Dynamodb, there is a feature called "optimistic locking" [4], and it can be used to ensure the writes are protected from being overwritten by the writes of others, and vice versa [4].You may refer to link [4] for more information on this feature and how to use it.That being said, please do accept answers if the answers resolve your question. That's a best practice in Q&A communities both for other viewers and also out of respect to other's time spent answering the questions.As always, Happy Cloud Computing.===============Links=====================[1] MySQL MVCC:https://dev.mysql.com/doc/refman/5.7/en/innodb-multi-versioning.html[2] Innodb locks:https://dev.mysql.com/doc/refman/5.7/en/innodb-locking.html[3] MySQL isolation levels:https://dev.mysql.com/doc/refman/5.7/en/innodb-transaction-isolation-levels.html[4] Dynamodb optimistic locking:https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/DynamoDBMapper.OptimisticLocking.html[5] innodb_lock_wait_timeout:https://dev.mysql.com/doc/refman/5.7/en/innodb-parameters.html#sysvar_innodb_lock_wait_timeoutCommentShareSUPPORT ENGINEERArnab_Sanswered a year ago"


Question: Auto mqtt Port Block

"We have a service which use mqtt for most of its data communicationMany clients with different public IPs connect to itSometime during peak hours, some of our clients acess is blockedThe block occurs in such a way that only mqtt ports are blocked other all ports are working fineThe block is automatically removed after 2 hours, by then total traffic of mqtt also settles downI have checked mqtt server/service software for any issues as well updated the software,open connection to the service is also at max.Does AWS automatically block IPs eventhough I have not enabled any firewall like services in AWS ?FollowComment"

Answer: "1Accepted AnswerI don't think there is any automatic blocking unless you are using services like network ACLs or security groups.The VPC flow logs should be checked as a way to investigate the error.In addition to that, if there are network-related CloudWatch metrics, etc., it would also be useful to check for suspicious activity.Also, if it is possible to obtain logs on the MQTT server side, it would be a good idea to check those logs.CommentShareEXPERTRiku_Kobayashianswered 12 days ago"


Question: How to make sure unified Quicksight visualization output format?

"Hi experts,Wondering if anyone encounter the same problem and I would love to get some suggestions, thank you in advance.For example, the font sizes are different between my published dashboard and exported email report. Also, I've found out that if I download my published dashboard into pdf file, the format of font size and visuals also look different on the pdf file. Is there any way that I can fix the output format to make sure that everything looks the same as what I see on the dashboard? Very appreciated!FollowComment"


Question: Initiating and enthusiastic on AWS Device Farm

"Good afternoon dear friends!We are very enthusiastic to use Device Farm with our Appium Ruby automation, but, we facing a problem to configure and start the yml configuration.Could you please show us an example about how to configure the yml and how to adapt the code to run it on DF, for example, what UDID we have to put on capabilities.We appreciate if had some example project on Appium ruby/cucumber.Thanks in AdvancePS. we had alot of tests trying to run, the last one was the below.https://us-west-2.console.aws.amazon.com/devicefarm/home?region=us-east-2#/projects/732be549-5dae-4aac-935f-ae71059fcc7a/runs/0c1982c1-b27b-4ec8-a63d-33fd70e914e3FollowComment"

Answer: "0Hi there,Thanks for reaching out. The problem with your test is that, in device farm, you're still using your local device configuration with udid "09340922021e7fda". You should be using the device farm udid, which is stored in an environment variable called "$DEVICEFARM_DEVICE_UDID". You're going to have to rework how your test starts its desired capabilities to use this environment variable. Let us know if you need any help doing this.For more help on scaling up with Device Farm and using the YAML configuration file, you can also reach out to us over email at aws-devicefarm-support@amazon.comThanks!CommentSharesimsjon at AWSanswered 4 years ago0Thank you for the support!!CommentShareEdsonVasquezanswered 4 years ago"


Question: Kinesis Data Analytics record ordering

"if I push IoT Core data to Kinesis Analytics as stream, how possible is to apply order by query to streaming data because you don't have complete data to call "order by" ?My goal is pushing IoT Core data and push them to Analytics in order to put them in sequence and push to AppSync to broadcast to subscribers. This Way I can visualize the data flow in time series and sequential in real time.ThanksFollowComment"

Answer: "0AWS IoT does not guarantee the order of received messages :The message broker doesn't guarantee the order in which messages and ACK are received.Therefore,  to use the order by clause in Amazon Kinesis Analytics, you need to have an attribute in the MQTT payload that you can order on. Ideally it's your device that adds it e.g a sequence number or timestamp.CommentShareEXPERTJan_Banswered 7 months ago0Definitely I will have attribute for order by, but my point if you don't have all of the record order by will miss some of them, unless you wait all messages received and run order byCommentShareOzy smileanswered 7 months ago"


Question: An error occurred (InvalidSsmlException) when calling the StartSpeechSynthesisTask operation: Invalid SSML request

"Why does the response in case of an error omit any details like which bits of the provided SSML is invalid?I'm currently facing a weird situation:When I try to start a StartSpeechSynthesisTask from a python application, using boto3, I get an InvalidSsmlException. But when I try the same input in the AWS Polly > Text-to-Speech console, it works flawlessly.Bet if the Exception included more info I would find the answer on my ownFollowComment"


Question: How can I determine why my output.manifest isn't being created?

"I'm getting the following messages.FAILED: ClientError: Initial probe with 10 objects failed. Look at the output manifest file for details.401 UnknownError: The specified key <path>/manifests/output/output.manifest isn't present in the S3 bucket <bucket>"I'm new to this so I don't know the best places to look to debug, but I have tried to find and read the logs. I've tested the lambdas individually with mock data (pre-processing lambda) and an s3 annotation file (post-processing lambda), but not tested the full pipeline. One weird thing is in one of my attempts, somewhere, I found a consolidated file that included a structure like:{'content':   {'example-attribute':and I have no idea where "example-attribute" can be coming from.Appreciate any help you can provide.FollowComment"


Question: "AWS lightsail instance, websocket connection not working"

"I am using AWS lightsail to host my webapp. Even though I opened the ports in the firewall, it is not possible to etablish a websocket connection. What could be the reason?FollowComment"

Answer: "1Accepted AnswerFound the issue. The firewall works fine. The problem was that I use cookies for authentication and the cookie was not created, since I have set it to "Secure", but didn't use an SSL certificate.CommentSharerePost-User-0566002answered 2 months ago"


Question: Lua 'require' module/library functionality in LY

"Hello all,I'm looking to use the 'require' functionality in Lua (as described here) as in this example:mymodule = require "mymodule"mymodule.foo()to utilise Lua's version of libraries (modules) in Lumberyard, however I'm getting the following error when attempting to do so:[Warning] levelname/scripts/test.lua:5: module 'mymodule' not found:Module "mymodule.luac" has not been registered with the Asset Database.---------- START STACK TRACE ---------- ---------- END STACK TRACE ----------I get the feeling that this functionality is not implemented for use in Lumberyard? Could this please be confirmed if so, or insight given as to the proper way to achieve this effect in LY if implemented differently?Thanks a lot,AlexFollow"

Answer: "0Accepted AnswerHey @REDACTEDUSERFileName: mymodule.luaREMOVEDUPLOADFileName: lua_test.luaOutput:Note: There is a known bug where lua files do not reload into the Lua Script component after we make changes to the scripts. For this, we simply need to re-browse for the Lua file in the Lua Script component to load the latest changes. We are working on fixing this issue ASAP —Hope this was helpful!SharerePost-User-5738838answered 6 years ago0Bumping this hoping for an answer, it's proving to be a blocker to implementing functionality!SharerePost-User-8841100answered 6 years ago0Hey @REDACTEDUSERSharerePost-User-8353690answered 6 years ago0Thank you @REDACTEDUSERSharerePost-User-8841100answered 6 years ago0i still get the: "has not been registered with the Asset Database." error when trying load a module (1.9.0.1)ThanksSharerePost-User-2516973answered 6 years ago"