Question: Bug in AWS Console preventing Cloudfront setup with domain after transfering domain between Companies

"Hey,I just purchased a specific domain from another company. If you have access to my account, it is the mostly recently added domain (the domain is 14 characters, including the ".com").I use AWS for hosting and so does the other company. We successfully transfered the domain to my Route 53 from their Route 53 no problem. I was also able to get a ACM Cert for this domain in my account.The prior company had the domain associated with a Cloudfront, and I would also like to associate it with a Cloudfront too.However, when I go to associate it with a Cloudfront, the AWS console says it cannot associate it with my cloudfront because it is already associated with another resources.I am fairly confident this is a bug in the AWS console because there is no other resource in my account that the domain is associated with - the other cloudfront resource is in the prior company's account, which should not be affecting anything in my account.ThanksFollowComment"

Answer: "-1This is expected behavior and not a bug on the AWS console. The domain in Route 53 is independent of the domain in Cloudfront. The alternate domain name for a Cloudfront distribution needs to be unique. When you try to add an alternate domain name to a Cloudfront distribution but the alternate domain name is already in use on a different distribution(across any AWS Account), you get a CNAMEAlreadyExists error (One or more of the CNAMEs you provided are already associated with a different resource).There is a process you can follow the move the domain from source distribution to a target distribution. https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/CNAMEs.html#alternate-domain-names-moveHope this helpsCommentShareKetananswered 20 days agoryanhughes 20 days agoI understand that, but how can I CNAME the domain with a cloudfront in my AWS account? I have no access to the other company's AWS account.  They don't own the domain anymore, so there's no point in having it attached to their cloudfront.Are you saying the only way is to contact the other company?ShareKetan 20 days agoIn that case, you have 2 options.If the source distribution in the other company's account is DISABLED, then it is a self-serviceable process. You can follow these steps that is mentioned here under "Use associate-alias to move an alternate domain name"  https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/CNAMEs.html#alternate-domain-names-move-associate-aliasPS: There is no way for you to know if the source distribution is in DISABLED state, so its a one time trial and error process.If option 1 does not work, you can work with AWS Support to assist in moving the domain to your distribution. They would need to verify if you own the domain, for which you would need to create TXT record in Route 53.  https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/CNAMEs.html#alternate-domain-names-move-contact-supportShareryanhughes 19 days agoHey,Thank you for the suggestions.Just tried 1, it didin't work unfortunately.I don't have a paid tier of support in my AWS account, so I can't reach out to support. If this is the only way, can you help me out here?Much appriciated,RyanShareryanhughes 12 days agoHey Ketan - Any update here? I'd love to use AWS for this domain. However, I cannot associate the domain with a Cloudfront instance, and I don't have access to the other company's AWS to disassociate the domain. I would be forced to use an alternative service like GCP here.Can you help?Share"


Question: "AppFlow Google Analytics 4 flow fails on schedule, succeeds on demand"

"We set up a flow syncing Google Analytics 4 metrics Metric:active1DayUsers, Metric:active7DayUsers, Metric:active28DayUsers by dimension Dimension:country.We have no filters.This flow succeeds on demand, but fails on schedule with this message:The request failed because the service Source Google Analytics 4 returned the following error: Details: The field that you specified as a filter, active1DayUsers, is not supported by the data object that you assigned to this flow. Specify a valid field and try again., ErrorCode: InvalidArgument.Any idea how I can fix this?FollowComment"

Answer: 0It worked after I deleted and recreated the flow.CommentShareDavid Grayanswered 2 months ago


Question: CDK RDS ServerlessCluster with public access

"Hi,I would like to create a ServerlessCluster with public access.  I have successfully been able to create a database, and can access it using private methods, but I would really like public access for my users.   const cluster = new rds.ServerlessCluster(this, 'AnotherCluster', {      engine: rds.DatabaseClusterEngine.AURORA_POSTGRESQL,      parameterGroup: rds.ParameterGroup.fromParameterGroupName(this, 'ParameterGroup', 'default.aurora-postgresql10'),      vpc: env.getVpc(),      vpcSubnets: {        subnetType: ec2.SubnetType.PUBLIC,  // doc indicates that this should result in public access      },      //publiclyAccessible: true,  // this option not available for ServerlessCluster      credentials: rds.Credentials.fromGeneratedSecret('postgres'),      enableDataApi: true,       defaultDatabaseName: 'defaultDatabase'    });The construct 'ServerlessCluster' does not have the 'publicAccessible' property, so that can't be configured.  The doc indicates that by specifying  subnetType: ec2.SubnetType.PUBLIC then the default is to provide public access, but despite placing the database in the public subnets, it does not do so.  The domain name resolves to a private address.I can create a similar database from the console, specify public access, and that works, but I really need to do this from the CDK.How can I get this to work?thanks.FollowComment"

Answer: "0Hello,As seen in the following AWS documentations You can't give an Aurora Serverless v1 DB cluster a public IP address. You can access an Aurora Serverless v1 DB cluster only from within a VPC[1].  Hence giving public access to serverlesss v2 cluster is not supported. That being said Aurora Serverless v2 does support public ip address as  seen in the following AWS document which also compares differences between an Aurora Serverless v1 V/S Aurora Serverless v2 cluster[2].References:[1]https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-serverless.html#aurora-serverless-v1.requirements[2]https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-serverless-v2.upgrade.html#Serverless.v1-v2-requirementsCommentShareAditya_Tanswered 10 months ago0Thanks for that info.  The doc doesn't state that ServerlessCluster launches v1 by default, and it wasn't my intention to do so, how can I launch a v2 cluster, and allow public access?CommentShareAWS-User-9720008answered 10 months ago0The user guide doc is your friend. Do note, however, that you'll have to run engine_version 13.6 or newer for v2; if you select e.g. 10.21 as your version, only serverless v1 is an option (I assume that's what you did). Thus, either create a new database with the right version (easiest, especially if you don't have a lot of data) or follow the upgrade instructions in the user guide (which takes a few steps, but may be a good learning experience).https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-serverless-v2.upgrade.htmlCommentSharestaringAWSanswered 10 months ago0Thanks for your answer, but still no luck.  I've changed the engine version to 13.6 (but see the same results with 13.7) as follows, but now it tells me8:36:21 AM | CREATE_FAILED        | AWS::RDS::DBCluster                         | AnotherCluster9D7C9369The engine mode serverless you requested is currently unavailable. (Service: AmazonRDS; Status Code: 400; Error Code: InvalidParameterValue; Request ID: 4e3e0d67-2055-48a6-aa9a-6cfcbc92e27b; Proxy: null)    const cluster = new rds.ServerlessCluster(this, 'AnotherCluster', {      engine: rds.DatabaseClusterEngine.auroraPostgres({ version: rds.AuroraPostgresEngineVersion.of('13.6', '13', { s3Import: false, s3Export: false }) }),       vpc: env.getVpc(),      vpcSubnets: {        subnetType: ec2.SubnetType.PUBLIC,      },      credentials: rds.Credentials.fromGeneratedSecret('postgres'),      enableDataApi: true,       defaultDatabaseName: 'defaultDatabase'    });Any further suggestions?CommentShareAWS-User-9720008answered 10 months ago0Is it mandatory for you to use the CDK for this? It appears that there's still no proper support in CDK for creating serverless v2 clusters, see e.g. https://github.com/aws/aws-cdk/issues/20197 which hasn't been marked as resolved yet. Some workarounds have been presented in the comments to that issue, so maybe you can get around the limitation that way if creating the cluster using e.g. the console is not an option.CommentSharestaringAWSanswered 10 months ago0Thanks.  It is mandatory that we use the CDK - all our infrastructure is automated and stood up using it.  I have since found a work around though.CommentShareAWS-User-9720008answered 10 months ago"


Question: GStreamer plugin for Kinesis data stream

"Hi, I am looking to use Kinesis data for my use case which involves video streams. I noticed that GStreamer plugin is available for Kinesis Video. Is there a similar support to push data to Kinesis data stream?FollowComment"

Answer: "0Are you looking for a library that will push video to Kinesis Video Streams or are you looking for a library that will push video to Kinesis Data Streams?If it is Kinesis Data Streams, then there is the Kinesis Producer Library - https://docs.aws.amazon.com/streams/latest/dev/developing-producers-with-kpl.htmlGithub location is https://github.com/awslabs/amazon-kinesis-producerCommentShareEXPERTIndranil Banerjee AWSanswered 8 months agorePost-User-8769592 8 months agoI am looking for GStreamer library that pushes data to Kinesis Data Stream instead of pushing data to Kinesis Video. I see a GStreamer plugin that exists for Kinesis Video (https://github.com/awslabs/amazon-kinesis-video-streams-producer-sdk-cpp) but I would like to push the video stream to Kinesis Data instead.ShareIndranil Banerjee AWS EXPERT8 months agoKinesis Video Streams is the right service for handling video. Kinesis Data Streams is not meant for handling video streams. It has a limit of 1MB for a particular message. What is your use-case for handling video streams with Kinesis Data Streams, if I may ask? We may be able to provide the correct recommendation if you can provide some details about what is it that you are trying to achieve?SharerePost-User-8769592 8 months agoThanks! I am using Kinesis data streams for other use cases and I am very happy with how it performs. Kinesis Video will be a completely new addition to our dependencies if I use it for video use case. Since it is new service for us, I will have to experiment and let it bake with our internal environment before we make use of it. Perhaps knowing a bit more about architecture of the service will help ease the worry of a new dependency. Is Kinesis Video built on top of Kinesis data? Are there any documents/blogs that provide more architecture related info on it?ShareIndranil Banerjee AWS EXPERT8 months agoIf you go to the documentation page for Kinesis Video Streams https://aws.amazon.com/kinesis/video-streams/ and scroll down all the way to the bottom, you will see a section on Blog Posts.You can also take a look at content on this service in the resources page - https://aws.amazon.com/kinesis/video-streams/resources/SharerePost-User-8769592 8 months agoI looked through those blogs but none of them seem to go into details of architecture. Can you please help answer these questions so that I can make a decision.Is Kinesis video is built on top of Kinesis Data? If not, do they have similar architecture for messaging and persistence?Besides the support for > 1 MB message size, are there other reasons why Kinesis Video is preferable over other popular messaging technologies (such as Kinesis Data stream, Kafka etc) for video streams?Thanks!Share"


Question: GameLift Server SDK now supports Unreal Engine 4.25 and Unity 2020

"Hello all game developers, We just released an update to the Amazon GameLift Server SDK. The new Server SDK version 4.0.2 is now updated to support Unreal 4.25 and Unity 2020 versions. Download the updated server SDK, and check out the release notes. No changes to the API.The GameLift TeamFollowComment"


Question: Email delivery receipt.

"Hello everyone, how´s it possible for me to request a delivery receipt of all the emails I send? I´m running outlook 2010 as my email client, I´ve checked the "request delivery receipt" but it doesn´t work as I´m used with my past server(SMTP instead of exchange).On the workmail page interface there´s only "read receipt", that´s not what I´m looking for.Appreciate any help.FollowComment"

Answer: "0Hi,I'm sorry to inform you that WorkMail does not support this feature. WorkMail only support the "Read receipt". I will pass this to the service team as feature request.Kind regards,RobinCommentShareMODERATORrobinkawsanswered 4 months ago"


Question: Missing customer name and address data in SP API response

"Hello,the new SP-API returns address data without name, address_line1, address_line2 und address_line3. All these fields are returned empty (endpoint /orders/v0/orders/{orderId}/address).How to enable the data being returned by SP-API?Thank you very much.FollowComment"

Answer: "0I'm having the same issue. Did you ever find a solution? Its worthless to us without the company name and address.CommentShareCheckPrintingSuppliesanswered 2 years ago0Yes, I found a solution:In my Developer Profile (https://sellercentral-europe.amazon.com/developer/register)the role "Tax Invoicing" was not selected.After activating this option and re-submitting the form, data for name and address is available now using SP-API.I had to setup a new IAM User and app client with access for this role.Updating an existing app client with the new role did not work for me.Hope this helps you.CommentShares-user-010answered 2 years ago"


Question: Return Value in XCOM from PythonVirtualenvOperator

"Dear All,  How can we return value from PythonVirtualEnvOperator ?I am unable to set it in XCOM as task instance context is not available  inside PythonVirtualEnvOperator.FollowComment"

Answer: 0Please refer to this issue https://github.com/apache/airflow/issues/15335 and respond if the issue still persists.CommentShareSUPPORT ENGINEERManu_Ganswered a year ago


Question: CodeCatalyst CLI - request for issue management API

"I realise CodeCatalyst is in preview, but it would be really useful if the API could be expanded so that we can manage issues via the CLI.As an example, I'm thinking that it would be useful for a workflow to be able to raise an issue if there was a problem with a new run, and assign it to the author of the associated commit.This could also provide a solution to my request for manual authorisation as part of a workflow - i.e. before deploying to prod, check if a ticket exists to approve the deployment, if not create one, and if one does exist, wait until it is closed by someone in a list. This would mean we need be able toquery if a issue exists based on id, associated commit id, or other criteria. If the issue does exists, the details of the ticket, including the issue status should be returnedcreate a queryFollowComment"

Answer: 1Thank you for your feedback.I have raised a feature request with the service team on your behalf.Please keep an eye on Whats' New and Blog pages for any new feature announcements.CommentShareMODERATORAWS-Christosanswered 3 months ago


Question: IAM user password last changed date using boto3

"Hi Team,Me looking to get the data on which password last changed for IAM users. get_login_profile gives the values on the day first time password created but doesn't provide the recent change date.Regards,Nikhil ShahFollowComment"

Answer: "0Accepted AnswerHi @AWS-User-1576695,IAM User's password does not appear to be accessible via any API call and it is supplied as password_last_changed in the **Credentials Report **that can be downloaded from the AWS IAM management console.aws iam list-users --query "Users[?UserName=="<user>"].PasswordLastUsed" should give the timestamp when the password was last changedIf the Answer is helpful, please click Mark as answered, this can be beneficial to other community members.CommentSharelearn2skillsanswered a year agoAWS-User-1576695 a year agoThank you.Share"


Question: AWS Translate with Amazon Connect voice channel in real time

"Hi,The scenario is, the contact center is running on using Amazon Connect. If a French speaking person calls in, can they interact with the agent, who knows only English with the help of real time translation from AWS Translate service? I would like to know, if it's possible.FollowCommentGovind Kumar 25 days agoSo I want to know whether the input will be inform of audio right?Share"

Answer: "2If you are thinking of using translate then the input has to be in text since translate only accepts text as input.So you can make use of Transcribe ---> translate ---> PollyTanscribe converts the speech into text and then you can change it to english using translate and then use polly (text to speech)https://docs.aws.amazon.com/transcribe/latest/dg/streaming.htmlhttps://docs.aws.amazon.com/polly/latest/dg/what-is.htmlPlease make sure that you are using the realtime API calls for the above services.Please refer to this link as it may help you!https://aws.amazon.com/blogs/machine-learning/break-through-language-barriers-with-amazon-transcribe-amazon-translate-and-amazon-polly/CommentShareGovind Kumaranswered 25 days ago1Regarding the chat channel, there are some scenarios already implemented by other customers that are solving this approach. They leverage Amazon translate with Amazon Connect to allow this cross language interaction between agents and customers. Have a look to this blog post for more info.For the voice channel, there are no out of the box integrations that allow to implement this approach as easy as with the chat channel.If you are still interested in having this approach with the voice channel you will have to implement a custom solution. This solution will have to leverage the Amazon Translate and Amazon Transcribe  services (for translate audio transcriptions), Amazon kinesis Video Streams (For streaming the audio of the call into those services) and finally Amazon Polly (for passing from the translated text to speech).There are no public resources to share on this approach, so if you are still interested on it and need more guidance I suggest you to contact your specific AWS team (Account manager or solution architect).CommentShareigsalvaranswered 25 days ago"


Question: AWS DMS Migration task Source MongoDB and Target RDS Postgres

"From few week all DMS tasks were successfully running, but now after full loads is completed and ongoing replication starts after few seconds this error comes:Replication task has failed. Reason: Last Error Error reading the database log. Task error notification received from subtask 0, thread 0 [reptask/replicationtask.c:2880] [1020460] Error executing source loop; Stream component failed at subtask 0, component st_0_YF7WZ2RCSVJ5YSNKTAJBYWAUWT3T7WKW4CXV6BA; Stream component 'st_0_YF7WZ2RCSVJ5YSNKTAJBYWAUWT3T7WKW4CXV6BA' terminated [reptask/replicationtask.c:2888] [1020460] Stop Reason FATAL_ERROR Error Level FATAL.Error in Cloud watch logs[SOURCE_CAPTURE  ]E:  Expected to read 4 operations as part of transaction '{    "lsid": {        "id": {            "$binary": {                "base64": "Gn5w6RP****sSG1w==",                "subType": "04"            }        },        "uid": {            "$binary": {                "base64": "c5zE0wpKRhgcs6YLEzR******LVUqMjMseoKo=",                "subType": "00"            }        }    },    "txnNumber": {        "$numberLong": "1"    }}' but read 2 [1020460]  (change_streams_capture.c:894)2022-07-10T12:31:24 [SOURCE_CAPTURE ]E: Expected to read 4 operations as part of transaction '{ "lsid" : { "id" : { "$binary" : { "base64": "Gn5w6DMW*****PsSG1w==", "subType" : "04" } }, "uid" : { "$binary" : { "base64": "c5zE0wpKRhgcs6****8Gynk4RLVUqMjMseoKo=", "subType" : "00" } } }, "txnNumber" : { "$numberLong" : "1"} }' but read 2 [1020460] (change_streams_capture.c:894)[SOURCE_CAPTURE  ]I:  Destroying mongoc client: '22360472577088'  (mongodb_imp.c:1161Destroying mongoc oplog client: '22360472609024'  (mongodb_imp.c:1168)[SOURCE_CAPTURE  ]E:  Error executing source loop [1020460]  (streamcomponent.c:1872)FollowComment"


Question: What to do if deepracer is not booting up to blue LED light state?

"LED stays in yellow(red) state. If I connect monitor/mouse/keyboard directly to Deepracer, the boot sequence has two Fails. To activate swap file and to start load/save Random Seed, and it never enter GUI login screen.In an earlier stage when connected directly with a monitor the Ubuntu GUI came up and I could login to Deepracer with deepracer password, but when trying to set up a new complicated password many times it kept responding "Sorry, that didn't work. Please try again"FollowComment"

Answer: "0Hi,Can you try the steps mentioned in this troubleshooting guide to manually update the DeepRacer device to the latest stable software - https://docs.aws.amazon.com/deepracer/latest/developerguide/deepracer-troubleshooting-manual-update-device.htmlCommentShareAWS-User-5066560answered a year ago"


Question: RDS Export to S3 failing with unknown error

"An RDS export that was previously working has started failing with an unknown error, docs label it as follows:An unknown internal error occurred.The task has failed because of an unknown error, exception, or failure.Has anyone got any advice on diagnostics or finding any further information anywhere?FollowComment"

Answer: "0Please check the following document items first. It may have been changed somewhere. Thank you.https://aws.amazon.com/premiumsupport/knowledge-center/rds-mysql-export-snapshot/?nc1=h_lsCommentSharetakakunianswered 6 months agorePost-User-3213957 6 months agoThanks for the link. I've gone through and checked those, nothing obviously missing. Worth noting that it was previously working before with no change (no cloudformation drift)Share"


Question: S3bucket using old kms key

For periodic backup plugin in jenkins I have provided s3 bucket as backup bucket. And later updated bucket with new kms key. But the bucket still using the old kms key for that bucket. It is not updated and not getting backup. How can I solve this issueFollowComment

Answer: "0Accepted AnswerIf you have changed the "default" KMS key on the bucket then thats it. Can you explain how you think its still using OLD key and not getting backed up now?The IAM user used to access the Bucket will also need access to the KMS Key. Ensure the policy and IAM policy for the user matches the settings for the new KMS key vs the old oneCommentShareGary Mcleananswered a month agorePost-User-7112403 a month agoOn day 1 I can see the backup objects in my bucket. On 2nd day the kms key for the bucket has been updated(changed to new one) and then it doesnt put backup objects .In system logs of plugin I see the  error saying the kms key is pending deletion(old key as that key has been destroyed via terraform and deployed new key).The policy everything is same just destroyed the old key and deployed new keyShareGary Mclean a month agoIts likely that you have OLD data and even system backup state data in the S3 bucket encrypted with the OLD key.I would NOT delete the old key until you are 100% ALL data that was encrypted with OLD key has gone or been re-encrypted.Unless the key has been compromised, I would not rush to delete key.I suspect if you restore the OLD key but leave the bucket on the NEW key it will all start working.Old objects will remain encrypted with OLD key. They do not get re-encyrpted!Sharesatya a month agoYa thanks, that worked as I deleted all the old objects which were encrypted with old key. Now it is getting backup.ShareGary Mclean a month agoGlad to helpShare"


Question: AWS Media Convert removes silent audio which causes the output video to be severly out-of-sync with audio

"Hi re:Post community,We have been using AWS Elemental MediaConvert for about 3 years but we have encountered some very strange behaviour roughly from the 10th of December 22 onwards. MediaConvert started removing all of the silent audio from our audio inputs and it merges all the speech in the input together. This is causing major syncing issues between the video and the audio in the output file.The rough specification of our MediaConvert jobs is:video input: H.264 or VP8audio input: Matroska with OPUSoutput: MPEG-4 AVC (H.264)We started receiving customer reports on the 12th of December saying that their videos are out of sync. I found a job from 9 Dec that was OK and I cloned and reran the job today (19 Dec). The result from today was missing all the silent audio which was matching all the broken files reported by our customers. The two jobs are using exactly the same inputs and the same configuration.This makes me think something must've changed internally in MediaConvert that is causing these issues. Perhaps a new setting?Has anyone experienced the same?ThanksMichalFollowCommentrePost-User-2457284 5 months agoI have also noticed some weirdness with MediaConvert recently. I'm not sure if it's related or not. We have been clipping some videos to extract a portion of the video from the middle. When we specify a start time/end time, AWS seems to be choosing values that are a few seconds off instead, and we haven't been able to figure out why yet. I can't yet say for sure this didn't happen previously, but user bug reports have been in the last week or two. ffmpeg seems to reproduce the same behavior when avoid_negative_ts is not set to make zero, which also may affect audio/video syncing.Share"

Answer: 0So it appears it was an internal issue with AWS MediaConvert. They fixed it really quickly after confirming the issue.CommentShareMichal Chudyanswered 5 months ago


Question: Problem with order of events in MediaConvert API destination

"We have set a rule in EventBridge for MediaConvert to send statuses PROGRESSING, COMPLETE and ERROR to our API as destination. We store the statuses in the db identified by the date and time of receiving. The problem is that for some cases we receive the COMPLETE status first and then PROGRESSING after a few seconds. Is this normal to receive the statuses in this order?FollowComment"

Answer: "0It is not normal for the MediaConvert service to send the COMPLETE status before the PROGRESSING status. Generally, you should receive the events in the following order: PROGRESSING, (potentially multiple times), then COMPLETE or ERROR.Network latency, temporary service disruptions, or other factors can sometimes cause events to be delayed or delivered out of order. While it's not common, it can happen. to detect such things you can monitor your AWS infrastructure and the MediaConvert service using Amazon CloudWatch to identify any potential issues that might be causing unusual event order or delays.CommentShareEXPERTsdtslmnanswered 2 months ago"


Question: CURL get request from server to AWS CloudFront very slow response time

"I have a very simple PHP CURL get request to retrieve a json file from my AWS CloudFront distribution.public function get_directory() {        $json = 'https://d108fh6x7uy5wn.cloudfront.net/themes.json';        $curl = curl_init();        curl_setopt($curl, CURLOPT_URL, $json);        curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1);        $array = curl_exec($curl);        curl_close($curl);        $array = json_decode($array, true);        $array = $array['themes'];        return $array;}I then have a foreach loop which displays the information contained in the json file.However, it takes over 120 seconds for the page to load, it's VERY slow. If I use my S3 origin URL instead of the CF URL the page loads instantly.I am using this same method on other servers without any issues. The issue only occurs on this server which is using the InterWorx hosting control panel software.The code resides on the server as a plugin for InterWorx, so located here /usr/local/interworx/plugins/wordpressIt seems it could be an issue with my CF distribution settings however I am a bit of a noob when it comes to AWS and am at a loss.If anybody can point me in the right direction that would be greatly appreciated.FollowComment"

Answer: "0You're right - 120 seconds is a very long time. If you instrument your code; or run curl with some logging where is the time being spent? Is it DNS lookup? Other protocol negotiation? Those sorts of details will help determine where you should investigate further.CommentShareEXPERTBrettski-AWSanswered a year agoismaelyws a year ago@Brettski@AWS I opened up my Chrome Developer Tools in the Network tab and noticed the Time To First Byte (TTFB) is 3.6 minutes. This ONLY occurs when I use my CloudFront distribution URL, it loads quickly with my S3 URL. Could this be due to a setting in my CF distribution behavior settings? Cache policy and origin request policy?Shareismaelyws a year agoThis is the log result when I turn on VERBOSE for the curl get request:About to connect() to d108fh6x7uy5wn.cloudfront.net port 443 (#0)Trying 2600:9000:2132:4e00:14:45cf:19c0:21...Connection timed outTrying 2600:9000:2132:7000:14:45cf:19c0:21...Connection timed outTrying 2600:9000:2132:2400:14:45cf:19c0:21...Connection timed outTrying 2600:9000:2132:2c00:14:45cf:19c0:21...Connection timed outTrying 2600:9000:2132:9600:14:45cf:19c0:21...Connection timed outTrying 2600:9000:2132:3000:14:45cf:19c0:21...Connection timed outTrying 2600:9000:2132:aa00:14:45cf:19c0:21...Connection timed outTrying 2600:9000:2132:5c00:14:45cf:19c0:21...Connection timed outTrying 13.224.38.161...Connected to d108fh6x7uy5wn.cloudfront.net (13.224.38.161) port 443 (#0)Initializing NSS with certpath: sql:/etc/pki/nssdbCAfile: /etc/pki/tls/certs/ca-bundle.crtCApath: noneSSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256Server certificate:subject: CN=*.cloudfront.netstart date: Mar 19 00:00:00 2021 GMTexpire date: Mar 17 23:59:59 2022 GMTcommon name: *.cloudfront.netissuer: CN=Amazon,OU=Server CA 1B,O=Amazon,C=USGET /themes.json HTTP/1.1Host: d108fh6x7uy5wn.cloudfront.netAccept: /< HTTP/1.1 200 OK< Content-Type: application/json< Content-Length: 68529< Connection: keep-alive< Last-Modified: Tue, 21 Dec 2021 12:05:12 GMT< Accept-Ranges: bytes< Server: AmazonS3< Date: Thu, 2Share"


Question: Not authorized to start new instances

"I have an EC2 instance with an IAM role attached that has the AmazonEC2FullAccess policy attached. This policy includes full access to runInstances. However, when I try run call runInstances from the instance (through the JavaScript SDK), in order to launch new instances, I get an error: ”UnauthorizedOperation: You are not authorized to perform this operation.” What is the problem here?FollowComment"

Answer: "0Accepted AnswerHello,The 'You are not authorized to perform this operation' error should be accompanied with its related 'Encoded authorization failure message'. You can then decode the message using decodeAuthorizationMessage [1] to see what went wrong specifically.Hope that this information helps to solve your issue.Links:[1] https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/STS.html#decodeAuthorizationMessage-propertyRegards,awstomasCommentShareAWS-User-3892169answered 4 years ago0Hi,Thanks for your reply. Now, I have decoded the message, using your link, and can see that an IAM permission was further needed to launch the new instances. Thanks.CommentShareAladdin101answered 4 years ago"


Question: Signing >4096 byte Messages With KMS Asymmetric Key Pair

"I'm looking to generate a digital signature HTTP response header for some of our REST APIs that return JSON. The original idea was to use KMS to store an asymmetric key pair(ECC_NIST_P256) and generate a signature given the response data and the ARN of the key pair that's stored.  However, KMS will only sign 4096 bytes of data.  For larger messages the guidance is to generate a message digest and sign that, but we need to sign the entire response.So then I wanted to just use KMS to manage the keys and sign it "manually" via java.security classes in my application outside of KMS. However, if I'm going to do the signing I need the private key from the keypair, and so far it doesn't seem like there's a way for me to get at it(the api mentions the private key of an asymmetric key never leaves KMS unencrypted, and I don't see a method to get at it using the java SDK).  We probably could import an existing asymmetric key into KMS, but then I'd have to have some other way of getting the private key bytes when signing rather than going through KMS, so that wouldn't really help.So is it not possible for me to digitally sign my >4096 byte responses with an asymmetric key pair in KMS without having to store the private key separately?FollowComment"

Answer: "0You can use GenerateDataKeyPair API to create private/public key pair you can use outside of AWS KMS. The private key is encrypted under a symmetric KMS key. To use the private key, you would need to call Decrypt API on the private key to get plaintext private key back. This solution works if your use case does not involve encrypting/decrypting within FIPS boundary.For larger messages the guidance is to generate a message digest and sign that, but we need to sign the entire response.Could you elaborate on this a little more? Curious to know why you need to sign the entire response. Also, how big is your response on average?CommentSharekumo-hiyorianswered 7 months agomford 7 months agoSigning the entire response was the original API customer requirement, but after some inquiries we were able to get sign-off on generating a message digest and just signing that.  FYI our responses are around 600-700K.Share"


Question: Email abuse report - Amazon SES

"Hi.Is it possible to contradict an email abuse report from Amazon SES?We are only sending transactional emails. I don't know why, but sometimes our customers click on the "Report as spam" button after we sent out the dispatch notice by email.Thanks ChrisFollowComment"


Question: My Aws Support Case still "Unassigned" after 24 hours

"Hello,I submitted a support case number xxxxxxxxxxx. 24 hours later, it's status is still listed as "unassigned". Please help me to solve my problem as soon as possible!*Edit: Removed case ID — Thomas E.FollowComment"

Answer: "0Which support plan do you have? For developer support, general guidance support cases have a target response time of 24 hours and 12 hours for system impaired. However, it is based on business hours. Business hours are generally defined as 8:00 AM to 6:00 PM in the customer country as set in My Account console, excluding holidays and weekends. These times may vary in countries with multiple time zones.Also, feel free to post the question here to get help from the community!Compare AWS Support PlansCommentShareTaka_Manswered 7 months agorePost-User-4738388 7 months agoThank you for your reply, I am using developer support.Share"


Question: Amplify with 2 different clients (front-ends)

"I am using Amplify backend for my Electron app (Desktop), now I will need to add the 'create' functions on a web app. Users will be able to create (data input) the data from the web app, and electron app will query (or edit) them.What would be the possible file structure for this? Can I pull from the same Amplify backend and use it for 2 different front ends (Electron and Web App). Electron structure is basically same as a web app, so it is actually same amplify for 2 different web apps.FollowComment"


Question: [CDK] how best to move from App to Stage

"A while ago moved all our infrastructure from manually defined infrastructure to AWS CDK for easier management. We followed some tutorials for this and ended up with a CDK app that contains multiple stacks. Now we want to move to AWS CodePipelines for the CI/CD of our infrastructure, but this requires that the Stacks are part of a stage.This presents a problem, as adding these stacks to a stage (instead of an application) means that the stacks are prefixed with the name of the Stage, which causes a recreation of stateful resources (such as DNS, and Databases, Cognito UserPools).What is the best way to move these stacks from the application to a stage? Ideally, without recreating the resources in the stacks, or renaming the stacks.We have found various articles that say some resources could maybe be moved, but this a highly involved process that seems overly complicated. Source: https://binx.io/2022/06/30/migrate-resources-across-cdk-stacks/FollowComment"


Question: AWS WAF Dashboard for visibility

"Hi,im recently check throught this blog: https://aws.amazon.com/blogs/security/deploy-dashboard-for-aws-waf-minimal-effort/but seems the cfn template link have a permission issues.Exist any updated version for that solution or another similar ?Thanks in advance,FollowComment"

Answer: "0Accepted AnswerHi Karlos,I tried it and I got similar access denied error. It is possible that a new version is being worked upon.In the meantime, I do see that there is an open issue on the aws-waf-dashboard Github page with a potential workaround which you could look into.https://github.com/aws-samples/aws-waf-dashboard/issues/13#issuecomment-1025077936CommentShareEXPERTTushar_Janswered a year ago"


Question: Mechanical Turk - Using AWS Billing with Mechanical Turk and IAM accounts

"When trying to submit HITs to Mechanical Turk using the IAM account my company created for me and the AWS Python API (boto3), I get the following message even though the root AWS account is linked with the Mechanical Turk and AWS Billing is enabled."This Requester has insufficient funds in their account to complete this transaction. Please visit https://requester.mturk.com/prepayments/new  to purchase Prepaid HITs. (1669330071784)"Even if I wanted to add funds to my IAM account instead of using the root's account AWS billing information, I can't since IAM accounts cannot access the requester website.FollowComment"

Answer: "0Hi there,Sorry to hear about this message you're receiving. Our MTurk team has the tools and visibility to investigate this concern. If you haven't had the chance, please connect by sharing the details on this form:https://go.aws/contact-mturk.Thanks for your patience while they take a closer look.Kind regards,- AWS Support - JohnCommentShareEXPERTAWS Support - Johnanswered 6 months agocustomer 5 months agoHello JohnI faced a similar issue and approached the support using the same link to resolve my case. I requested a credit limit upgrade of $2000, but it's been a month, and no one has given me any update on the case. I am still waiting for someone to respond to my emails. The case Id is xxxxxxxxxxx. Can you please look into this and brief me on why it is taking so long to increase the credit limit for my account? Or at least suggest publishing HITs and paying using a credit card.ThanksEdit: Removed case ID from comment on 01/05.ShareAWS Support - John EXPERT5 months agoHello there,Responding to the recent comment here since I'm unable to directly reply to comments.I apologize for any frustration or inconvenience this has caused! That’s not the experience we aim for.After taking a closer look on your behalf, I can confirm your case has been routed to our best suited team with the needed access to get this addressed. I've taken steps internally to flag the information you've shared here for additional review and consideration. In order to get your questions and concerns securely answered, I ask that you continue to follow up on your case correspondence.Thank you for your continued patience as our internal team works to resolve this matter.Kind regards,- John M.SharerePost-User-9687991 4 months agoSame. I'm new and my limit says it's 2,500 already yet I couldn't publish something for 1,008. I dropped it to 2 and that exceeded the limit too. So I'm pretty sure when you're new the limit is 0. We are forced into AWS billing and can't use pre-paid HITS or pay upfront in any way and then they don't give you a workable account. I've been waiting for 5 days and this is after being told 3 times my case is being expedited. I cannot wait a month because I need this batch for doctoral research to graduate.Share"


Question: Cloudwatch count and graph ERROR count in cloudwatch - only getting '1'

"Morning, I would like to add a graph of each occurrence of a WARNING in a log stream.  I created a metric filter, the pattern "WARNING" and when I test I see all the occurrences.    But, when I goto the metrics and graph it, it never goes above 1.   So over an hour I see it go .02, .05, 1, etc.I am trying to do a graph over time and look and see the spikes, etc. so how do I have it count or total etc?   Normally 1 warning has 5 or 7 different WARNINGS at that same time so would be great to see that spike to 7, then nothing.So how do I make that graph work that way or get those values.ThanksFollowComment"

Answer: "0Accepted AnswerSorry, in more clicking I noticed the cloudwatch has AVG as the default, where I changed to SUM and got it ... Sorry for this one!CommentSharelraymondanswered a year ago"


Question: Can AppRunner provide more helpful logs

"Hi,I'm using AppRunner for a prototype application (building from Githib repo) and have had it running successfully. Sometimes however,  deployment fails at an early stage with event logs as follows:08-23-2022 10:09:42 AM [AppRunner] Failed to create pipeline for automatic deployments.08-23-2022 10:08:50 AM [AppRunner] Service status is set to OPERATION_IN_PROGRESS.08-23-2022 10:08:50 AM [AppRunner] Service creation started.there is no further information in the deployment logs either.Can AppRunner provide more helpful logs as to what is the problem? E.g. it an AWS issue, or something wrong with the github connector, or something else? Some reason would really help to figure out what is going on.FollowComment"

Answer: "0Hello,Below is the link that mentions all the methods and you can also use them in your current account, however, there are no other mechanisms than these to capture App-runner logs. However, App Runner is integrated with AWS CloudTrail, a service that provides a record of actions taken by a user, role, or an AWS service in App Runner. CloudTrail captures all API calls for App Runner as events.You can view the most recent events in the CloudTrail console, and you can create a trail to enable continuous delivery of CloudTrail events to an Amazon Simple Storage Service (Amazon S3) bucket.You can also reach out to AWS Premium Support for more details and information and confirm if there are any internal tools that the Support Team has access to which can provide more detail.Logs- https://docs.aws.amazon.com/apprunner/latest/dg/monitor-cwl.htmlCommentShareSUPPORT ENGINEERAWS-User-Chiraganswered 9 months ago"


Question: "Free tier EC2 instance stopped, actual usage below 100%, I want to get my info and delete, can't even get into the environment. No support available for free tier."

"Had some work done in college on AWS. Haven't touched this account in a few months and somehow its pulling in hours and keeping things online. I know I have an allowance of 750 a month, I cant get to my environment to grab my docs and delete it. Cannot find a tutorial for taking it temporarily offline either. Frustrated I can't grab the files to jump ship."The delay may be caused by high CPU usage in your environment..."VPC settings are fine.https://docs.aws.amazon.com/cloud9/latest/user-guide/troubleshooting.html#troubleshooting-ide-low-memoryThis guide didn't help at all.Billing refuses to temporarily upgrade me to get into my "high cpu" environments and grab the files and delete my account.FollowComment"

Answer: "0I'm not sure what "pulling in hours" means here. And instances don't just restart by themselves if they are shutdown - it requires manual intervention or some other API call (perhaps some automation or health check that is running?) to do that.If you need to remove the data from the instance and shut it down, what is preventing you from doing that? If the instance is running then you should be able to SSH/RDP to it and access your data.There's not a lot of information to go on in your answer so I can only provide you with general advice.CommentShareEXPERTBrettski-AWSanswered 4 months ago"


Question: AWS Console Build Problem

"I am currently having a strange problem with my build in the Amplify Console in which the first build performed by the console works only upon the first connection with any individual branch within the repo. Any subsequent builds will fail on the backend step of the build with the following error message:Error: You are not working inside a valid amplify project.Use 'amplify init' in the root of your app directory to initialize your project with AmplifyI observed that the first successful build would successfully create the Amplify environment, but subsequent builds would fail to do so. I am stuck as to what is possibly causing this problem. I have already deleted and reinitialized Amplify in my app, and I don't believe there is anything strange with the build settings I am working with. Can anyone offer any help regarding this?My build settings:https://gist.github.com/zoumengguang/c2a9d904674fccbfae37b759ff865280The build logs:https://gist.github.com/zoumengguang/8edb3901c0d2feb1c21504c31024079dThanks in advance.FollowComment"

Answer: 0Question was answered after e-mailing support.CommentSharejzouanswered 4 years ago0Can you please share the solution?CommentShareVirtualRickanswered 3 years ago


Question: performing systematic literature review on mturk

"I have a large collection of papers 15K, stored on RDS and also on local excel sheets. the data were collected from different databases (IEEE, ACM... etc). I want the Mechanical Turk to follow my inclusion and exclusion criteria and update the records (included or excluded).I am facing to obstacles ATM;connecting Mturk scrip to RDS database. (couldn't find support on that even mturk support did not have an asnswer)how can I split the script so each mturk update the record once so I do not end up with duplicated results or have the mturk perform already performed task?FollowComment"


Question: "How can resolve "This is a bug in the provider, which should be reported in the provider's own │ issue tracker." problem in terraform apply to iam role creation?"

"When I apply terraform,I have got an error like,"Error: Provider produced inconsistent final plan│ When expanding the plan for aws_iam_role.eks_cluster_role to include new│ values learned so far during apply, provider"This is a bug in the provider, which should be reported in the provider's own│ issue tracker.Let me know how can resolve it.FollowComment"

Answer: "0Per the message, this is a terraform issue on the provider side. Check this issue in terraform's aws provider and log the issue as necessary: https://github.com/hashicorp/terraform-provider-aws/issuesCommentSharejoahnaanswered a year ago"


Question: Lightsail - EC2 - Instances Hard Limit

"Hello AWS Pros !I have a question about the limits of the instances.Have you ever tried or maybe had a chance to work on a project with plenty of instances in one REGION?I have information that with the default setting, I can create up to 20 instances per REGION for Lightsail and EC2, but do you know how much more I can request? Is there a hard limit?For example: with the best possible setup for my project/case, I can request maximum 99 instances or 1000 instances.Thanks :)FollowComment"

Answer: "0You can see your account's service quotas via the Service Quotas console. Through this page, you can also request quota increases. The upper limit depends on a number of factors. Smaller increases are generally automatically approved, while larger requests are submitted to AWS Support. See: https://docs.aws.amazon.com/servicequotas/latest/userguide/request-quota-increase.htmlCommentShareTom Nanswered 8 months agoTokson 8 months agoThank you, Tom :) But are you aware of any number? Like for example, I will request 150 instances, and the limit is 99.ShareKrzysztof Slowinski 8 months agoIt would be good to have at least the estimate on the hard limit, to be able to know how much one account can scale.Share"


Question: Bug report: AWS Explorer's "Add AWS Credential Profile" - link is not working

"How to reproduce this bug?Open Visual Studio 2019 professional.Make sure AWS Tool kit for Visual Studio has been installed.Go to View->AWS Explorer (or press CTRL+K,A)Refer to Credentials and click on "Add AWS Credential Profile"On the lower section of the opened dialog click on https://aws.amazon.com/developers/access-keys/ (where it says "account information can be found..."That link is referring you to 404 page pointing on: "Sorry, this URL does not exist or is no longer available."FollowComment"

Answer: "1Thank you for bringing this to our attention!I was able to find that this link previously was a redirect to this documentation page (1). I will be sure to report this internally as well to get this fixed.(1) https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_access-keys.html?icmpid=docs_iam_consoleCommentShareSUPPORT ENGINEERWayne_Ganswered a year agoLior Carmon a year agoHi Wayne,Thanks for your swift response and for bringing up this workaround.Cheers,Lior CarmonShare"


Question: Adding the filename as a column in the output

"Does anyone know of a way to add the source filename as a column in a Glue project? We just started using it, and have it crawling for files in S3, applying some simple transformations, and then writing to a clean file in S3. In our data set we would like to know the source file that each row of data originated from, so it would be ideal if we could somehow add in the filename as a column or something like that. I looked through the documentation and the aws-glue-libs source, but didn't see anything.I'm still learning Glue, so apologies if I'm using the wrong terminology.FollowComment"

Answer: "0You could create folders within your data path and the Glue crawler will create partitions in the schema for every folder. If you name the folders like key=value the column name for the partition will be key.For instance if your filenames are named source_a..., source_b...you should create the followings3/your-bucket/data/source=A/source_a_...csvs3/your-bucket/data/source=A/source_a_...csvs3/your-bucket/data/source=B/source_b_...csvs3/your-bucket/data/source=B/source_b_...csvso the schema will have a source column for the source partition.CommentShareFrankiSansanswered 3 years ago0Apache Spark has input_file_name() methodYou can add a new column based on this. See the below sample.df = spark.read.parquet('path_to_file')\        .withColumn('filepath', input_file_name())See details here: https://spark.apache.org/docs/latest/api/python/pyspark.sql.html?highlight=functions#pyspark.sql.functions.input_file_nameCommentShareAWS-User-6283168answered 3 years ago"


Question: Elastic Beanstalk stuck aborting current environment operation

"Hi,I am unable to abort or terminate an Elastic Beanstalk environment that has been hanging for 7+ hours after attempting to update an environment variable. I've successfully cloned the environment and deployed my application to the clone, but I am unable to delete the old one even after deleting all of the resources in its CloudFormation stack. According to CloudTrail logs, there were some log stream creations from the original environment's EC2 instance that errored, but outside of that I'm unable to figure out why or how the Elastic Beanstalk environment is stuck. Please help!ThanksFollowComment"

Answer: "0I have reasearched about this and found that when elastic beanstalk is stuck, desired, max and min are set to zero in autoscaling group and then the application is deployed. Then return  to previous settings and deploy  again and it would then show ok. I am not sure if this can be done or it resolves your problem but you can try.I highly recommend that you reach out to support team here : https://aws.amazon.com/support/CommentShareSandeepVudataanswered a year agotn-mikael a year agoThanks for your response! I did check the autoscaling policy and set all three settings to zero, but I think the trigger for the policy was not hit ( NetworkOut > 6000000 for more than 5 minutes), so it never added a new instance to the environment. We will have to update the policy for a more accurate trigger in the future.I checked this morning, and eventually the hanging environment registered a failed update. I initiated a terminate environment command, but it failed because I already manually deleted the RDS instance. Is there a way to force terminate the environment? Or should I delete the CloudFormation stack myself? Will this also terminate the Elastic Beanstalk environment? It's a little hard to glean the answers to these questions from searching through AWS docs.ShareSandeepVudata a year agoI have found this link to terminate the environment. It includes force terminate option, just in case you have not already seen it. It is advisable to reach out to support if this doesn't work. https://awscli.amazonaws.com/v2/documentation/api/latest/reference/elasticbeanstalk/terminate-environment.htmlShare"


Question: Export Lightsail snapshot to EC2 takes too long

That progress takes more than a week. How can I stop it?FollowComment


Question: SES IP range blacklisted

"Several of the Amazon SES ip ranges are blacklisted, making mail delivery impossible, where does one report this for attention?FollowComment"

Answer: "-2Hello,Per the DNS Blackhole List (DNSBL) FAQs:Q4. Can Amazon SES have its IP addresses removed from a DNSBL?We actively monitor DNSBLs that could impact delivery across the entire Amazon SES service, or that could impact the ability to send email to recipients who use major email providers, such as Gmail, Yahoo, AOL, and Hotmail. The DNSBLs offered by Spamhaus fall into this category. When one of our IP addresses appears on a list that meets either of these criteria, we take immediate action to have that address removed from the DNSBL as quickly as possible.We don't monitor DNSBLs that are unlikely to impact delivery across the entire Amazon SES service, or that don't have a measurable impact on delivery to major email providers. The DNSBLs offered by SORBS and UCEPROTECT fall into this category. Because of the specific listing and delisting practices of the vendors who operate these lists, we are unable to have our IP addresses removed from these lists.CommentShareEXPERTChris_Ganswered 10 months ago"


Question: SNS Subscription

"I am working on a requirement to integrate 2 applications on 2 different cloud (AWS & Oracle).  We are going to use Amazon SNS to send notification to Oracle Integration Cloud.  I created the Topic in Amazon SNS, but struggling to subscribe to the topic from Oracle Integration (it supports Rest API calls).  I aim to use HTTPS protocol for SNS to send notifications to Oracle Integration Cloud.  The end point URL will work only with authentication (either basic authentication of Oauth 2.0).  So, my question is :  Is it possible to have an https endpoint with Authentication details included for AWS SNS subscription ?  Any suggestions/guidance on this would be of great help.FollowComment"

Answer: "1Limited authentication is supported. See: https://docs.aws.amazon.com/sns/latest/dg/sns-http-https-endpoint-as-subscriber.htmlYou could use notification to a Lambda function to make a more complicated authentication call. You may want SQS in the middle to ensure delivery.CommentShareRodney Lesteranswered a year agoAWS-User-8243736 a year agoThank you very much for your quick response.  I tried that basic authentication by passing username:password in the https endpoint, but that doesn't work.  Is there any other way to obtain the Subscription URL, so I can manually subscribe to the topic ?  Or any other alternative ?Share0If you can use basic auth then it's ok and you can subscribe using https://user:password@domain.com format as described here, the doc linked by Rodney Lester.Oauth 2.0 is not supported.CommentShareMGanswered a year agoAWS-User-8243736 a year agoThank you very much for your quick response.  I tried that basic authentication by passing username:password in the https endpoint, but that doesn't work.  Is there any other way to obtain the Subscription URL, so I can manually subscribe to the topic ?  Or any other alternative ?Share"


Question: ssh: connect to host 18.222.193.232 port 22: Connection timed out

"Hello, I can't ssh to my instance for last few hours. I tried running traceroute it shows can't reach my instance ip after reaching to amazon network. I launched another instance with same security group and vpc, but could connect to that and traceroute was also able to reach. I associated a different ip with same vpc to this instance but that didn't work wither. What might be the reason? How can I troubleshoot this?PS: I've been using this instance for 1 month and everything was fine. No security groups, vpc, subnet settings or firewall has been changed. It just suddenly stopped working.Edited by: rofi93 on Jul 23, 2020 8:20 AMFollowComment"

Answer: "0Hello,I cannot see an instance with the IP address of 18.222.193.232 in your account but I can see another instance that has the IP address of 18.223.90.18.This instance is failing health checks on the OS level. In this case it appears that you are getting Out of Memory errors (OOM)[4387432.249467] Killed process 23851 (node) total-vm:1899156kB, anon-rss:616560kB, file-rss:0kB, shmem-rss:0kB[4388361.208192] Out of memory: Kill process 24410 (node) score 550 or sacrifice childWhat I would recommend here is to perform a reboot from the AWS console and this should allow you to connect to the instance.Once connected you review the logs within your instance and look at the application that you are running.Edited by: aws-chrisa on Jul 23, 2020 8:49 AMCommentShareAWS-User-8424448answered 3 years ago0Thank for your response. You're right, I just checked the instance ip right now and I see ip has been changed. How did this happen or what can cause this?CommentSharerofi93answered 3 years ago0Hello,When you do not use an Elastic IP address the public IP address of the instance can change when it is stopped.You cannot manually associate or disassociate a public IP address from your instance. Instead, in certain cases, we release the public IP address from your instance, or assign it a new one:We release your instance's public IP address when it is stopped, hibernated, or terminated. Your stopped or hibernated instance receives a new public IP address when it is started.More information on it herehttps://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-instance-addressing.html#concepts-public-addressesTo have a fixed public IP address you would need to use an Elastic IP address.https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/elastic-ip-addresses-eip.htmlCommentShareAWS-User-8424448answered 3 years ago"


Question: "Hi AWS, only testing"

"Centuries ago there lived--"A king!" my little readers will say immediately.No, children, you are mistaken. Once upon a time there was a piece of wood. It was not an expensive piece of wood. Far from it. Just a common block of firewood, one of those thick, solid logs that are put on the fire in winter to make cold rooms cozy and warm.I do not know how this really happened, yet the fact remains that one fine day this piece of wood found itself in the shop of an old carpenter. His real name was Mastro Antonio, but everyone called him Mastro Cherry, for the tip of his nose was so round and red and shiny that it looked like a ripe cherry.As soon as he saw that piece of wood, Mastro Cherry was filled with joy. Rubbing his hands together happily, he mumbled half to himself:"This has come in the nick of time. I shall use it to make the leg of a table."He grasped the hatchet quickly to peel off the bark and shape the wood. But as he was about to give it the first blow, he stood still with arm uplifted, for he had heard a wee, little voice say in a beseeching tone: "Please be careful! Do not hit me so hard!"What a look of surprise shone on Mastro Cherry's face! His funny face became still funnier.He turned frightened eyes about the room to find out where that wee, little voice had come from and he saw no one! He looked under the bench--no one! He peeped inside the closet--no one! He searched among the shavings--no one! He opened the door to look up and down the street--and still no one!"Oh, I see!" he then said, laughing and scratching his Wig. "It can easily be seen that I only thought I heard the tiny voice say the words! Well, well--to work once more."He struck a most solemn blow upon the piece of wood."Oh, oh! You hurt!" cried the same far-away little voice.Mastro Cherry grew dumb, his eyes popped out of his head, his mouth opened wide, and his tongue hung down on his chin.As soon as he regained the use of his senses, he said, trembling and stuttering from fright:"Where did that voice come from, when there is no one around? Might it be that this piece of wood has learned to weep and cry like a child? I can hardly believe it. Here it is--a piece of common firewood, good only to burn in the stove, the same as any other. Yet--might someone be hidden in it? If so, the worse for him. I'll fix him!"With these words, he grabbed the log with both hands and started to knock it about unmercifully. He threw it to the floor, against the walls of the room, and even up to the ceiling.He listened for the tiny voice to moan and cry. He waited two minutes--nothing; five minutes--nothing; ten minutes--nothing."Oh, I see," he said, trying bravely to laugh and ruffling up his wig with his hand. "It can easily be seen I only imagined I heard the tiny voice! Well, well--to work once more!"The poor fellow was scared half to death, so he tried to sing a gay song in order to gain courage.He set aside the hatchet and picked up the plane to make the wood smooth and even, but as he drew it to and fro, he heard the same tiny voice. This time it giggled as it spoke:"Stop it! Oh, stop it! Ha, ha, ha! You tickle my stomach."This time poor Mastro Cherry fell as if shot. When he opened his eyes, he found himself sitting on the floor.His face had changed; fright had turned even the tip of his nose from red to deepest purple.FollowComment"

Answer: "0Hello, Thank you for reaching out & sharing the same. I hope the purpose of testing was achieved. Feel free to reach back in case you have any further queries with respect to ELB or any Networking & Content Delivery services.CommentShareSUPPORT ENGINEERAWS-User-Chiraganswered a year ago"


Question: AWS Batch - Job Stuck in RUNNABLE state

"In AWS Batch, sometimes the job is stuck in RUNNABLE state. Under what conditions the job gets stuck? Is there a way to find out the reason job gets stuck? Also Is there a way to alert via Cloudwatch metrics and SNS?Also is there a max time after which if job is still stuck, it means that the job will never run??Edited by: arian on Mar 17, 2019 8:38 AMFollowComment"

Answer: "0Hi! If a Batch job is in the RUNNABLE state, it is waiting to be placed on an instance. If you believe your job is stuck in RUNNABLE, it means something is preventing Batch from placing the job.https://docs.aws.amazon.com/batch/latest/userguide/troubleshooting.html#job_stuck_in_runnable shows you the most common reasons why the Batch job may be stuck in RUNNABLE. For some of these reasons (such as EC2 limits), the logs will show an error code.Since there are varied reasons why Batch jobs are in RUNNABLE, there's no set time that means a Batch job will fail if it can't be placed.CommentShareAWS-User-3176245answered 4 years ago"


Question: IAMS user can't access Cloud9 IDE

"As a root user, I created an environment in Cloud9, then created IAMS users and gave them RW access to the environment, which I can see has worked when I click the Share button on the upper left corner of the environment, but when they log in and go to Cloud9 they can see the card for the environment but 'Open IDE' is grayed out and they can't access it.  Sigh.FollowComment"

Answer: "0Generally it's against best practices to use root credentials to create and share environments because read/write members can use the environment owner's AWS access credentials. See here for more information. Specifically this section:For EC2 environments, read/write members can use the environment owner's AWS access credentials, instead of their own credentials, to make calls from the environment to AWS services. To prevent this, the environment owner can disable AWS managed temporary credentials for the environment. However, this also prevents the environment owner from making calls. For more information, see AWS Managed Temporary Credentials.As for your question, what's the IAM policy look like for your IAM user(s)? Are you using an AWS Managed Policy like AWSCloud9User or are you using a custom policy? If using a custom policy, ensure it includes the permissions similar to those listed out in the AWSCloud9User as those will be required to see and access environments, whether they are shared or not.CommentShareAWSJoeanswered a year ago"


Question: AWS WAF URI regex don't match

"Hi, I created a Web ACL with one rule to allow traffic only on some enpoint, and the default ACL action is to block requests that don't match the rule.## RuleField to Match: URI PathRegular Expression: /(account|category|post)/ Action: ALLOW##  Default web ACL action for requests that don't match any rulesAction: BLOCKThe problem is that the rule match only path with two or more segments, but don't match path with 1 segment.http://api.example.com/account/foo/bar     => MATCH - ALLOWhttp://api.example.com/account/foo?bar=baz => MATCH - ALLOWhttp://api.example.com/account/foo         => MATCH - ALLOWhttp://api.example.com/account             => DON'T MATCH - BLOCKhttp://api.example.com/account?foo=bar     => DON'T MATCH - BLOCKWhat's wrong? I would like the rule matches also path with 1 segment.Thanks in advanceFollowComment"

Answer: 3Your regex ends with "/" so the last two URLs will not match because "account" in these URL does not end with "/"Can you try with "/(account|category|post)"?ThanksCommentShareEunsu_Shinanswered a year agoAWS-User-3147005 a year agoUh really?  I'm using "/" as a delimiter of the regex. Anyway now it worksShare


Question: Data transfer using f1.x4large

"Hi,I am new to AWS FPGA Development.My task is, Using f1.x4large instance, I need to transfer packetized data from one FPGA to another FPGA.After power-on, by design one FPGA is defined as Sender and the other as Receiver.And Sender starts sending packets one at a time and the gap between the two packets is huge.On receiving the correct packet, the receiver acknowledges this with an ACK packet.Both Sender and Receivers maintain transmit and receive packet counters.This data transfer happens without driver involvement.The driver should be able to access the transmit and receive count register and other registers.I have gone through the example DMA test cases.I couldn't understand how to communicate without any driver involvement.Appreciate your help.Regards,VenkatFollowComment"

Answer: "0Hi Venkat,Have you gone through this https://github.com/awslabs/aws-fpga-app-notes/tree/master/Using-PCIe-Peer2Peer for peer-to-peer transfers? The app note also provides recommendations no how to get best performance.It's a bit unclear to me that you want "... data transfer happens without driver involvement."  Are you referring to the DMA driver? Could you elaborate more?Thanks,ChenCommentShareAWS-zhczanswered 2 years ago0Hi Chen,Thanks for the response.I have gone through the Using-PCIe_Peer2Peer app note.Yes, In my question, I was referring to the 'DMA driver' which I don't want to use.In conventional FPGA implementation, either I would have connected FPGA1 to FPGA2 and then displayed the counters.If I would like to achieve the same, with using f1.4xlarge instance.Could you please let me know how to achieve this?Regards,VenkatCommentSharevenkubanswered 2 years ago0Hi venkub,Thank you for the clarification. I need to point out that direct FPGA-to-FPGA connection are not supported by F1. For inter-card communication, you need to use peer-2-peer transaction through PCIe. The link I shared should have all the details needed for BAR4 address exposure, accessing, etc. You don't need to use DMA diver for all that. Please let me know if that answers your questions.ChenCommentShareAWS-zhczanswered 2 years ago0Thanks for the response.CommentSharevenkubanswered 2 years ago"


Question: How to use question mark in a query using Athena JDBC driver?

"Following is an example query that I'm trying to execute using Athena JDBC driver. It works fine using Athena query editor.CREATE OR REPLACE VIEW default.simple_table_transformed AS SELECT REGEXP_REPLACE( so_simple, '(?i)(Hive)?(SerDe)' ) AS example from default.simple_tableHowever, it fails with following error when executed using JDBC driver. Following is from driver debug log, query after translation is identical to how we would have executed in the query editor and it would have worked.Apr 21 16:42:04.312 TRACE 1 com.simba.athena.dsi.core.impl.DSIConnection.toNativeSQL("CREATE OR REPLACE VIEW default.simple_table_transformed AS SELECT REGEXP_REPLACE( so_simple, '(?i)(Hive)?(SerDe)' ) AS example from default.simple_table;"): +++++ enter +++++Apr 21 16:42:04.312 TRACE 1 com.simba.athena.athena.dataengine.AJDataEngine.prepare(): +++++ enter +++++Apr 21 16:42:04.312 DEBUG 1 com.simba.athena.athena.dataengine.AJDataEngine.prepare: Query before escape: CREATE OR REPLACE VIEW default.simple_table_transformed AS SELECT REGEXP_REPLACE( so_simple, '(?i)(Hive)?(SerDe)' ) AS example from default.simple_table;Apr 21 16:42:04.314 DEBUG 1 com.simba.athena.athena.dataengine.AJDataEngine.prepare: Query after escape: CREATE OR REPLACE VIEW default.simple_table_transformed AS SELECT REGEXP_REPLACE( so_simple, '(?i)(Hive)?(SerDe)' ) AS example from default.simple_tableApr 21 16:42:04.315 TRACE 1 com.simba.athena.athena.dataengine.AJQueryExecutor.AJQueryExecutor(): +++++ enter +++++Apr 21 16:42:04.315 TRACE 1 com.simba.athena.athena.core.AJConnection.getClient(com.simba.athena.athena.api.AJClient@710b30ef): +++++ enter +++++Apr 21 16:42:04.315 TRACE 1 com.simba.athena.athena.core.AJStatement.getQueryInfoHandler(): +++++ enter +++++Apr 21 16:42:04.315 TRACE 1 com.simba.athena.athena.core.AJStatement.getQueryInfoHandler(): +++++ enter +++++Apr 21 16:42:04.368 ERROR 1 com.simba.athena.exceptions.ExceptionConverter.toSQLException: [JDBC Driver]Operation unsupported for Statement Type CREATE_VIEW (Service: AmazonAthena; Status Code: 400; Error Code: InvalidRequestException; Request ID: 80cb6a85-400d-4a04-80aa-4bacaa382539; Proxy: null)java.sql.SQLException: [JDBC Driver]Operation unsupported for Statement Type CREATE_VIEW (Service: AmazonAthena; Status Code: 400; Error Code: InvalidRequestException; Request ID: 80cb6a85-400d-4a04-80aa-4bacaa382539; Proxy: null)  at com.simba.athena.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1879)  at com.simba.athena.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1418)  at com.simba.athena.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1387)  at com.simba.athena.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1157)  at com.simba.athena.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:814)  at com.simba.athena.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:781)  at com.simba.athena.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:755)  at com.simba.athena.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:715)  at com.simba.athena.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:697)  at com.simba.athena.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:561)  at com.simba.athena.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:541)  at com.simba.athena.amazonaws.services.athena.AmazonAthenaClient.doInvoke(AmazonAthenaClient.java:2570)  at com.simba.athena.amazonaws.services.athena.AmazonAthenaClient.invoke(AmazonAthenaClient.java:2537)  at com.simba.athena.amazonaws.services.athena.AmazonAthenaClient.invoke(AmazonAthenaClient.java:2526)  at com.simba.athena.amazonaws.services.athena.AmazonAthenaClient.executeCreatePreparedStatement(AmazonAthenaClient.java:532)  at com.simba.athena.amazonaws.services.athena.AmazonAthenaClient.createPreparedStatement(AmazonAthenaClient.java:499)  at com.simba.athena.athena.api.AJClient.prepareStatement(Unknown Source)  at com.simba.athena.athena.dataengine.AJQueryExecutor.<init>(Unknown Source)  at com.simba.athena.athena.dataengine.AJDataEngine.prepare(Unknown Source)  at com.simba.athena.athena.dataengine.AJDataEngine.prepare(Unknown Source)  at com.simba.athena.jdbc.common.SStatement.executeNoParams(Unknown Source)  at com.simba.athena.jdbc.common.BaseStatement.execute(Unknown Source)  at org.sudarshan.CreateView.createView(CreateView.java:43)  at org.sudarshan.CreateView.main(CreateView.java:33)Caused by: com.simba.athena.amazonaws.services.athena.model.InvalidRequestException: Operation unsupported for Statement Type CREATE_VIEW (Service: AmazonAthena; Status Code: 400; Error Code: InvalidRequestException; Request ID: 80cb6a85-400d-4a04-80aa-4bacaa382539; Proxy: null)  ... 24 moreSample codeString sqlToExecute = "CREATE OR REPLACE VIEW default.simple_table_transformed AS SELECT REGEXP_REPLACE( so_simple, '(?i)(Hive)?(SerDe)' ) AS example from default.simple_table;";Statement statement = connection.createStatement();statement.execute(sqlToExecute);What have I tried?Tested with following but none of them seems to have helped.Using ?? in place of ?Escaping ? with the help of \ characterFollowComment"


Question: Unknown parameter in input: "BillingMode"

"My old DynamoDB script that works:{    "AttributeDefinitions": [        {            "AttributeName": "userId",            "AttributeType": "S"        }    ],    "TableName": "DEV_Users",    "KeySchema": [        {            "AttributeName": "userId",            "KeyType": "HASH"        }    ],    "ProvisionedThroughput": {        "ReadCapacityUnits": 1,        "WriteCapacityUnits": 1    }}My two attempts at updating this script to work for on-demand:{    "AttributeDefinitions": [        {            "AttributeName": "userId",            "AttributeType": "S"        }    ],    "TableName": "TEMP_Users",    "KeySchema": [        {            "AttributeName": "userId",            "KeyType": "HASH"        }    ],    "BillingMode": "PAY_PER_REQUEST"}And also{    "AttributeDefinitions": [        {            "AttributeName": "userId",            "AttributeType": "S"        }    ],    "TableName": "TEMP_Users",    "KeySchema": [        {            "AttributeName": "userId",            "KeyType": "HASH"        }    ],    "BillingModeSummary": [{"BillingMode ": "PAY_PER_REQUEST"}    ]}Both attempts result in:Parameter validation failed:Missing required parameter in input: "ProvisionedThroughput"Unknown parameter in input: "BillingMode", must be one of: AttributeDefinitions, TableName, KeySchema, LocalSecondaryIndexes, GlobalSecondaryIndexes, ProvisionedThroughput, StreamSpecification, SSESpecificationAm I doing anything wrong? Looks like I am complying with the create-table CLI? https://docs.aws.amazon.com/cli/latest/reference/dynamodb/create-table.htmlFollowComment"

Answer: 0Accepted AnswerI believe you might be using an older version of aws cli and hence its not able to recognize recently added parameter 'BillingMode'. Can you update aws cli using following command 'sudo pip3 install --upgrade awscli' to latest version and then retry.CommentShareAWS-User-2633450answered 4 years ago0Thank you - this was the problem.CommentSharec3R1YXJ0answered 4 years ago0I am glad issue is resolved.CommentShareAWS-User-2633450answered 4 years ago


Question: Global secondary indexes null partition key

"Hi,I've been digging around but I don't seem to find anything that could help me.Basically, I created an index for my table and I'd like to keep adding objects to the original table even if the index partition key (let's call it index_id) is not specified. It does not seem possible, yet when I created the index, some of the previous items did not have index_ids and they were just ignored by the index. Is there a way to do this for future items added to the table ?ThanksFollowComment"

Answer: "0Hi mszniber,"For any item in a table, DynamoDB will only write a corresponding entry to a global secondary index if the index key value is present in the item. For global secondary indexes, this is the index partition key and its sort key (if present). If the index key value(s) do not appear in every table item, the index is said to be sparse."That is to say, if the item does not have the attribute which you choose to be the partition key of your GSI, it will not show in your GSI table.Please refer to the following link regarding this for more details:http://docs.aws.amazon.com/amazondynamodb/latest/developerguide/GuidelinesForGSI.html#GuidelinesForGSI.SparseIndexesCommentShareAWS-User-5141743answered 6 years ago"


Question: Loosing table attribute when creating partition using it on partitionKeys.

"Im loosing my table attributes when using them as table partitions. below the code used to write dynamic frame with partitions.## write dynamic frame to glue catalogglueContext.write_dynamic_frame.from_options(    frame=dyf, connection_type="s3",    connection_options={"path": "s3://project_data/onesearch-logs-{}/".format(environment), "partitionKeys": ["endpoint","region","date"]},    format_options={"compression": "snappy", "useGlueParquetWriter": "true"},    format="parquet", transformation_ctx="writer")I can see the s3 folder hierarchy correctly created as per belows3://project_data/onesearch-logs-dev/endpoint=autocomplete/region=ap_southeast_1/date=2023-04-10/part-00000-17b869f5-0400-469d-9866-e8e630f7b378.c000.snappy.parquetAfter crawling and cataloging my folder  s3://project_data/onesearch-logs-dev/ i loose the attribute region in my table** 'dev_endpoint_autocomplete'**Also when I try to read from_catalog using the region as push_down_predicate as per code below I get the error belowCODE :dyf_ac = glueContext.create_dynamic_frame.from_catalog(database="searchdb"                                                         , table_name=**'dev_endpoint_autocomplete'**                                                         , transformation_ctx="reader"                                                         , push_down_predicate="region==ap_southeast_1 and date=='2023-03-14'"                                                         , additional_options={"catalogPartitionPredicate":"endpoint='autocomplete'"}                                                         )**ERROR: **com.amazonaws.services.glue.model.InvalidInputException: Unknown column 'endpoint' (Service: AWSGlue; Status Code: 400; Error Code: InvalidInputException; Request ID:I also tried the below variant for push_down_predicate but failed.dyf_ac = glueContext.create_dynamic_frame.from_catalog(database="searchdb"                                                         , table_name=**'dev_endpoint_autocomplete'**                                                         , transformation_ctx="reader"                                                         , push_down_predicate="endpoint='autocomplete' AND region='ap_southeast_1' AND date='2023-03-14'"                                                         , additional_options={"catalogPartitionPredicate":"endpoint='autocomplete'"}                                                         )also, push_down_predicate="endpoint='autocomplete' AND region='ap_southeast_1' AND date='2023-03-14'", push_down_predicate="endpoint=autocomplete AND region=ap_southeast_1 AND date=2023-03-14"**ERROR: **com.amazonaws.services.glue.util.NonFatalException: User's pushdown predicate: endpoint='autocomplete AND region=ap_southeast_1 AND date='2023-03-14' can not be resolved against partition columns: [date,region] Not sure if im doing something wrong or if my assumptions on the usage of push_down_predicates are somewhat incorrect.ThanksFollowComment"

Answer: "1Hello,I created the below sample data:idfirst_namelast_nameemailendpointregiondate1RetaPitrassorpitrasso0@ox.ac.ukAlphazapPortugal5/13/20222ConsolataPresseycpressey1@ebay.co.ukRegrantVietnam3/13/20233FabePortefporte2@free.frCardifyNetherlands7/1/20224AlvyTabordatabord7@microsoft.comRonstringChina1/7/2023I read the data using DynamicFrame and written the data back to S3 location using the same code as yours in parquet file format:## write dynamic frame to glue catalogS3bucket_node3 = glueContext.write_dynamic_frame.from_options(    frame=ApplyMapping_node2, connection_type="s3",    connection_options={"path": "s3://<bucket>/project_data/onesearch-logs/", "partitionKeys": ["endpoint","region","date"]},    format_options={"compression": "snappy", "useGlueParquetWriter": "true"},    format="parquet", transformation_ctx="S3bucket_node3")Got the expected output at the target S3 location(added one sample output):s3://<bucket>/project_data/onesearch-logs/endpoint=Alphazap/region=Portugal/date=5%2F13%2F2022/After that I created a Crawler to Crawl 's3://<bucket>/project_data/onesearch-logs/'  data source and I can see the correct number of columns along with partition columns[  {    "Name": "id",    "Type": "string"  },  {    "Name": "first_name",    "Type": "string"  },  {    "Name": "last_name",    "Type": "string"  },  {    "Name": "email",    "Type": "string"  },  {    "Name": "endpoint",    "Type": "string",    "PartitionKey": "Partition (0)"  },  {    "Name": "region",    "Type": "string",    "PartitionKey": "Partition (1)"  },  {    "Name": "date",    "Type": "string",    "PartitionKey": "Partition (2)"  }]Also, I used the push_down_predicite to read DynamicFrame and I was able to see the correct results:dyf_ac = glueContext.create_dynamic_frame.from_catalog(database="default"                                                         , table_name='onesearch_logs'                                                         , transformation_ctx="reader"                                                         , push_down_predicate="region=='China'"                                                         , additional_options={"catalogPartitionPredicate":"endpoint='Ronstring'"}                                                         )dyf_ac.toDF().show()Output:idfirst_namelast_nameemailendpointregiondate8AlvyTabordatabord7@microsof...RonstringChina1%2F7%2F2023Therefore, I would like to inform you that your assumption and usage of the push down predicate is correct. However, I suspect the issue is at the Crawler stage. Please check your Crawler logs/S3 parquet data to understand the reason why the column 'region' is not getting added to the Data Catalog table.That being said, if you would like resource based troubleshooting, please raise a support case with AWS for further information and the support team will get back to you with the root cause on the support ticket.Thank you!CommentSharerePost-User-7999548answered a month agoJorge Vidinha a month agoThank you for your time ,I forgot to mention that before crawling I also inspect the written parquet files using 'Big Data Tools' plugin from IntelliJ and the 'endpoint' attribute is also not present in the parquet files written.Share"


Question: SNS Push notification list of available FailureTypes

"Hi all!Currently the team I'm working on is configuring the topic for the Delivery Failure event  in our Platform application.We are receiving the proper event, for example see below:{    DeliveryAttempts: 1,    EndpointArn: "arn::endpoint",    EventType: "DeliveryFailure",    FailureMessage: "Platform token associated with the endpoint is not valid",    FailureType: "InvalidPlatformToken", <<<<<<<<==========================    MessageId: "dd686e01-3f8f-56f7-9683-348cb97d649a",    Resource: "arn:aws:sns:eu-central-1:1212121212:app/GCM/PushNotification",    Service: "SNS",    Time: "2022-02-21T12:25:22.787Z"}Can anyone tell us the list of available FailureType?FollowComment"


Question: About recovery operation when AZ failure occurs

"When a website system is configured by combining a multi-AZ configuration and an ALB When an AZ failure occurs, I think the EC2 on the failure side will be separated, but please tell me what will happen when the AZ failure is recovered.Automatic If there is a document page that can be used as a reference, such as whether the connection will be restored on a regular basis, please share that as well.FollowComment"

Answer: "1Hi,When there is an AZ failure, the health checks on the ALB would fail on the basis of unhealthy threshold and stop sending traffic to the instance in failed AZ. The health checks continue in the background and when the AZ recovers the instance is marked healthy after meeting the success threshold. For the duration that the EC2 remains unhealthy due to the supposed AZ failure, the ASG health checks define what happens to the unhealthy instance (if the instances were part of the ASG & ideally should be for multi AZ config). The default is EC2 health checks in ASG, which means that the instance would be replaced only if the instance has a hardware failure and is impaired. You can also set it to ELB health check type in ASG, where the instance would be auto replaced due to being marked unhealthy by the ALB and to maintain the desired countIf you manually added the instances in different AZ to the ALB ( ie. no ASG), then the instance would only be marked unhealthy and not receive traffic for the duration of the AZ failure but wont be terminated. Once the AZ recovers, the instance would start receiving traffic.Some useful links:https://docs.aws.amazon.com/autoscaling/ec2/userguide/ec2-auto-scaling-health-checks.htmlhttps://docs.aws.amazon.com/autoscaling/ec2/userguide/as-add-elb-healthcheck.html--SydCommentShareSydanswered 9 months agoEXPERTChris_Greviewed 9 months ago"


Question: How to setup Container Insights for AWS EKS with both EC2 Nodegroup and Fargate Profile?

"I have an EKS cluster with both EC2 Nodegroup and Fargate Profile, and I want to setup Container Insights for both. I followed the docs, but I got error which tell that the default-scheduler failed to schedule fluent-bit on Fargate Profile. As I understand, it should be Fargate Scheduler launch fluent-bit as sidecar container into Fargate Pods.Does anyone knows how to setup Container Insights for both EC2 Nodegroup and Fargate Profile? Thank youFollowComment"

Answer: "0To setup Container Insights for both EC2 Nodegroup and Fargate Profile in your EKS cluster, you need to follow these steps:Enable Container Insights for your cluster by following the steps mentioned in the official AWS documentation: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Container-Insights-setup-EKS-quickstart.htmlOnce you have enabled Container Insights, install the Fluent Bit log collector on your EC2 instances by running the following command:kubectl apply -f https://raw.githubusercontent.com/aws-samples/amazon-cloudwatch-container-insights/latest/k8s-yaml-templates/quickstart/cwagent-fluent-bit-quickstart.yamlVerify that the Fluent Bit log collector is running by checking the logs of the fluent-bit container in the amazon-cloudwatch namespace:kubectl -n amazon-cloudwatch logs -f fluent-bit-xxxxxTo enable Container Insights for Fargate profiles, you need to create a Fargate profile with the cwagent and cwlogs addons enabled. You can do this by creating a YAML file with the following contents:apiVersion: eksctl.io/v1alpha5kind: FargateProfilemetadata:  name: my-fargate-profile  region: <region>  version: '1.17'spec:  selectors:    - namespace: default  subnets:    - subnet-xxxxxxxx  addons:    - name: cwagent      version: 'latest'    - name: cwlogs      version: 'latest'Apply the YAML file using the eksctl CLI tool:eksctl create fargateprofile -f fargate-profile.yamlVerify that the Fluent Bit log collector is running as a sidecar container in your Fargate pods by checking the logs of the fluent-bit container in the amazon-cloudwatch namespace:kubectl -n amazon-cloudwatch logs -f fluent-bit-xxxxxBy following these steps, you should be able to enable Container Insights for both EC2 Nodegroup and Fargate Profile in your EKS cluster.CommentSharehashanswered a month ago"


Question: Regarding the Admin access in Grafana workspace

"I have configured the Grafana workspace using the SAML configuration, and I can able login to Grafana console not able to see the admin privileges in the console like I can't see the configuration setting option in the console.FollowComment"

Answer: "0Hi,Thank you for contacting us. I understand that you have configured Amazon Managed Grafana with a 3rd party SAML Identity Provider. Now, you are concerned that once the user logs into the Grafana console, they are lacking admin privileges.Could you please confirm if you have opted out of assigning admins to your workspace? Please refer to the following note from [1]:[1] Azure Active Directory - Step 2: Steps to complete in Amazon Managed Grafana - https://docs.aws.amazon.com/grafana/latest/userguide/AMG-SAML-providers-Azure.html#AMG-SAML-providers-Azure-step2"Under Assertion mapping, do the following:Make sure that I want to opt-out of assigning admins to my workspace is not selected.NoteIf you choose I want to opt-out of assigning admins to my workspace, you won't be able to use the Amazon Managed Grafana workspace console to administer the workspace, including tasks such as managing data sources, users, and dashboard permissions. You can make administrative changes to the workspace only by using Grafana APIs."We have documentations for setting up access with each Identity Provider. The following blogpost also walks through setting up admin role access.[2] https://aws.amazon.com/blogs/mt/amazon-managed-grafana-supports-direct-saml-integration-with-identity-providers/If you continue to experience this issue, please feel free to raise a support case so we are able to take a look at the configuration in detail.Note: For security and privacy reasons, please avoid sharing any details regarding your resources over re:Post since this is a public platform.CommentShareSUPPORT ENGINEERSumukhi_Panswered 2 months ago"


Question: How to send data from IoT Core rules to IoT SiteWise

"Hi everyone, I'm relatively new on AWS. I currently receive data in a Rule in IoT Core (MQTT) using SDK in the information source. This data needs to be send to IoT SiteWise to trade it. In the AWS SiteWise manual, I have seen ways to do that using Greengrass, but I cannot use this option (company politics). I tried to do what it's explined in the folloing link: https://iot-sitewise.workshop.aws/en/40_aws-iot-sitewise-data-ingestion/ingest-data-through-iot-core.htmlThe problem is that, on that link it doesn't explain how to configure an IAM role.I also found this link: https://repost.aws/questions/QUbrB4L4GdTNinE1kxZ0PFqw/problem-with-ingestion-data-from-iot-core-mqtt-to-aws-sitewiseBut in my opinion, it's not completely answered.I have also found information about Device Shadow, but in my case, I prefer to use the Rule, thus I already receive information there, and I have not understood the way to install the "connect the device package" in my device.How can I take the values from my Rule (or it can be also from S3) and trend it in IoT SiteWise?Thanks.FollowComment"

Answer: "0Hi Eduardo,you can find a sample IAM policy to route data from AWS IoT Core to AWS IoT Sitewise in the related rule documentation.You can create an IAM role for with a trust relationship for IoT Core and attach the policy.Cheers,PhilippCommentSharePhilipp Sanswered 20 days ago"


Question: "I am trying to log in through the Cognito hosted UI. I don't see such a function in the example, what should I do?"

"I am trying to log in through the Cognito hosted UI. I don't see such a function in the example, what should I do?FollowComment"

Answer: "0Accepted AnswerHello,If you are looking for an example of how to use our feature for player registration and login (powered by Cognito), then please check out either our Blueprint/UI examples for player login or our C++ examples for the Identity and Authentication feature.Instructions of where each of these examples (plus examples of our other features) can be found in our AWS GameKit documentation https://docs.aws.amazon.com/gamekit/latest/DevGuide/identity-auth-examples.html . Additionally, documentation for how to add the Identity and Authentication feature to your game can be found here https://docs.aws.amazon.com/gamekit/latest/DevGuide/identity-auth-deploying.html.Thank You,AWS GameKitCommentShareJake_AWSanswered a year ago"


Question: Unexpected number of sqs requests

"I've registered aws account few days ago and managed to run few lambdas integrated with API gateway, SQS, s3, DynamoDB and RDS etc. I've performed few requests and sent not more than 10 messages to sqs. However when I opened my billing console I saw that there are more than 20000 SQS requests tracked on my account (other services statistic was totally ok).I am 100% sure my code could not trigger such amount of requests, and despite the fact I am still pretty far from exceeding the free tier limit I am very curious why is that happening?I hope someone who is more experienced in sqs could help me to understand that.FollowComment"

Answer: "0Accepted AnswerThere's a bit more info in the announcement of the integration between Lambda and SQS:https://aws.amazon.com/blogs/aws/aws-lambda-adds-amazon-simple-queue-service-to-supported-event-sources/There are no additional charges for this feature, but because the Lambda service is continuously long-polling the SQS queue the account will be charged for those API calls at the standard SQS pricing rates.CommentShareKubaanswered 3 years ago"


Question: "[Announcement] Upgrade Amazon Aurora PostgreSQL 10.13, 10.14, 10.16, 11.8, 11.11, 12.4, and 12.6 minor versions by July 15, 2022"

"Newer versions of Amazon Aurora PostgreSQL-compatible edition are now available and database cluster(s) running Aurora PostgreSQL minor versions 10.13, 10.14, 10.16, 11.8, 11.11, 12.4, and 12.6 need to be upgraded by July 15, 2022. These newer minor versions include important updates that will improve the operations of your Aurora PostgreSQL instances and workloads. We strongly encourage you to upgrade to at least a recommended minimum minor version at your earliest convenience.For PostgreSQL Minor Versions 10.13, 10.14 and 10.16, the recommended minimum minor version is 10.17.For PostgreSQL Minor Versions 11.8 and 11.11, the recommended minimum minor version is 11.12.For PostgreSQL Minor Versions 12.4 and 12.6, the recommended minimum minor version is 12.7.Starting on or after 12:00 PM PDT on July 15, 2022, if your Amazon Aurora PostgreSQL cluster has not been upgraded to a newer minor version, we will schedule the relevant recommended minimum minor version to be automatically applied during your next maintenance window. Changes will apply to your cluster during your next maintenance window even if auto minor version upgrade is disabled.Restoration of Amazon Aurora PostgreSQL 10.13, 10.14, 10.16, 11.8, 11.11, 12.4, and 12.6 database snapshots after July 15, 2022 will result in an automatic upgrade of the restored database to a supported version at the time.How to Determine Which Instances are Running These Minor Versions?In the Amazon RDS console, you can see details about a database cluster, including the Aurora PostgreSQL version of instances in the cluster, by choosing Databases from the console's navigation pane.To view DB cluster information by using the AWS CLI, use the describe-db-clusters command.To view DB cluster information using the Amazon RDS API, use the DescribeDBClusters operation. You can also query a database directly to get the version number by querying the aurora_version() system function i.e., "SELECT * FROM aurora_version();".*How to Apply a New Minor Version *You can apply a new minor version in the AWS Management Console, via the AWS CLI, or via the RDS API. Customers using CloudFormation are advised to apply updates in CloudFormation. We advise you to take a manual snapshot before upgrading. For detailed upgrade procedures, please see the available User Guide [1]. Please be aware that your cluster will experience a short period of downtime when the update is applied.Visit the Aurora Version Policy [2] and the documentation [3] for more information and detailed release notes about minor versions, including existing supported versions.If you have any questions or concerns, the AWS Support Team is available on AWS re:Post and via Premium Support  [4].[1] https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_UpgradeDBInstance.PostgreSQL.html[2] https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/Aurora.VersionPolicy.html[3] https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/AuroraPostgreSQL.Updates.20180305.html[4] https://aws.amazon.com/supportFollowComment"