Question: Trying to understand async/await in lambda

"Thanks to some great help here I have made some progress un understanding the problem I'm trying to solve, but I'm still missing something fundamental.My use case is an existing lambda-based rules engine, written in Node. The rules in a set generally use results from evaluation of earlier rules, so executing them in sequence, synchronously, makes most sense. I can see how it might be possible to fire off separate asynchronous function calls for everything and then somehow clear up the mess afterwards, potentially re-calling those that failed due to missing data but this would be a nightmare.So what I'm trying to do is insert an async call in what is currently an exclusively synchronous architecture, and I'm not even sure if this is possible in JS/Node. Any advice gratefully appreciated! This might be a Javascript or even a Node.js question rather than an AWS Lambda one, but from my research the way that asynchronous functions are scheduled does seem to be unique to this combination so I thought I'd start here!It would be great to get to the bottom of this though ... I'd feel less dumb :)This is a stripped-back example that shows what I'd like to achieve, inserting an async call to ChatGPT:const { Configuration, OpenAIApi } = require("openai");exports.handler = async function(event, context, callback) {    var output;try {output = await makeSentence(event.prompt);console.log('output: ' + output);}catch (e){output = e.message;}let response = {statusCode: 200,headers: { "Content-type" : "application/json" },body: JSON.stringify(output)};return response;};async function makeSentence(prompt){const rule1 = getOpening();                     // existing sync callconst rule2 = await getMiddle(prompt);          // new async callconst rule3 = getClosing(rule1 + ' ' + rule2);  // existing sync call        // assemble all the results and return the final resultreturn rule3;}function getOpening(){const greeting = [ 'Hello', 'Hi', 'Greetings'];const random = Math.floor(Math.random() * greeting.length);return '<sentence>' + greeting[random];}async function getMiddle(prompt){    console.log("getMiddle('" + prompt + "')");    const configuration = new Configuration({apiKey: "my-api-key-here",});const openai = new OpenAIApi(configuration);await openai.createCompletion({model: "text-davinci-003",prompt: prompt,temperature: 0.7,max_tokens: 500,top_p: 1,frequency_penalty: 0,presence_penalty: 0,}).then(res => {        var text = res.data.choices[0].text;        console.log('got response: ' + text);        return text;    }).catch(error => {        console.log('Error: ' + error.message);        return error.message;    });}function getClosing(resp){return resp + '</sentence>';}The result of this is:Event JSON{  "prompt": "what did the fox say?"}Response{  "statusCode": 200,  "headers": {    "Content-type": "application/json"  },  "body": "\"<sentence>Greetings undefined</sentence>\""}Function LogsSTART RequestId: c7153471-1563-430d-889a-cb394737b5dd Version: $LATEST2023-04-26T17:16:44.120Zc7153471-1563-430d-889a-cb394737b5ddINFOgetMiddle('what did the fox say?')2023-04-26T17:16:46.119Zc7153471-1563-430d-889a-cb394737b5ddINFOgot response: The fox usually says, "Ring-ding-ding-ding-dingeringeding!"2023-04-26T17:16:46.119Zc7153471-1563-430d-889a-cb394737b5ddINFOgetClosing("<sentence>Hi undefined")2023-04-26T17:16:46.119Zc7153471-1563-430d-889a-cb394737b5ddINFOoutput: <sentence>Hi undefined</sentence>END RequestId: c7153471-1563-430d-889a-cb394737b5ddREPORT RequestId: c7153471-1563-430d-889a-cb394737b5ddDuration: 2039.43 msBilled Duration: 2040 msMemory Size: 128 MBMax Memory Used: 77 MBFollowComment"

Answer: "0Accepted AnswerI found the answer ...In case it helps anyone, the code below mixes synchronous and async function calls in sequence, waiting for the async one to complete before continuing to the next function.const { Configuration, OpenAIApi } = require("openai");exports.handler = async function(event, context, callback) {    var output;    try {const rule1 = getStart();                                    // call the first (sync) function        const rule2 = await getMiddle(event.prompt).then(res => {    // call the second (async) function and wait                return res.data.choices[0].text;        }).catch(error => {                return error.message;            });                output = getEnd(rule1 + ' ' + rule2);                        // call the third (sync) function        console.log('result: ' + output);    }    catch (e){output = e.message;    }    let response = {statusCode: 200,headers: { "Content-type" : "application/json" },        body: JSON.stringify(output)    };    return response;};function getStart(){    return '<sentence>Hi there,';}async function getMiddle(prompt){    console.log("getMiddle('" + prompt + "')");    const configuration = new Configuration({        apiKey: "my-api-key-here",    });    const openai = new OpenAIApi(configuration);    return openai.createCompletion({            model: "text-davinci-003",            prompt: prompt,            temperature: 0.7,            max_tokens: 500,            top_p: 1,            frequency_penalty: 0,            presence_penalty: 0,    });}function getEnd(resp){    return resp + '</sentence>';}Response{  "statusCode": 200,  "headers": {    "Content-type": "application/json"  },  "body": "\"<sentence>Hi there, \\n\\nThe fox usually makes a sound similar to \\\"Skrr! Skrr!\\\"</sentence>\""}Function LogsSTART RequestId: 41cc46f8-9a9b-4500-854e-574739511e2e Version: $LATEST2023-04-27T10:55:22.820Z41cc46f8-9a9b-4500-854e-574739511e2eINFOgetMiddle('what did the fox say?')2023-04-27T10:55:25.040Z41cc46f8-9a9b-4500-854e-574739511e2eINFOresult: <sentence>Hi there, The fox usually makes a sound similar to "Skrr! Skrr!"</sentence>END RequestId: 41cc46f8-9a9b-4500-854e-574739511e2eCommentSharedmb0058answered a month ago0Hi,I think your issue is due to that in getMiddle function, if you use await, you do not need to chain or with a then statement.You could just sayConst res = await openai.createCompletion(…)See below as example:https://levelup.gitconnected.com/build-your-personal-speaker-assistant-with-amplify-and-chatgpt-8b6433fea042Hope it helps ;)CommentShareEXPERTalatechanswered a month ago0Hmm, I wondered about that, but it doesn't seem to make a difference.I read your excellent article on Amplify and ChatGPT, and I thought I understood most of it - I'm still studying and learning :) The example that you gave to my related question worked perfectly, with no synchronous calls in the chain. However when I tried to integrate async and sync functions the async ones behave synchronously (actually I think they just return a Promise and the caller continues regardless).I don't understand (mea culpa) why the call to getMiddle() in makeSentence() doesn't seem to wait, it sends the request and then goes straight to the getClosing() call ... I suspect the problem is something to do with how async functions are off-boarded to the Node environment, but I'm just guessing here.CommentSharedmb0058answered a month ago"


Question: codecommit repositories

"How to import code between two codecommit repos, where we doesn't want to use https or ssh?FollowCommentkyager 7 months agoCodeCommit only offers HTTPS or SSH, if you want to use a different protocol you will need to use a different service.Share"

Answer: 0Hello!CodeCommit only supports connections with SSH or HTTPS. Please see: https://docs.aws.amazon.com/codecommit/latest/userguide/how-to-connect.htmlCommentSharemasseanswered 7 months ago


Question: What's the recommended way to use PrivateLink with a PaaS backend which only provides FQDNs?

"I would like to create a connection between a lot of AWS Lambda services and AWS ElastiCache (EC) service using the PrivateLink (PL) approach.We are working in multi-account environment and EC consumers are isolated into a lot of accounts.According to the AWS documentation each VPC requires at least one VPC Interface Endpoint at service consumer side and VPC Endpoint Service at service provider side. Also according to the documentation this could only be done using private facing ELB, which Target Group expects the IPs or instances IDs as targets and not the FQDNs that are provided by AWS EC (write and read FQDNs).The question is -- what is the recommended way to create a multi-account connectivity using the PL within such environment?NOTE: I've already saw several posts like https://aws.amazon.com/blogs/networking-and-content-delivery/hostname-as-target-for-network-load-balancers/ and don't like an idea of some additional moving part responsible for TargetGroup update. Is that the only solution?FollowComment"

Answer: "0TL;DR: Contact your local AWS Solutions Architect for an in-depth discussion of alternative solutions.Tricky question because there's no easy way to solve this.In an ideal world you'd just put a NLB in front of the ElastiCache cluster; point PrivateLink at it and away you go. But it isn't that easy.One way to solve this would be to deploy Lambda functions to each account; and have them independently call the clusters. Probably raises more problems than it solves: Lambda deployment; cross-account access; sync/async calls; all sorts of things.In the end, you may find the solution that you've linked to is the way to go; but it also (as you know) has drawbacks.Definitely an opportunity to chat to your local AWS team and find a "good" way of doing this.CommentShareEXPERTBrettski-AWSanswered a year ago"


Question: I want to run the "node server.js" and start the server with terminal on the amplify hosted app

"I am new to Amplify and development.I am hosting a server that is located in file "server.js" in the root of my Amplify app.It can be start on localhost with the console command "node server.js" when present in the root folder of my app (the file server.js is located in my root app folder).I push my project to GitHub , and connected it with Amplify.I can run this server on localhost but I cannot :find my app files hosted on the serverhow can I access my files on amplify server with terminal?if I access the server with terminal then I hope I will be able to run  console "node server.js" command to start the server online.Please let me know if anyone have a clue.FollowComment"

Answer: "0So amplify isn't a server. It's a service. And one meant for deploying your UI, not the backend. To run your server you would need to use a different service like EC2, ECS or beanstalk. From the FAQAWS Amplify consists of a set of tools (open source framework, visual development environment, console) and services (web app and static website hosting) to accelerate the development of mobile and web applications on AWS.See here for more details about amplifyhttps://aws.amazon.com/amplify/faqs/CommentShareDakota Lewallenanswered 5 months ago0Amplify is usually used for front-end applications, not backend HTTP servers. But, Amplify does support Server-side Render.Try updating your CI backend build pipeline to execute a custom script instead of the built-in one:backend:  phases:    build:      commands:        - sh scripts/amplifyPush.shThe custom scripts/amplifyPush.sh can have whatever you need for running your NodeJS application.I hope this helps.CommentSharebill_bsbanswered 4 months ago"


Question: Data transfer cost for Amazon Quicksight

"Hi,Is there any data transfer out associated cost when visualizing dashboards in Amazon Quicksight or exporting data in to CSV, that should be added to the user monthly fee? Or is it already included in the user fee?ThanksFollowComment"

Answer: "1Accepted AnswerThere are no charges for exporting data to CSV or when visualizing it.  They get 10GB of SPICE capacity per author user they add, and can optionally purchase more SPICE at $.38/gb/month.  Other than that it is only the user charges.CommentShareAWS-User-5529594answered 4 years ago"


Question: How to Configure and Release a Saas-based platform to AWS Marketplace ?

I am looking for some help in configuration and release of a SaaS/container-based platform to AWS marketplace? I’m stuck on a project and any help (in terms of guidance/concrete steps to follow upon) on this is appreciated.FollowComment

Answer: "1Accepted AnswerHello Adit!Our documentation with regards to deploying SaaS to the Marketplace is available here: https://docs.aws.amazon.com/marketplace/latest/userguide/saas-products.htmlHowever, if you do require further help/ guidance, you are also able to reach out to the Marketplace team directly here: https://aws.amazon.com/marketplace/management/contact-us/CommentShareSUPPORT ENGINEERJasper_Ranswered a year ago1Have you looked at this guide?CommentShareRoianswered a year agoAdit a year agoThank you, it seems helpful. Is it possible to get some help from aws marketplace team for some aspects of how I can publish my product to marketplace. There seems to be a lot of moving parts and it is hard to wrap my hand around all of them.Share"


Question: Terminated instances showing up in ssm get-inventory CLI

"Hi all,I need to automatise run command to install and configure CW and get inventory for creating JSON files with the installed Applications.  Splunk will pull these files from S3. I have created some scripst for this using the AWS CLI but I'm facing an issue.When I query ssm inventory like bellow, terminated instances are still showing up on the CLI eventhough some have been terminated days ago.Example:  aws ssm get-inventory --filters '[{"Key":"AWS:Tag.Key","Values":["OS"],"Type":"Equal"},{"Key":"AWS:Tag.Value","Values":["windows"],"Type":"Equal"}]'| grep -i instanceid | awk '{print $2}' | sed 's/."(.)"[^"]*$/\1/' | wc -l5I have only four running instances with those particular tags.Even ec2 describe says that it has been terminated. Bellow the terminated instance id which is still showing up in the inventory list. On the GUI I cannot see the terminated instance.aws ec2 describe-instances --instance-ids i-06122dfe502f15968{"Reservations": [{"Instances": [{"Monitoring": {"State": "disabled"},"StateReason": {"Message": "Client.UserInitiatedShutdown: User initiated shutdown","Code": "Client.UserInitiatedShutdown"},"PublicDnsName": "","Platform": "windows","State": {"Code": 48,"Name": "terminated"...Can you guys help me with this. How can I remove them or when will AWS remove?ThanksNorbertEdited by: NorbertS on Jun 17, 2021 11:51 AMFollowComment"

Answer: "0I think I found a solution to query the inventory without listing the terminated instances IDs.Bellow is my one liner.aws ssm get-inventory --filters '[{"Key":"AWS:Tag.Key","Values":["OS"],"Type":"Equal"},{"Key":"AWS:Tag.Value","Values":["windows"],"Type":"Equal"},{"Key":"AWS:InstanceInformation.InstanceStatus","Values":["terminated"],"Type":"NotEqual"}]'| grep -i instanceid | awk '{print $2}' | sed 's/."(.)"[^"]*$/\1/'Now it is only showing the running instances.CheersNorbertCommentShareNorbertSanswered 2 years ago"


Question: CW Metric Filter to group Glue crawler logs by crawl id

"Hi! I read through https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/FilterAndPatternSyntax.html for CW metric filter syntax and don't think this is possible, but wanted to ask anyways to see if anyone else has the same use case. Our Glue Crawler runs drop logs into CloudWatch with the following syntax:*2023-03-31T09:00:40.477-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] BENCHMARK : Running Start Crawl for Crawler staging_table2023-03-31T09:00:40.825-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] INFO : The crawl is running by consuming Amazon S3 events.2023-03-31T09:00:41.323-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] INFO : The number of messages in the SQS queue arn:aws:sqs:us-west-2:xxxxxxxxx:staging-crawler-queue is 82023-03-31T09:00:41.617-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] INFO : The number of unique events received is 2 for the target with database: staging2023-03-31T09:02:48.853-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] BENCHMARK : Classification complete, writing results to database staging2023-03-31T09:02:48.880-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] INFO : Crawler configured with Configuration {"Version":1.0,"CrawlerOutput":{"Partitions":{"AddOrUpdateBehavior":"InheritFromTable"}},"Grouping":{"TableGroupingPolicy":"CombineCompatibleSchemas"}} and SchemaChangePolicy {"UpdateBehavior":"LOG","DeleteBehavior":"LOG"}. Note that values in the Configuration override values in the SchemaChangePolicy for S3 Targets.2023-03-31T09:08:29.205-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] INFO : Some files do not match the schema detected. Remove or exclude the following files from the crawler (truncated to first 200 files): staging-xxxxxxxxxxxx-us-west-2-prod/xxx/organization_id=xxxx/title_id=xxxxxxxx/land_date=2022-12-07/land_hour=17/abcdefghij.gz2023-03-31T09:08:38.075-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] INFO : Discovered schema changes for Table staging_table in database staging2023-03-31T09:08:54.188-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] INFO : Created partitions with values [[xxx, xxxxxx, abcde, 15], [yyy, yyyyyy, xyz, 16]] for table staging_table in database staging2023-03-31T09:09:15.901-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] BENCHMARK : Finished writing to Catalog2023-03-31T09:09:15.945-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] INFO : Run Summary For PARTITION:2023-03-31T09:09:15.945-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] INFO : ADD: 22023-03-31T09:10:24.005-07:00[1bd316e6-9020-456c-9c3e-7c96f80b6b6a] BENCHMARK : Crawler has finished running and is in state READY*Is it possible to create a metric filter that can group by the crawl id, i.e. the 1bd316e6-9020-456c-9c3e-7c96f80b6b6a value in the logs above. Given each time log has a time entry, is it possible to group these logs by the crawl id to extract the duration between the first and last occurrences and have it be reported as a metric with the the crawl id as a dimension. Glue does not publish any CloudWatch metrics for the crawler, and this is one option I'm exploring so we can monitor and visualize our crawl times over time.FollowComment"


Question: EC2 bandwidth to the Internet

"A customer wants to migrate an application to a cloud based solution so they can make use of autoscaling and good bandwidth. Therefore, he asks for bandwidth figures to the Internet (not internal bandwidth figures) from different types of instances. And whether an autoscaling group shares a fixed amount of bandwidth or each instance multiplies the bandwidth, which he hopes it would if using a bandwidth metric to auto scale.Could someone help with that?FollowComment"

Answer: "0Accepted AnswerWhilst some instance types can clearly deliver 10Gbps or more of bandwidth you can't use all of this for internet-bound traffic.  You should expect to see the following limits on internet egress bandwidth per instance:Single Flow from one instance - 5GbpsMultiple Flows from one instance - 5GbpsIn many scenarios, multiple flows from an instance can hit much higher limits (e.g. 25Gbps to S3, or over VPC Peering links), but for Internet egress there is a 5Gbps cap per instance.  You can find this in the public documentation here:Network traffic outside a cluster placement group (e.g. to the Internet) is limited to 5 Gbps (full duplex)CommentShareEXPERTDr Andrew Kaneanswered 5 years ago"


Question: How to move WorkMail to another region

"I've created an Organization under Workmail, setup the domain, and everything was needed, and only at the end I've realized that I wasn't in the region where I'd like to be.Considering that I've migrated all of my emails, and using WorkMail since some days already, Is there a way to move WorkMail to another (supported) region?Thanks!FollowComment"

Answer: "1Accepted AnswerHi,I'm sorry to inform you that currently there is no easy way to move a WorkMail organization to a different region, this will require a migration.Kind regards,RobinCommentShareMODERATORrobinkawsanswered a year agotmow a year agoThanks! I think I'll survive staying in this region. :-)Share"


Question: Cloud9 ide support for jsdoc typechecking with typescript

"Hi, typechecking with Typescript on javascript projects is already supportes by vscode. Is it possible for cloud9 ide tu support the feature too? See more here: https://www.typescriptlang.org/docs/handbook/intro-to-js-ts.html.FollowComment"

Answer: "0Hi! Thanks for reaching out, I passed your feature request to AWS Cloud9 teamCommentShareanester-awsanswered a year ago"


Question: How long will the AWS RDS outage take when enabling backups?

"The documentation (https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithAutomatedBackups.html) states that in case of changing the retention period from 0 to some positive number, there will be an outage. Unfortunately i cannot find any info on how long will it be.This is a production db for high availability service - and I do not want it to take like an hour or so.The db size is significant - about 100 GB.Does anyone know how long can it take?FollowComment"

Answer: "0There is no outage to enable automated backup in RDS Service. When you modify instance and enable backup retention period there will be an I/O suspension typically for few seconds for RDS service to initiate snapshot backup of storage volumes used by RDS db engine.CommentShareAWS-User-5132967answered 7 months ago0That answer is not quite correct. For RDS engines other than Aurora, the documentation is accurate: when enabling a backup retention there is a brief outage while we restart the database. It is just the time it takes to reboot the database.CommentShareMODERATORphilawsanswered 7 months agoEXPERTIndranil Banerjee AWSreviewed 7 months ago"


Question: When will Amazon Linux 2022 become available on Lightsail?

"Currently there's no mention of it, and since the support date for AL 2 is fairly short, would be nice to start planning.FollowCommentiwasa EXPERT9 months ago+1Support for Amazon Linux 2 has been postponed until June 30, 2024.https://aws.amazon.com/amazon-linux-2/faqs/?nc1=h_lsBut even when Amazon Linux 2 came out, we had to wait until it was available for his Lightsail, so AWS might as well roll it out for his Lightsail users.Share"

Answer: "1Hello,Thank you for reaching out on RePost!Amazon Linux 2 End of Life (EOL) support has been extended by one year from 30-06-2023 to 30-06-2024 to provide customers with ample time to migrate to Amazon Linux 2022. Amazon Linux 2022 Generally Available (GA) release is scheduled for later this year, and will be supported for five years.The Release Candidate for Amazon Linux 2022 has been made available on EC2, which is solely for testing and customer feedback only.https://aws.amazon.com/linux/amazon-linux-2022/We do not have an ETA on Amazon Linux 2022 availability on LightSail as of now. Once we have an update from the Lightsail team, release details will be posted here for your reference.Thank you.CommentShareSUPPORT ENGINEERRinal Janswered 9 months ago0Thanks.It sounds like we probably won't be seeing it in Lightsail before next year. At least that gives me some planning time.I understand not announcing releases for things before they're ready, but it's helpful to know when they WON'T be available too.CommentSharerePost-User-7950338answered 9 months ago"


Question: Connection to windows-instance extremely slow

"Connection to my windows instance locate at Frankfurt, Zone A (eu-central-1a) is extremely slow recently. I tried, RDC and ping from using different ISP and also VPN but no luck. My internet connection is good, but RDC connection is either not established or freezes after a brief connection. My hosted website has also become also very slow. What could be the reason?I'm using,512 MB RAM, 1 vCPU, 30 GB SSDWindows Server 2019Frankfurt, Zone A (eu-central-1a)FollowComment"

Answer: "1There could be a couple reasons as to why you could be experiencing such high levels of inconsistency, such as insufficient ram, network congestion,  CPU size, etcHowver, you can troubleshoot this by using cloudwatch1- Check the CloudWatch metrics for your instance, including CPU usage, network traffic, and disk I/O. This can help you identify if any of these resources are causing the issue.2- Try resizing your instance to a larger size to see if that improves performance.3- Check the logs of your applications and services to see if there are any errors or performance issues that are causing the slow performance.4- Check the AWS Service Health Dashboard to see if there are any issues with the network or infrastructure in the region.5- Contact AWS Support for further assistance if you are unable to resolve the issue.CommentShareAWS_Guyanswered 3 months ago"


Question: RDP asking for NLA a month after Active Directory FSx setup

"I am having an issue that seems to be stemming from some incorrect network or directory configuration that I cannot seem to pin down.My server setup is as follows:multiple Windows server 2016 EC2s (created off an image I set up roughly a week ago)AWS managed Microsoft Active Directory (bare bones, just used for FSx)FSx filesystemI set this all up a month ago and everything was smooth sailing (attached the Directory following the AWS doc here: https://docs.aws.amazon.com/directoryservice/latest/admin-guide/join_windows_instance.html). However, last night (exactly one month after I hooked up the AD and FSx) I could no longer RDP into my server (I had successfully RPDed in the night before). I received an error message that stated “The remote computer that you are trying to connect to requires network level authentication (NLA), but your windows domain controller cannot be contacted to perform NLA...”. I thought maybe the server was just wonky so I spun up a new server off my image. Not only could I not RDP into the new server, but it did not appear to be able to access files from my FSx filesystem (couldn’t RDP in to see exactly why or if I could manually map it to a drive). The existing servers that I still could not RDP into were serving files from FSx just fine at that point (they later failed at 1 pm PST without any outside intervention). I tried creating servers off of old images to see whether the problem was just my recent image, but any image that I had created after I initially hooked up my Directory would present me with the same error when I tried to RDP in. I ended up having to go back to an image I created before and manually hook that up to the Directory and File System again which fixed the issue, but I suspect I am going to run into this again in a month.The fact that it was a month on the nose between setting everything up and the error, I suspect it was caused by some session expiring. Am I right in my thinking that this was the cause of the issue or am I totally off base? If I am right, is there anything I can do to extend the session or make it unlimited in some way?I’m new to using active directories (in the past I’ve just used a windows server mapped to a domain in my host file to serve files), so I’m sure there’s something I’m missing.Thanks!FollowComment"

Answer: 0Sounds similar to this post.  I'm guessing you forgot to run SysPrep before making the image.https://forums.aws.amazon.com/thread.jspa?threadID=328709Here are instructions on how to SysPrep EC2 instances.https://aws.amazon.com/premiumsupport/knowledge-center/sysprep-create-install-ec2-windows-amis/CommentShareJoeD_AWSanswered 2 years ago


Question: Moving from Goddy -> AWS LightSail .... issues with setting DNS for SES.

"Moving from Goddy -> AWS LightSail .... issues with setting DNS for SES.I updated my GoDaddy to using the ASW name servers but now I am trying to enter a CNAME record on AWS and its not letting me do anythingFollowCommentiwasa EXPERT5 months agoHi, @JohnathanSmith.Please organize the following and let me know.Backgroundwhat you did to realize the backgroundShareGabriel - AWS 5 months agoAre you using Route53 directly to manage the name server or Amazon Lightsail?its not letting me do anythingAre you unable to create records or are the records not producing any results when you call the endpoint? Each Route53 or Lightsail DNS Zone has a different set of name servers, so double check that you are using the right set of name servers for the zone in question.Share"


Question: GO SDK V2 - Describe Addresses paginator

"Hi,I'm using the GO SDK V2 to fetch all the EIPs of an account.My goal is to get the number of EIPs in a specific account.I couldn't find a paginator option for this API call DescribeAddresses.There is a paginator/next token option for the DescribeAddressesAttribute API call,but for this option, I could not retrieve all the EIPs addresses of the account.Actually without attribute passed, I got an empty result [].I have a couple of questions:Is there a way to use pagination for DescribeAddresses?Is there a parameter for DescribeAddressesAttribute to make this call to retrieve all EIPs?What is the maximal number of EIPs in an account?What is the maximal number of results that can be returned from DescribeAddresses?Thank you,Ori AdlerFollowComment"

Answer: "0DescribeAddresses isn't a paginated API action. It will return all Elastic IP addresses in the targeted account and region. Perhaps you are invoking it against the wrong account or region?The maximum number of EIPs in an account and region is 5 by default, but is adjustable by issuing a service limit request.CommentShareEXPERTMichael_Fanswered a year ago"


Question: kube-controller in my EKS is consuming all the cpu and memory Resources

Kube-controller pod in AWS EKS is consuming a majority of the CPU and memory resources.How to reduce it and make it available for the podsFollowCommentVenkat Penmetsa SUPPORT ENGINEER9 months agoAre you referring to an EKS Anywhere cluster?Share

Answer: "0Its about the managed kubernetes service- Amazon Elastic Kubernetes Service.Iam using  8gb, 2vcpu T3.large Instance type as kubernetes Nodes. As per the metric server output, Kube-controller is using 1820m of CPU core and 2351 mi of RAM. This makes the usable memory in each Node as only 5GB out of the 8GB.CommentSharerePost-User-1390514answered 9 months ago"


Question: RealTime Servers and Reliable UDP

"Hi there,https://docs.aws.amazon.com/gamelift/latest/developerguide/realtime-howitworks.htmlThe RealTime Servers documentation saidCommunication between a Realtime server and connected game clients uses two channels: a TCP connection for reliable delivery and a UDP channel for fast delivery. When creating messages, game clients choose which protocol to use depending on the nature of the message. Message delivery is set to UDP by default. If a UDP channel is not set up or not available, all messages are sent using TCP as a fallback.It didn't mention if the UDP is a Reliable UDP implementation or not. If not, is there a plan to introduce a RUDP protocol in the future?FollowComment"

Answer: "0No, RTS doesn't use Reliable UDP. It uses dgram provided by NodeJS (https://nodejs.org/api/dgram.html).Could you help me understand your use case for this? Do you have any data to show that TCP or UDP are insufficient for what you are trying to do? With these info, I can work with the product team and send in a feature request.CommentSharerePost-User-7108006answered 2 years ago0Well, any genre that is latency-sensitive. For example, the real-time strategy genre.I'm from a Unity background that almost every popular network solutions offer RUDP as the preferred network protocol. I'd like to borrow the concept of Ruffles (a reliable UDP library of Unity):Reliable : All messages are guaranteed to be delivered, the order is not guaranteed, duplicates are dropped. Uses a fixed sliding window.ReliableSequenced : All messages are guaranteed to be delivered with the order also being guaranteed, duplicates are dropped. Uses a fixed sliding window.Unreliable : Delivery is not guaranteed, nor is the order. Duplicates are dropped.UnreliableSequenced : Delivery is not guaranteed but the order is. Older packets and duplicate packets are dropped.The most useful one is the first "reliable" type.The problem is RUDP is just a layer on top of UDP. So there's no gold standard or dominated cross-platform solution there.CommentSharerePost-User-6332773answered 2 years ago0Thanks for the details @REDACTEDUSERCurrently we are using DTLS to provide encryption in-flight over UDP. Do you know if RUDP has something similar? Could you recommend some popular RUDP libraries that are tried-and-true? Could you also share examples of your aforementioned network solutions which use RUDP?GLIFT-15961CommentSharerePost-User-7108006answered 2 years ago0Low-level RUDP LibrariesNameLanguageEncryptionRufflesC#n/aLiteNetLibC#AES or XORLidgren.NetworkC#AESHazel-Networking forkC#DTLSENetCn/aENet-CSharpC#n/aKCPCn/aRuffles - https://github.com/MidLevel/RufflesLiteNetLib - https://github.com/RevenantX/LiteNetLibLidgren.Network (maintain mode) - https://github.com/lidgren/lidgren-network-gen3Hazel-Networking (fork) - https://github.com/willardf/Hazel-NetworkingENet - https://github.com/lsalzman/enetENet-CSharp - https://github.com/nxrighthere/ENet-CSharpKCPhttps://github.com/skywind3000/kcp/blob/master/README.en.mdhttps://github.com/vis2k/kcp2k/ (C# port)https://github.com/leenjewel/node-kcp (node wrapper)High-Level Network Solution that supports RUDPNameRUDPRUDP LibraryMLAPIYvia RufflesUNET/Mirror NetworkingYvia Ignorance (an ENet wrapper)DarkRift 2non-officialvia EnetListenerPhotonYadopt from an early version of ENetWell, asymmetric cryptography is not the focus of these RUDP libraries, very few implemented DTLS.For reputationENET is the well-used one but lacks documentation.KCP seems promising in the Chinese community.Hazel-Networking (fork) is maintained by the author of Among Us (and the game uses it).CommentSharerePost-User-6332773answered 2 years ago0Thanks for the detailed list! Those are definitely convincing.If we pull in this feature, we would probably add one of the C# libraries in the C# RTS client; however, on the server side, we'd have to use NodeJS. It's shame that there is no widely used or actively maintained RUDP NodeJS library as far as I see. I found these 2: https://github.com/shovon/node-rudp, https://github.com/Raulmsm/RUDP. The former is slightly more promising and could be looked into.Last question that could help greatly in prioritization, is there any research that shows concrete numbers on how much improvements RUDP brings over UDP and TCP, e.g. in areas like throughput / packet loss rate? (No big deal if you don't know, we'll do this research ourselves, but it seems like you are an expert in this so doesn't hurt to ask :) )CommentSharerePost-User-7108006answered 2 years ago0For benchmark[The author @REDACTEDUSERBenchmark for ENet and KCP https://paytonturnage.com/writing/latency-of-reliable-streams/Another benchmark for ENet and KCP https://github.com/libinzhangyuan/reliable_udp_bench_mark/blob/master/bench_mark.mdReliable User Datagram Protocol as a Solution to Latencies in Network Games - compare TCP, UDP, and RUDPFor cross-platform, since RUDP is just a custom layer on top of UDP, different implementations are not compatible with each other. To get a cross-platform solution you may have to port one implementation to node, vice versa.ENET is written in C, so it can be used anywhere with a wrapper layer.node wrapper: https://gitlab.com/dacevedo/enet-jsKCP is also written in C and has both C# port and node wrapper.Another idea is to use edge.js to integrate .NET DLL with node, then both server and client can stick with the same managed .NET solution.Not really an expert, hope this information help.CommentSharerePost-User-6332773answered 2 years ago0Actually there is a RUDP lib for Nodejs. Please check out geckos.io:https://github.com/geckosio/geckos.ioFrom the Geckosio page:Version 2 has huge performance improvements. I switched from wrtc to node-datachannel, which is much lighter and faster compared to wrtc.CommentSharerePost-User-6375143answered a year ago0I think GameLift Realtime Server is looking for a cross-platform solution.CommentSharerePost-User-6332773answered a year ago"


Question: How do we update Amazon CloudWatch Evidently Segments?

"We've created a segment in amazon cloudwatch evidently using CloudFormation.  However, we are not able to find a way to update the segment without creating a new one. Is there a direct way to update a segment in evidently?FollowComment"

Answer: "0The following document shows that all parameters are "No interruption", so I think there is no problem if you update the parameters as they are.https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-evidently-segment.htmlCommentShareEXPERTRiku_Kobayashianswered a month ago"


Question: SNS: Phone carrier has blocked this message when message includes URL

"Hi, I was using SNS to send transactional SMS. When ever the message contains a URL, I get error message that the "Phone carrier has blocked this message" from the Delivery status logs. The carrier is T-Mobile. The message is: "Thanks for attending our GW004 event at GW004! see for dets-  aws3.link/nkhNzy". It gets delivered if I remove the link from message body.`@message{"notification":{"messageId":"91a4663a-61bb-575a-9f06-3a79c825faed","timestamp":"2023-01-19 20:26:06.957"},"delivery":{"phoneCarrier":"T-mobile USA Inc.","mnc":800,"numberOfMessageParts":1,"destination":"+12244328742","priceInUSD":0.00831,"smsType":"Transactional","mcc":310,"providerResponse":"Phone carrier has blocked this message","dwellTimeMs":22,"dwellTimeMsUntilDeviceAck":1160},"status":"FAILURE"}@timestamp1674159970707delivery.phoneCarrierT-mobile USA Inc.delivery.priceInUSD0.00831delivery.providerResponsePhone carrier has blocked this messagedelivery.smsTypeTransactional`Could you please let me know what I could do?Thanks!FollowComment"

Answer: 0Mobile carriers restrict the domains that can be included in SMS messages in order to protect their customers. URLs associated with free link-shortening services are likely to get filtered. The carriers are more likely to accept messages with shortened URLs if those URLs are created using paid services that let you use your own branded domain.CommentShareEXPERTBrentAtAWSanswered 4 months ago


Question: Can not able to deploy Private ECR to Personal Linux machine using greengrass. while deploying component is not able to download Artifact.(Reason: Failed to get auth token for docker login)

"I created a component using "Recipe as YAML"---RecipeFormatVersion: '2020-01-25'ComponentName: com.example.MyPrivateDockerComponentComponentVersion: '1.0.0'ComponentDescription: 'A component that runs a Docker container from a private Amazon ECR image.'ComponentPublisher: AmazonComponentDependencies:  aws.greengrass.DockerApplicationManager:    VersionRequirement: ~2.0.0  aws.greengrass.TokenExchangeService:    VersionRequirement: ~2.0.0Manifests:  - Platform:      os: all    Lifecycle:        Run: docker run <accountID>.dkr.ecr.us-east-1.amazonaws.com/demo:latest    Artifacts:      - URI: "docker:<accountID>.dkr.ecr.us-east-1.amazonaws.com/demo:latest"i have tried to  install docker-ce docker-ce-cli by usingInstall:      RequiresPrivilege: true      Script: apt-get install docker-ce docker-ce-cli containerd.ioafter component created i tried to deploy it in core but it is showing:-FAILED_NO_STATE_CHANGE: Failed to download artifact name: 'docker:<accountID>.dkr.ecr.us-east-1.amazonaws.com/demo:latest' for component com.example.Test7-1.0.0, reason: Failed to get auth token for docker loginFollowComment"

Answer: "1Hi. Have you followed the pre-requisites for running a Docker container in a component? Included in that, for using a Docker image stored in a private ECR repository, you need to add the following to your Greengrass device role:{  "Version": "2012-10-17",  "Statement": [    {      "Action": [        "ecr:GetAuthorizationToken",        "ecr:BatchGetImage",        "ecr:GetDownloadUrlForLayer"      ],      "Resource": [        "*"      ],      "Effect": "Allow"    }  ]}CommentShareEXPERTGreg_Banswered a year agorePost-User-0564850 a year agoHi, thanks for responsei have provided Role to greengrass device the same error is showing after that alsoShare"


Question: username property in access_token is different between using SRP_AUTH and hosted UI

"Currently we have a field named 'username' which is a UUID for the user and an e-mail address field, which is used for logging into the application.However, when logging in using the Hosted UI, the username field of the access_token is populated with the UUID field. But when logging in using SRP_AUTH with the Amplify module, the username property in the access_token is populated with the e-mail address.Using the USER_PASSWORD_AUTH Flow, the access_token is populated with the username, but we cannot use this flow because it doesn't support MFA or device tracking.We want a consistent access_token over all our apps, independent of the way we log in. How can we achieve this?FollowComment"

Answer: "0I have limited information on the implementation to answer,  like if you have multiple user pool or same, different  app client for each or what is the attributes selected.However one caveat may be if you have enabled login with email or username, this value might toggle based on how user logs in.CommentSharePravoanswered 9 months ago"


Question: Device Farm: Provisioning a device with a work profile

"Hello, I want to know if is possible to test an Android work profile provisioning in Device Farm with a private device, I guess in a public device is not possible because they have a profile of Amazon and I've tried. Can you help me confirming if this is possible, mean if with one of this kind (private or public devices) is it possible, and if is possible, What steps I have to follow?FollowComment"

Answer: "0**Short Answer **: YesLong Answer : is described below.By default when using Amazon Device Farm service with public devices, we normally resign the app using Amazon profile. For information on this process is described in FAQ : Do you modify my app?When using ADF privates devices you can use profile. How?when you use private devices, you can skip the step where AWS Device Farm re-signs your app using the instructions provided here Skipping App Re-Signing on Private Devices in AWS Device Farm.CommentSharesyumaKanswered a year agocguevara_nrmm a year agoLooks good, but I think that is like a custom Amazon profile, right?. I want to use de Google Management API to provision a device work profile to test the enrollment and company policies: https://developers.google.com/android/management/provision-device#sign-in_urlSharesyumaK a year ago@cguevara_nrmm, with Private devices, you can use your own provisioning profile (either from Apple or Google)Share"


Question: Help with Microsoft RMD 0x204 error code

"Could anyone help with this issue?When I try and open an EC2 Remote Desktop and launch the desktop file downloaded I get an 0x204 error code and a message saying 'We couldn't connect to the remote PC. Make sure the PC is turned on and connected to the network, and that remote access is enabled.' while it is trying to initialise.Thank youFollowCommentAWS-User-5291433 a year agoTry AWS Systems Manager's Session Manager and Start Session. See if that works.Share"

Answer: "0Hi,As per https://appuals.com/remote-desktop-error-code-0x204/#:~:text=One%20of%20the%20most%20common,by%20allowing%20Network%20Level%20connections.One of the most common problems that will trigger the Error Code 0x204 is an instance in which the Remote Desktop Protocol is not enabled on the Windows machine. In this case, you can fix the issue by enabling it manually via the System Properties screen and by allowing Network Level connections.I would suggest you to check the followingAs AWS-User-5291433 mentioned, check if Session manager worksCheck the security group allows traffic from your computer to port 3389 (RDP).Check if the instance health checks have passedCheck that your instance has a public IPv4 address.Check if the instance is in a public subnet and check the route table for the subnetCheck the network access control list (ACL) for the subnet.As a last step, check if Remote Desktop Protocol is enabled but this can only be done once you access through session managerIf none of these helped, please provide the console output for your instance using the Amazon EC2 console, select the instance, and then choose Actions, Monitor and troubleshoot, Get system logYou could also use https://docs.aws.amazon.com/AWSEC2/latest/WindowsGuide/troubleshoot-connect-windows-instance.html#troubleshoot-instance-connect-mac-rdpTo troubleshoot using the AWSSupport-TroubleshootRDP documentLog in to the Systems Manager Console.Verify that you are in the same Region as the impaired instance.Open the AWSSupport-TroubleshootRDP document.For Execution Mode, choose Simple execution.For Input parameters, InstanceId, enable Show interactive instance picker.Choose your Amazon EC2 instance.Review the examples, then choose Execute.To monitor the execution progress, for Execution status, wait for the status to change from Pending to Success. Expand Outputs to view the results. To view the output of individual steps, in Executed Steps, choose an item from Step ID.CommentShareSrianswered a year ago"


Question: Your Request For Accessing AWS Resources Has Been Validated

"Hello Team,I need your help with below email received for my new AWS Account. How do I check what service requested extra validation? I searched CloudTrail but didn't get any clue as to what could have happened here.Dear AWS Customer,Thank you for using Amazon Web Services!You recently requested an AWS Service that required additional validation. Your request has now been validated for AWS Europe (Frankfurt) region(s). If you are still experiencing difficulty, please contact us at aws-verification@amazon.com <[[mailto:aws-verification@amazon.com]]>.Thank you for your patience.—The Amazon Web Services TeamThis message was produced and distributed by Amazon Web Services, Inc. and affiliates, 410 Terry Ave. North, Seattle, WA 98109-5210."Thanks,FollowComment"

Answer: "0The email that you received is generated automatically when you launch a new resource or service in a new region. Some regions need this extra validation in order to deploy a service properly. It might be possible that since you have started deploying workloads in the eu-central-1 region, therefore you received the particular notification. As mentioned in the email, if you still face issues with launching new services in a new region reach out to the AWS team at aws-verification@amazon.com.CommentShareNirali Deliwalaanswered 2 months ago"


Question: Can I have multiple private VIFs associated with one VGW?

"Hi, I am studying the direct connect service. We are thinking about getting a one-gig DX and we want to peer with using two on-prem routers. My understanding is that, for this one connection, I will have two private VIFs, each with a different Vlan. My routers will have different sub-interfaces (one for each Vlan) and my BGP is likeon-prem router1 sub-interface.100 <---vlan100---> private VIF1on-prem routers sub-interface.200 <---vlan200---> private VIF2Does this look right? Can I associate both private VIFs to the one VGW for my VPC?ThanksDifanFollowComment"

Answer: "0Hello Difan,You can definitely attach two VIFs to the same VGW and it doesn't matter if those two VIFs on running on the same underlay DX connection or not. Your scenario is valid and your traffic can flow from both on-premise routers to your VPC without any problem. Please note that in this scenario (DXVIF is attached directly to VGW), the DXVIF (or the DXCON) will need to be in the same region as the VPC, whereas with Direct Connect Gateway (DXGW), you can access the VPCs in other regions.You can take a look on (https://docs.aws.amazon.com/directconnect/latest/UserGuide/direct-connect-gateways-intro.html ) to find out more about using DXGW.Thanks.ShawnCommentShareAWS-User-7959482answered 2 years ago0Thanks Shawn. I will look into the DXGW.CommentShareDifananswered 2 years ago"


Question: need help about load balancer

"hello guys , i am new at amazon ec2 , i want to use application load balancer , i already post 1 time but that method didn't worked for me  , i have currently 1 instances right now , i wanna use application load balancer on it , currently i am using cloud panel and WordPress and i am running 3 WordPress website on it  , i want to use load balancer so i can use WAF & Shield and CloudFront cdn , please help me anyoneFollowComment"

Answer: "0Accepted Answeryou can use Application Load Balancer and set the target by using URL path as target group for your 3 WordPress sites.CommentSharemfadamanswered 8 months agorePost-User-6960604 8 months agolike any example / or like my wesbite is bharatayurwed.com so what willl be path?SharerePost-User-6960604 8 months agoits not working can you help ?SharerePost-User-6960604 8 months agothanks , i have 3 website hosted in one instances , so now i need to use 3 application load balancer right ?Share"


Question: How are AWS Instances licensed for SCCM Server management?

We get a lot of questions regarding Microsoft licensing portability. For a comprehensive guide go here: https://aws.amazon.com/windows/resources/licensing/FollowComment


Question: Retrieve list of buckets from all regions using boto3

"I was trying to retrieve the list of buckets from all regions using boto3, however I am unable to list the buckets from the correct regionSo far I have tried location['LocationConstraint'], which comes up as NoneI have also tried the following as well but it didn't work.Any help is appreciated, thank youif client.head_bucket(Bucket=bucket['Name'])['ResponseMetadata']['HTTPHeaders']['x-amz-bucket-region'] == 'us-east-1':                print ("bucketname %s " % s3_bucket.name)Codeimport jsonimport boto3bucketlist = []def lambda_handler(event, context):    # Get list of regions    ec2 = boto3.client('ec2')    regions = ec2.describe_regions().get('Regions',[] )    # Iterate over regions    for region in regions:            print ("*************** Checking region  --   %s " % region['RegionName'])        reg=region['RegionName']            client = boto3.client('s3', region_name=reg)        response = client.list_buckets()        for bucket in response['Buckets']:            s3 = boto3.resource('s3', region_name=reg)            s3_bucket = s3.Bucket(bucket['Name'])            if client.head_bucket(Bucket=bucket['Name'])['ResponseMetadata']['HTTPHeaders']['x-amz-bucket-region'] == 'us-east-1':                print ("bucketname %s " % s3_bucket.name)                bucketlist.append(s3_bucket)    return {        "statusCode": 200    }Output: The buckets testbucket1 and testbucket2 are only available in us-east-1 regionSTART RequestId: e22f6ac0-7bb9-4e2b-84d7-5512ce97acfa Version: $LATEST*************** Checking region  --   eu-north-1 bucketname testbucket1 bucketname testbucket2 *************** Checking region  --   ap-south-1 bucketname testbucket1 bucketname testbucket2 [...]*************** Checking region  --   us-east-1 bucketname testbucket1bucketname testbucket2Expected Output:START RequestId: e22f6ac0-7bb9-4e2b-84d7-5512ce97acfa Version: $LATEST*************** Checking region  --   eu-north-1 *************** Checking region  --   ap-south-1 *************** Checking region  --   eu-west-3 *************** Checking region  --   eu-west-2 *************** Checking region  --   eu-west-1 *************** Checking region  --   ap-northeast-3 *************** Checking region  --   ap-northeast-2 *************** Checking region  --   ap-northeast-1 *************** Checking region  --   sa-east-1 *************** Checking region  --   ca-central-1 *************** Checking region  --   ap-southeast-1 *************** Checking region  --   ap-southeast-2 *************** Checking region  --   eu-central-1 *************** Checking region  --   us-east-1 bucketname testbucket1 bucketname testbucket2 *************** Checking region  --   us-east-2 *************** Checking region  --   us-west-1 *************** Checking region  --   us-west-2 FollowComment"

Answer: "0Accepted AnswerThe head_bucket function automatically redirects to the correct region in the background, so the x-amz-bucket-region header will always end up being the bucket's region no matter which region you called it from originally.Changing the condition to be the following should give you the output you want:if client.head_bucket(Bucket=bucket['Name'])['ResponseMetadata']['HTTPHeaders']['x-amz-bucket-region'] == reg:However, iterating over every region like that is making a lot of unnecessary requests, so it might be worth looking at the get_bucket_location function which returns the LocationConstraint value, which - as you've found -  is None for buckets in us-east-1. Buckets in any other region should return the actual region name. Just iterating over all buckets once and calling get_bucket_location on each of them should speed up the response.CommentShareEdanswered a year agoSri a year agoThank you so much @Ed, it worked and I also improved the code as per you suggestionimport jsonimport boto3bucketlist = []def lambda_handler(event, context):    client = boto3.client('s3')    all_buckets = client.list_buckets()    for bucket in all_buckets['Buckets']:        bucket_name = bucket["Name"]        region = client.get_bucket_location(Bucket=bucket_name)["LocationConstraint"]        print(bucket_name, region)            return {        "statusCode": 200    }testbucket3 us-west-2testbucket1 Nonetestbucket2 NoneShare"


Question: AWS System Manager package and association

"Hello,I created a package in AWS system manager distributor and when I try to install it with "Install On schedule" option, i have the following error message in the parameter part: Cannot read property 'action' of undefinedIf I try to use state manager directly  and create an association with AWS-ConfigureAWSPackage, i received  this error in parameter "Cannot read property 'MofsToApply' of undefined"the only way to install the package is using Install one time  option...Do i have missed something?thxFollowComment"

Answer: "0Hi,Thanks for reporting this. We had an issue on the console which resulted in this behavior. We have resolved the console issue. Please let us know if you still are not able to use Distributor with install on schedule option.Regards,Upender S.CommentShareAWS-User-7592761answered 4 years ago0...Edited by: dje on Jun 11, 2019 5:06 AMCommentSharedjeanswered 4 years ago"


Question: Configure MWAA to use json logging

"It seems like it is possible in Apache Airflow to override loggers to use specific json logging.I've been noticing it is very difficult to trace logs in cloud watch for airflow since they are poorly formatted from all sources (scheduler, processor, task instance, etc).I'd like to configure MWAA to use a json logger instead that will output all log info into a single json-formatted string, however, I did not find anything in documentation for this.I believe I can add logging handler within DAGs and Operators, however, it will most likely not apply to the global logger in the scheduler and other components.Is there any way to configure such logging?FollowComment"

Answer: "0Hello,It is the default behaviour of MWAA wherein it sends the logs to CloudWatch in the said format. As mentioned by you, it is possible to make use of the logging python package within your DAGs and operators individually to edit the format of your logs. Please note that MWAA being a managed service, it is currently not possible to edit the logs format on the global level. I apologise for the inconvenience that this may cause to you. If you would like to get more details about this with respect to your use case then please feel free to reach out to AWS Premium Support team. They would be more than happy to help you out.For more details about logging in MWAA, please refer thisCommentShareSUPPORT ENGINEERChaituanswered 4 months ago"


Question: Decreasing texture size depending on distance LODs

"I am now at the step of LODs. With the help of Lods, we can control the performance of a scene by reducing polygons. But how to make the 4k by 4k texture decrease or increase dynamically its size relative to the player. that is, at the maximum approximation, the texture of the material = 4k, at a distance of 5 meters it becomes 2k at a distance of 10 meters 1k, etc. How to do it?Follow"

Answer: "0Accepted AnswerYou don't need to make LOD materials for this. You can make them of course, if you like, but there is an automatic way to handle this.When an image map is processed for Lumberyard, it will generate a set of mipmaps. Whatever size your texture is, it will be halved by a power of two down to 16x16 or 5 mip levels depending on the starting size. If your texture is 4096 squared to start with, you'll get mipmaps for 2048, 1024, 512, 256 and 128.The mipmaps will load automatically depending on camera distance.If you double click a texture in Asset Browser, the Texture Settings Editor will open. You can see the mipmaps for the texture and make some settings adjustments for them. This doc page is unfortunately far out of date, but mostly still applicable:https://docs.aws.amazon.com/lumberyard/latest/userguide/asset-pipeline-generating-mipmaps.htmlSharerePost-User-6034607answered 2 years ago0Can't you just set a different material for each LOD that refers to different quality textures?SharerePost-User-9359627answered 2 years ago0Hi @REDACTEDUSERThere may be other solutions but you can create different materials and each material has a separate texture eg : a mat for 2K , a mat for 4k, etc , then with a script canvas graph based on the distance you can load the material you need, This project and this video tutorial can give you a better understanding.I hope my idea is useful for you and others.https://www.youtube.com/watch?v=JsCoFnw7sLUhttps://forums.awsgametech.com/t/video-demonstration-of-3d-visualization-script-canvas-project-amazon-lumberyard-1-25/9351SharerePost-User-8224505answered 2 years ago0I assumed he wanted more control over it than mipmaps allows.SharerePost-User-9359627answered 2 years ago0this is exactly what I need! Thank you! But tell me, I use substance-material, what should I build a mip map for them?SharerePost-User-0396919answered 2 years ago0I have not used Substance with Lumberyard yet, but there is a gem available for Substance. You need to enable the Gem in Project Configurator for your project and rebuild your project. There is some documentation for how to use SUustance with Lumberyard, but I am not sure how complete or accurate it is:https://docs.aws.amazon.com/lumberyard/latest/userguide/mat-substances.htmlI do have Substance, and I can maybe try to hack my way through this with you if you have issues.SharerePost-User-6034607answered 2 years ago0I create materials in the Substance Designer and load their engine and add them successfully. But the question concerns the topic of lods. If the texture has dense detail, then it starts flickering when the player is located far from it. The only option is to reduce the resolution of the material. But I don’t know how to do this with regard to the submissions material.SharerePost-User-0396919answered 2 years ago"


Question: squidbusiness.fr has been down for two days.

"Our website squidbusiness.fr has been down since yesterday. I thought it might be storage issue, so I moved it to a bigger machine. But the issue still exists. The instance shows that Apache, MariaDB, and PHP-FPM are running according to the output of /opt/bitnami/ctlscript.sh status. We need our website to be up and running so urgently. I would appreciate if you could guid me how to solve the issue.FollowCommentiBehr EXPERT24 days agoI am able to load the site from my browser.  Does not mean much to me since I don't speak French but I hope this means that you got the help you needed.Share"


Question: Query exhausted resources at this scale factor

"Got an Query exhausted resources at this scale factor error when running Query Id: f0263908-31e5-48d7-a8d7-e1ec2492ed6b.I have some gzipped parquet files in S3 in the following layout -/data  /day=0    data_0.parquet  /day=1    data_0.parquet:::I created the table using the following queries -create external table if not exists mytablename (    i1 int,    i2 int,    i3 int,    i4 int,    i5 int,    i6 int,    i7 int,    i8 int,    i9 int,    i10 int,    i11 int,    i12 int,    i13 int,    s1 string,    s2 string,    s3 string,    s4 string,    s5 string,    s6 string,    s7 string,    s8 string,    s9 string,    s10 string,    s11 string,    s12 string,    s13 string,    s14 string,    s15 string,    s16 string,    s17 string,    s18 string,    s19 string,    s21 string,    s22 string,    s23 string,    s24 string,    s25 string,    s26 string,    label int)PARTITIONED BY (day STRING)STORED AS PARQUETLOCATION 's3://my/s3/location/data/'tblproperties ("parquet.compression"="GZIP");MSCK REPAIR TABLE mytablename;And then I ran the following test query where I hit the error:select i1, s1 from mytablename limit 10;FollowComment"

Answer: "0“Query exhausted resources at this scale factor” indicates that you hit memory limits on the Athena cluster that runs your query. Most commonly, this can be probably as the query doesn’t follow the best practices. New Athena query engine version 3 is now available in most regions - try upgrading to that or to Version 2 (You should see a notification at the top of Athena interface with that information). This issue may sometime be transient and it may go away if you retry. If there are joins the query in the you ran or if you have not partitioned the data, I could try to optimizing it - but this does not seem to be the case here. Check the below items as well:How big is your data after compression in the parquet/gzip format? and how is your data accessed? (What the typical WHERE clause elements?).Please check if your partition strategy is right for your data, as you have already partitioned by dayTry bucketing your data by specifying CLUSTERED BY (<bucketed columns>) INTO <number of buckets> BUCKETSUse the new query stats visualizer (click Query stats next to Query results, then Execution details) to figure out if it shows any errors.Please refer to this blog for some tuning tips for your query to perform better:   https://aws.amazon.com/blogs/big-data/top-10-performance-tuning-tips-for-amazon-athena/CommentShareAnanth Tirumanuranswered 8 months ago"


Question: Lambda .net 5 container not an option in aws toolkit blueprints

When I create a new AWS Lambda .Net Project there is no blueprint option for .Net 5 (Container Image) as I see in the example posts.  I have verified all the required versions as far as I can tell.  Is there something else I need to make this available?I am running:Visual Studio 2019 16.11.5Docker Desktop InstalledAWS Toolkit 1.26.0.0FollowComment

Answer: "0VS 2019 has the .NET 5 container images and VS 2022 has the .NET 6 container images. I suspect there is some confusion on how to get to the AWS Lambda blueprints in VS.To see the blueprints in Visual Studio:Select "Create a new project" in the VS splash screen or from the shell menu "File -> New -> Project"In project template search box enter "AWS Lambda".Select either "AWS Lambda Project (.NET Core - C#)" or "AWS Lambda Project (.NET Core - F#)". If you have the Amazon.Lambda.Templates NuGet package installed for the .NET CLI that might be adding additional entries into the list which could be confusing.Enter project name and push CreateThe Lambda blueprint wizard will popup. Select the ".NET 5 (Container Image)" blueprint and push finishThat will create the .NET 5 project with the appropriate Docker file. If this doesn't work for me let me know which step is showing you a different results.CommentShareNormanswered a year agosup_compliance a year agoThank you again for replying, The last step is the issue. I choos AWS Lambda Project (.NET Core - C#) Then in the blueprints list there is no option for ".NET 5 (Container Image)It won't let me attach an image, but these are what I have: Empty Function Custom Runtime Function Detect Image Labels Lex Book Trip Sample Order Flowers Chatbot Simple Application Load Bal... Simple DynamoDB Function Simple Kinesis Firehose Func... Simple Kinesis Function Simple S# Function Simple SNS Function Simple SQS FunctionShareNorm a year agoI wish we could post images as well. Out of curiosity can you tell me what the description for the "Custom Runtime Function" blueprint says?Sharesup_compliance a year agoNormI really appreciate the quick reply.  I didn't get a notification in my email which is why it has taken me so long to get back to your question.It says:Custom Runtime FunctionUse Lambda Custom Rutime reature to build Lambda functions using .NET 5.Share0We just released .Net 6 support both as container image and as a managed runtime. We do not have official support for .Net 5.CommentShareEXPERTUrianswered a year agosup_compliance a year agoThank you for taking the time, but I don't see any container options. Neither .net 5 nor .net 6 as per the images in this aws documentation:https://aws.amazon.com/blogs/developer/net-5-aws-lambda-support-with-container-images/ShareUri EXPERTa year agoThat is an older post. See here for the list of supported .Net container images.Share"


Question: Auto rollback with Guardrails if model accuracy is not good

"While deploying model with guardrails for SageMaker Inference Endpoint::We can create CloudWatch alarms to monitor Endpoint performance for metrics like Invocation5XXErrors, ModelLatency and we can rollback the model to previous version if the threshold is matched. [Different metrics available][https://docs.aws.amazon.com/sagemaker/latest/dg/monitoring-cloudwatch.html]Please let me know is there any way to achieve any one of the following requirement:I want to the use metrics like "accuracy" returned by endpoint and rollback to previous version if the model performance is consistently not good in the real time.Use the metrics like "accuracy" returned by version2 and compare it with version1 or with the ground truth and rollback model if necessaryFollowComment"

Answer: "0You should take a look at SageMaker Model Monitor capabilities and its integration with SageMaker Pipelines to achieve this.In this method, you will continuously "monitor the model" for model drift and take downstream actions when you detect the drift. The action could be to send a notification(SNS) or re-trigger the Model training.Some examples for using SageMaker Model Monitor can be found hereCommentShareAWS-Raghuanswered a year ago"


Question: Pass importer list in subnet

"Hey,I'm trying to import the already created subnets to pass as a parameter.Example passing manually works: Subnets:        - subnet-0000000000000000        - subnet-1111111111111111        - subnet-2222222222222222But trying to use the importer to bring the subnets already exported from the error:      Subnets:        - !ImportValue vpc-subnet-private-1        - !!mportValue vpc-subnet-private-2        - !ImportValue vpc-subnet-private-3I put it in the output to print the value of the exported variable and it shows the correct value.Outputs:  Subnets:    Value: !ImportValue vpc-subnet-private-1Error message that appears when I try to use the importer inside subnets:There was an error creating this change setModule Resolution Failed: Unsupported keywords found in module fragment: Fn::ImportValueDoes anyone know how I might be fixing this?Thanks!FollowComment"

Answer: "0Hello there,I see you are facing issues while importing subnets using ImportValue.To test the same, I ran the following templates in my test account and it worked smoothly.Exporting the Subnet :Resources:    VPC:    Metadata:      Comment: Stage speicfic VPC    Properties:      CidrBlock: 10.0.0.0/16      EnableDnsHostnames: 'true'    Type: AWS::EC2::VPC  mySubnet:    Type: AWS::EC2::Subnet    Properties:      VpcId:        Ref: VPC      CidrBlock: 10.0.0.0/18      AvailabilityZone: "us-east-1a"      Tags:      - Key: stack        Value: production  subnet2:    Type: AWS::EC2::Subnet    Properties:      VpcId:        Ref: VPC      CidrBlock: 10.0.64.0/18      AvailabilityZone: "us-east-1b"      Outputs:  VPC:    Description: The VPC    Export:      Name: VPC    Value: !Ref VPC  subnet:    Export:      Name: subnet1    Value: !Ref mySubnet  subnet2:    Export:      Name: subnet2    Value: !Ref subnet2Importing the value :Resources:    MyLoadBalancer:      Type: AWS::ElasticLoadBalancing::LoadBalancer      Properties:        Subnets:        - !ImportValue subnet1        - !ImportValue subnet2        CrossZone: true        Listeners:        - InstancePort: '80'          InstanceProtocol: HTTP          LoadBalancerPort: '80'          Protocol: HTTPI request you to test these samples in your account as well and check if they work. To find the root cause of the issue, can you please share the code snippet by removing any private information from it or raise a case with the support team so that we can look at the resources and guide you toward the solution.CommentShareSUPPORT ENGINEERGurpreet Singhanswered 3 months ago"


Question: Faster alter table column type in RDS Postgres?

"Hello,has anyone figured out faster way of doing postgres 14 column type change in RDS?We currently have a table that is running out of int4 space and multiple columns needs to be converted to int8.Table also has quite many foreign keys pointing to it and lot of indexes.On top of this, database cannot be taken down for maintenance for a long period of time.Tried doing the type conversion on warmed up copy of the database, but it takes almost 3 hours which is way too much.things already considered:take a snapshot, restore with huge amount of iops, make the conversion, reduce iops (won't work as freshly restored RDS postgres seems to be really slow with disk)increase current iops to max and do the conversion, reduce iops later (would cost ton of money and probably won't work as volume optimizing reduces performance, etc.)exporting & re-importing table data (might be really fast but then would need to drop and re-create indexes otherwise import would be slow)Any other ideas? are there some postgres settings or tricks that could be used for making the process faster?FollowComment"

Answer: "0Hello, Couple of options I would recommend that works for any RDBMS:Cast the column datatype and CTAS from the source(original) table into a new target table. Drop original table and rename new table to old. Ofcourse indexes have to be created on new table again. Quick and easy.Export table data to S3. Empty the original table and modify the Datatype. Import the data back from S3 to the table again. You may refer below AWS Documentation for this approach:https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/postgresql-s3-export.htmlhttps://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_PostgreSQL.S3Import.htmlGood Luck with your next steps.CommentShareknamburianswered 4 months ago"


Question: Can I control WEB (not admin) users access to specific folders on my static S3 website?

"I have a very simple S3 website.  I would like to allow public access to the root, "css", "javascript" folders, but restrict access to the "account" folder.  The account folder has subfolders containing pages that are different for EACH web user.  The subfolders are named after each username (i.e. "Bill", "Dave", "Jill", "Heather", etc.).  My question is:Is this possible?Which AWS services should I use?I have tried AWS Cognito (User Pools) and have my S3 bucket up and running.  I just can't figure out how to connect the dots so to speak.  All the docs I have read and videos I have watched reference admin users, not simple WEB VIEWERS.  I do like Cognito's feature of allowing users to sign up by themselves, but I need to know what I should study to make it all work.I assume in the end I'll need to have a bucket policy that includes:........"Resource": ["arn:aws:s3:::my-bucket-name/${aws:username}/*"]Am I on the right track?  Can I just use Cognito User Pools and a Bucket policy only or do I also need CloudFront, Lambda, other, services as well?FollowComment"

Answer: "1Haven't tried this myself, but this blog may give you pointers on how to accomplish what you are trying - https://aws.amazon.com/blogs/networking-and-content-delivery/authorizationedge-how-to-use-lambdaedge-and-json-web-tokens-to-enhance-web-application-security/CommentShareEXPERTIndranil Banerjee AWSanswered a year ago"


Question: investigate ECS unhealthy

"Hi team,I have My ECS fargate task, stopped due to failure and relaunched againI'm trying to find the reason why the task was stopped in cloud watch but could not find anything/errors in cloud watch logsis there any other way to investigate the reason why fargate task failed?I ran this command :aws ecs describe-tasks --tasks <task-id> --cluster <cluster-name>I hade :{    "tasks": [],    "failures": [        {            "arn": "arn:aws:ecs:region:123456789:task/4easdscsddsbdsdsdsdadssdwe9",            "reason": "MISSING"        }    ]}it seems like a networking issue on the app mesh level, I have trace status like : Fault(5xx) for some callsseems also it's a health check failure at the envoy levelThank youFollowCommentHenrique Santana a year agoDid you run this command just when the task stop? Or after a while? Could you please share the task ID?Share"

Answer: "0Hello Jess,The "MISSING" status for the task during describe-tasks CLI operation occurs either when you provide an incorrect task ID or when ECS had already reaped your stopped task. To find out details about the task that has already been reaped, you can contact AWS Premium Support and they will be able to provide you with the information.If your issue is consistent, you can re-create the task and find out the reason for the task failure right after it has moved to STOPPED state. You can also find the reason for the task failure in ECS service events as explained in this doc.I hope this information is helpful to you. Please reply if you have further questions related to this issue.CommentShareSUPPORT ENGINEERVenkat Penmetsaanswered a year agoJess a year agoi'm using app mesh and cloud map (ApiGW => vpc link => NLB => virtual GW task => web app task)envoy image public.ecr.aws/appmesh/aws-appmesh-envoy:v1.21.1.0-prodhealth check with : curl -s http://localhost:9901/server_info | grep state | grep -q LIVEthe web task that contain x-ray, envoy and myapp containers fails each couple of hourstasks fail around midnightShare"


Question: Invalid format for date

"This is the query I use in the view to put the string to date:"date_parse"("ctr"."currentagentsnapshot"."agentstatus"."starttimestamp", '%Y-%m-%dT%H:%i:%sZ') "StartTimestamp"starttimestamp=2022-04-05T01:03:08.234ZI am getting the below error. Can anyone help, I am guessing there is an issue with '%sZ':INVALID_FUNCTION_ARGUMENT: Invalid format: "2022-04-04T23:04:59.001Z" is malformed at ".001Z"This query ran against the "connect_metrics" database, unless qualified by the query. Please post the error message on our forumor contact customer support with Query Id: b4920385-1417-40aa-b788-ae7e9432cbd7ThanksJohnFollowComment"


Question: Glue Jupiter Notebook

"I tried below code in aws glue jupyter notebook for widget textbox but I got text context but I expected text box.import ipywidgets as widgetsfrom IPython.display import displaytext_input = widgets.Text(    value='',    placeholder='Enter some text',    description='Text:',    disabled=False) dropdown = widgets.Dropdown(    options=['Option 1', 'Option 2', 'Option 3'],    value='Option 1',    description='Select an option:',    disabled=False) display(text_input)display(dropdown)Current Output:Text(value='', description='Text:', placeholder='Enter some text') Dropdown(description='Select an option:', options=('Option 1', 'Option 2', 'Option 3'), value='Option 1')Expected Output:I expected text box and dropdown box like data bricks. Please confirm we can able to achieve in aws glue jupyter notebookFollowComment"


Question: How to change DocumentDB default subnet group VPC (after deleting and re-creating the default VPC)?

"I deleted and re-created the default VPC, but DocumentDB default subnet group still points to the deleted VPC ID: https://eu-west-1.console.aws.amazon.com/docdb/home?region=eu-west-1#subnetGroup-details/defaultHow do I fix it?FollowComment"

Answer: "0you wont be able to delete a VPC due to existing network interfaces for the cluster instance.CommentShareAWS-User-8174525-subhashanswered 3 months agoTeroNiemi 3 months agoTrust me, the default VPC was destroyed.resource "aws_default_vpc" "default" {  force_destroy = true}Share0Once a DocumentDB cluster is created, the VPC cannot be changed. You'll have to restore from a snapshot to a new cluster, using the new default VPC.CommentShareMihai Aanswered 2 months agoTeroNiemi 2 months agoProblem is that the old "default" vpc hangs in here:The vpc-06...69 does not exist anymore, but because it is "default" I cannot delete it.Share"


Question: Problem with RDS UI when promote Aurora read replica

"Hello. We want migrate to AuroraDB.We have postgres RDS database instance in us-east-1Created Aurora Read-replica in same regionTry to promote read-replicaSee blank screen in UI.Tried to do this from multiple locations, with multiple browsers, with cleared cache, with incognito - result the same. Error still appear 24h and still not fixed. Feedback with issue sent twice.Errors in browser console:`browser-polyfill.js:1163 Uncaught (in promise) Error: Cannot read properties of undefined (reading 'allowlisted')    at wrappedSendMessageCallback (browser-polyfill.js:1163:16)`DevTools failed to load source map: Could not load content for https://dado4e41kbenk.cloudfront.net/xxxxxxxxxxx/chunkxxxxx.js.map: HTTP error: status code 403, net::ERR_HTTP_RESPONSE_CODE_FAILUREchunk2477.js:2 TypeError: Cannot read properties of null (reading 'Engine')Pls help.FollowComment"


Question: New EC2 instance within default public subnet doesn't get public IP address

"Hi everyone!Since I've set up an AWS infrastructure for a web project using ECS cluster more than a year ago everything was fine. Until yesterday when I've decided to update AMI to the freshest official Amazon ECS-optimized image. I've updated launch configuration, terminated an instance, and started waiting until it will be recreated by auto-scaling group. The new instance was created but I've noticed that it didn't get public IP address. It was attached to the same default public subnet with an attribute "Auto-assign public IPv4 address" equals to "Yes".Also, I've noticed that the instances system log contains some errors related to internet connectivity. Here is a piece of it:<13>Oct 17 17:06:17 user-data: + for i in '{1..5}'<13>Oct 17 17:06:17 user-data: + yum install -y bind-utils htop less postgresql traceroute aws-cli awslogs jq screen<13>Oct 17 17:06:17 user-data: Loaded plugins: priorities, update-motd, upgrade-helper<13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data:  One of the configured repositories failed (Unknown),<13>Oct 17 17:06:36 user-data:  and yum doesn't have enough cached data to continue. At this point the only<13>Oct 17 17:06:36 user-data:  safe thing yum can do is fail. There are a few ways to work "fix" this:<13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data:      1. Contact the upstream for the repository and get them to fix the problem.<13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data:      2. Reconfigure the baseurl/etc. for the repository, to point to a working<13>Oct 17 17:06:36 user-data:         upstream. This is most often useful if you are using a newer<13>Oct 17 17:06:36 user-data:         distribution release than is supported by the repository (and the<13>Oct 17 17:06:36 user-data:         packages for the previous distribution release still work).<13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data:      3. Run the command with the repository temporarily disabled<13>Oct 17 17:06:36 user-data:             yum --disablerepo=<repoid> ...<13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data:      4. Disable the repository permanently, so yum won't use it by default. Yum<13>Oct 17 17:06:36 user-data:         will then just ignore the repository until you permanently enable it<13>Oct 17 17:06:36 user-data:         again or use --enablerepo for temporary usage:<13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data:             yum-config-manager --disable <repoid><13>Oct 17 17:06:36 user-data:         or<13>Oct 17 17:06:36 user-data:             subscription-manager repos --disable=<repoid><13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data:      5. Configure the failing repository to be skipped, if it is unavailable.<13>Oct 17 17:06:36 user-data:         Note that yum will try to contact the repo. when it runs most commands,<13>Oct 17 17:06:36 user-data:         so will have to try and fail each time (and thus. yum will be be much<13>Oct 17 17:06:36 user-data:         slower). If it is a very temporary problem though, this is often a nice<13>Oct 17 17:06:36 user-data:         compromise:<13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data:             yum-config-manager --save --setopt=<repoid>.skip_if_unavailable=true<13>Oct 17 17:06:36 user-data: <13>Oct 17 17:06:36 user-data: Cannot find a valid baseurl for repo: amzn2-core/2/x86_64<13>Oct 17 17:06:36 user-data: Could not retrieve mirrorlist https://amazonlinux-2-repos-us-east-1.s3.dualstack.us-east-1.amazonaws.com/2/core/latest/x86_64/mirror.list  error was<13>Oct 17 17:06:36 user-data: 12: Timeout on https://amazonlinux-2-repos-us-east-1.s3.dualstack.us-east-1.amazonaws.com/2/core/latest/x86_64/mirror.list : (28, 'Failed to connect to amazonlinux-2-repos-us-east-1.s3.dualstack.us-east-1.amazonaws.com  port 443 after 2702 ms: Connection timed out')<13>Oct 17 17:06:36 user-data: + sleep 60And it's not clear what was the reason and what was the effect. Either instance didn't get public IP address due to errors in the instance setup process, or the instance setup process has failed due to network issues.FollowCommentbwhaley EXPERT8 months agoHave you tried terminating and spinning up another new instance?Share"

Answer: "0The error is connection timed out and if the EC2 instance does have a public IP assigned, the issue can be with other networking configurations such as a change in the route table, security group, etc. I recommend taking a look at the following article to troubleshoot.Why can't my Amazon EC2 instance connect to the internet using an internet gateway?CommentShareTaka_Manswered 7 months ago"


Question: AWS VTL Gateway and Glacier Deep Archive Storage

"Is there a way to move tapes, those that were created and archived before 3/27/19, from Glacier to Glacier Deep Archive Storage?FollowComment"

Answer: "0Hi,We are planning to add this capability this quarter (Q2'19). We have also covered this in the Storage Gateway FAQ under Tape Gateway.https://aws.amazon.com/storagegateway/faqs/If you could please PM me with your use case and account details, it will be great.Regards,BhavinCommentShareAWS-User-4940880answered 4 years ago"


Question: [For hire] Prof and Fresh Music and Sound FX

"Hello!My name is Ilia, I compose music for everyday usage: video games, animations and so on. I like impressive video games, colourful cartoons and animation - in short words all that gives people joy. Quantity of my finished projects is approaching 100 (i have many completed html5 projects, mail me i will give links to the games).I have a degree in the speciality "Information science in Art". I practise playing musical instruments (clarinet - elementary music school, drums) for about 20 years and composing music for about 10 years.Since 2016 I’ve been also studying interactive audio at the Sound Design Institute in Moscow. You can test my skills!http://www.volkovstudio.com/You can contact with me viaskype: vierarmige-mail: vierarmig@gmail.comPlease check my portfolio:https://vimeo.com/vierarmig/videos/all/https://soundcloud.com/vierarmig https://www.youtube.com/user/CAFCAFCAF3/videos Selected works:Music sets:https://soundcloud.com/vierarmig/secret-trackhttps://soundcloud.com/vierarmig/sets/hero-simulatorhttps://soundcloud.com/vierarmig/sets/bee-good-computer-gamehttps://soundcloud.com/vierarmig/sets/trick-or-treat-cgFollow"

Answer: "0Twisted City - only Sound effectsSharerePost-User-5057659answered 5 years ago0Amazing work @REDACTEDUSERSharerePost-User-5738838answered 5 years ago0Big Thanks! =)SharerePost-User-5057659answered 5 years ago0My sfx for Coca-Cola Russia https://vimeo.com/256214500SharerePost-User-5057659answered 5 years ago0Samurai's Way (Slot) - Promohttps://www.youtube.com/watch?v=bhZwOblcpmMSharerePost-User-5057659answered 5 years ago0Sinbad (promo)https://www.youtube.com/watch?v=OzOTZ47QL0oSharerePost-User-5057659answered 5 years ago0Fibrum - VR Сумасшедшая гонка (только SFX и фоли)https://www.youtube.com/watch?v=tU5yhHkfKVISharerePost-User-5057659answered 5 years ago0CASE: Animatronics (музыка и sfx)https://www.youtube.com/watch?v=hg8ZeGv6OM8SharerePost-User-5057659answered 5 years ago0Skate Hooligans - Amusement Parkhttps://www.youtube.com/watch?v=fR_w58aGUbISharerePost-User-5057659answered 5 years ago0Kizi Kart (Menu music)https://www.youtube.com/watch?v=mlkIYiFyrFgSharerePost-User-5057659answered 5 years ago0"Candy Shop" - Gameplay (slot)https://www.youtube.com/watch?v=PfP-8RBd_nISharerePost-User-5057659answered 5 years ago0Soccer Simulator Idle (music and sfxs) Gameplay iOS Android Video HDhttps://www.youtube.com/watch?v=1eHTL5GkSKwSharerePost-User-5057659answered 5 years ago0Watch Out (sfxs)https://www.youtube.com/watch?v=3vhlG58Qj9oSharerePost-User-5057659answered 5 years ago0Pirates of Islets (music and sounds)https://www.youtube.com/watch?v=xFF7Fb-C8SM&feature=youtu.beSharerePost-User-5057659answered 5 years ago0https://www.youtube.com/watch?v=k8ZiUTko6AAPokerWorld - Intro Music, музыка меню, SfxsSharerePost-User-5057659answered 5 years ago0Тимур Руби (геймплей - музыка и sfxs)https://www.youtube.com/watch?v=DVZJl6GfQv4SharerePost-User-5057659answered 5 years ago0"Connect up - Nescafé" by Jambo (sfx by volkovstudio)https://www.youtube.com/watch?v=crC_udr83GQSharerePost-User-5057659answered 5 years ago0https://www.youtube.com/watch?v=Pe_rOAz9MJASkate Hooligans - Airport (sfx and music)SharerePost-User-5057659answered 5 years ago0https://www.youtube.com/watch?v=L7V8sbLNvjISexy and Glamour (music and sfx)SharerePost-User-5057659answered 5 years ago0Robo Repair (music and sfxs)https://www.youtube.com/watch?v=MsEEgI2vTpESharerePost-User-5057659answered 5 years ago0https://www.youtube.com/watch?v=JfKJFj2x_dECollection of catsSharerePost-User-5057659answered 5 years ago0Buffalo 3000https://www.youtube.com/watch?v=sL39Wq9KT_wSharerePost-User-5057659answered 5 years ago0Drink & Sporthttps://www.youtube.com/watch?v=S8VBvy_T3rUSharerePost-User-5057659answered 5 years ago0INSIDE KYRIE’S BAG OF TRICKShttps://www.youtube.com/watch?v=fGHI1n6_XTESharerePost-User-5057659answered 5 years ago0https://www.youtube.com/watch?v=LYK3PX_iBDgMeowvelous cat clicker (music and sfxs)SharerePost-User-5057659answered 4 years ago0The Golden Age of Piracy Tavern 2018https://www.youtube.com/watch?v=9pZ702ZEO6kSharerePost-User-5057659answered 4 years ago0https://www.youtube.com/watch?v=VnbCcujvJAATrend Setter (promo)SharerePost-User-5057659answered 4 years ago0Bonded Heroes (music and sounds)https://www.youtube.com/watch?v=4pKH908tlcMSharerePost-User-5057659answered 4 years ago0https://www.youtube.com/watch?v=E0b9riKBljEPumpkin Fairy (music and sfx) for Igrosoft (Игрософт)SharerePost-User-5057659answered 4 years ago0https://www.youtube.com/watch?v=iq1MLQFtLt4FeArea - Desert Slayer (sfx, voice and music)SharerePost-User-5057659answered 4 years ago0https://www.youtube.com/watch?v=XPn2IPNbACMFor jambo animation schoolSharerePost-User-5057659answered 4 years ago0https://youtube.com/watch?feature=youtu.be&v=-_NAQDpC6WAParrots 2 - menu (Christmas music update)SharerePost-User-5057659answered 4 years ago0https://www.youtube.com/watch?v=NHq1NRIZ29gWild Box (promo)SharerePost-User-5057659answered 4 years ago"


Question: Pyspark job fails on EMR on EKS virtual cluster:  java.lang.ClassCastException

"Hi,we are in the process of migrating our pyspark jobs from EMR classic (EC2-based) to EMR on EKS virtual cluster. We have come across a strange failure in one job where we are reading some avro data from s3 and saving them straight back in parquet format. Example code:        df = spark.read.format("avro").load(input_path)        df \            .withColumnRenamed("my_col", "my_new_col") \            .repartition(60) \            .write \            .mode("append") \            .partitionBy("my_new_col", "date") \            .format("parquet") \            .option("compression", "gzip") \            .save(output_path)This fails with the following message at the .save() call (We can tell from the Python traceback, not included here for brevity):Job aborted due to stage failure: Task 1 in stage 0.0 failed 4 times, most recent failure: Lost task 1.3 in stage 0.0 (TID 17) (10.0.3.174 executor 4): java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.sql.execution.datasources.FileFormat$$anon$1.dataReader$1 of type scala.Function1 in instance of org.apache.spark.sql.execution.datasources.FileFormat$$anon$1We are running this with --packages org.apache.spark:spark-avro_2.12:3.1.1 in sparkSubmitParameters.Exact same code ran fine in a normal EMR cluster. Comparing the environments, both have Spark 3.1.1, Scala version version 2.12.10, only the Java version is different: 1.8.0_332 (EMR classic) vs 1.8.0_302 (EMR on EKS).We should also mention that we were able to run another job successfuly on EMR on EKS, that job doesn't have this avro-to-parquet step (the input is already in parquet format). So we suspect it has something to do with the extra org.apache.spark:spark-avro_2.12:3.1.1 package we are importing.We searched the web for the java.lang.ClassCastException and found a couple of issues here and here, but they are not particularly helpful to us since our code is in Python.Any hints what might be the cause?Thanks and regards,NikosFollowComment"

Answer: 0I was able to overcome this issue after realizing that the container image used by the driver and the executor pods (e.g. 755674844232.dkr.ecr.us-east-1.amazonaws.com/spark/emr-6.3.0) has already a spark-avro.jar in /usr/lib/spark/external/lib/ directory.I replaced the --packages org.apache.spark:spark-avro_2.12:3.1.1 option (which downloads spark-avro from Maven Central repository)  with --jars local:///usr/lib/spark/external/lib/spark-avro.jar in sparkSubmitParameters... and the script worked!CommentSharenikos64answered a year ago


Question: Workspaces are Blurry (WSP)

"I'm having an issue with a few users in our environment that use the WSP protocol. The PCoIP protocol was giving us some audio issues (choppy, etc) so we migrated them to WSP which fixed the audio issues but now have complaints about slow pixel rendering.For example, when moving the mouse, or scrolling on a webpage, the text is blurry for a brief second or two. This is somewhat expected due to the nature of data transmission but it's bad enough where it can hurt your eyes over the course of the day. I currently ping about ~30ms to US-EAST-1 and do not have these issues. The users in question ping about ~60ms and have noticeable issues.We've tried Hardware Acceleration as well as High DP mode but that didn't seem to make a difference.I remember reading somewhere that you can manually set the Workspace settings by going to either some .ini or .json config file on the Workspace itself for PCoIP machines in the following locations:C:\Program Files\AmazonC:\ProgramData\AmazonDo these config files also exist for WSP Workspaces?Any other suggestions?FollowCommentMike a year agoMy organization is experiencing the exact same issue. We have several users experiencing compression artifacts and pixelation after migrating their WorkSpaces from PCoIP to WSP. These users are connecting from their home ISPs, WorkSpaces network check all green, ping < 100 ms. Have you found a fix to this issue? So far all we can do is migrate these users back to PCoIP.ShareAWS-User-9592667 a year agoNo, I have not found a solution and I did exactly what you did which was migrate them all back to PCoIP.Share"

Answer: "-1WSP updates to improve frame rates are regularly being released, however I would like to revisit the audio issues at 60 ms with PCoIP. Typically, customers start to notice audio issues above 100 ms, so I think there is more to the story.CommentShareEXPERTStevieStetsanswered a year agoAWS-User-9592667 a year agoI'd love to provide more context about our setup. Feel free to reach out or provide a way for me to reach you please.Share"