Question: How to request php8.1 to be added to amazon-linux-extras

"We are currently using php8.0 (via amazon-linux-extras) on our EC2 servers running Amazon Linux 2 and we would like to upgrade to php8.1. We know we can build php8.1 completely from source, and we know we can do things like add REMI repo and install it with yum. But with our current server setup things would be a lot cleaner of it were available out of the box in amazon-linux-extras.So my question/s are:Is there some sort of request process to request php8.0 gets upgrade to php8.1 in amazon-linux-extras?It is there any way to see the status of new packages coming to amazon-linux-extras in future updates?Is there any reasons why it may not be in there currently/in the future (Eg. only LTS packages are added)FollowCommentJoshuaCoder97 10 months agoYeah. we are waiting on this as well. its seems buggy building php 8.1 from source.ShareKZenisek 8 months agoWhile we're currently left without knowing when/if it will be done (saying it won't be done, if true, will at least let people know they should do this a different way.) It's been asked here multiple times:https://bit.ly/3TwqRCZhttps://bit.ly/3Sb8P8ihttps://bit.ly/3TfJlImWhile it's also been brought up on the Elastic Beanstalk discussion at https://bit.ly/3ME1xsC where it was added to EB months ago while it's also been discussed there how it seems like a real oversight to not also add it to amazon-linux-extras at the same time (then discussing that lingering topic there as well.)Share"

Answer: "4We are interested in official 8.1 support.We are holding some releases until we have 8.1 available through amazon-linux-extrasCommentSharecrojasaragonezanswered 9 months ago2Symfony 6.1 is loaded as a dependency when installing Laravel 8.8. Symfony 6.1 requires PHP 8.1. I guess AWS does not plan to support Laravel 8 or 9 on its EC2 instances?CommentSharejsCatnipanswered 8 months agoKZenisek 7 months agoI mean, AWS has officially stated Amazon Linux 2 will be supported through June 2024 and it would seem crazy that one of the more important features (the way the OS recommends managing the PHP versions as they're released & other select software without using an external/separate service like elastic beanstalk, docker, external builds of the software, etc.) would be left without necessary updates (especially considering PHP's supported version timeline) for multiple years before the end of support on the OS.Might as well just say that OS isn't supported anymore if that were the case (while Amazon Linux 2022 is still in release candidate status [I wonder if it will even come out in 2022] so they don't really have their successor to AL2 available to be used so it seems Amazon Linux is kinda just not getting the attention it needs.)Then again, one should expect the OS & its recommended software would be supported. Here's hoping they get 8.1 added before 8.0 falls out of support from PHP itself. Also, really curious why it was added just to be removed days later per what happened about a week ago. So it's like they're almost doing what's needed... no idea why it was then removed from being available.Share1Accepted AnswerThis is now available in Amazon Liunx Extras.EDIT: This has since been removed by AWS. Fun times.I had been waiting for it for so long I built a fargate bot to run every day to see if php8.1 was available. When it was I got this posted in our dev slack channel.I logged onto my EC2 and double checked and this is what I got.[ec2-user@ip-AA-BB-CC-DD ~]$ amazon-linux-extras | grep php  _  php7.4                   available    [ =stable ] 51  php8.0=latest            enabled      [ =stable ]  _  php8.1                   available    [ =stable ]I also confirmed that when I went and looked today this is now gone.CommentShareBradM_VManswered 7 months agocrojasaragonez 7 months agoThank you!!Sharecrojasaragonez 7 months agoI am getting:Could not retrieve mirrorlist https://amazonlinux-2-repos-us-east-1.s3.dualstack.us-east-1.amazonaws.com/2/extras/php8.1/latest/x86_64/mirror.list error was14: HTTPS Error 403 - ForbiddenSharerePost-User-7526301 7 months agoAlso getting the same https://amazonlinux-2-repos-us-east-1.s3.dualstack.us-east-1.amazonaws.com/2/extras/php8.1/latest/x86_64/mirror.list 403 Forbidden error when trying to install it.Sharecrojasaragonez 7 months agophp8.1 is no longer available :(Any update?ShareStephen 7 months agoWhen can we expect PHP8.1 to be added back to amazon-linux-extras ?ShareShow 3 more comments0For anyone looking (that's how I came across this post), I'm now seeing php.8.1 as being available:$ amazon-linux-extras | grep phpphp7.4=latest       enabled      [ =stable ]php8.0                   available    [ =stable ]php8.1                   available    [ =stable ]CommentSharegreganswered 5 months agocrojasaragonez 5 months agoYes it is, our apps are running on laravel 9 with php 8.1 now 🎉Share-5Hello Brad, Thank you for your post. The Amazon Linux Team has taken this request into its backlog, and will prioritize it along with our other packaging requests. As always, demand and use cases from our customer base drive our prioritization, and your feedback is always welcome. We cannot provide a timeline or guarantee for availability of this package from Amazon Linux's repositories.CommentShareSUPPORT ENGINEERAWS_SamManswered a year agojonlink 8 months agoThis needs to be moved off the backlog. It's not acceptable. PHP 8 will reach EOL November 2022.ShareKZenisek 8 months agoStill backlog for adding support to a PHP version that's nearly half of it's active development lifetime when it was added to Elastic Beanstalk months ago? Do we even have confirmation that this is planning to be done and/or will we be waiting until 8.0 actually hits end of development (next month) or end of security support (in ~1 year) before it's added?Just knowing the answer to those questions will help determine if one should wait for this or if this should be added via an alternative method for those that used the official Amazon Linux 2 AMI (then test/migrate before 8.0 support ends.)ShareKZenisek 8 months agoSeriously... how can AWS not confirm/deny that PHP 8.1 will be added to Amazon Linux Extras? The question has lingered for nearly a year now (support was requested a couple days after PHP 8.1 was released [as one would expect]), and nobody has made the decision to plan to add what's clearly needed for those using the Amazon Linux 2 AMI and the PHP setup it comes with? That "We cannot provide a timeline or guarantee for availability of this package from Amazon Linux's repositories." line really is not a good thing to hear when it's a foundational requirement for so many.Sharethe-guy-with-a-problem 7 months agoHow much more feedback do you need though? There's multiple threads on re:Post asking for it. It's been a year... We're almost at EOL for 8.0 and 8.2 will probably be available soon too.Share"


Question: AWS Instance replication to another AZ for quick recovery

"Our customer have critical server in one AZ. its not database server. They are doing backup but that way recovery is very time taking. and unfortunately there is not load balancing technique we can use across multiple instance neither NLB we can use.Is there anything like full instance replication to different AZ so that incase our primary instance goes down, we can bring up our instance in other zone quickly. 10-15 mins data loss is agreeable.They had this feature in Hyper-V DR VM replication.Okay that elastic IP is there, which can be easily mapped to different instance in different AZ, but can the subnet be moved as well to different AZ so that we can eventually bring same server up with same IP from different AZ (support we have only this server in that subnet)FollowComment"

Answer: "0Accepted AnswerHello Shahid,AWS does not offer a replication solution for EC2 instances. However, I would suggest you to automate the AMI [1] and or the the EBS Snapshot [2] creation.Also it is possible to copy your AMI from one AWS Region to another [3].Furthermore, for the best availability and durability of your data I also suggest you to look at the FSx solution. With FSx you can create a Multi-AZ file system, which provides redundancy across multiple AZs. In this way you will not keep any data locally to the server and even if the instance goes down your data will still be accessible from any other instance.Thank you,VasosAWSReferences:[1] https://aws.amazon.com/premiumsupport/knowledge-center/ec2-systems-manager-ami-automation/[2] https://docs.aws.amazon.com/AmazonCloudWatch/latest/events/TakeScheduledSnapshot.html[3] https://aws.amazon.com/premiumsupport/knowledge-center/copy-ami-region/[4] https://aws.amazon.com/fsx/CommentShareAWS-User-5546426answered 3 years ago"


Question: Load Balancer HTTP 404 Error

"Hello, since yesterday I'm trying setup a HTTPS website from my EC2 instance website. My site is www.isicamci.com I tried everything on the videos I found but it gave me error everytime. I couldn't count how many times I created and deleted balancers, SSL's and etc.Probably the problem is Load Balancer. I gave permission to security groups, added target group but still not working. This is my last load balancer url:http://newisicamci-1522558003.eu-central-1.elb.amazonaws.com/What is the problem?FollowComment"

Answer: "0Hi,So just to be clear, as of right now you are stuck with just getting the Load Balancer to work (SSL is NOT in the equation, correct). When it was setup, you would attempt to access the URL Link: http://newisicamci-1522558003.eu-central-1.elb.amazonaws.com/ and instead of getting the web page, you would get a HTTP Response code of 404 from the Load balancer? Getting the 404 Error code is actually a good sign that your environment infrastructure appears to be set up and allowing the Load Balancer to properly forward HTTP traffic to the Load Balancer's Target Group. The 404 Error code usually means that the page on the website that you were trying to reach could not be found on the server.  If this is possibly the issue, please double check that the Web Server's document root contains the web page. Also double check the Web Server's access/error logs to see if the request for the page shows up.-randyCommentShareRandyTakeshitaanswered 4 years ago"


Question: What are the disks means in the aurora rds cluster?

"Recently I have started working with the aws and now I need to write a python script for disk congestion on aurora rds cluster using chaos engineering, for that I have understood pretty good information but the thing is that when I am using the aurora volume status query it is giving me the no.of disks and nodes present in my cluster. So I have only 1 db cluster with a reader and a writer node but the query is giving me as disks present are 96 and the nodes present are 96. How is that possible, as per the documentation each cluster contains 6 nodes, 2 in each AZ then why am I getting nodes as 96 and disks as 96 and what exactly these disks are? How many disks can be present for a node?FollowComment"

Answer: "0"The Aurora cluster illustrates the separation of compute capacity and storage. For example, an Aurora configuration with only a single DB instance is still a cluster, because the underlying storage volume involves multiple storage nodes distributed across multiple Availability Zones (AZs)." - Amazon Aurora DB clustersPlease also refer Amazon Aurora storage and reliabilityCommentShareAshish_Panswered 10 months ago0Aurora storage consists of 10G chunks called protection groups. What exactly is the size of your database? So depending upon the size of your database, you can calculate as to how many Protection groups there are going to be and then its distributed six times , twice in each AZ  I am doubtful this information is exposed to the user.**PS: Please accept the answer if it resolves your issue **CommentShareDevinder-theDBGuyanswered 10 months ago"


Question: Upload error when uploading a new war file to an ELB instance.

"Its very strange. For the last 2 years we have been successfully uploading war files to our Tomcat application running on ELB. 3 days back, the upload process failed with a standard message "Unable to create the Application version". There was no error or reason mentioned in any log file. The only thing I could find was a long list of 401 errors (Unauthorized access) in the f12 browser console at some point in the application upload process.Once that error occurred, then all other operations with ELB started acting strange for the next few minutes. When you clicked on a link to show the Application under an ELB instance it would show the entire list of ELB instances. If I logged out and in again then it was fine.After 2 days of futile research, I just tried Chrome instead of Firefox and the error went away. I am using the latest versions of FF and Chrome. So as it stands I still cannot upload our application if I use FF, but it works fine if I use Chrome. Does anybody have any clue on how to make sense of this?!FollowComment"


Question: Fetching Secret Key from Parameter Store: ParameterNotFound

"I am having an issue during my CodeDeploy scripts because when I run the aws cli get-parameter command on a Parameter Store parameter that holds a AWS_SECRET_KEY value, I get "ParameterNotFound".Is this because it's a secret key for an account?When using EC2Connect and running the same command from the shell, I am able to get the value from the Parameter Store.Any recommendations on how to troubleshoot why the Parameter is returning ParameterNotFound though I can clearly see that it is in the Store?FollowComment"

Answer: "0Hi,Could you check if the CodeDeploy service role has the required permissions to access to that Parameter Store key? Note that if you are using a secure string parameter, it will also need permission on the KMS key to decrypt data.CommentShareMikel Del Tioanswered 8 days agoAlbertTS 5 days agoI have done so, but the issue remains.ShareAlbertTS 5 days agoI think it's looking for the AWS_SECRET_ACCESS_KEY in the environment? When I try to run the script from the command prompt, I see "Partial credentials found in env, missing: AWS_SECRET_ACCESS_KEY"ShareAlbertTS 5 days agoI am able to run 4 other get-parameter aws commands right before it and they work just fine.ShareMikel Del Tio 5 days agoI'm so sorry. Could you update the question and add part of the CodeDeploy scripts? I think it would be useful to help you.Share0Yes, please check the role as previous answer suggests.CommentSharemyronix88answered 7 days agoAlbertTS 5 days agoI have done so, but the issue remains.Share"


Question: "ERROR when transferring calls through Quick Connections, in Amazon Connect."

"I've been trying to figure out how my AWS Connect agents can transfer calls to each other via the quick connect feature in connect. Everything starts well but after a few seconds the agent interface hangs and goes blank leaving the agent without the ability to control his CCP and leaving the customer on hold until he decides to hang up himself.We tried to see if it turned out to be a bug in the transfer flow we have, but found nothing out of the ordinary.Other methods like Service Limit Increase have been tried but none with good results.Any advice please?FollowComment"

Answer: "-1A lot of problems with QCs recently. I just tested things in one of my instances and there were no problems. So, what flow is the QC associated with? Can you post a picture of the flow?davidCommentSharedmaciasanswered 8 months ago"


Question: AWS China CloudFront Error when provisioned using terraform

"I am attempting to deploy two cloudfront distributions in cn-northwest-1 and I cannot seem to get ACM certificates attached to them, terraform keeps returning the following errorerror creating CloudFront Distribution: InvalidViewerCertificate: The specified SSL certificate source isn't available in this region.│       status code: 400The ACM certificates are being generated in us-east-1 and the validation is completing successfully, but it seems that the cloudfront distribution which is created in china cannot access the certificates in the account with access to us-east-1 and RAM does not work for ACM Certificates as far as I could find.Has anyone run into the similar issue, is the only solution here using SSL/TLS certificates and manually importing them?FollowComment"

Answer: "0Unfortunately, Amazon CloudFront in the China Regions currently does not support Amazon Certificate Manager. You must get an SSL/TLS certificate from a different third-party certificate authority (CA) and then upload it to the IAM certificate store.For more information, see Importing an SSL/TLS Certificate in the Amazon CloudFront Developer Guide.https://docs.amazonaws.cn/AmazonCloudFront/latest/DeveloperGuide/cnames-and-https-procedures.html#cnames-and-https-uploading-certificateshttps://docs.amazonaws.cn/en_us/aws/latest/userguide/cloudfront.htmlCommentShareSUPPORT ENGINEERRichard Wanswered a year ago"


Question: Lambda connecting to on-prem oracle

What would be a good connection pooling strategy for Lambda connecting to on-prem Oracle? Assume the network connectivity has been established.  Should I use provisioned concurrency?FollowComment

Answer: "0If your intention is to reduce the number of concurrent lambda invocations to a certain number so you don't open more than a fixed number of connections to your on-prem Oracle database, then you may want to look at reserved concurrency - https://docs.aws.amazon.com/lambda/latest/dg/configuration-concurrency.htmlProvisioned concurrency helps reduce cold start times because the lambda service keeps that many lambda functions initialized and ready to act on an event, so you don't pay the cold start penalty.CommentShareEXPERTIndranil Banerjee AWSanswered 9 months agoAWS-User-8049274 9 months agoI don't want every Lambda that inits to open a new connection to database.  Like in a typical non-serverless applications you maintain a pool of connections to database and avoid opening a connection prior to issuing the query (or transaction) - much like what RDS Proxy offers. One option I can think of is using provisioned concurrency - since we have a warm pool each one can have one open session but its still inefficient.Share0Have you considered using Database Resident Connection Pool (DRCP) on Oracle Database? It provides a connection pool in the database server.You can see the detailed information by the following document.https://docs.oracle.com/en/database/oracle/oracle-database/19/admin/managing-processes.html#GUID-BB76E57C-3F16-4C85-AEF6-BA14FC1B4777CommentShareAWS-User-5505188answered 9 months agoAWS-User-8049274 9 months agoYes, someone from aws team recommended this.  Have not had a chance to experiment but Thank you for sharing.Share0https://www.jeremydaly.com/reuse-database-connections-aws-lambda/CommentShareSirish Bajpaianswered 9 months ago0You can't really have a connection pool inside Lambda as each Lambda instance is isolated for the others. RDS proxy is an external component that we use to create a connection pool, but it does not support Oracle or on-premises databases.If you want to actually have a connection pool, you will need to create your own proxy layer, similar to RDS proxy, that Lambda functions connect to, and it connects to the database.Another option is to limit the number of Lambda function instances so that you do not have too many connections. This is not really a connection pool, but it will protect the database from to many connections. The way to limit number of instances is using Reserved Concurrency. The functions will create the DB connection at Init time and will maintain it open for the life time of the function.CommentShareEXPERTUrianswered 9 months ago"


Question: How the Detailed monitoring is actually charged.

"I wanted ask about cloudwatch detailed monitoring pricing.In billing details under cloudwatch section I can see following details.$0.30 per metric-month for the first 10,000 metrics - Asia Pacific (Mumbai) 12.551 Metrics and cost is $3.77Why these number of metrics are in floating number as 12.551.How the number of metrics are calculated and charged?FollowComment"

Answer: "1Hi Ophelia,For detailed monitoring you are charged per metric that is sent to CloudWatch. You are not charged for data storage. For more information https://aws.amazon.com/cloudwatch/pricing/. You can see the various tiers associated with the costs, navigate by region (pricing can vary by region) and see some pricing examples as well. All custom metrics charges are prorated by the hour and metered only when you send metrics to CloudWatch.So for example, for EC2 Detailed Monitoring if your application runs on 10 Amazon EC2 instances 24x7 for a 30-day month, and you enable EC2 Detailed Monitoring on all instances, your charges would be as follows:Total number of metrics = 7 metrics per instance * 10 instances = 70 metricsMonthly CloudWatch Metrics Charges @$0.30 per custom metric = 70 * $0.30 = $21Monthly CloudWatch charges = $21 per monthWith regards to what you said you saw in Billing under CloudWatch, the number 12.544, it might be that some metrics got deleted as it was no longer in use as a result you only pay for the time it was active.I hope this helps.CommentShareamz99answered 2 years ago"


Question: Query get data only to last month on Athena

"Hi guys, hope you are well!I need help with a query in athena to get my data for the previous month. In sql I used a query that worked very well and in athena I'm not getting it.My field is coming in yyyymmdd and string format.The query that I need help for athena to understand is this one:REF_DATE BETWEEN DATEADD(MONTH, -1,(GETDATE()1DAY(GETDATE())+1)) AND DATEADD(DAY,1,(GETDATE()DAY(GETDATE())+1)))Thank you so much!FollowComment"


Question: ASG Won't Put Healthy EC2 Instances InService. Stuck in Pending.

"I am having trouble getting ASG's to put healthy EC2 instances in service after it starts them. There are no lifecycle hooks. The instances are healthy, passed the EC2 status checks. I can shell into them. But the ASG never moves them from Pending to InService, and eventually it shuts them down.I tried with a different AMI, subnet, VPC, spot instances, normal ones, and I get the same result. But this only appears to be happening in N. California. Things in N. Virginia seem to be working normally.Can anyone help resolve this? Thank you!FollowComment"

Answer: "0I figured it out. When creating a launch config, DON'T check the box labeled "Link to VPC" if you're launching instances INTO a VPC. This is for classic instances that will be linked to a VPC.It would be nice if there was some sort of error or status message to let the user know about this mismatch.CommentShareseanlsanswered 4 years ago"


Question: An error occurred (ModelError) when calling the InvokeEndpoint operation

"Hello,I received the following error message when I tried to send an array to my model:An error occurred (ModelError) when calling the InvokeEndpoint operation: Received server error (500) from container-1 with message "<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN"><title>500 Internal Server Error</title>
Internal Server Error

The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.
  ". See https://us-east-1.console.aws.amazon.com/cloudwatch/home?region=us-east-1#logEventViewer:group  I have created inference pipeline containing preprocessing and autoencoder model and deployed it to a single endpoint. Am trying to send raw data in text/csv format. EX: "39, 4, 9, 8, contact"Please help me out in this.Much appreciated,KarthikFollowComment"

Answer: "0Hello,So the issue here is most likely with your inference code and how you are parsing/transforming the data coming in. Your endpoint is up and running but the format in which you are feeding it data is confusing it. The endpoint is expecting encoded data thus you need to convert your payload into the appropriate data format, there are two manners in which you can approach this.Use a serializer, when creating your endpoint with the predictor class you want to use the SageMaker Serializer to automatically encode/decode your data, this is configured while creating your endpoint. Look at the following code snippet below.from sagemaker.predictor import csv_serializerrf_pred = rf.deploy(1, "ml.m4.xlarge", serializer=csv_serializer)#for prediction, decode the data properlyprint(rf_pred.predict(payload).decode('utf-8'))If you choose not to use the serializer you want to encode the data on your own using something such as json.dumps(payload) to encode your data properly before sending the data to the endpoint.Extra Resources:SageMaker Serializers: https://sagemaker.readthedocs.io/en/stable/api/inference/serializers.htmlHope this helps!CommentSharervegira-awsanswered 2 years ago"


Question: How do I parse multiple group claims from an OIDC Token/Provider into an IAM Policy?

"Suppose you want to use the "groups" claim from your OIDC provider to dictate resource access for your IAM role.i.e. if you're in group A, you can touch resource A. A user could be in groups A, B, and C all at the same time.All of the IAM examples so far seem to assume that a user has a single group or department attribute that dictates access (i.e. bob's department=accounting), instead of multiple (i.e. bob's departments=[accounting]). Usually this is never the case in reality and doesn't seem applicable to hardly any use cases.Furthermore it seems that mapping the "groups" claim in an OIDC provider with Cognito Identity pools transcribes the array to a singular string (i.e. the array [groupA, groupB, groupC] is parsed to the literal string "["groupA", "groupB", "groupC"]", which is near impossible to use in IAM roles when checking access levels due to a lack of advanced string parsing.Any ideas? Is this just not a thing in IAM? Can you just simply not use the groups claim from an OIDC provider?FollowComment"

Answer: "0Assuming you are using cognito for authN and implementing groups to assign roles , you have the option of using priority with in your roles. If that does not suffice you can implement RBAC as defined https://docs.aws.amazon.com/cognito/latest/developerguide/role-based-access-control.html .CommentShareJoel_Ponukumatlaanswered 8 months agoBrandon-Ellis-AI 8 months agoRBAC still caps out at 25 rules -> 25 roles per OIDC provider, right? So if you had more than 25 possible groups this wouldn't be a practical solution either.It also forces you to "pick" a single role to sign in as at a time, instead of utilizing the credentials of multiple, which isn't ideal.Share"


Question: What to do with source servers with replica after recovery into EC2 [Elastic Disaster Recovery]

"Hello guys!I was able to successfully recover my instances after the outage in the premise office, currently, all my machines are running in EC2 and source servers are shown as "Ready, lag 9d" "Stalled" and I keep being charged for replica EBS volumes, as well as AWS Replication Instances (t3.small).While I dont have any info on when it will be possible to perform the failback, Id like to cut some costs and remove replica EBS volumes. I was thinking about the action "Disconnect from AWS" but it does not work with the message:Some Source servers could not be processed:s-1ed6*9: Cannot disconnect Source Server s-1ed**9 because it has a Recovery Instance.What would be the correct action in such a case? (remove source server\remove just the volumes\something else) (the goal to cut the costs while keeping the possibility of failback later).Thanks!Regards,FollowComment"


Question: How to see SES usage for domains?

"I verified two of my domains with SES and created one IAM for SMTP credentials.I have sent emails programmatically from both domains and now I would like to see, from the AWS console, how many emails have been sent from each of the two verified domains. How can I do that?Also, if I delete a verified domain (ie. not delete the domain but just delete it from the list of verified domains), is it possible to see how many emails were sent from that domain before it was deleted as a verified domain?FollowComment"

Answer: "2Accepted AnswerI recommend taking a look at this documentation for Setting up Amazon SES event publishing. You can publish SES events to CloudWatch to get metrics. Alternatively, you can send it to other destinations such as Kinesis Data Firehose to send it to S3 and other places so you can store events for deleted domains for archives.Price per metric – You can view basic Amazon SES metrics in CloudWatch for free. However, when you collect metrics using event publishing, you create custom metrics in CloudWatch. Each unique combination of event type, dimension name, and dimension value creates a different custom metric in CloudWatch. When you use CloudWatch, you are charged for each custom metric you create. For this reason, you might want to avoid choosing dimensions that can take many different values. For example, unless you are very interested in tracking your email sending events by "From" domain, you might not want to define a dimension for the Amazon SES auto-tag ses:from-domain because it can take many different values. For more information, see CloudWatch Pricing.CommentShareTaka_Manswered 7 months ago"


Question: A request Form for another time extension of 120 minutes for doing the lab session 1(Introduction to S3).

"Respected Sir/Madam, Best wishes to your company. Sir/Madam i have recently joined in the aws services sir/madam i'm experiencing a wonderful completely corporate environment while doing the lab sessions and even I'm enjoying it in a great manner.Sir/Madam I've completed 6 labs out 7 lab sessions by achieving respectable grades, sir/madam while doing the lab session 1(Introduction To Amazon S3) i didn't came to know that there will be a time limit of 240 minutes.Unfortunately the lab time exceeded and I'm not able to do that lab, so I'm kindly requesting you Sir/Madam to spare me another 120 minutes to complete that lab session.Sir/Madam please spare another 120 minutes because I'm new to it, i have no idea that there will be time for the lab session excluding the lab session time 1 hour. So, Sir/Madam please do accept my request.I'm able to create another and email id, and can start aws services from the beginning, but the email id which I've registered with aws services it is my professional email id, i want the certification on my professional email id.So I'm kindly requesting you Sir/Madam to spare me another 120 min.If possible i can restart from the beginning "with the same email id"which i have registered with aws services.FollowComment"

Answer: "0Please submit a ticket to the AWS Training & Certification customer support team, and they will provide assistance. If you already submitted a case, please allow at least 48 hrs to get a response.CommentShareNelliT-AWSanswered 3 months ago"


Question: Vertex Filtering Significant Performance Issues

"Hello,let me share a very simple query which I am getting poor performance on. I'll share the profile and hopefully someone can explain why it is taking over 10 seconds. Additional filters after the .HasLabel() are significantly hurting performance even further (2 to 3 times worse)."gremlin":"g.V().has('__graph','123').hasLabel('MyType').count()"            Neptune Gremlin Profile  Query Stringg.V().has('__graph','123').has(label,'MyType').count()Original Traversal[GraphStep(vertex,[]), HasStep([__graph.eq(123), ~label.eq(MyType)]), CountGlobalStep]Optimized TraversalNeptune steps:[NeptuneCountGlobalStep {JoinGroupNode {PatternNode[(?1, <label>, ?2=<MyType>, <>) . project ?1 .], {estimatedCardinality=1273722, expectedTotalOutput=1273722, indexTime=0, joinTime=1131, numSearches=1, actualTotalOutput=830889}PatternNode[(?1, <__graph>, "123", ?) . project ask .], {estimatedCardinality=2854796, indexTime=887, joinTime=8371, numSearches=830889}}, annotations={path=[Vertex(?1):GraphStep], joinStats=true, optimizationTime=0, maxVarId=3, executionTime=10614}}]Physical PipelineNeptuneCountGlobalStep|-- StartOp|-- JoinGroupOp|-- SpoolerOp(1000)|-- DynamicJoinOp(PatternNode[(?1, <label>, ?2=<MyType>, <>) . project ?1 .], {estimatedCardinality=1273722, expectedTotalOutput=1273722})|-- SpoolerOp(1000)|-- DynamicJoinOp(PatternNode[(?1, <__graph>, "123", ?) . project ask .], {estimatedCardinality=2854796})Runtime (ms)Query Execution: 10614.135Traversal MetricsStep                                                               Count  Traversers       Time (ms)    % DurNeptuneCountGlobalStep                                                 1           1       10614.027   100.00>TOTAL                     -           -       10614.027        -Predicatesof predicates: 189ResultsCount: 1Output: 414752Index OperationsQuery execution:# of statement index ops: 830890# of unique statement index ops: 830890Duplication ratio: 1.0# of terms materialized: 0Edited by: austinmalpede on Jul 7, 2020 2:02 PMEdited by: austinmalpede on Jul 7, 2020 2:03 PMEdited by: austinmalpede on Jul 8, 2020 7:55 AMFollowComment"

Answer: "0Looking at the profile, here’s the relevant part:PatternNode[(?1, <~label>, ?2=<MyType>, <~>) . project ?1 .], {estimatedCardinality=1273722, expectedTotalOutput=1273722, indexTime=0, joinTime=1131, numSearches=1, actualTotalOutput=830889}PatternNode[(?1, <__graph>, "123", ?) . project ask .], {estimatedCardinality=2854796, indexTime=887, joinTime=8371, numSearches=830889}Neptune first evaluates the scan for all patterns of "MyType", which returns 830k nodes. This scan takes about 1.1s. The resulting 830k node IDs are then probed against the index in the second pattern, and all of them happen to satisfy the filter "__graph" == "123". Generally, such "probing" lookups are more expensive (in this case, ~.8.3s) than the first, continuous index scan.A couple more thoughts:Adding more filters may or may not help. If you add a selective filter (using your version of the query), you should see Neptune starting out with the most selective filter(s), so the overall amount of processed solutions might become much lower, resulting better execution time; if, on the other hand, none of your additional filters are selective, then each filter would induce additional overhead. So when you’re saying that you added additional FILTERs and those were decreasing your execution time, I would be curious to understand whether you’re observing performance problems also in case of adding more selective filters?As a general callout, Neptune evaluates the Gremlin query using a single thread. So while you’re seeing high latency in answering, your server (depending on the instance type) would be underutilized when running a single query alone. The type of query that you’re running looks more like an analytical query; if you’d evaluate a set of such analytical queries together, the observed overall server throughput/utilization could become much better.Edited by: awsmichaels on Jul 8, 2020 4:21 PM (provided example was not working / semantically wrong)CommentShareAWS-User-8405213answered 3 years ago0One thing you could try is using a query optimizer hint that enforces a hash join:g.withSideEffect('Neptune#hashJoin', '__graph').V().has('__graph','123').has(label,'MyType').count()When using this query, the second (i.e., '__graph' == '123') filter should be evaluated as a hash join. This means that Neptune would not "substitute in" solutions from the first pattern (and performing 880k lookups) but instead evaluate the pattern for the graph filter stand-alone, and then perform a hash join.This might be more efficient as long as the triples with '__graph' == '123' is of comparable size to the triples with type 'MyType'. The reason why, in your case, Neptune is not automatically switching to this strategy is that the estimated sizes in your case are quite large, which is why the optimizer choses to opt for a more memory efficient plan (trade-off between performance and memory).CommentShareAWS-User-8405213answered 3 years ago0Hi Michael,Thanks for the response. I've tried your suggestion to use the hashJoin sideEffect. Unfortunately the results were about the same. The profile can be found at the bottom of this post.Our customers are going to want to get a "totalCount" when querying for their data. The results of this query aren't even half the results our customers are wanting to store in the future. I've been under the impression that filtering vertices by properties would have consistent performance as the DB grows. If we cannot meet their requirements we may need to look at alternative DB solutions.To put things into perspective, our __graph property is how we are partitioning our data. Each one of these __graph partitions could have around 4 million vertices. The "myType" vertex label is very common across the entire database, taking up almost 1/4 of an entire __graph (e.g. 1 million hits). We're planning to have hundreds of these __graphs in our DB.I'm looking for direction from you and your team on how we can prevent simple filtering operations from taking 10+ seconds and degrading as our data grows. Keeping it under 1 second is our goal. I'm hoping you can help us meet our requirements            Neptune Gremlin Profile  Query Stringg.withSideEffect('Neptune#hashJoin', '__graph').V().has('__graph','123').hasLabel('MyType').count()Original Traversal[GraphStep(vertex,[]), HasStep([__graph.eq(123), ~label.eq(MyType)]), CountGlobalStep]Optimized TraversalNeptune steps:[NeptuneCountGlobalStep {JoinGroupNode {PatternNode[(?1, <label>, ?2=<MyType>, <>) . project ?1 .], {estimatedCardinality=1274196, expectedTotalOutput=1274196, indexTime=0, joinTime=1239, numSearches=1, actualTotalOutput=830890}PatternNode[(?1, <__graph>, "123", ?) . project ask .], {estimatedCardinality=2625528, indexTime=837, joinTime=9734, numSearches=830890}}, annotations={path=[Vertex(?1):GraphStep], joinStats=true, optimizationTime=1, maxVarId=3, executionTime=12023}}]Physical PipelineNeptuneCountGlobalStep|-- StartOp|-- JoinGroupOp|-- SpoolerOp(1000)|-- DynamicJoinOp(PatternNode[(?1, <label>, ?2=<MyType>, <>) . project ?1 .], {estimatedCardinality=1274196, expectedTotalOutput=1274196})|-- SpoolerOp(1000)|-- DynamicJoinOp(PatternNode[(?1, <__graph>, "123", ?) . project ask .], {estimatedCardinality=2625528})Runtime (ms)Query Execution: 12024.553Traversal MetricsStep                                                               Count  Traversers       Time (ms)    % DurNeptuneCountGlobalStep                                                 1           1       12024.375   100.00>TOTAL                     -           -       12024.375        -Predicatesof predicates: 189ResultsCount: 1Output: [414752]Index OperationsQuery execution:# of statement index ops: 830891# of unique statement index ops: 830891Duplication ratio: 1.0# of terms materialized: 0CommentShareaustinmalpedeanswered 3 years ago0I've followed the following principle, which Kelvin taught me awhile ago:"Take a sip from Neptune before drinking"My interpretation of this phrase was that when fetching data, do so in two queries:Query #1: perform whatever filters or traversals to find the vertex id's you need.Query #2: retrieve the needed data using the vertex Id's from query #1 as your starting points.The prior of the two is giving us the most trouble. It's impossible to see how many results, or even paginate the results are when the result set is large. The joins are very expensive and are causing CPU to spike over 50%.The IO of Neptune is performing well. the fetching vertex ids / count is faltering when many results are found.Perhaps there are more techniques we could use when "sipping"? I look forward to hearing from your team.Edited by: austinmalpede on Jul 10, 2020 1:32 PMEdited by: austinmalpede on Jul 10, 2020 1:35 PMCommentShareaustinmalpedeanswered 3 years ago0I was able to meet with the Neptune team yesterday. They were able to answer all of our questions. To summarize the discussion:Gremlin is fast at filtering however it's inherently limited due being single threaded. This can pose issues when the result set is extraordinarily large. The example provided in this thread returned more than 400k results. SPARQL is inherently multi-threaded so some performance can be gained by using this language.Combining commonly used property filters into a single property (e.g. multi-key) can boost performance when filtering for large amounts of resultsNeptune is working on some upcoming features which can help optimize the problem discussed in this forum postHopefully this is helpful, @NeptuneTeam correct me if I mis-spoke on anything.Thanks,AustinCommentShareaustinmalpedeanswered 3 years ago"


Question: Long running event processing

"I am planning to build a long-running event processing system. I already have EC2 instances for my application and want to utilize the same compute to process long-running events. I am planning to use SQS with higher visibility timeouts and if the processing goes beyond that limit, I will change the message visibility time while processing. Can this pattern be used for scheduled events from the event bridge (do we have a concept of visibility timeout for event bridge events or do we have to send those to the SQS to get the same pattern)? Also, curious to know about ECS as a long-running compute for such events in the future (if I want to separate the compute from my existing ec2 compute), do we have to follow the same change in visibility timeouts for ECS as well if so?FollowComment"

Answer: "1Accepted AnswerI think you've answered all of your questions yourself (nice!) but to confirm:Your thoughts around SQS and visibility timeouts are correct. What compute platform you use there (EC2 or ECS) is not crucial - it's the same logic working the same way.EventBridge doesn't work the same way as SQS - there is no concept of event visibility in the sense that SQS has message visibility. But you could use EventBridge to schedule a message to be sent to SQS.CommentShareEXPERTBrettski-AWSanswered 7 months agorePost-User-2348879 7 months agoI also stumbled upon AWS Batch. I think I can use my existing compute with AWS Batch. Do you think AWS Batch would be a better fit both in terms of better dev experience (not using the SQS pattern with custom de-dup for effective one-time processing, etc) and cost?ShareBrettski-AWS EXPERT7 months agoPerhaps. You might also consider Step Functions.Share"


Question: How do uninstall a CLI for mac

"Hello everyone, I'm currently following an udemy course for the AWS cloud practitioner exam. This would be my second or third attempt at this course and I'm having trouble using the terminal on my macbook to configure/access the CLI.For my tutorial we learned how to download the latest version of CLI on a mac then was instructed  to open my terminal and configure it by using the new access key and secret access key. However when I inputed aws configure in the terminal here is what it outputted.Last login: Tue Feb  7 17:48:40 on ttys000(base) khalidabdalla@Khalids-MacBook-Air ~ % aws configureAWS Access Key ID [****************SXFZ]:AWS Secret Access Key [****************6WW3]:Default region name [us-east-1]: us-east-1Default output format [none]:(base) khalidabdalla@Khalids-MacBook-Air ~ % aws iam list-usersUnknown output type: noneI'm not sure why there is a different access key and secret access key (maybe from the cli package I downloaded in the past ?)FollowComment"

Answer: "0Accepted AnswerRerun the 'aws configure' command and accept the current values for everything (just hit return/enter) except 'Default output format'. Type in 'json' for that. Then rerun your command. You can also override this value on the command line with the --output option.aws iam list-users --output jsonCommentShareEXPERTkentradanswered 4 months agoKv3 4 months agoAmazing, worked like a charm! Thank you !Share0Hi there to remove the AWS CLI from your MAC, follow the instructions here - https://docs.aws.amazon.com/cli/latest/userguide/uninstall.htmlplease make sure you read all the instructions to make sure it meets your requirementsCommentShareEXPERTGreg Vintonanswered 4 months ago"


Question: Can DRS support using on-prem infrastructure as DR environment?

"I have a customer who has migrated a workload to AWS and is now focused on Disaster Recovery options.  They do have a bit of on-prem infrastructure available and were curious if they could run AWS Elastic Disaster Recovery in the other direction with AWS hosting their Production environment and their on-prem data center hosting their DR site.  In trying to search for this answer, all results come back with the more traditional on-premise to AWS DR solution, so I can't find anything definitive.  Is this possible?FollowComment"

Answer: "0I would say this isn't possible and even if you would be able to get it working, I feel it wouldn't make sense.On https://aws.amazon.com/disaster-recovery/ it does list 3 use-cases, but aws-to-onprem isn't one of them. Value prop is around not paying for 2 sites, but only provision AWS resources when DR is needed. This wouldn't be true for opposite case where you have active environment in AWS and DR hardware on-prem :-(However they could do DRS from aws-to-aws and that is both supported use-case and more economic as you don't need to maintain on-prem hardware for DR site. And if you would be interested in more advanced AWS-to-AWS DR scenarios (going beyond just EC2s) I can recommend https://arpio.io/ as a happy customer of the service.CommentShareKalluanswered 4 months agoRyan 4 months agoYes, I agree that this scenario typically doesn't make since as most companies don't have spare infrastructure capacity available.  But this customer does and are looking for use cases for it, and DR would be one such use case if the tools support it.  Thanks!ShareKallu 4 months agoOk, but it wouldn't be any more expensive to use another AWS account as your DR -site.And that would be supported in DRS.Share"


Question: Details about AWS Always Free tier - how to sign up

My 1 year free account expires at the EOM. How do I convert it to an always free account and what are the resource restrictions?FollowComment

Answer: "1Hi you do not sign up for Always Free Tier.At the end of Free Tier (https://aws.amazon.com/free/), the Always Free services (https://aws.amazon.com/free/?all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all) are just free under certain circumstances for any customer, such as first 1.000.000 requests for SQS or Lambdas.Hope it clarifies and if it does I would appreciate answer to be accepted so that community can benefit for clarity, thanks ;)CommentShareEXPERTalatechanswered 2 months agorePost-User-7743783 2 months agoAre all the services that were free during the first year, still free, or only a specific subset (ie, SQS/Lambda), and one would be billed for small former free instances, for example?Sharealatech EXPERT2 months agoFree services usually belong to either always free (eg free amount of requests per month, then after a threshold, you pay), or 12 months free (which after that you have to pay) or free trial (depends on service). To answer your question, depends on the service, and I would suggest to look at the link above. For instance after 12 months, the free tier eligible ec2 (t2.small or similar) is not free anymoreShare"


Question: .NET SDK Cognito Identity InitiateAuth yields AmazonServiceException: Unable to get IAM security credentials from EC2 Instance Metadata Service

"I am attempting to authorize users that I have added to a Cognito User Pool through a client application (like a website) using the .NET SDK..NET SDK version: 45-3.7.494.1As far as I know I have set up everything correctly on the AWS side - user pool, federated identity pool tied to user pool, IAM auth & unauth roles tied to identity pool.I added the user email to the user pool and now need them to login.  However, on attempting to begin the process with the code below:I get:From what I can tell I am using the appropriate logic based on https://docs.aws.amazon.com/cognito/latest/developerguide/amazon-cognito-user-pools-authentication-flow.html and other associated documentation.  I have also combed the internet (re:Post, git, stack) for some kind of hint with no luck.  I had tried CognitoSync but this method proved more useful initially.Any ideas or potential insight would be greatly appreciated!FollowComment"

Answer: "0I managed to find my way around this and am posting this response for anyone who has the same problems:There are a few things wrong with the code listed:First, credentials need to be passed through when constructing the AmazonCognitoIdentityProviderClient (idClient).  Otherwise the request instance hangs and the following error occurs: AmazonServiceException: Unable to get IAM security credentials from EC2 Instance Metadata ServiceThe SRP_A value is a special value and needs code to comupte it (see Secure Remote Password on wiki).  The C# code I found that works for this is here: https://github.com/aws/aws-sdk-net-extensions-cognito/tree/master/src/Amazon.Extensions.CognitoAuthentication/UtilYou will need all the scripts in the util folder.The call for InitiateAuth must be tied to something - in this case: Amazon.CognitoIdentityProvider.Model.InitiateAuthResponseThe correct code (as far as I can tell at this moment) is:This returns the PASSWORD_VERIFIER challange as part of "response".There may be issues with this I have yet to run into as I am still in the process on integrating - so please be careful.CommentSharerePost-User-3544658answered 2 months ago"


Question: How we can visualize as a diagram using workload discovery?

I have gone through this article to generate architecture diagrams of AWS Cloud workloads there is no certain guideline on where to start and how to start to build this to get architecture diagrams of any size live workload of aws account to reside.Does anyone use this feature to create architecture diagrams of AWS Cloud workloads?FollowComment

Answer: "0Hi Amir,I'm sorry I don't have the answer for you, but I'm asking similar questions. Two things I'm looking at are AWS Workload Discovery, which you've already found (see the Implementation Guide for details), and an AWS Marketplace service called Cloudcraft. My problem right now is trying to find out what their differences are. One thing I do notice is that the cost of Workload Discovery is just the cost of the AWS resources required (about $425/month for a single instance -- there are also multiple instance options for availability at a higher cost), while the cost of Cloudcraft seems to be based on the number of users (about US$490/user per year), so from that perspective the breakeven point seems to be 11 users. But where the documentation for both is vague is in what their actual capabilities are, which is kind of strange! Anyway good luck, and if you find out anything useful, please let me know!CommentShareTImanswered 4 months ago0Other helpful options include, (open source) CloudMapper (https://github.com/duo-labs/cloudmapper) and (Paid, $9.95pm) SmartDraw (https://www.smartdraw.com/whats-new/aws-integration.htm). It really depends on your goals - being one time mapping (e.g. end of project) or ongoing mapping for operational reviews and maintenance.CommentShareGAanswered 4 months ago"


Question: Getting Started with Amazon Managed Service for Prometheus guide helm deployment error

"Hi,trying to follow the: Getting Started with Amazon Managed Service for Prometheus guidehttps://aws.amazon.com/blogs/mt/getting-started-amazon-managed-service-for-prometheus/?sc_channel=EL&sc_campaign=Demo_Deep_Dive_2021_vid&sc_medium=YouTube&sc_content=Video8861&sc_detail=MANAGEMENT_GOVERNANCE&sc_country=USBut getting an error on the Deploying Prometheus server helm deployment step.I have the variables set up, amp setup. but when runninghelm install prometheus-for-amp prometheus-community/prometheus -n prometheus -f ./amp_ingest_override_values.yaml \--set serviceAccounts.server.annotations."eks\.amazonaws\.com/role-arn"="${IAM_PROXY_PROMETHEUS_ROLE_ARN}" \--set server.remoteWrite[0].url="https://aps-workspaces.${AWS_REGION}.amazonaws.com/workspaces/${WORKSPACE_ID}/api/v1/remote_write" \--set server.remoteWrite[0].sigv4.region=${AWS_REGION}I get the error:zsh: no matches found: server.remoteWrite[0].url=https://aps-workspaces.eu-west-2.amazonaws.com/workspaces/ws-xxx/api/v1/remote_writeWhen i go to AMP i can see the http path is correct (the console gives a v1/query instead of v1/remote_write though.Any idea how troubleshoot?FollowComment"

Answer: 1Accepted AnswerIt looks like the shell is unable to parse the command. You can try to escape the square brackets in server.remoteWrite[0].url and see if it works.Change server.remoteWrite[0].url to server.remoteWrite\[0\].urlAnother approach is to hardcode the URL in your amp_ingest_override_values.yaml file and remove the --set server.remoteWrite[0].url flag from your command.server:  remoteWrite:    -      url: https://aps-workspaces.eu-west-2.amazonaws.com/workspaces/ws-xxx/api/v1/remote_write      queue_config:        max_samples_per_send: 1000        max_shards: 200        capacity: 2500I hope this helps!CommentShareSUPPORT ENGINEERVenkat Penmetsaanswered a year ago


Question: SageMaker issue: cannot start kernel

"Hello, I have a problem with SageMaker: I tried to start kernel with ml.g5.12xlarge instance, but it failed with InternalFailure error. After a couple of unsuccessful attempts I started to get another error about account-level service limit. My limit is 1, and it says I already have 1 instance running. However, I do not see any running instances in the list of running instances. So now I am stuck. Could someone from AWS technical support help me please?Failed to start kernelFailed to launch app [pytorch-1-13-cpu-py-ml-g5-12xlarge-9b5704dda36ab08eb9a29af41aed]. ResourceLimitExceeded: The account-level service limit 'Studio KernelGateway Apps running on ml.g5.12xlarge instance' is 1 Apps, with current utilization of 1 Apps and a request delta of 1 Apps. Please contact AWS support to request an increase for this limit. (Context: RequestId: 03518865-dde3-493e-8751-b631cf7e80ea, TimeStamp: 1682699325.895717, Date: Fri Apr 28 16:28:45 2023)FollowComment"

Answer: 0Hi - I would suggest to check on endpoint and any notebook instance types in your account.You can then always request a quota increase using these stepsCommentShareEXPERTAWS-User-Nitinanswered a month ago


Question: Restore versions of replicated S3 objects with version ID and timestamp intact

"I have replication setup between 2 S3 buckets and in-sync replicated copies of multiple objects between the 2 (Versioning is enabled). I have deleted an object from source site (Site 1) but the replicated version exists in my target bucket (Site 2).How do I get that replicated object back to the Site 1 with the version ID and last modified date as they are shown in Site 2 bucket? I have that copy so there mEverything I try fails. Have tried:Replicate from 2 to 1 with tags to limit which files are replicated - fails presumably to prevent chained replications. Sort of expected that.Move or copy: creates a new last modified date and version ID. Did not expect that, especially on move operation.If the object owner is to believe it is the original version, when you have a copy in site 2, there must be a way to get that object version back to site 1?FollowComment"

Answer: 0To my understanding it is not possible since PUT-Operation will always create a new version. (https://docs.aws.amazon.com/AmazonS3/latest/userguide/versioning-workflows.html)Why are you not just deleting the deletemarker on the object in bucket1 to get the specific object-version back? (https://aws.amazon.com/de/premiumsupport/knowledge-center/s3-undelete-configuration/)Is there a reason you need exactly the version you deleted or why not just use the new version generated when you copy the file back from bucket2 to bucket1? That will create a new version on bucket2 as well as on bucket1.CommentShareHeikoMRanswered 6 months ago


Question: How to control voice speed in Polly's neural voices?

"Hi, in Amazon Polly console, I noticed that the voice speed tag prosody rate doesn't work for neural voices. How can I change voice speed?  For example, the new neural italian voice "Adriano", wich is beautiful, is unfortunately very fast and doesn't sound natural at the default rate, I would like to slow down it. How can I do? Thank you.FollowComment"

Answer: "0Hi, as per documentation:Prosody tag attributes are fully supported by the standard TTS voices. Neural voices support the volume and rate attributes, but don't support the pitch attribute.(emphasis mine)I just successfully synthesized below, observing slower speaking rate:<speak>    <prosody rate="slow">        Ciao! Mi chiamo Adriano, e posso leggerti qualsiasi testo tu mi scriva.    </prosody></speak>CommentShareTBanswered 4 months ago"


Question: Create bot for Artificial Intelligence Group

Could you please help me find a developer in AWS Polly that can build an AI bot for the Artificial Intelligence and Business Analytics (AIBA) Group in LinkedLin ?  https://www.linkedin.com/groups/62438/ AlbertoFollowComment


Question: How to clear Server cache in EC2

Our site is showing site can't be reached. When I've checked the disk space and its showing its full and the cache has added to it.May I know how to clear that cache.FollowComment

Answer: "0Best way is to schedule cronjob to clean up the cache. Below cronjob commands are to clear the server cache every hour. Please change it according to your needs.1 * * * * sync; echo 3 > /proc/sys/vm/drop_caches1 * * * * sync; echo 2 > /proc/sys/vm/drop_caches1 * * * * sync; echo 1 > /proc/sys/vm/drop_cachesCommentShareRamakrishnan Lakshmanananswered 4 months agoskinsman EXPERT4 months agoDoesn't this just drop disk cache out of memory?  @Post is having trouble with free disk not free memory. Seems to me that "server cache" in the question isn't talking about the Linux disk cache.  Cheers.Share0You've mentioned a server cache in EC2 but added "Amazon File Cache" as a tag - are you actually using this? https://aws.amazon.com/filecache/faqs/.If it's a server cache on EC2, wht are you caching and what are you using to perform the caching?CommentShareEXPERTskinsmananswered 4 months ago"


Question: "Quicksight Aurora access, VPC issue"

"I have followed the docs to enable connecting QuickSight to an Aurora psql instance but I can't get it to work.When I try add the VPC from QuickSight I see the following error in the chrome dev console (no visible error on the page itself..)I.e. it says "Not autorized to perform ec2:CreateNetworkInterface"I have done the followingChecked that my user has ec2:CreateNetworkInterface and quicksight:CreateVPCConnectionChecked that the aws-quicksight-service-role-v0 also has these two permissionsChecked that the role has sts:AssumeRoleCheck the VPC, security groups etc. Though its unlikely its any of that since the failure happens as I'm trying to add the VPC to QuickSightDo you have any idea where I can look next? The UX for this from QS is not great.ThanksFollowComment"

Answer: "0Thanks I tried explicitly adding the two I did not have (ec2:CreateNetworkInterface was already there) to both the role and my user. But I get the same error.It is specifically saying ec2:CreateNetworkInterface which I know is there, so that is odd. I've confirmed its using the correct role.Most frustratingCommentShareAndreanswered 2 months agoRiku_Kobayashi EXPERT2 months agoDoes this still occur if I add administrator privileges?Share0Try to operate with the following permissions set for IAM users and IAM rolesec2:CreateNetworkInterfaceec2:DescribeNetworkInterfacesec2:DeleteNetworkInterfaceCommentShareEXPERTRiku_Kobayashianswered 2 months ago"


Question: Exceed monthly credit limit

"I am getting an error saying that I have exceeded monthly credit limit, and cannot publish any batch.I have searched the problem for a while but cannot get a proper solution. Can anyone tell me how to deal with it?FollowCommentrePost-User-4379080 8 months agohi i too getting this issue. have you resolved the problem. please replyShare"

Answer: "0I too have searched for this information and haven't succeeded in finding it anywhere in the MTurk information.  But I may have missed it.To resolve this issue, send a message to the support link below and ask MTurk to increase your monthly spending limit:https://support.aws.amazon.com/#/contacts/aws-mechanical-turkI am told by Amazon MTurk support that when an account is set up, there is a review and a monthly spending limit is applied to your account. According to the support email I received, the way this review is done is "proprietary."It is worth noting that if the projected cost of your HITS assessed by MTurk exceeds the monthly spending limit to your account, this may affect how your HITS run (ie you may be prevented from approving workers, bonusing, or launching compensation HITs, if this limit is projected to be “overspent” within the month).  In other words, even if you haven’t spent up to the maximum of the “spending limit,” if the projection is that you exceed this amount, these issues still arise.A temporary fix might be to change (decrease) the sample size of your HITS in the hopes that the projection now meets the monthly spending limit, but I think it is best to work with MTurk to establish the limit you need. It may necessitate proof you are capable of paying the amount; I don't know.IN SUM:  To rectify this, contact their support and request the increase and hopefully an increase is approved.CommentShareAWS-User-9223853answered a year agorePost-User-9687991 4 months agoMy limit shows as 2,500 and my hit of 1,008 still exceeded the limit. I dropped it down to just 2 and it still exceeded the limit which is insane.Share"


Question: Routes for pods in EKS

Hi. Is it possible to set up routing rules for pods in EKS using standard mesh plugins? I’m not able to install plugins like Calico.FollowComment

Answer: 0I want to use Security Groups for manage inbound and outbound routes for podsCommentShareIhor Prytolanswered 3 months ago


Question: Accessing AWS ENRON dataset

"I am trying to access and use this enron dataset for academic research: https://aws.amazon.com/datasets/enron-email-data/.I tried to create an EBS volume and connect it with the dataset using the snap id listed on the page. However, I am not able to find this snap id when I try to create the EBS volume. I am not sure whether I am doing it the right way or whether there are other ways to access the dataset. Please guide me.FollowComment"

Answer: 0What region are you working in? The snapshot is available in us-east-1 (North Virginia).CommentShareEXPERTBrettski-AWSanswered a year ago


Question: Glue with MySQL clean cache

"Glue is needed to grab new data for processing, but Glue keeps grabbing cached data, which leads to an error that prevents us from processing it.Glue source table comes from MySQL and can be found in MySQL.Through Transform SQL (same SQL) in Glue Job, but this data is not seen in Data Preview.Results Error occurred after execution, and the execution time was extremely long.What's the reason?FollowComment"

Answer: 0Accepted AnswerThe issue there is that the DataPreview keeps trying to connect to the data catalog of the region but seems the job is running in a VPC without Glue endpoint.CommentShareGonzalo Herrerosanswered 25 days agoEXPERTFabrizio@AWSreviewed 24 days ago


Question: Generating Parquet files from Glue Data Catalog

"I have a glue job that write to a Data Catalog.  In the Data Catalog I originally set it up as CSV, and all works fine.  Now I would like to try to use Parquet for the Data Catalog.  I thought I would just have to re-create the table and select Parquet instead of CSV, so I did so like so:CREATE EXTERNAL TABLE `gp550_load_database_beta.gp550_load_table_beta`(  `vid` string,  `altid` string,  `vtype` string,  `time` timestamp,  `timegmt` timestamp,  `value` float,  `filename` string)PARTITIONED BY (  `year` int,  `month` int,  `day` int)ROW FORMAT SERDE  'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe'STORED AS INPUTFORMAT  'org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat'OUTPUTFORMAT  'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat'LOCATION  's3://ds905-load-forecast/data_store_beta/'TBLPROPERTIES (  'classification'='parquet')I left my glue job unchanged.  I have it sending its output to the Data Catalog Table like so:    additionalOptions = {"enableUpdateCatalog": True, "updateBehavior": "LOG"}    additionalOptions["partitionKeys"] = ["year", "month", "day"]        # Data Catalog WRITE    DataCatalogtable_node2 = glueContext.write_dynamic_frame.from_catalog(        frame = dynamicDF,        database = db_name,        table_name = tbl_name,        additional_options=additionalOptions,        transformation_ctx = "DataCatalogtable_node2",    )When I checked the files being created by the Data Catalog in s3://ds905-load-forecast/data_store_beta/, they look to just be CSV.  What do I need to do to use Parquet? Can I just change the sink routine to use glueContext_write_dynamic_frame.from_options()?FollowComment"


Question: Does Amazon Translate glue words together for you too?

"I am experiencing an issue with Amazon Translate where words in the translated text sometimes get glued together (i.e. spaces between them are dropped).  The bug affects some but not all target languages; unfortunately English is among those affected. It correlates with the presence of paired HTML tags in the source text, and is reliably reproducible when the entire multi-word string is surrounded by a pair of HTML tags like

: it is precisely the first two words after the opening tag that get glued together. The bug affects both realtime and batch translation in any document format. Realtime example:Since in general I don't speak the language I am translating into, and there are typically hundreds such buggy cases per translation job, the output is effectively useless. Is anyone else experiencing this issue? Has anyone managed to overcome it?FollowComment"

Answer: "2I reproduced your case, and have submitted a feedback entry on the console.At the moment I'd suggest you to translate the text without the HTML tag. Which gives you a better result for your use case, like Marrick mentioned above.Another alternative is running a grammar check after receiving the translated text.CommentShareMia Canswered 10 months agoSUPPORT ENGINEERMonica_Lluisreviewed 9 months agoRulatir 10 months agoWe need to translate large collections of HTML fragments. Nothing short of Amazon actually fixing the bug will work for us.ShareRulatir 6 months agoAny progress?Share1Hey! It seems like you've stumbled on a fairly interesting bug. I've managed to reproduce the issue using the CLI, which shows that this is a bug with Translate itself not just the Console:Translate seems to handle other kinds of brackets fine, but angled brackets definitely trip it up a little bit. According the Translate API doucumenation, strings with angled brackets should be supported. However, angle brackets are used to specify do-not-translate tags and so this issue likely lies with the implementation of this feature.Anyways, it sounds like you may be trying to translate HTML documents specifically? If so, you may find the example code for translating a web page useful: https://docs.aws.amazon.com/translate/latest/dg/examples-web.html. Instead of translating the raw HTML, it uses an HTML parser to only translate the text parts of the page while leaving the tags unchanged.Hope that helps!Marrick.CommentShareMarrickanswered 10 months agoRulatir 6 months agoWe have considered the "translate whole pages" approach in the beginning, and decided against it. Our requirement is that we translate CMS content exhaustively, not just some selected partial views of the content (i.e. "pages"). We crawl the CMS database and extract strings into a catalog, then we upload it to localise.biz, and before switching to machine translation we would just hand the localise.biz project to a human translator. Now we still want to have the catalog on localise.biz for human intervention, but we now export XLIFF from there and batch-translate. It used to work; the bug is new.Share"


Question: Deployment package size limit exceeded while deploying Chalice Application

I am using Chalice as backend for my application but due to n number of dependency to install the package that Chalice is building while deploying .zip file is crossing 50 MB which exceeds the allowed limit of lambda function. I tried to implement the same with setting "automatic_layer": true in config file or enabling layer also that was not working. As i am relaying on Chalice to build and deploy my application I am not able to find a way out to deploy the application using Chalice. What should I do?FollowComment

Answer: "0The best place to get assistance would be on the chalice github repository. Looking at some of the open issues, there are feature requests like container support to work around the package size limit and it doesn't seem to be supported. In general, you would want to try reducing the number of dependencies (maybe use a tool other than chalice) to reduce the package size or find a way to create a container image with the chalice app to work around the size limit.Packaging Python Lambda functions with only the dependencies they need.Support for container images #1598CommentShareTaka_Manswered 5 months ago"


Question: AWS DMS migration task doesn't automatically increment the source table

"I'm trying to perform a basic AWS DMS migration of Amazon RDS MySQL to Amazon Aurora MySQL. The data from the source table has been successfully copied, and I performed an alter table on the database, which auto incremented the primary key. However, whenever data was inserted in to the database, the target hadn't been updated. Is there any configuration within the data replication task that will allow me to do this? Or is this something that needs to be done manually?FollowComment"

Answer: "0Accepted AnswerIt isn't recommended to use AWS DMS or mysqldump to transfer a schema. This approach can cause issues such as the one you're experiencing, where a column marked as auto_increment did not transfer over successfully.CommentShareorlyandicoanswered 3 years ago"


Question: HIVE_PARTITION_SCHEMA_MISMATCH - Athena error on S3 Parquet file

"Getting below error while querying S3 parquet file from Athena. The schema has changed from timestamp to string for one of the columns, is there any workaround to have the latest schema changed to string (Alter table and msck repair table didn't work).HIVE_PARTITION_SCHEMA_MISMATCH: There is a mismatch between the table and partition schemas. The types are incompatible and cannot be coerced. The column 'birth_year' in table 'curated_ndb_datapipeline.registered_nurse' is declared as type 'timestamp', but partition 'data_year=2021/prov_terr_reg=959' declared column 'birth_year' as type 'string'FollowComment"

Answer: 0If all partitions have the same schema with the column defined as string and only the table has the column defined as timestamp you could try to:run a Glue crawler and see if it correctly updates the tableuse the Glue APis to update the column data type where needed (if it is only at table level you could consider to do it in the console).hope this helps.CommentShareEXPERTFabrizio@AWSanswered a year ago


Question: LightSail as a managed service for hosting of 1000 WordPress sites?

My customer is managing on-prem infrastructure for hosting of ~1000 WordPress sites.Currently they are evaluating an option to start using cloud based managed service for that purpose.I'm wondering if I can position LightSail for that?Thanks in advanceFollowComment

Answer: 0Accepted AnswerLightsail is generally for smaller projects and has limited scaling capabilities (it now has a simplified load balancer but no autoscaling). Personally a better option is to use ElasticBeanstalk as it give you the advantage of not having to fully manage the underlying ec2 infrastructure but comes with Autoscaling and ALB access. It also allows for blue green deployment and detailed monitoring and scaling features. If the customer is planning to host 1000s of wordpress sites then they will want to have access to all the monitoring/scaling automation that are out there.Here is the tutorials on hosting wordpress on elastic beanstalk:https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/php-hawordpress-tutorial.htmlhttps://aws.amazon.com/getting-started/hands-on/build-wordpress-website/CommentShareEXPERTagardezianswered 3 years ago


Question: How to subscribe to IoT core using MQTT uri

"Hey,I need to connect a remote application to IoT core. Using Mqtt i'll need an URI but where do i find this uri? or how would this uri look like ? and which port should i use ?FollowComment"

Answer: "2Hi,you can find your AWS IoT Core endpoint in the AWS IoT management console under Settings or with the DescribeEndpoint API.You can use the AWS CLI to call this API: aws iot describe-endpoint --endpoint-type iot:Data-ATS.Please take a look at device communication protocols for the support ports.Cheers,PhilippCommentSharePhilipp Sanswered 4 months ago"


Question: Route53 - TLD - .at Austria TLD domain

"Hi AWS Team,we would love to also transfer our Austria domain nebenan.at to Route53. Unfortunately .AT TLDs are not supported at the moment.Austria is a country in the center of Europe with 9M residents and tons of .AT domains.Thanks in advanceSebastianFollowComment"

Answer: "0Hello, thank you for reaching out.I understand that you are requesting to support ".at" TLD registration on Route 53.Route 53 Domains is currently directly accredited with .com, .net, and .org registries. All other TLDs are provided via third party registrar associates. To improve our level of service and support, we are actively working to become directly accredited with all other TLDs. In addition to improving our existing offering, we will become accredited with other registries to expand our TLD catalog. This work is currently in progress. We do not currently have dates to share for adding new TLDs.You can monitor the updates here at AWS Blogs - https://aws.amazon.com/blogs/aws/ and what's new on AWS - https://aws.amazon.com/new/CommentShareAustin_Lanswered 10 months ago"


Question: Connecting a Desk Phone to Amazon Connect without Third-Party Phone Services (SIP Providers) Exploring the Option of Building a SIP Server on AWS"

"I'm overhead on this project, I want to explore the possibility of using a Desk Phone with Amazon Connect without relying on any third-party phone services (SIP providers). I am wondering if it is feasible to achieve this goal by building a server on AWS. If it is, could you please guide me on the necessary steps and resources required to set it up? My Amazon Connect is already running with a 1-800 number with 5 agents.The example of what I want is:Customer Calls ==> 1-800-123-123 => Amazon Connect answers and transfers to "Queue" saying "Wait while I connect you to an agent". (This feature, I already have, ok?)Now, while Amazon Connect plays the Prompt and song, I want to transfer this customer to a "Extension" on a Desk Phone. ex: 2026 (instead of using a phone number on CCP "Desk Phone"). I want it automatically.My thoughts are: How to integrate Amazon Connect (1-800-123-123) com um Server (whatever it is) to work with extensions.(This is what I need to do)My project is(My customer has 16 stores around the U.S)Customer Calls 1-800-123-123Listen to the Prompt (Welcome... Press 1, 2, 3...)Customer Choose 3The Call automatically forwards to the "Store 3" (Extension: 2026) which is located in Los AngelesThe agent answers the call and interacts with the customer.I really appreciate your help.#AmazonAWS #AmazonConnect #DeskPhoneIntegration #SIPProviders #ServerSetup #CallRouting #ExtensionRouting #VirtualQueue #AutoForwarding #CallCenter #CustomerService #CloudTelephony #AWSArchitecture #AWSImplementation #Lambda #DynamoDB #EC2 #CustomerServiceFollowComment"

Answer: "1Hey there!If I understand your use case correctly, you can use a Transfer to Phone Number block as part of your contact flow. This supports sending DTMF tones, which can help in reaching the right extension. This would initiate an outbound call from Amazon Connect to an external phone number, like a desk phone at one of your locations.Happy building!CommentShareEXPERTAWS-samfredanswered a month ago1The desk phone mode for the agent CCP only works over the PSTN, and that connection is handled inside of the Connect, as managed service. What you are trying to build is not supported in Connect today.CommentShareMagdaanswered a month ago0Let say as example:I have a Asterisk with FreePBX running on Ubuntu, which I already have a SIP Server and Desk Phones configured and working as extensions. Also I already have the Amazon Connect running with a Toll-Free Number 1-800 and I want to connect the customer with one of my extensions on Asterisk FreePBX.Is it possible integrate Amazon Connect with my Asterisk with FreePBX? if so, in which way should I look for? remembering I want to keep everything on AWS.I already heard about Lambda Function,  Amazon Chime SDK, DynamoDB table.I don't know actually to where I should looking for to get it done.Thank you allCommentShareTiagoanswered a month agoAWS-samfred EXPERTa month agoHi Tiago, Magda's comment below is right. Amazon Connect only accepts PSTN connections inbound to our service, and outbound. For outbound, it can either be the transfer to phone number block as I described above for unattended transfers as part of a contact flow, or if it is agent based, CCP desk phone settings. There is no SIP integration for our service as of today.Share0Hi AWS-samfred,I already have the "Transfer to Phone Number" feature on and works perfectly, but what I need is, inside the same "path" be able to deal with extensions on Desk Phone (such as Polycom or Grandstream, Yealink ) (configured with SIP Server), So I don't need to have a CCP, or App on.Thank you for your help.CommentShareTiagoanswered a month ago"


Question: Syncing up a specific schema between two RDS Tables (postgres)

"HiCurrently we have two dbs in AWS RDS (Postgres). One for Demo (Internal Testing) and another for beta environment. Both dbs have a schema called "strapi" which contains common data to display to user. Our use case is that whenever the admin updates the strapi data in demo db, it should reflect in beta as well. So I was searching for AWS services that supports our use case.Searched for similar questions and I found people recommending AWS DMS. So went ahead and created endpoints and initially ran the task with "Do Nothing" option for Target Table Preparation Mode.Later ran the full load task with "Truncate" option for Target Table Preparation Mode .The task failed with following error"RetCode: SQL_ERROR  SqlState: 0A000 NativeError: 1 Message: ERROR: cannot truncate a table referenced in a foreign key constraint; Error while executing the query [1022502]  (ar_odbc_stmt.c:4828). Failed to truncate table strapi.programs [1022502]  (odbc_endpoint_imp.c:4372)"Tried setting session_replication_role parameter to replica on target database in RDS and still getting the same error. Any help would be appreciated.Note: I still am not sure whether AWS DMS is a good service for our use case.Thanks in Advance.FollowComment"

Answer: "0Accepted AnswerFound the solution. The solution is to manually drop foreign key constraints before full load and recreating them once migration task is over.A simple script to drop foreign key constraints (Taken from https://dba.stackexchange.com/a/97047)create table if not exists dropped_foreign_keys (        seq bigserial primary key,        sql text);do $$ declare t record;begin    for t in select conrelid::regclass::varchar table_name, conname constraint_name,            pg_catalog.pg_get_constraintdef(r.oid, true) constraint_definition            from pg_catalog.pg_constraint r            where r.contype = 'f'            -- uncomment the below line for current schema only:            -- and r.connamespace = (select n.oid from pg_namespace n where n.nspname = current_schema())        loop        insert into dropped_foreign_keys (sql) values (            format('alter table %s add constraint %s %s',t.table_name, t.constraint_name, t.constraint_definition));        execute format('alter table %s drop constraint %s', t.table_name, t.constraint_name);    end loop;    end $$;And to recreate the dropped foreign key constraintsdo $$ declare t record;begin    -- order by seq for easier troubleshooting when data does not satisfy FKs    for t in select * from dropped_foreign_keys order by seq loop        execute t.sql;        delete from dropped_foreign_keys where seq = t.seq;    end loop;end $$;CommentShareGanesh Mohanrajanswered a year ago"


Question: Nvidia Driver R515 does not work on P3 instance types

"I have loaded the Nvidia drivers on a CentOS 7 AMI from Nvidia's RPM repositories. In the past this was loading the R510 drivers and they were working on P3 instances with V100 GPUs, but earlier this month they updated the repository to R515 and those drivers are not recognizing the V100 GPUs in the P3 instances. I have some on-premise nodes with a different model of V100 and the R515 drivers work there so the problem appears to only be with AWS instances. I have tried opening a bug report with Nvidia, but have not gotten a response yet.Can anybody else reproduce this issue or have I messed up something? If this is indeed an issue with the new driver then any tips on getting Nvidia to fix it? Or is it a problem specific to AWS instances that AWS needs to fix?FollowComment"


Question: AWS Dev 1.8.1 Missing XILINX_SDK env var for sdaccel_setup.sh

"Hello,I recently moved over to the new 1.8.1 FPGA Developer AMI from 1.7.0 and I'm trying to get started with the SDAccel OpenCL hello world tutorial listed in the aws-fpga git to make sure everything is working. When I source the sdaccel_setup.sh script I get the following error:ERROR: XILINX_SDX variable not set and sdx not in the pathERROR: Please set XILINX_SDX variable to point to your location of your Xilinx installation or add location of sdx exectuable to your PATH variableI can see in my path that the following directories are added to my path automatically:/opt/Xilinx/Vitis/2019.2/bin:/opt/Xilinx/Vivado/2019.2/binHowever sdx is not in my path and I can see that it doesn't appear to be in the bin folders of Vivado or Vitis. On the 1.7.0 version of the AMI XILINIX_SDX equates to the following directory: /opt/Xilinx/SDx/2019.1.op2552052 which isn't available.  The tutorial in the GitHub just states to source sdaccel_setup.sh and there's no mention of a SDX install.Is there some way to fix this or is it just missing and I need to install it?FollowComment"

Answer: "0Accepted AnswerHello,From 2019.2 on-wards, Xilinx has launched Vitis in replacement of SDAccel. Our 1.8.x AMI's onwards will thus include Vitis.Our Github has been updated to use the Vitis tool-flow and you can find the instructions here: https://github.com/aws/aws-fpga/tree/master/VitisTo go through older SDAccel tutorials, you would need the 1.7.0 AMI.I hope this helps.-DeepCommentShareDeep_Panswered 3 years ago0Ah I see thank you for the information. I was unaware that they were going to replace SDAccel completely.CommentSharecfaberanswered 3 years ago"


Question: Do I need to Transfer My Domain?

My Domain is Hosted with Godaddy. I have set word press up on light sail and now want to set my domain name purchased from godaddy. Do I need to transfer the domain over?FollowCommentPhindi a year agoIt is recommend that you transfer management of your domain's DNS records to Lightsail. This allows you to efficiently administer your domain and compute resources together in one place. https://lightsail.aws.amazon.com/ls/docs/en_us/articles/lightsail-how-to-create-dns-entryI hope that will help.Share

Answer:
"0Hello,

There is no need to transfer the domain over. You can create an A record from your domain name provider  point it to the Public IP of the site hosted in LightSail.
Even though it is recommended that you transfer management of your domain's DNS records to Lightsail. This allows you to efficiently administer your domain and compute resources together in one place . This guide[1] shows you how to create a Lightsail DNS zone for your domain, and how to transfer management of your domain's DNS records to Lightsail. After transferring management of your domain's DNS records to Lightsail, you will continue to manage renewals and billing for your domain at your domain's registrar. The following document [2] shows you how to to point a domain to an Amazon Lightsail instance using Amazon Route 53 .

References
[1] https://lightsail.aws.amazon.com/ls/docs/en_us/articles/lightsail-how-to-create-dns-entry
[2] https://lightsail.aws.amazon.com/ls/docs/en_us/articles/amazon-lightsail-using-route-53-to-point-a-domain-to-an-instance

I hope the Information above helps. Feel free to reach out for any concerns.

 Thank youCommentSharePhindianswered a year ago"


Question: Glue processing a csv

I am having a csv file on a s3 bucket and using a glue crawler to have a table created on Athena. The table gets created but the data gets messed up. The values gets shifted to the adjacent columns for some of the records. Is there any way to mitigate this? Does glue work fine for csv files or do the files need to be converted to a paruqet or json.FollowComment

Answer: "0Accepted AnswerGlue should work fine with CSV or any other delimited format. When you mentioned "some records", can you validate that the csv row corresponding to those records are well-formatted ?You can compare how Glue perform by using EMR Hive to create a s3-backed table.CommentSharewijayahanswered 3 years ago"


Question: Metatrader 5 crashing on t2-micro

"Hello people, how are you?I'm not able to run Metatrader 5 on t2-micro.. I manage to install the metatrader all right but when I go to put the brokerage account it hangs and is not responding.. Does anyone know if there is any more specific configuration that I need to do to be able to run it this application correctly?Thanks a lot in advance..FollowComment"


Question: Do HTTP APIs have same IAM integrations as REST APIs?

"Regarding the newly announced simplified HTTP APIs for API Gateway, do they include the same IAM integrations as traditional REST APIs?For example, when adding permissions to invoke a Lambda to the API Gateway service, are HTTP API supported with the same service principals (--principal apigateway.amazonaws.com --source-arn "arn:aws:execute-api:..."), etc?FollowComment"

Answer: 0Accepted AnswerYes the same IAM integrations apply for HTTP APIs as for REST APIs. The same IAM integrations apply for controlling access to API endpoints (HTTP and REST) as well as invoking backend AWS services like Lambda.More specifically you can refer to this public blog post for HTTP APIs and adding permissions to invoke a Lambda function that is integrated with an HTTP API endpoint:Don’t forget that you will need to add a Lambda resource policypermission to the function to allow API Gateway to invoke yourfunction. For example:aws lambda add-permission--statement-id dd0dffb7-971e-5952-9699-38493cf34293--action lambda:InvokeFunction--function-name "arn:aws:lambda:us-west-1:[your account number]:function:Echo"--principal apigateway.amazonaws.com--source-arn "arn:aws:execute-api:us-west-1:[your accunt number]:[your gateway id]/"CommentShareEd Sanswered 3 years ago


Question: How to get AWS Lambda Function URL string in code

"Hi,Is there a way to get the AWS Lambda Function URL string (or the bits to construct it) programmatically from the running instance of the Lambda itself?I tried the below options and neither of them had the necessary URL:checked the input object in handleRequest(Object input, Context context)checked the items in System.getenv()ThanksFollowComment"

Answer: "0Accepted AnswerI am not sure why would you need the URL from within the function itself, but you can call the Lambda.get_function_url_config API to get the string you need.CommentShareEXPERTUrianswered 2 months agorePost-User-8467086 2 months agoAs I mentioned in the above comment, the AWS Lambda is used with 2 events (periodic scheduled and Function URL request) and the periodic event need to send the Function URL endpoint to the external system, so the external system can send updates to the Function URL.SharerePost-User-8467086 2 months agoI'm accepting this as the answer since it allows me to gather the necessary details of a given AWS Lambda resourceShareUri EXPERT2 months agoI would probably create two functions. The first function is the one that is triggered on a schedule. The second function is the one withe function URL. The first function receives the function URL of the other function as an environment variable. You can create both functions in a single SAM template and there you can reference the URL in the env variables using something like 'Fn::GetAtt: HelloWorldFunctionUrl.FunctionUrl'.Share0The function URL domain and path are present as a part of the event object when the function is triggered from a function URL. You can see the event payload format here [1]. The function URL can be seen in full at event.requestContext.domainName, or just the UUID at event.requestContext.domainPrefix. You could also get it from event.headers.host.[1] Invoking Lambda function URLs - Request payload format - https://docs.aws.amazon.com/lambda/latest/dg/urls-invocation.html#urls-request-payloadCommentShareKevin_Canswered 2 months agoEXPERTBrettski-AWSreviewed 2 months agorePost-User-8467086 2 months agoYes, I know that these details are available from when triggered as a Function URL, however; that's too late for getting the domain or host details for me. I use the (same) AWS Lambda in 2 distinct ways:periodically triggered based on cron defined schedule as AWS Lambda. This may kick off an HTTP request to an external system to run some async background processing which will later send updates  back to the AWS Lambda Function URL - thus I need to know the Function URL up front so the external system knows where to send updates to.triggered by incoming request as a Function URL. This will receive the external system generated update.Yes I can hardcode the Function URL host in code but since the AWS Lambda can be "configured" with a Function URL, I would have expected that this configuration is available through some sort of generic "event" object or at least as part of the system environment.ShareKevin_C 2 months agoIn that case you would just need to use the API to retrieve it. You can grab the function ARN from the context object or the function name from environment variables and use that to call the GetFunctionUrlConfig API which will return all of the information related to your function URL. In Boto3 for example: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/lambda/client/get_function_url_config.htmlShare"


Question: Transfer some instance ownership

"Here is the situation:Lets say my organization use 10 VM EC2 instancesCan I transfer the ownership of 5 VM EC2 instances into a different organization or personal account?I am trying to avoid migration, because these 5 instance are production instance.Thanks!FollowComment"

Answer: "1Short answer: No.While you can transfer a whole account to a different organization you can't transfer EC2 instances between accounts. In this case, you can't transfer part of an account - only the whole account so you will need to look at some type of migration process. You might consider the Application Migration Service.CommentShareEXPERTBrettski-AWSanswered 2 months agoEXPERTalatechreviewed 2 months ago1To expand on Brettski-AWS answer.As Brettski-AWS mentioned you can only migrate whole accounts between AWS Organisations or update/transfer ownership to another individual or organisation, which moves all resources in the accounts.By transfer ownership I assume you mean move them to a separate AWS account. There are a few ways to achieve this:AWS Application Migration Service: https://aws.amazon.com/application-migration-service/Share the AMI: https://repost.aws/knowledge-center/account-transfer-ec2-instanceShare EBS Snapshot: https://repost.aws/knowledge-center/share-ebs-volumeIn all cases this will allow you to move the data and re-provision the compute instance, but will require changes to networking, e.g. Security Groups, Elastic IP's and Elastic Load Balancers. Also note that Tags should be captured and verified / re-applied as well.If you do complete progress with this look at using CloudFormation (https://aws.amazon.com/cloudformation) to provision the new instances so they can be managed as code going forward, which will make future migrations / updates easier.CommentShareRobanswered 2 months ago"


Question: Upgrade to python > 3.9 on Cloud 9

"My current Cloud9 environment has Python 3.7.16, I need to upgrade to 3.8 and up. How do I do it? Thank you.FollowComment"

Answer: "0What operating system does Cloud9 use?Amazon Linux2 vagy Ubuntu?I think a good way to upgrade is to add pyenv and switch from 3.7 to 3.9.For example, if you are on Amazon Linux2, execute the following command.git clone https://github.com/pyenv/pyenv.git ~/.pyenvcat << 'EOT' >> ~/.bashrcexport PATH="$HOME/.pyenv/bin:$PATH"eval "$(pyenv init -)"EOTsource ~/.bashrcsudo yum -y updatesudo yum -y install bzip2-develsudo yum -y install xz-develpyenv install 3.9.13pyenv global 3.9.13Also, since Cloud9 seems to have a Python alias set by default, please set the following command in "~/.bash_profile".export PATH="$HOME/.pyenv/shims:$PATH"You can confirm that the version changes by executing the following command after setting.source ~/.bash_profilepython --versionCommentShareEXPERTRiku_Kobayashianswered a month ago0I always upgrade with ...wget https://www.python.org/ftp/python/3.9.9/Python-3.9.9.tgztar -xf Python-3.9.9.tgzcd Python-3.9.9./configure --enable-optimizationssudo make altinstallCommentShareARBRanswered a month ago"


Question: Different layouts of Shanghai Sudu track

I just noticed there are two quite different Shanghai Sudu track layouts.One is offered when creating a new model (AWS DeepRacer > Reinforcement learning > Create model) and labeled as Shanghai Sudu Training.The other is offered on virtual circuit page (AWS DeepRacer > DeepRacer Virtual Circuit > Shanghai Sudu) and labeled just as Shanghai Sudu.Does it mean that the models are trained on a one track and then compete against each other on a different one?FollowComment

Answer: "0Accepted AnswerYou can't train directly on the virtual circuit tracks.Each race in the circuit has its own new competition track that you cannot directly trained on.  This is to prevent people from just overfitting a model on the trainable track to get the best time.  The virtual circuit will resemble the matching trainable circuit, but will be changed just enough to ensure your model needs to be generalized.CommentShareaychanganswered 4 years ago"