Question: Starting targeted instances during a maintenance window?

"I have a small resource group (5 instances), and there's a weekly script I would like to run on all 5 of them. They start automatically when their users need to interact with them, and stop automatically when idle for 30 minutes. (Similar to a Cloud9 IDE environment, but not managed by Cloud9.) The maintenance window is scheduled for a time when they would all be stopped. There is no reliable time when I know for sure that they would all be running.When the weekly maintenance window rolls around, I would like SSM to start the instances, run the shell script on them, and then stop them. I thought I had managed it, by creating a maintenance window with three tasks:Priority 10: AUTOMATION task using the AWS-StartEC2Instance documentPriority 20: RUN_COMMAND task using the AWS-RunShellScript documentPriority 30: AUTOMATION task using the AWS-StopEC2Instance documentAll three tasks specify the resource group as the target, and {{RESOURCE_ID}} as the InstanceId parameter.The problem is that each task only runs on instances that are already running when the maintenance window starts, which would seem to make the AWS-StartEC2Instance automation kind of pointless. When there are no instances running, each task has a status of No invocations to execute.I could certainly use an EventBridge rule with a Lambda to make sure the instances are up and running, and then just have the RunShellScript task in the maintenance window. But the use case I described above seems like it would be a no-brainer easy thing to accomplish, so I'm concerned I'm just missing something simple. Any suggestions?FollowComment"

Answer: "0Hello mbklein,Thank you for reaching out with your query.Below are the common possible reasons for this issue:No defined maintenance window targetsNo resource id is present.When required policies are not correct.For tasks which require unique identifiers for input. if there are no targets, the task will report back that there are no invocations to execute, as there were no inputs.To troubleshoot the issue, I performed this scenario in my internal lab and was able to successfully perform below mentioned tasks.AUTOMATION task using the AWS-StartEC2Instance documentRUN_COMMAND task using the AWS-RunShellScript documentAUTOMATION task using the AWS-StopEC2Instance documentPlease refer to the steps I performed below:Scenario1: When instances are already in stopped stateCreate a tag for your instance i.e. (Name = Department Value = Dev)Create a Resource Group [1], for group type select "Tag based"For resource types select "AWS::EC2::Instance"Next select the tag key (Department) and value (Dev)After the Resource Group is created, you can create a Maintenance Window and register the target with the Maintenance WindowOn Maintenance Window go to “Actions” > “Register targets”Select "Choose a resource group"Select the Resource group you created earlierThen click on “Register Target”Then click on "Actions" dropdown ->"Register Automation taskNext under Automation document-> "AWS-StartEC2Instance"Under Targets choose "Selecting registered target groups" and then select the Windows target IDFor Input parameters > "InstanceIDs" input parameter, Add all instance IDs separated by comma which you have mentioned in resource group. for example : i-abc********, i-def********For Input parameters > "AutomationAssumeRole" input parameter, input the role that you have configured for AutomationBelow is the AutomationAssumeRole policy I used in my lab:AutomationAssumeRole:Trust Entity{"Version": "2012-10-17","Statement": [{"Sid": "","Effect": "Allow","Principal": {"Service": "ssm.amazonaws.com "},"Action": "sts:AssumeRole"}]}Inline Permission Policy:{"Version": "2012-10-17","Statement": [{"Sid": "VisualEditor0","Effect": "Allow","Action": ["ec2:StartInstances","ec2:StopInstances","ec2:DescribeInstanceStatus"],"Resource": "*"}]}For IAM service role :To create  IAM service role, Please follow below stepsGo on IAM Dashboard and click on create RolesUnder "Select trusted entity" click on "Custom trust policy" and add below mentioned policy{"Version": "2012-10-17","Statement": [{"Sid": "","Effect": "Allow","Principal": {"Service": ["ec2.amazonaws.com   ","ssm.amazonaws.com   "]},"Action": "sts:AssumeRole"}]}Click on nextIn Permissions add below three policiesNote: a) and b) are AWS Managed policies. You can easily search for them but for c) you need to create inline policya) AmazonSSMMaintenanceWindowRoleb) AmazonSSMFullAccessc) IAMPassRolePolicy: For IAMPassRolePolicy add below mentioned inline policy{"Version": "2012-10-17","Statement": [{"Effect": "Allow","Action": "iam:PassRole","Resource": "*","Condition": {"StringEquals": {"iam:PassedToService": "ssm.amazonaws.com   "}}}]}You can also follow the AWS video tutorial to know more about Maintenance windows or IAM service role.[+]https://www.youtube.com/watch?v=aR02m1Xsz1E&t=113sPlease repeat above steps for AWS-StopEC2Instance document and AWS-RunShellScript document.Scenario 2: When Instances are already in running stateThe above steps allowed me to successfully execute all the three above mentioned document in a Maintenance Window in both the scenarios.Additionally, After following above steps if issue still exists then I would request you to open a case under our support team for further troubleshooting as we need to check all the associated resources to troubleshoot it further.References[1] https://docs.aws.amazon.com/ARG/latest/userguide/resource-groups.htmlCommentShareSUPPORT ENGINEERNikunj-Ganswered 8 months agombklein 8 months agoThank you for these steps. I notice there's one incomplete sentence that looks kind of important:For Input parameters > "InstanceIDs" input parameterWhat is the value that's supposed to go in the InstanceIDs input parameter when targeting a resource group?Share0Thank you for pointing this out.Add all instance IDs separated by comma which you have mentioned in resource group.for example : i-abc********, i-def********CommentShareSUPPORT ENGINEERNikunj-Ganswered 8 months ago"


Question: API definition for ModelBiasMonitor and ModelExplainabilityMonitor

Where can I find the actual references to API definitions and descriptions for ModelBiasMonitor and ModelExplainabilityMonitor Classes?I can a find a few mentions in the Amazon SageMaker documentation in the following links.https://sagemaker.readthedocs.io/en/stable/api/inference/model_monitor.htmlhttps://sagemaker-examples.readthedocs.io/en/latest/sagemaker_model_monitor/fairness_and_explainability/SageMaker-Model-Monitor-Fairness-and-Explainability.htmlWhere can I find the actual reference and the code implementation for these Classes?FollowComment

Answer: 0Accepted AnswerThe actual reference to the classes can be found here:https://github.com/aws/sagemaker-python-sdk/blob/master/src/sagemaker/model_monitor/clarify_model_monitoring.py It encapsulates the definitions and descriptions for all of SageMaker Clarify related monitoring classes.CommentShareEXPERTVikesh_Panswered 2 years ago


Question: EMR Serverless Custom Image not running

"Hi Team,I wanted to run spark application built using JDK 11 on EMR Serverless. Since the default image does not have support of JDK 11, I created the custom image based on following links:Use case 2 : https://aws.amazon.com/ru/blogs/big-data/add-your-own-libraries-and-application-dependencies-to-spark-and-hive-on-amazon-emr-serverless-with-custom-images/https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/using-custom-images.htmlThis is the content of my DockerFile ( I have M1 Mac)FROM--platform=linux/amd64 public.ecr.aws/emr-serverless/spark/emr-6.9.0:latestUSER root# install JDK 11RUN sudo amazon-linux-extras install java-openjdk11# EMRS will run the image as hadoopUSER hadoop:hadoopAfter uploading the image on ECR, I created the EMR Serverless application (x86_64) using the same custom image.Next I tried submitting the job with my jar built with JDK 11, however, it failed with following error:The job run failed to be submitted to the application or it completed unsuccessfully.Then, as per the above mentioned second link, I tried giving these two spark configuration while configuring the job:--conf spark.executorEnv.JAVA_HOME=/usr/lib/jvm/java-11-openjdk-11.0.16.0.8-1.amzn2.0.1.x86_64 --conf spark.driverEnv.JAVA_HOME=/usr/lib/jvm/java-11-openjdk-11.0.16.0.8-1.amzn2.0.1.x86_64I am still getting the below error:Job failed, please check complete logs in configured logging destination. ExitCode: 1. Last few exceptions: Caused by: java.lang.UnsupportedClassVersionError: <ClassName> has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0\nException in thread \"main\" java.lang.BootstrapMethodError: java.lang.UnsupportedClassVersionError: <ClassName> has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0...-- Update--I have also tried running the job by specifying JAVA_HOME in configurations like this:{  "applicationConfiguration": [    {      "classification": "spark-defaults",      "configurations": [],      "properties": {        "spark.driverEnv.JAVA_HOME": "/usr/lib/jvm/java-11-openjdk-11.0.18.0.10-1.amzn2.0.1.x86_64",        "spark.executorEnv.JAVA_HOME": "/usr/lib/jvm/java-11-openjdk-11.0.18.0.10-1.amzn2.0.1.x86_64"      }    }  ]}Am I missing any step?RegardsTapanFollowComment"

Answer: "0Accepted AnswerI am able to run my jar in JDK11 environment. The correct driver environment variable for JAVA_HOME is spark.emr-serverless.driverEnv.JAVA_HOME.Also, the latest JDK that gets deployed is of version : java-11-openjdk-11.0.18.0.10-1.amzn2.0.1.x86_64 and applicationConfiguration is not important.CommentShareTapan Sharmaanswered 21 days ago"


Question: AWS to have an AI interface for console management

"When will AWS have an AI interface? I am thinking something like a chatbot that I tell it what to do such as create a vpc, create a rest api, create lambda function ect.?FollowComment"


Question: Access to the Risk tables

"Hi,I am unable to access table "Risk_model_user"."All_diss", even through I am  a cia & s_cia user.getting error as :Permission denied on S3 path: s3://<s3_bucket_name>This query ran against the "risk_models_user" database, unless qualified by the query. Please post the error message on our forum  or contact customer support  with Query Id: 96d89bfb-6691-4eab-9abb-0b67cb3f06dcFollowComment"

Answer: 0Please open a case with AWS Premium Support and provide all the resource details there for further investigation. For future reference - please refrain from posting any of the AWS resource ARNs on the public forum.CommentShareMeghana_Sanswered a year ago


Question: What software to install on the MediaLive

"Hello,I want to start streaming using the MediaLive.Tell me please, for receiving, processing and transmitting a stream, I need to install third-party software, for example, OBS for Linux?Or is this done with own tools MediaLive, SDK or another software?FollowComment"

Answer: "0Accepted AnswerBased on your requirements, it does looks like vMix Call Pro Edition would work for you. They have a free watermarked demo version to try outLink: https://youtu.be/opgJTvV4dHULink: https://www.vmix.com/products/vmix-call.aspxThey also have a Multi-view demo here:Link:https://www.youtube.com/watch?v=tvl6v1GX_-ASounds like a fun project!-randyCommentShareRandyTakeshitaanswered 4 years ago0Setting Up the Upstream - The upstream system must be capable of sending a video stream to MediaLive via RTP/RTMP and the stream must be redundantly sent to two different IP addresses.You can setup 3rd party tools, such as OBS Studio as a contribution encoder using RTMP push to MediaLive.Link: https://aws.amazon.com/blogs/media/connecting-obs-studio-to-aws-media-services-in-the-cloud/Processing and transmission of streams can be done within the AWS ecosystem:o Set up OBS Studio as a contribution encoder using RTMP pusho Configure AWS Elemental MediaLive to receive an incoming contribution stream and encode it into a set of adaptive bitrate (ABR) streamso Configure AWS Elemental MediaPackage to connect to AWS Elemental MediaLive outputs, for further processing and packaging, to create a channel that can be viewed on connected devicesO Use the AWS Elemental MediaPackage endpoint as an origin for a CDN such as Amazon CloudFrontAdditional info:Link: https://docs.aws.amazon.com/medialive/latest/ug/getting-started.htmlHope this helps.-randyCommentShareRandyTakeshitaanswered 4 years ago0Great!!! Thanks!!!I read, very useful for my first steps.And a bit more, do I understand correctly, to deliver the stream to Youtube/Twitch it will come from AWS Elemental MediaPackage?CommentShareomega92answered 4 years ago0Both YouTube and Twitch live streaming utilize RTMP, which can be handled completely within AWS MediaLive (i.e. MediaPackage is not required).Also, if you want to Live stream just to YouTube or just to Twitch, you probably don't need AWS MediaLive. However, if you want your Live Stream to broadcast both to YouTube and Twitch concurrently, that is when OBS with AWS MediaLive will become useful.More about when you would consider using AWS MediaPackage with MediaLive:AWS Elemental MediaLive is deeply integrated with AWS Elemental MediaPackage so customers can easily combine live encoding with content origination, dynamic packaging, and live-to-VOD capabilities. To configure an AWS Elemental MediaLive channel with AWS Elemental MediaPackage, simply create a channel with AWS Elemental MediaPackage to get a destination address, then select HLS WebDAV as the output for your AWS Elemental MediaLive channel profile and add the destination address. With AWS Elemental MediaPackage you can create output groups for multiple delivery protocols like HLS and DASH, add DRM and content protection, and a live archive window for DVR-like features.Link: https://aws.amazon.com/mediapackage/faqs/Edited by: rtakeshi on Aug 4, 2019 10:39 AMCommentShareRandyTakeshitaanswered 4 years ago0Sorry, I had to describe my task.We will have from 1 to 6 sources (gamer with OBS) from which we must receive streams, merge them into one and send them concurrently to Twitch and YouTube. Is there enough MediaLive for this task?that is when OBS with AWS MediaLive will become usefulShould I install an OBS (Linux version) on a MediaLive and use it to configure and send a stream? Did I understand you correctly?Thanks for your help!CommentShareomega92answered 4 years ago0From my understanding,OBS will allow multi-cam, but only allows switching between cameras, not combining live streams.OBS is setup on its own server and will push its live stream over RTMP to AWS Elemental MediaLiveAWS Elemental MediaLive is NOT mixing software, it will take in one live video feed and can send the feed to concurrently to YouTube and Twitch.For your architecture, I would recommend researching vMix + AWS Elemental MediaLiveLink: https://www.vmix.comvMix will allow allow you to receive/merge input streams into one. vMix will also allow you to send the output stream to both Twitch and YouTube. However, because live streaming does take up significant bandwitch and CPU, it may result in lagging. That is where AWS Elemental MediaLive will possibly help by taking in the Live video stream from vMix and then sending the stream concurrently to both Twitch and YouTube.Hope this helps.-randyCommentShareRandyTakeshitaanswered 4 years ago0omega92Can you please elaborate on the requirement of merging the 6 feeds into a single feed that you can then send to Twitch & YouTube? What do you mean by needing to "merge" the 6 feeds into one? Does this have to happen in real-time?Within MediaLive you have the capability of creating multiple inputs and attaching them to a single MediaLive channel. Using the MediaLive Schedule (https://docs.aws.amazon.com/medialive/latest/ug/working-with-schedule.html), you can then select any one of the inputs to be used to create the MediaLive output.  Using the Input Switch schedule action you can set a schedule, e.g. switch to Input 1 at time A, switch to input 2 at time B, etc.Also, please note that you can't install any SW on the MediaLive instance. You will have to install OBS upstream of MediaLive so that they can send content via OBS to MediaLive.RegardsCommentShareAWS-User-5437070answered 4 years ago0Thank you for your help, now I will describe the task in detail.We hold World of Tanks tournaments, two versus two and a commentator works on the match. The commentator has the main source with OBS and there are 4 sources from the players webcams. I need to put four sources from webcams on the main source, so that it looks like in the picture and send it in one stream simultaneously to YouTube and Twitch.https://imgur.com/7CGoUuWWill the MediaLive help me with this task or am I misrepresenting the tasks for which it is needed?CommentShareomega92answered 4 years ago0Very cool program, thanks! I will research it.I in the message above described my task in detail, please see. Does it really look like vMix?CommentShareomega92answered 4 years ago0omega92Unfortunately MediaLive does not have to capability to do picture-in-picture (PIP) as shown in your screenshot example. This will have to be done upstream of MediaLive.As for what type of device/SW solution you would need upstream of MediaLive:You would need a solution that can accept as input the different player sources, then create a scene with main video and PIP overlays, and then send this content via either RTP with FEC, or RTMP to MediaLive. Perhaps someone on the forum will know of such a solution and would be willing to make a recommendation for you.RegardsCommentShareAWS-User-5437070answered 4 years ago0You would need a solution that can accept as input the different player sources, then create a scene with main video and PIP overlays, and then send this content via either RTP with FEC, or RTMP to MediaLive.And the MediaLive will receive the stream and help him transfer it simultaneously to Twitch/Youtube?CommentShareomega92answered 4 years ago0Thank you very much for the help!))CommentShareomega92answered 4 years ago0omega92Yes, from a single MediaLive channel you can stream to both YouTube and Twitch at the same time.RegardsCommentShareAWS-User-5437070answered 4 years ago0Ypu can Stream from OBS to AWS Elemental MediaLive which is simple.Learn more about it : https://www.apps4rent.com/obs-open-broadcaster-software-streaming-hosting/CommentShareAdrianG001answered 3 years ago0For an AWS blog post on streaming from OBS, see https://aws.amazon.com/blogs/media/connecting-obs-studio-to-aws-media-services-in-the-cloud/CommentShareAWS-User-5437070answered 3 years ago"


Question: VMWare: AWS Backup to on-premise virtual machine restore

"I've backed up 7 on premise VMs to AWS using AWS Backup. By all indications the 7 machine backups were completed successfully 2 days in a row. In attempting to restore a single VM from AWS back to on premise, the error is given:"Invalid request detected during virtual machine creation. Aborted restore job"A solution isn't apparent in the documentation:https://aws.amazon.com/blogs/storage/backup-and-restore-on-premises-vmware-virtual-machines-using-aws-backup/Can anyone offer some clues as to how to troubleshoot through this?Thank you in advance.Vcenter version: 8.0.0.10000Hypervisor VMware ESXi, 7.0.0FollowCommentrePost-User-8645854 7 months agoThank you kindly for answering the question.The documentation indicates the supported version of VMware ESXi is 7.0, which is what we have.The documentation does not seem to address the version of vCenter. Does the version of vCenter matter? Is there any indication of when vCenter 8.x might be supported?Thank you in advance for your guidance.Share"

Answer: "1Hello - Have you successfully restored to a 7.x vCenter? 8.x is not listed as supported.https://docs.aws.amazon.com/aws-backup/latest/devguide/vm-backups.html#supported-vmsCommentShareEXPERTPatrick Kremeranswered 7 months agoPatrick Kremer EXPERT6 months agoAddressing your followup questions - I submitted a documentation update request to also state supported vCenter versions. You don't configure the gateway to connect to ESXi hosts, you configure the gateway to connect to a vCenter Server, so the version does matter.I do not have a timeline for when vCenter 8 will be supported.SharerePost-User-8645854 6 months agoThank you kindly for your follow up note. The additional information is very helpful.Share"


Question: RDS Option Group - Oracle EE TDE

"Hello Community,I am currently learning for the aws database specialty exam/certificate.In my online courses and in the aws documentation for the rds option groups it specifies that you cannot remove permanent options from an option group.https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithOptionGroups.htmlPermanent options, such as the TDE option for Oracle Advanced Security TDE, can never be removed from an option groupBut In my test I was able to delete that permanent option "TDE" from the (disassociated) option group.Is that by design for unused option groups or is the documentation not specific enough?Thanks in advance.HeikoFollowComment"

Answer: "0Accepted AnswerHi Heiko,Permanent options can be removed as long as there are no DB instances or snapshots associated with the option group.You wrote that you had the option group already disassociated; in that case, removing the permanent option worked as designed.In my opinion, what doesn't come across 100% clear in the documentation (the link you've given) is that once you set such an option, it becomes permanent for the database. If you wanted to associate another option group to this database, it must have the (permanent) TDE option in it as well.As a side note, the help text of the AWS Console says so.HTH,UweCommentShareUwe  Kanswered 4 months ago0Hi Uwe,thanks four your answer.SincerelyHeikoCommentShareHeikoMRanswered 4 months agoUwe  K 3 months agoYou're welcome and all the best for your exam!BTW, I wonder whether the exam questions really reflect this particularity. But I suppose they assume a (more typical) setup where associated DBs or snapshots still exist. However, if you should encounter a discrepancy between your observations above and a related exam question, please give a feedback to the training&certification team.Share"


Question: Setting report_host on MySQL/MariaDB RDS instance for replication from external host

How do you set report_host / report-host on a MySQL or MariaDB RDS instance for replication from an external source? Or something that will appear in show replicas.FollowComment

Answer: "0Hi,This issue has been tracked internally with our service team. Currently, we do not have a way to set this parameter since RDS is managed service with some limitations.If you want to track issue further, you may also reach to us through support case or you may raise feature request from console:navigate lower left corner--> click Feedback --> click feature request which should reach to service team directly.CommentShareSUPPORT ENGINEERKevin_Zanswered a year ago"


Question: Extract details from an ID (Not US based ID)

"Hi, I am currently exploring AWS services for a project (KYC Processing) and I would like to know if I can extract data from an ID (Ex: Driver License). Textract already provide this service but it only allow US Driver License and Passport. Is there any way I can do so that it can also cater driver license from other country?WHAT I KNOW:Use Textract Analyze IDUse AWS Rekognition text to image service (It can be used, but what I want to do is return a key-value pair for the details and the service only returns the text)QUESTIONS:For #1, It only supports US Driver License and Passport. Is there any way I can customize it so it could also read driver license from different countryFor #2, I can create a custom label, train my model, and it can identify the details from the ID. Is there any way I can also extract it, not just provide a bounding box on it?If I am going to use a custom label, what is the required quantity of the dataset to make my custom model accurate? Should I use different ID's of different persons or a multiple image of the same ID but with different cases (Different Angle, Different lighting, or Different position on the image).FollowComment"

Answer: "0Accepted AnswerIn order to extract the data for a non-US ID or Driving license you can use Textract Queryhttps://docs.aws.amazon.com/textract/latest/dg/API_Query.htmlPlease check this example for the UK (dummy sample),as you can see in the example, I used "what is the DATE in 3." or "what is the COUNTRY in 3." to extract the correct subfield in the row main field "3."Using this feature of Textract together with Rekognition Custom Labels to recognize the type & country of the ID , you can leverage a Step Function logic flow for your problem.Note that Rekognition Text detection is mostly used for road signs, logos and not for document intelligent OCR (Optical Character Recognition) extraction, therefore Textract is a best fit.[Please accept my answer if you consider it helped you]CommentShareAlexRanswered 2 months ago"


Question: OpenSearch Dashboards Index Pattern and Discover issues

"I've loaded 1600+ JSON files via the Bulk API into an OpenSearch domain and have verified that via the Developer Tools console. Now I wanted to use the _dashboards interface to create an index pattern and then use the 'Discover' option to search. I'm following the instructions from here --> https://docs.aws.amazon.com/opensearch-service/latest/developerguide/gsgsearch.htmlI am able to successfully create the index pattern, but then when I click on 'Discover', it takes me to the 'Create Index Pattern' screen again. Hopefully there is something trivial that I've overlooked.  Thanks.FollowComment"

Answer: "0The "fix" to this was deleting the domain, re-creating, and reloading the data. Worked fine after doing that.CommentSharemdkailanswered a year ago"


Question: Http Api 403 error from gateway troubleshooting

"I am trying to invoke a HTTP API gateway endpoint and I am getting the below error message with status code of 403.I am using  Authorization token generated using accekey, secretkey. I signed the API request using aws sig4. Is there any way to more logs on further troubleshooting the issue{"message":"Forbidden"}Using same Accesskey/Secret I was able to make a postman call but not able to make a request from jmeterFollowCommentJason Butz 6 months agoAre you certain jmeter isn't adding additional HTTP Headers that aren't included when generating the signature? I believe all or most of the HTTP Headers need to be factored into the signature.Share"

Answer: "0Some quick checks you can verifyCheck for any missing values for your User Defined Variables like  AWS access key, secret key, host, service name and region as applicableCheck for proper header names with valuesCommentShareEXPERTAWS-User-Nitinanswered 6 months ago"


Question: AWS EC2 free tier-storage and CPU upgrade

HiI signed in for EC2 free instance. I set 100GB as the storage now I see when I need to upload some big size data like 1.4 GB the app stores it in .tmp folder and says there is not space left on server.how can I increase the storage and CPU on this instance ?Also when I check on server using df -H it still says /dev/root as 8 GBThanksFollowComment

Answer: "0Not sure if you have attached more volume or using theInstances that use Amazon EBS for the root device automatically have an Amazon EBS volume attached. When you launch an Amazon EBS-backed instance, we create an Amazon EBS volume for each Amazon EBS snapshot referenced by the AMI you use. You can optionally use other Amazon EBS volumes or instance store volumes, depending on the instance type. After you attach an Amazon EBS volume to your instance, it is exposed as a block device. You can format the volume with any file system and then mount it. After you make the EBS volume available for use, you can access it in the same ways that you access any other volume. Any data written to this file system is written to the EBS volume and is transparent to applications using the device.For volume modification please refer https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/modify-volume-requirements.html which states requirements for root and non-root volumeChanging the instance type of your EC2 Linux instance allows you to change the following:Number of CPU coresAmount of RAMAmount of assigned instance store spaceAmazon Elastic Block Store (Amazon EBS) optimizationReference :https://aws.amazon.com/premiumsupport/knowledge-center/resize-instance/https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/modify-volume-requirements.htmlhttps://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-using-volumes.htmlCommentShareEXPERTAWS-User-Nitinanswered 6 months ago0Please keep in mind, for Free Tier instance size, it's only for the default volume size. If you've increased the volume it's no longer going to be in the free tier for the storage backing it.If you increased the storage after creating the instance you will need to go into Linux and extend the volume.https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/recognize-expanded-volume-linux.htmlCommentShareEXPERTRob_Hanswered 6 months ago"


Question: Provision SSO user via Cloudformation AWS::SageMaker::UserProfile is not working

"I have issue that when running a CloudFormation stack with AWS::SageMaker::UserProfile in it, it did create the user profile under sagemaker domain, but when I tried to login to the sagemaker with the specified user via SSO, it always got rejected and saying the user is not added to the domain.While if I add the user manually with AWS Console GUI, it works. So I suspect it's an issue of CloudFormation with AWS::SageMaker::UserProfile resource.And I also found this github issue https://github.com/aws-cloudformation/cloudformation-coverage-roadmap/issues/1128Could someone help me confirm it? Or I misunderstand something?FollowComment"

Answer: "1The symptoms you are describing aligns to the github issue.  Are you able to workaround this issue by manually associating the same User referenced via CloudFormation User Profile with the Domain. Ignore the error you will see when doing this action, but internally it will call AssociateProfile API.  Also, can you confirm whether you are using domainID in the CloudFormation template:UserProfile:    Type: AWS::SageMaker::UserProfile    Properties:       DomainId: !GetAtt StudioDomain.DomainId      UserProfileName: !Ref UserProfileName      UserSettings:        ExecutionRole: !GetAtt SageMakerExecutionRole.ArnCommentShareEXPERTHrushi_Ganswered a year agoAWS-User-0013679 a year agoI did use the domainId in my clouformation, here is the code snippet, but I'll also tried the workaround to see if it works.  UserXXX:    Type: AWS::SageMaker::UserProfile    Properties:      DomainId: !Ref Domain      SingleSignOnUserIdentifier: UserName      SingleSignOnUserValue: xxx@yyy.com      UserProfileName: xxx-yyy-com      UserSettings:        ExecutionRole: !GetAtt DomainDefaultExecutionRole.ArnShare"


Question: [Video Tutorial] Upload your Game Build to AWS GameLift

"https://www.youtube.com/playlist?list=PLjd5NhkT3LsiVfXFj1bUfN11j6LVQop9eSaw questions about using GameLift, and though these are not Lumberyard specific, thought I'd share them here in case they can be of help. Featuring our very knowledgable gaming SA @REDACTEDUSERThe playlist consists of 7 parts:Uploading the Build PackageCreating a FleetConfiguring your FleetAnalyzing Server MetricsHandling Server Software UpdatesControlling Latency & CostsScaling your ServersFor Lumberyard specific questions, those are on my roadmap for 2020.FollowComment"


Question: EBS initialize cost horribly long time

"I restored a 4TiB EBS volume(provisioned IOPS 16000, throughput 500MB/s) from a snapshot, and copying the data in the block to the instance store of the ec2 (I need the data to be in the instance store, and I think this can also be regarded as a initialize process.)There's around 2.5TiB data to be copied, and copying has lasted over a week, while the disk's latency is still too high and the throughput is just 3~5MiB/s:I know that a new restored EBS volume from snapshot is lazy loading but I also read from this blog post that there's a background process keeps doing this:https://aws.amazon.com/blogs/storage/addressing-i-o-latency-when-restoring-amazon-ebs-volumes-from-ebs-snapshots/The replicated volume loads data in the background so that you can begin using it immediately. If you access data that hasn’t been loaded yet, the volume immediately downloads the requested data from Amazon S3, and then continues loading the rest of the volume’s data in the backgroundMay I know how this background process works exactly? Since my initializing process(the copying process) is ongoing as well, will this background job runs as well?FollowComment"

Answer: 0The overall process works based on disk access. You can try and initialize it faster by hitting every  block of the disk to attempt to load it faster. Otherwise it may be beneficial for you to look into FRS https://aws.amazon.com/blogs/aws/new-amazon-ebs-fast-snapshot-restore-fsr/CommentShareEXPERTRob_Hanswered 6 months agocifer 6 months agoCould you elaborate more on "The overall process works based on disk access"?  How it based on disk access? I know the FRS mechanism but just want to know how the initilize works in background when we use the disk normally.Share


Question: AWS_PLATFORM error

"Hello, please help for the below issue.I meet the AWS_PLATFORM error for building a project on AWS machine, please see below error:ERROR: [v++ 60-1258] No valid platform was found that matches 'AWS_PLATFORM'. Please make sure that the platform is specified correctly, and the platform has the right version number. The platform repo paths are:/home/ubuntu/aws/aws-fpga/Vitis/aws_platform/xilinx_aws-vu9p-f1_shell-v04261818_201920_2/tools/Xilinx/Vitis/2019.2/platformsThe valid platforms found from the above repo paths are:/home/ubuntu/aws/aws-fpga/Vitis/aws_platform/xilinx_aws-vu9p-f1_shell-v04261818_201920_2/xilinx_aws-vu9p-f1_shell-v04261818_201920_2.xpfm/tools/Xilinx/Vitis/2019.2/platforms/xcvc1902_fixed/xcvc1902_fixed.xpfmwhen I check the ENV I get:$ echo $PLATFORM_REPO_PATHS/home/ubuntu/aws/aws-fpga/Vitis/aws_platform/xilinx_aws-vu9p-f1_shell-v04261818_201920_2$ echo $AWS_PLATFORM/home/ubuntu/aws/aws-fpga/Vitis/aws_platform/xilinx_aws-vu9p-f1_shell-v04261818_201920_2/xilinx_aws-vu9p-f1_shell-v04261818_201920_2.xpfmSo where is the problem? I already set the correct AWS_PLATFORM name and the correct PLATFORM_REPO_PATHS. but Vivado still complain that  No valid platform was found that matches 'AWS_PLATFORM'.FollowComment"

Answer: "0Accepted AnswerI suspect you forgot the $ in front of AWS_PLATFORM when running you make command.The proper command should be:make check TARGET=hw DEVICE=$AWS_PLATFORMCommentShareThomasXilinxanswered 3 years ago0OK I just find a solution, if I use the below command to build, there will be no error report, build can be done..make check TARGET=hw DEVICE=xilinx_aws-vu9p-f1_shell-v04261818_201920_2So the AWS_PLATFORM (which is generated by sourcing vitis_setup.sh I think) is not correct?CommentSharemacleonshanswered 3 years ago"


Question: AWS Transfer Family - SSH Key Pair

"Hi all:We are using the AWS Transfer Family service as our SFTP service.Currently, we are generating a ssh key pairs for our vendors and add the public keys to the vendor account while creating the vendor accounts.We are transferring the private keys to the vendors and with this they are able to log onto the account.Let me know if this is the right approach or not.One of the vendor says that transferring private key is not safe and asking us for the public key.If I provide him the public key and have the public key attached to the account within AWS Transfer family, he is getting authentication error.Should we send them the public key or private key? Is it safe to send them the private key?Also, if he has  key pair generated, is it okay if I have his public key attached to the account?Can someone who is an expert in this area clear my confusion.Appreciate any help in this.Regards!VenkataFollowComment"

Answer: "0Hello Venkata,In terms of security best practices, sharing a Private Key is not recommended. As the name suggests, the Private Key should be kept private to the user who generated them and not shared with anyone.Concerning SSH Key authentication, the server holds the Public Key whereas the client holds the Private Key. Authentication succeeds when the client uses the Private key which is compared against its corresponding Public Key on the server. This is why in the first case, authentication succeeded when you shared the Private Key with your vendor. When you share the Public Key with your vendor, the authentication process will fail as you cannot use a Public Key against a Public Key. Therefore the behavior that you observed when you shared the Public Key is expected.To your questions specifically:Q: Should we send them the public key or private key?A: If your vendor is going to connect to your server, the vendor should have the Private Key while you/server should have the Public Key.Q: Is it safe to send them the private key?A: It depends on how you share the Private Key, however it is not recommended and not a best practice approach as there is always a chance of security breach during sharing confidential keys.Q: Also, if he has key pair generated, is it okay if I have his public key attached to the account?A: Yes, there are no issues in having a corresponding Public Key. As the name implies, they are public information.With that said, the best approach would be to have your vendor create the SSH Keys and share the Public Key with you. You can then add the Public Key to your server and the authentication should succeed when they use the corresponding Private Key.Let me know if you have questions.Regards,SagarCommentShareEXPERTsagarb-awsanswered 2 years ago0Thanks Sagar for sharing the information.CommentSharevenkata99answered 2 years ago"


Question: Create API Gateway Using Terraform

"Hi,I am trying to create API Gateway with two methods PUT and POST using Terraform. Here is my code:Simply I want to create below methods under same API gateway using terraform but getting errorPut - /events/updatetags/{object_id}Post - /events/wafacl/add_ipsetNot sure, how to handle stage when creating more than one method using Terraform. Code works for one method.Error:│ Error: creating API Gateway Stage (dev): ConflictException: Stage already exists│ │   with module.api_gateway.aws_api_gateway_stage.events_waf_apig_stages,│   on api_gateway/main.tf line 389, in resource "aws_api_gateway_stage" "events_waf_apig_stages":│  389: resource "aws_api_gateway_stage" "events_waf_apig_stages" {Terraform Coderesource "aws_api_gateway_rest_api" "events_apig" {  name = "demo-events-handler-apig-${var.environment}"  api_key_source = "HEADER"  endpoint_configuration {    types = ["REGIONAL"]  }}resource "aws_api_gateway_resource" "events_apig_resources_event" {  rest_api_id = aws_api_gateway_rest_api.events_apig.id  parent_id = aws_api_gateway_rest_api.events_apig.root_resource_id  path_part = "events"  # path = "/events"}resource "aws_api_gateway_resource" "events_apig_resources_updatetags" {  rest_api_id = aws_api_gateway_rest_api.events_apig.id  parent_id = aws_api_gateway_resource.events_apig_resources_event.id  path_part = "updatetags"  # path = "/events/updatetags"}resource "aws_api_gateway_resource" "events_apig_resources_objectid" {  rest_api_id = aws_api_gateway_rest_api.events_apig.id  parent_id = aws_api_gateway_resource.events_apig_resources_updatetags.id  path_part = "{object_id}"  # path = "/events/updatetags/{object_id}"}resource "aws_api_gateway_request_validator" "updatetag_request_validator" {  name = "updatetag_request_validator"  rest_api_id = aws_api_gateway_rest_api.events_apig.id  validate_request_body = true  validate_request_parameters = false}resource "aws_api_gateway_method" "events_apig_method" {    authorization = "AWS_IAM"    http_method = "PUT"    resource_id = aws_api_gateway_resource.events_apig_resources_objectid.id    rest_api_id = aws_api_gateway_rest_api.events_apig.id    # api_key_required = ""    request_parameters = {      "method.request.header.x-key" = true    }    request_validator_id = aws_api_gateway_request_validator.updatetag_request_validator.id    # request_models = { "application/json" = "${aws_api_gateway_model.demos_event_requestbody_model.name}"}}resource "aws_api_gateway_integration" "integration_updatetags" {    # demos_event_handler_invoke_arn  http_method = aws_api_gateway_method.events_apig_method.http_method  resource_id = aws_api_gateway_resource.events_apig_resources_objectid.id  rest_api_id = aws_api_gateway_rest_api.events_apig.id  integration_http_method = "POST"  type = "AWS_PROXY"  request_templates = {}  uri = var.demos_event_handler_invoke_arn}resource "aws_api_gateway_method_response" "events_response_200" {  rest_api_id = aws_api_gateway_rest_api.events_apig.id  resource_id = aws_api_gateway_resource.events_apig_resources_objectid.id  http_method = aws_api_gateway_method.events_apig_method.http_method  response_models = {}  status_code = "200"}resource "aws_api_gateway_integration_response" "integration_updatetags_response" {    depends_on = [      aws_api_gateway_integration.integration_updatetags    ]    rest_api_id = aws_api_gateway_rest_api.events_apig.id  resource_id = aws_api_gateway_resource.events_apig_resources_objectid.id  http_method = aws_api_gateway_method.events_apig_method.http_method  status_code = aws_api_gateway_method_response.events_response_200.status_code  response_templates = {}}resource "aws_api_gateway_deployment" "integration_updatetags_deploy" {      rest_api_id = aws_api_gateway_rest_api.events_apig.iddepends_on = [    aws_api_gateway_resource.events_apig_resources_objectid  ]  triggers = {    redeployment = sha1(jsonencode([        aws_api_gateway_resource.events_apig_resources_objectid.id,        aws_api_gateway_method.events_apig_method.id,        aws_api_gateway_integration.integration_updatetags.id,    ]))  }    lifecycle {    create_before_destroy = true  }}resource "aws_api_gateway_stage" "events_apig_stages" {      deployment_id = aws_api_gateway_deployment.integration_updatetags_deploy.id  rest_api_id   = aws_api_gateway_rest_api.events_apig.id  stage_name    = var.environment}# @ PATH:Update Tags# @Consumer: ServiceNowresource "aws_api_gateway_resource" "waf_events_apig_resources" {  rest_api_id = aws_api_gateway_rest_api.events_apig.id  parent_id = aws_api_gateway_resource.events_apig_resources_event.id  path_part = "wafacl"  # path = "/events/wafacl"}resource "aws_api_gateway_resource" "waf_events_apig_resources_objectid" {  rest_api_id = aws_api_gateway_rest_api.events_apig.id  parent_id = aws_api_gateway_resource.waf_events_apig_resources.id  path_part = "add_ipset"  # path = "/events/wafacl/add_ipset"}resource "aws_api_gateway_request_validator" "add_ipset_request_validator" {  name = "add_ipset_request_validator"  rest_api_id = aws_api_gateway_rest_api.events_apig.id  validate_request_body = true  validate_request_parameters = false}resource "aws_api_gateway_method" "waf_events_apig_method" {    authorization = "AWS_IAM"    http_method = "POST"    resource_id = aws_api_gateway_resource.waf_events_apig_resources_objectid.id    rest_api_id = aws_api_gateway_rest_api.events_apig.id    # api_key_required = ""    request_parameters = {      "method.request.header.x-servicenow" = true    }    request_validator_id = aws_api_gateway_request_validator.add_ipset_request_validator.id    # request_models = { "application/json" = "${aws_api_gateway_model.demos_event_requestbody_model.name}"}}resource "aws_api_gateway_integration" "waf_event_api_integration" {    # demos_event_handler_invoke_arn  http_method = aws_api_gateway_method.waf_events_apig_method.http_method  resource_id = aws_api_gateway_resource.waf_events_apig_resources_objectid.id  rest_api_id = aws_api_gateway_rest_api.events_apig.id  integration_http_method = "POST"  type = "AWS_PROXY"  request_templates = {}  uri = var.gateway_publicip_handler_invoke_arn}resource "aws_api_gateway_method_response" "waf_events_response_200" {  rest_api_id = aws_api_gateway_rest_api.events_apig.id  resource_id = aws_api_gateway_resource.waf_events_apig_resources_objectid.id  http_method = aws_api_gateway_method.waf_events_apig_method.http_method  response_models = {}  status_code = "200"}resource "aws_api_gateway_integration_response" "waf_integration_response" {    depends_on = [      aws_api_gateway_integration.waf_event_api_integration    ]    rest_api_id = aws_api_gateway_rest_api.events_apig.id  resource_id = aws_api_gateway_resource.waf_events_apig_resources_objectid.id  http_method = aws_api_gateway_method.waf_events_apig_method.http_method  status_code = aws_api_gateway_method_response.waf_events_response_200.status_code  response_templates = {}}resource "aws_api_gateway_deployment" "waf_integration_deploy" {      rest_api_id = aws_api_gateway_rest_api.events_apig.iddepends_on = [    aws_api_gateway_resource.waf_events_apig_resources_objectid  ]  triggers = {    redeployment = sha1(jsonencode([        aws_api_gateway_resource.waf_events_apig_resources_objectid.id,        aws_api_gateway_method.waf_events_apig_method.id,        aws_api_gateway_integration.waf_event_api_integration.id,    ]))  }    lifecycle {    create_before_destroy = true  }}resource "aws_api_gateway_stage" "events_waf_apig_stages" {  deployment_id = aws_api_gateway_deployment.waf_integration_deploy.id  rest_api_id   = aws_api_gateway_rest_api.events_apig.id  stage_name    = var.environment}FollowComment"

Answer: "0Accepted Answer@alatech and @iBehr thanks for quick reply.I think, I found the solution and it worked nicely. There is  no such example in official documentation.Here is updated deployment block. We can list as multiple methods and respective resource and integration in trigger redeployment so it can deploy the all methods at same stage.resource "aws_api_gateway_deployment" "waf_integration_deploy" {      rest_api_id = aws_api_gateway_rest_api.events_apig.iddepends_on = [    aws_api_gateway_resource.waf_events_apig_resources_objectid  ]  triggers = {    redeployment = sha1(jsonencode([        aws_api_gateway_resource.resource1.id,        aws_api_gateway_method.method1.id,        aws_api_gateway_integration.integration1.id,        aws_api_gateway_resource.resource2.id,        aws_api_gateway_method.method2.id,        aws_api_gateway_integration.integration2.id,    ]))  }    lifecycle {    create_before_destroy = true  }}resource "aws_api_gateway_stage" "events_waf_apig_stages" {  deployment_id = aws_api_gateway_deployment.waf_integration_deploy.id  rest_api_id   = aws_api_gateway_rest_api.events_apig.id  stage_name    = var.environment}CommentSharesnowcoder_07answered 14 days ago0Looks like you are trying to create two stages with the same name.resource "aws_api_gateway_stage" "events_apig_stages" {  deployment_id = aws_api_gateway_deployment.integration_updatetags_deploy.id  rest_api_id   = aws_api_gateway_rest_api.events_apig.id  stage_name    = var.environment}andresource "aws_api_gateway_stage" "events_waf_apig_stages" {  deployment_id = aws_api_gateway_deployment.waf_integration_deploy.id  rest_api_id   = aws_api_gateway_rest_api.events_apig.id  stage_name    = var.environment}Both of these resources are creating stages with the name set to the value of var.environment.  Stage names have to be unique so the second attempts fails.  You should be able to remove it and just refer to aws_api_gateway_stage.events_apig_stages.id.Hope this helps!CommentShareEXPERTiBehranswered 21 days agosnowcoder_07 21 days agoHi @iBehrThanks for reply. I tried with one block i.e. first block but after terraform apply when I looked at API Gateway, I do not see second method under API => Stages.I had to re-deploy API manually to same stage i.e. Dev to see both methods. I am sure, I am missing something here. Terraform documentation does not help much in this case.Share0Hi,apart from removing the stage, can you try using the below deployment?resource "aws_api_gateway_deployment" "my_api_gw_deployment" {  rest_api_id = aws_api_gateway_rest_api.my_api_gw.id  triggers = {    redeployment = sha1(jsonencode(aws_api_gateway_rest_api.my_api_gw.body))  }  lifecycle {    create_before_destroy = true  }}Hope it helps ;)CommentShareEXPERTalatechanswered 20 days ago"


Question: Media Convert - PCR/PMT Period consistency

"Hi. Is possible to generate a TS file with consistent PCR/PMT Period?Currently I am setting "PCR control" = CONFIGURED_PCR_PERIOD, "PAT interval"=100, "PMT interval" = 100, and "Max PCR interval" = 100.However, the transcoded video file has the following PCR period.97 ms, 97ms, 62ms, 34ms, 99ms, 95ms, 84ms, 12ms, 97ms... 96ms, 85ms, 11msThanksFollowComment"

Answer: "0Accepted AnswerThank you for the clarification. I hope AWS can add new optino/feature to force a consitent PCR/PMT interval in the future.Thanks.CommentSharerePost-User-0596720answered a year ago0HelloCurrently, mediaconvert has no option/feature to force a consistent PCR interval. it only has the ability  to set the maX PCR intervals as you has tested it out.From the output test you had, i reckon you are using a VBR/QVBRAnd the specification on Measurement and analysis of the MPEG-2 Transport Stream  ETR 101 290states in section 5.2.2 that PCR Accuracy tests should only be performed on constant bit rate transport streams.Hope it helps!CommentShareAWS-User-6819265answered a year ago0Hi. Thank for your answer. I am using the MPEG-2 TS Container Bit Rate Mode to CBR (Constant) and CBR for Video ES Bit Rate Mode for my preset. I am not expecting a consistent PCR period interval for MPEG-2 TS VBR Bit Rate Mode.Thanks.CommentSharerePost-User-0596720answered a year ago0HelloThanks for the update and clarification.For CBR mode ,  unfortunately, mediaconvert still has no option/feature to force a consistent PCR interval.Regards,CommentShareAWS-User-6819265answered a year ago"


Question: Connecting to LightSail with MySQL Connector ODBC

"I am using a Ubuntu image on Lightsail, and created a mariaDB database for my LAMP application. However, I am getting an error when trying to use MySQL Connector/ODBC to connect to the database from my Windows 10 laptop.[MySQL][ODBC 8.0(w) Driver] Can't connect to MySQL server on '(IP address)' (10060).My concern is that the LightSail console (database tab) says I don't have any databases. Yet, I have already created that mariaDB database and restored a mysqldump and the database is working just fine.Do I need to recreate my database somehow, or register my existing database with the LightSail Console/Database tab somehow?To connect Filezilla to my Lightsail instance, I had to use the security keys. Do I have to use them now?Thank you in advance.ZoomiestEdited by: zoomiest on Jun 15, 2019 3:33 AMEdited by: zoomiest on Jun 15, 2019 3:34 AMEdited by: zoomiest on Jun 15, 2019 3:35 AMFollowComment"

Answer: "0Where did you create the schema? In your Ubuntu instance mariaDB server or in a Lightsail managed database?If the database tab in Lightsail says there are no databases, then you don't have a managed database.If you created the schema in your Ubuntu instance, then you'll need to open port 3306 for the instance in order to connect.CommentShareDavid Ganswered 4 years ago0Thank you, David.  I have opened port 3306 using the Security interface in LightSail.I see an error made in my questions. The error message is actually 10061, instead of 10060.So, I am still not connecting. Still getting:[MySQL][ODBC 8.0(w) Driver] Can't connect to MySQL server on (IP Address) (10061):.When I do a netstat, MySQL seems to be listening on 3306, but I don't know about those zeros for an IP...ubuntu@host:/$ netstat -plutn(Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.)Active Internet connections (only servers)Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    tcp        0      0 127.0.0.1:3306          0.0.0.0:*               LISTEN      -                   tcp        0      0 127.0.0.53:53           0.0.0.0:*               LISTEN      -                   tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      -                   tcp6       0      0 :::80                   :::*                    LISTEN      -                   tcp6       0      0 :::22                   :::*                    LISTEN      -                   udp        0      0 127.0.0.53:53           0.0.0.0:*                           -                   udp        0      0 172.26.6.174:68         0.0.0.0:*                           -Further, I went into MySQL and granted privileges from any IP address... (less secure, I know)# GRANT ALL ON database.* TO 'user'@'%' IDENTIFIED BY 'password';Any thoughts? I continue to wonder about the AWS Lightsail platform, as i am unfamiliar with it... Any platform-specific hurdles I am missing?CommentSharezoomiestanswered 4 years ago0Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    tcp        0      0 127.0.0.1:3306          0.0.0.0:*               LISTEN      -      ```The netstat output identifies the problem.You have the database server configured to listen on 127.0.0.1, which means it will only listen to clients running on that machine.You'll need to change your /etc/my.cnf file ...[mysqld]bind-address    = 0.0.0.0Also, if the my.cnf file shows 'skip-networking', comment that out.davidCommentShareDavid Ganswered 4 years ago0THANK YOU DAVID!We are in, now!CommentSharezoomiestanswered 4 years ago"


Question: Query Id: 21dd9f51-192f-48c9-ad82-5dc2bc87ca20

"I am trying to create a view but the error I am facing is the query keeps timing out. But if I run the query without trying to save the view, It has no errors and runs successfully.FollowComment"

Answer: "0Please follow this linkhttps://docs.aws.amazon.com/athena/latest/ug/views.htmlmaybe it is related with your permissions, or limitations etc.CommentShareEXPERTsdtslmnanswered 12 days ago"


Question: Lambda Automation

"I'm working on some POC to migrate applications from on-premise to AWS.What can I automate using Lambda if I deploy and manage workloads on the Amazon EKS cluster (ELB/ECR/RDS)? I'm thinking of different use cases. Thanks.FollowCommentMaulik_Makadiya a year agoHi,It really depends on your requirement and what type of automation you really needs.Lambda functions could be triggers on many services and its like a sea.If you can explain your idea and challenges then we can answer in better way.ThanksShareAWS-User-5291433 a year agoA few automation I have done before like Creating ec2 snapshots, checking ec2 health, sending notifications. I'm not sure in this case.ShareMonica_Lluis SUPPORT ENGINEERa year agoHello AWS-User-5291433, has your issue been resolved? Please let us know by posting and answer.  Thank you for your participation in AWS re:Post community.Share"

Answer: 0This question was answered live in great detail at twitch https://www.twitch.tv/aws/video/1420471067.CommentShareSUPPORT ENGINEERMonica_Lluisanswered a year agoEXPERTRob_Hreviewed a year ago


Question: Cannot install Visual Studio

When I run the setup assistant it says I need Visual Studio 2013 or 2015.Visual Studio 2015 has no "get it" link and I cannot find a download for it (thanks MS).Visual Studio 2013 has a "get it" link which is currently broken.Thanks for any help.Follow

Answer: "0Accepted AnswerYou can get it, it's just not easy to find. Go to here:https://www.visualstudio.com/dev-essentials/Once, you've signed up for an account search the downloads list for visual studio 2015 SP3 (community version as it's free). It takes a while to hit the right link but it's there, I've already mentioned they need 2017 support in my feedback thread.SharerePost-User-6279251answered 6 years ago0Thanks, I finally found it.SharerePost-User-4161939answered 6 years ago0Any ideas as to when Visual Studio 2017 support will be added to Lumberyard?SharerePost-User-9149768answered 6 years ago0The "tools development support" in Lumberyard seems to be about 2-5 years behind, I really wish the Devs would work on updating the Development Tools support in Lumberyard (Support Visual Studio 2017, support 3ds Max 2018, 3ds Max 2017, Maya 2018, Maya 2017. By the time Visual Studio 2017 is finally added, I'm sure Visual Studio 2019 will be out! I really hope the Devs can get on this, and please update the tools as quickly as possible. It's difficult to create a curriculum, or teach a class when the development tools are several years behind.SharerePost-User-9149768answered 6 years ago0Are you using 2019, and somehow got around it ?Hope you are still monitoring this, as I'm using 2019, seems silly remove it just for the luxury of using this engine.SharerePost-User-2755327answered 4 years ago0Again,why is VS 2019 not supported,given we're at the END of 2019 ?I already have 2019 ,and NOT about to remove it just fora backwards engine.Why so slow to adopt current components ?SharerePost-User-2755327answered 3 years ago"


Question: Issues with RDS billing

"Google translate:Good morning,I have the following problem: the billing panel shows a charge referring to the use of RDS, around USD 9.00... charge. After checking the charge, delete the db (I didn't even create the database tables), but what do I do about this amount that is being charged??FollowComment"

Answer: "2Accepted AnswerThe free storage limit for RDS is 20 GB.Limiting the image to 40GB provisioned, it seems that a fee may have been charged.There is also a charge for backup storage, so snapshots taken by the system may be available somewhere.https://aws.amazon.com/rds/pricing/?nc1=h_ls20 GB of General Purpose (SSD) DB storage.20 GB of storage for your automated database backups and any user-initiated DB Snapshots.CommentShareEXPERTRiku_Kobayashianswered a month ago19USD has been accrued for this month and the fee must be paid.Also, if you leave snapshots when you delete RDS, you will be charged for the snapshots, so please delete snapshots if you do not need them.CommentShareEXPERTRiku_Kobayashianswered a month agorePost-User-4895873 a month agoi didn't create a snapshot when i delete RDS...ShareRiku_Kobayashi EXPERTa month agoIs there a different region you are checking or something?The billing screen shows Sao Paulo, is that the right region for RDS?Are there any other snapshots taken by the system that are still available?Check the system column, not the manual column.SharerePost-User-4895873 a month agothere really was a snapshot in the manual comlumn, in my region... now i deleted it, thanksShare0CommentSharerePost-User-4895873answered a month ago0I chose the free tier for RDS when  started the service...CommentSharerePost-User-4895873answered a month ago"


Question: Error while getting response from load balancer

"I have deployed react application on Application load balancer and there are two ec2 instance in a target group,the issue is that the web page loads properly after multiple refresh or else gives blank screen because of the error "Uncaught SyntaxError: Unexpected token '<'". in the console and only loads the static index.html.The application loads by directly accessing the instance without any error and even after multiple refreses.The issues get encountered in load balancer only.I have also tried changing the health check configuration but didn't worked and the checkups are also healthy.I also tried deploying the application with classic load balancer but issues were faced.What might be the possible issue because it successfully responds sometimes and mostly reponds with errors?FollowCommentHarshavardhan_G SUPPORT ENGINEER2 months agoThe issue is most likely on the application side. Using Chrome developer tools, can you please capture the Request and Responses when the page loads and when you observe this error? This will help us better understand the issue.Share"

Answer: "0This error may be related to React application also. Would recommend to use your browser dev tools or any available React Developer Tools to debug the same.  This will provide some insights where things are failing.CommentShareEXPERTAWS-User-Nitinanswered 2 months agodemo 2 months agoThere is no issue in the application i have checked and also it works fine by directly accessing the instance.The link for load balancer:http://projectbalancer-1437849666.ap-south-1.elb.amazonaws.com/You can have a look,and let me know what is causing the load balancer to show this error.Inorder to access the page you have to refresh multiple times and i have also mentioned to which server it is accessing either 1 or 2Share"


Question: Update expression consistency

"Do the ADD and DELETE update expressions guarantee write consistency?Example: Given this code from the AWS docsaws dynamodb update-item \    --table-name ProductCatalog \    --key '{"Id":{"N":"789"}}' \    --update-expression "ADD Color :c" \    --expression-attribute-values '{":c": {"SS":["Yellow", "Green", "Blue"]}}' \    --return-values ALL_NEWhttps://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Expressions.UpdateExpressions.html#Expressions.UpdateExpressions.ADDIs it guaranteed that the colors Yellow, Green, Blue will eventually show up? Or could this update to the item simply get overwritten and lost if there is another update at the same instant that adds the color 'Black'?FollowComment"

Answer: "0Hi, I think you meant to ask about read-after-write consistency. DynamoDB support strongly consistent reads, which means you will always get the most up to date data. If your read request is served in between the two write requests, then you will see {Yellow, Green Blue}. If your read request is served after the second write request is completed, you will see {Black}. NoSQL is a distributed data processing system, and is designed to support many types of applications. I would recommend starting with your business use case and working from there. If you have a need to capture and read every update to your table, then you may want to consider the DynamoDB Streams + Lambda/Kinesis architecture. If you are looking for the latest update, with read after write consistency, then use DynamoDB's strongly consistent reads. Hope this helps.CommentSharePadma_awsanswered 4 years ago0Sorry, probably my question wasn't formulated clear enough.If your read request is served after the second write request is completed, you will see {Black}Considering that the ADD operation is used I would expect that generally you will see {“Black”, "Yellow", "Green", "Blue"}. This is at least what you'll get when executing it via the CLI manually.My question was whether we have a guarantee that the result will eventually always be the above four values. Or could it happen that only one of the two update-item operations wins and I’ll only see either {"Yellow", "Green", "Blue"} or {“Black”}?(I’m working on the assumption that initially the set “Color” is empty).I’m aware I could do an additional read request first and use a ConditionExpression to make sure I don't lose any previously added values. But considering that I’m using ADD which is an idempotent operation I feel using an ConditionExpression should not be necessary.CommentSharemarkuskrameranswered 4 years ago0Thanks for that clarification. You are right, the result set will eventually show the four values.As a programming best practice in general, and this applies to any API operation, you will implement an exponential backoff/retry in your code to catch any exceptions and retry them.Let me know if you have any more questions.CommentSharePadma_awsanswered 4 years ago0Okay great. Thanks for confirming that the four values will eventually show up and non of the update operations using ADD might silently get dropped.CommentSharemarkuskrameranswered 4 years ago"


Question: AWS Private Certificate Authority - certificate request is still Pending

"AWS Private Certificate Authority - certificate request is still Pending. 2 days passed and the status is still pending. Is it normal, or how many days will it take to be issued?We have ML modules in other cloud providers and our company domain is registered in AWS. To make it secure and the same domain as other ML modules which are in the other cloud, we requested a private certificate.!FollowComment"

Answer: 0CommentSharealkakandiillianswered 2 months ago


Question: Data Transfer charges for creating volumes from another availability zone

"Consider this scenario: If I have a snapshot of a volume in us-east-2a and I modify its permissions such that it would be possible to create volumes from said snapshot in another account.If I create a volume from it in us-east-2c (same region, different availably zone), would that incur AWS data transfer charges?FollowComment"

Answer: "1In short noEBS snapshots are stored in S3 but there are no s3 data transfer charges for using ebs snapshots in the same region. See s3 pricing You pay for all bandwidth into and out of Amazon S3, except for the following: "Data transferred from an Amazon S3 bucket to any AWS service(s) within the same AWS Region as the S3 bucket (including to a different account in the same AWS Region)." - covers s3 to ec2 for ebs snapshotsYou do pay for data transfer for copying snapshots to another regionCommentShareEXPERTPeter_Ganswered a year ago"


Question: Call last Sagemaker Model in Batch Transform Jobs

"Hi Dears,Hope this message finds you wellI have a sagemaker model, buit by on demand notebook.I have been used batch transform jobs using lambda function, It take input inference json from s3 to create batch transform job and have finally predictions.The question how can I make lambda to use last trained model automaticity ?model_name = 'forecasting-deepar-2022-05-20-22-23-20-225',Lambda code :if 'input_data_4' in file:            def batch_transform():                transformer = Transformer(                    model_name = 'forecasting-deepar-2022-05-20-22-23-20-225',                    instance_count = 2,                    instance_type = 'ml.m5.xlarge',                    assemble_with = 'Line',                    output_path = output_data_path,                    base_transform_job_name ='daily-output-predictions-to-s3',                    #sagemaker_session = sagemaker.session.Session,                    accept = 'application/jsonlines')                transformer.transform(data = input_data_path,                                     content_type = 'application/jsonlines',                                     split_type = 'Line',                                    wait=False,                                     logs=True)                    #Waits for the Pipeline Transform Job to finish.                print('Batch Transform Job Created successfully!')            batch_transform()ThanksBasemFollowCommentTasio EXPERTa year agoHi, how are you triggering that Lambda function that starts the batch transform job?Share"

Answer: "0Accepted AnswerHi Basem,If I understood correctly you'd like your Lambda function to automatically choose the latest SageMaker model when it runs, instead of hard-coding the model name.Although you could do this simply with boto3.client("sagemaker").list_models(...) (which can sort by creation time), I would not recommend it. The reason is that in general this lists all models present in SageMaker - which might include some for different use cases in future, even if you only have the one DeepAR forecasting use-case today. You'd have to manually filter after the API call.A better approach would probably be to register your forecasting models in SageMaker Model Registry - which will allow you to register different versions and track extra metadata like metrics and approval status for each version if you need.First (e.g. from your notebook) you can create a model package group to track your forecasting models.Then (when you create your SageMaker Model) you can register it as a new version in the group - via Model.register().At the point you want to look up which model to use, you can then list_model_packages which can filter to your specific group of models, and also by approval status if you like.So for example you could set the model package group name as a configuration environment variable for your Lambda function, and have the function dynamically look up the latest version to use from the group when needed.Of course there are also many more custom ways to do this such as creating an SSM Parameter to track the name of your current accepted model, or creating your own model registry using a data store like DynamoDB... But SageMaker Model Registry seems like the most purpose-built tool for the job here to me.CommentShareEXPERTAlex_Tanswered a year ago"


Question: how to invoke a multi model endpoint in triton server?

"set up - testing a multi model endpoint in a nvidia triton server. I created the multi model endpoints based on the aws docs here (https://docs.aws.amazon.com/sagemaker/latest/dg/create-multi-model-endpoint.html#create-multi-model-endpoint-sdk-gpu) .  the model i'm using is  a ditilbert model (https://huggingface.co/docs/transformers/model_doc/distilbert). also based on the docs here, https://aws.amazon.com/blogs/machine-learning/host-ml-models-on-amazon-sagemaker-using-triton-python-backend/, i created a model.py file for the python backend (sample below). I also have config.pbtxt file  . based on the docs here - https://raw.githubusercontent.com/triton-inference-server/python_backend/main/examples/add_sub/model.py , we need to implement execute method and execute method takes a list of  pb_utils.InferenceRequest argument. before this , in a single model implementation , i invoke it by passing json data as payload. so i understand i have to convert my text to pb_utils.InferenceRequest  type , as the python backend for triton server only accepts pb_utils.InferenceRequest  type. I couldn't find any examples of this. what are the steps i need, to migrate to a multi model endpoint in a nvidia triton container. I need to convert text to token via tokenizer before sending to the python backend?config.pbtxtname: “some_model_config”backend: “python”max_batch_size: ??input: [    {         name: “INPUT0”         data_type: TYPE_STRING         dims: [ -1 ]    },]output [      {           name: “output”           data_type: TYPE_STRING           dims: [ -1 ]invoke a multi model endpointpayload = "some text here"response = runtime_sm_client.invoke_endpoint(EndpointName=endpoint_name,ContentType="application/json",Body=json.dumps(payload),)import triton_python_backend_utils as pb_utilsclass TritonPythonModel:    def initialize(self, args):       ....    def execute(self, requests):       `execute` must be implemented in every Python model. `execute`        function receives a list of pb_utils.InferenceRequest as the only        argument. This function is called when an inference is requested        for this model.        Parameters           requests : list     A list of pb_utils.InferenceRequest        Returns :  list of pb_utils.InferenceResponse. The length of this list must be the same as `requests`FollowComment"


Question: AWS Api Gateway: how to expose new services automatically?

"Hi everyone,I'm searching for a way to expose service routes to Api Gateway automatically. The flow should be the following:New service in EKS is createdTwo proxy resources added to api gateway /public/<service-name> and /private/<service-name>Integration with new service added to created resources (perhaps we would have ALB per service, so it resource integration would be done through ALB)Api gateway redeployedSo far, I've come up with the solution using a lambda function which will listen to cloudtrail ALB creation event and make calls to API gateway to create new resources and publish them, but I feel that there should be something more AWS native that works out of the box.FollowCommentvitaly_il a year agoHi, did you find a way to implement such automatic scenario?Share"


Question: Cloud9 Menu bar no longer appears anyway

"Hi. I have been using cloud9 regularly. But this morning, I noticed that the menu bar disappeared. I am specifically looking to go to launch the preview of my webapp which can only be done using the menu at the top. Please advise.FollowComment"

Answer: "1Hi, @miyakojingiIs the top menu collapsed as shown below?Click the triangle icon in the next area or its center and it should expand again.If this doesn't work, try clearing your browser's cache or launching your browser in secret mode.CommentShareEXPERTiwasaanswered 10 months agomiyakojingi 10 months agoPerfect! Thanks for the answer. I have to click on that thin strip at the top to recover my menu.Share"


Question: No module named 'psycopg2'

"Despite this being one of only two pre-installed Python modules (https://docs.aws.amazon.com/mwaa/latest/userguide/working-dags-dependencies.html), I'm getting this error (No module named 'psycopg2') with a test DAG. It's from the following import:from airflow.operators.postgres_operator import PostgresOperatorThis service isn't listed in the Support Ticket drop-down yet, so I'm hoping somebody here might have an idea!BTW, I don't think these submodules should have an impact on the availability of psycopg2, but here's my requirements.txt file.(All in the form "apache-airflow bracket submodule bracket", reformatted for this post)amazonpostgresmysqldockerslackcryptoThanks for your time,TimEdited by: TKnight-HG on Dec 1, 2020 11:21 AMEdited by: TKnight-HG on Dec 1, 2020 11:23 AMFollowComment"

Answer: "0My requirements.txt file contained an error on the "postgres" Extra package (a space was inside the bracket). Fixing that line and properly updating the environment to point to the new version of the file solved the problem.CommentShareTKnight-HGanswered 2 years ago0Hi,For additional information on the topic please see:https://docs.aws.amazon.com/mwaa/latest/userguide/troubleshooting.html#missing-postgreshttps://docs.aws.amazon.com/mwaa/latest/userguide/working-dags-dependencies.htmlThanks!CommentShareJohn_Janswered 2 years ago0We have followed the troubleshooting guide and are still receiving the same error. Are there any other resources we can reference in order to resolve this issue?CommentSharek-afanswered 2 years ago0Hi!If any of your requirements fail, then the rest will quit loading.  There will be better logging in the near future, however in the interim please try removing apache-airflow bracket crypto bracket from the list as it looks like that is the one that is failing.Thanks!Edited by: JohnJ-AWS on Jan 6, 2021 1:33 PMCommentShareJohn_Janswered 2 years ago"


Question: How to verify a aws ecs cluster is a private cluster

We have 4 cluster in my account but I need to verify which cluster is private and which is publicFollowComment

Answer: "1I believe it is possible to determine this from the subnets used by the cluster.If there is a route to the Internet Gateway in the subnet's route table, it is public.CommentShareEXPERTRiku_Kobayashianswered 10 days agoAWS-Harrison 8 days agoTo expand, a cluster is neither public or private. The subnets it is using are what is public or private.Share"


Question: Rust SDK for Lambda - CRUD && trigger with DynamoDB

"Playing around with Rust SDK and cargo lambda, to create a fn that reads new items appended to a specific table in DynamoDB, which is set as the trigger. I've written a fn as such. What are better approaches to this? I guess the more broader question would be - is there a quicker way to access enum variants that are passed as event to the handler fn?fn matchAttribute<T>(attribute: &AttributeValue) -> Option<T>     where         bool:   Into<T>,        f64:     Into<T>,        String: Into<T>,        T: for<'a> std::convert::From<&'a std::string::String>{    match attribute {        AttributeValue::Boolean(b) => Some((*b).into()),        AttributeValue::Number(f) => Some((*f).into()),        AttributeValue::String(s) => Some((s).into()),        _ => None,    }}FollowComment"

Answer: 0One option to consider is DDB Streams using Lambda event filtering: FIlteringCommentShareAWSdaveanswered 5 months ago


Question: Cloud-Watch Metric Query to select instances based on tags or particular environment instances

I'm trying to create alarm for multiple instances using cloud watch metric query. I have used the sample query as shown below.SELECT MAX(CPUUtilization) FROM "AWS/EC2" GROUP BY InstanceId ORDER BY MAX() ASC LIMIT 10I have different environments in my aws account in same region. If i use above query then its shown all instances. I want only to select particular environment instances. Is there a way to achieve it.FollowComment

Answer: "0Yes, you can modify your CloudWatch metric query to select only instances belonging to a specific environment by adding a filter based on tags. Here's an example of how you can modify your query to achieve this:SELECT MAX(CPUUtilization) FROM "AWS/EC2" WHERE Tag.Environment = 'YourEnvironment' GROUP BY InstanceId ORDER BY MAX() ASC LIMIT 10In the above query, replace 'YourEnvironment' with the specific value of the tag key-value pair that represents your environment. By adding the WHERE clause with the appropriate tag filter, you can narrow down the instances to only those with the specified tag value.Make sure you have applied the appropriate tags to your instances with the desired environment value. You can use the AWS Management Console, AWS CLI, or SDKs to add tags to your instances.By adding the tag filter to your query, you'll limit the results to instances that match the specified environment, allowing you to create alarms specific to that environment.CommentSharehimanshustallongmailcomanswered 12 days agorePost-User-2738569 12 days agoHi Good Afternoon Himanshu,Thanks for answaaring...I tried to run the above query but It say syntax error.Share0That's incorrect, tags are not available for filtering CloudWatch metrics insights queries.Currently the only way to filter CloudWatch metrics insights queries is to use the WHERE clause with metrics dimensions and the = or != operator.CommentShareJscanswered 12 days ago"


Question: Policies needed for creating and writing files in simulation application

"Hi,I've been able to build, bundle and launch simulations, but now I'm trying to write a file (CSV) with my simulation application.In my simulation application the robot does some tasks, and when it completes a task, its speed, task time, task success etc. gets logged into a CSV file by a ROS node. Then, I have another ROS node that uploads that log to my S3 bucket.However, the node wasn't able to create a file. I looked at the location using the Terminal application and the file doesn't exist. Furthermore at the beginning of the simulation log this appeared:WARNING: Could not change permissions for folder [/home/robomaker/.ros/log/5670f31c-4309-11ea-a51d-0242a9fe0103], make sure that the parent folder has correct permissions.which led me to think my IAM Role doesn't have sufficient permission to write in the EC2 instance of the simulation application.The IAM role I used for launching the sim app has the following policies:AmazonEC2FullAccessAmazonS3FullAccessAWSRoboMakerFullAccessAWSRoboMakerServiceRolePolicyAWSCloud9AdministratorCloudWatchLogsFullAccessMy question is, what other policies do I need in order to create and write files in the simulation application instance?FollowComment"

Answer: "0Accepted AnswerHi khaiyichin,Your IAM policies do not affect the ability for your application to write to disk. The /home/robomaker folder is your best bet for writing files and you should have permissions to write there. You could then upload them to S3 via boto3 or the awscli installed into your bundle.Your error message, is a red herring in regards to write permissions. The user your code is running as has permissions to the folders, the error message in question is thrown because the user cannot chown the folder to match its parent: https://github.com/ros/ros_comm/blob/796ef0cbdc78d04938be0af96b1512f8b1803d25/tools/rosgraph/src/rosgraph/roslogging.py#L196The terminal application is running on a separate filesystem than the simulation/robot applications, this means you will not be able to see the files created by those applications from the terminal GUI.Regards,MattCommentShareAWS-User-9830425answered 3 years ago"


Question: What key to pass to s3.Object()?

"I have no experience with AWS. I'm trying to figure out what is supposed to go in the place of "solution_key_name" here:obj = s3.Object(solution_bucket_name, solution_key_name)I just need to get this working so I can call the alpha qubo api like in this script: https://github.com/MetaAnalytics/meta-analytics/blob/master/notebooks/AlphaQUBO-1.3-QuickStart.ipynbI've created the s3 bucket, but I don't know if I also need to create a key somewhere or whether it needs to be on my local machine or somehow connected to my aws account. Whatever the case is, I'm looking for the simplest solution, I don't have anything important on aws, I am not concerned about security.FollowComment"

Answer: "0The way the notebook reads, once you define the Bucket and the Key (which is the path and filename combined - so think foldername/filename) it:Deletes the existing object if it is there. (step 16)Passes the name to SolverAynscRequest which (should, I guess) store the solution in the Key name that you've specified. (step 17)Reads the content of the object. (step 18)CommentShareEXPERTBrettski-AWSanswered 3 months agorePost-User-6850271 3 months agoI'm not really concerned about what the script is doing, what I need is step by step instructions on how to create or download the key (if necessary) and find the key path.ShareBrettski-AWS EXPERT3 months agoAs I read the notebook, you specify the key; step 2 creates the data and stores it in the key; step 3 then reads the object so you could use the same Python code to do that.Share"


Question: ModuleNotFoundError when starting a training job on Sagemaker

"I want to submit a training job on sagemaker. I tried it on notebook and it works. When I try the following I get ModuleNotFoundError: No module named 'nltk'My code isimport sagemaker  from sagemaker.pytorch import PyTorchJOB_PREFIX   = 'pyt-ic'FRAMEWORK_VERSION = '1.3.1'estimator = PyTorch(entry_point='finetune-T5.py',                   source_dir='../src',                   train_instance_type='ml.p2.xlarge' ,                   train_instance_count=1,                   role=sagemaker.get_execution_role(),                   framework_version=FRAMEWORK_VERSION,                    debugger_hook_config=False,                     py_version='py3',                   base_job_name=JOB_PREFIX)estimator.fit()finetune-T5.py have many other libraries that are not installed. How can I install the missing library? Or is there a better way to run the training job?FollowComment"

Answer: 0Accepted AnswerCheck out this link (Using third-party libraries section) on how to install third-party libraries for training jobs.  You need to create requirement.txt file in the same directory as your training script to install other dependencies at runtime.CommentShareSamanswered 3 years ago


Question: DMS replication

"Hello AWSWe are having an issue related to DMS table replication.The DMS manager says that there is no error in the replication task or errors in the tables, howeverwe have detected that some records are not updated correctly. Some data exists at the source but does not exist at the destinationCan you help us understand what happened?ComplimentsFollowComment"

Answer: 0Please refer to DMS task cloudwatch logs for any warnings or errors.If the error is from failed dml operation on target you can check for any reported errors in target awsdms_apply_exceptions tableFor further pointers please refer tohttps://aws.amazon.com/blogs/database/debugging-your-aws-dms-migrations-what-to-do-when-things-go-wrong-part-1/https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Troubleshooting.htmlCommentShareAWS-User-8174525-subhashanswered 10 months ago


Question: Sagemaker Built-in Algorithms

"I am exploring the Sagemaker Built-in algorithms, and I am curious to learn more about the details of the algorithms. However, I am surprised that it is hard to find any references for the research background and implementation details in the numerous documents and tutorials for particular algorithms. If such information exists somewhere, I would highly appreciate a pointer. Thanks a lot in advance!FollowComment"

Answer: "0Accepted Answerthanks for your interest in the built-in algorithms! You can find research papers in the documentation of many of them. And documentation page has a section "how it works" explaining the science of every algorithm. For example:BlazingText: BlazingText: Scaling and Accelerating Word2Vec using Multiple GPUs, Gupta et KhareDeepAR DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks, Salinas et al.Factorization MachinesIP InsightsKMeansKNNLDALinear LearnerNTMObject2VecObject Detection (it's an SSD model)PCARandom Cut Forest: Robust Random Cut Forest Based Anomaly Detection On Streams, Guha et alSemantic SegmentationSeq2seqXGBoostCommentShareEXPERTOlivier_CRanswered a year agopeisenha a year agoThank you very much for the swift response; the links to the research papers are exactly the type of information I am looking for. However, let's take the paper "BlazingText: Scaling and Accelerating Word2Vec using Multiple GPUs" as an example: Where exactly in the AWS documentation would I find a link to it?  Is there a central place to access the foundational papers for the different algorithms?ShareDurga_S a year agoAs Oliver mentioned, the SageMaker developer guide links to the appropriate papers (for example, see BlazingText) or has a 'How it works' section (for example, K-means). For information on all built-in algorithms, see here.Share"


Question: Sagemaker Notebook keeps hanging/freezing

"I have been using Sagemaker Studio Notebook and suddenly it started hanging.When this happens, the notebook freezes completely. Than I have to wait some seconds (the delay duration is not constant and is common to reach about 30 seconds) and then it just freezes again, making its usage impossible.I was using a temporary account provided by Udacity and after trying different approaches to find and solve the problem, I switched to a personal account but the problem persists.Approaches I have tried so far:Shutdow and start kernelRestart kernelRestart kernel and clear outputsLog out and Login (from Sagemaker)Log out and Login (from AWS)Change regionTrying a different browser (I tried Chrome and Firefox)Trying using other account (personal)I also checked CloudWatch logs but didn't find anything that seemed unusual.FollowComment"

Answer: "1Accepted AnswerThe most likely cause of this from my experience is a (very) large number of active git changes.Given your "current" working folder (the one you're navigated to in the folder sidebar menu), the jupyterlab-git integration regularly checks if you're inside a git repository and polls for changes in that repository if so.When this list is very large, I've sometimes seen it cause significant slowdowns in the overall UI because of the way the underlying (open-source) extension works. This has been discussed before for example in this GitHub issue - which is now marked closed but I've still seen it happening.For example, maybe you (like me 😅) forgot to gitignore a data folder or node_modules and generated thousands of untracked files there: You might see a significant slowdown whenever you're navigated to a folder within the scope of that git repo.Suggested solution would be:Use the folder sidebar to navigate anywhere other than the affected git repository (e.g. to your root folder?), and you should see the slowdown resolve pretty much immediately if this is the underlying causeNow the tricky task of finding and clearing up the problemmatic folder(s) without navigating to them in the folder GUI:You could use a System Terminal, cd to the affected folder and run git status to see where the many changes are hiding, if you're not sure alreadyAdd a .gitignore file (or modify your existing one) to make git ignore those changes. Because it starts with a dot, .gitignore is hidden by default in the JupyterLab file browser anyway. I usually use a system terminal to e.g. cp myrepo/.gitignore gitignore.txt to create a visible copy (somewhere other than the repository folder which you're trying to avoid navigating to!) and then mv gitignore.txt myrepo/.gitignore to overwrite with my edited versionAlternatively (if e.g. it's a folder full of new files that you no longer care about like node_modules) you could just slog through the slowness to delete the problemmatic folder in the UI - but of course the problem would return if you re-created them later without .gitignore.CommentShareEXPERTAlex_Tanswered a year agoThiago 10 months agoThanks a lot Alex! That was the cause!Simply deleting the folder which had thousand of images made the UI responsive again. And then I also noticed that before the deletion the git status bar was permanently in "Refreshing" status.  After the deletion, it's quickly toggling between "Refreshing" and "Idle"Share"


Question: How to link AWS SQS queue to push for API integration and IoT.

"Hi everyone,I am trying to link a switchboard that pushes the data gathered to the AWS SQS, to an API platform from where the users will be able to monitor the data in real-time (e.g. digital twin).Previously, I was able to link these devices via the MQTT Broker with RabbitMQ MQTT broker installed. Now, I am trying to do the same with the switchboard linked as above and edit the script accordingly for this case study. I appreciate your advice and help! Thanks in advance!the previous script was as follow:Create the container:sudo docker run --hostname navvis-rabbitmq --name navvis-rabbitmq -p 5672:5672 -p 15672:15672 -p 1883:1883 -p 15675:15675 -td rabbitmq:3Copy2.Enter the container terminal:sudo docker exec -it navvis-rabbitmq bashCopy3.Enable required plugins:rabbitmq-plugins enable rabbitmq_managementrabbitmq-plugins enable rabbitmq_web_mqttCopy4.Exit the container terminal:exitCopy5.Create a new file named rabbitmq.conf.loopback_users.guest = falselisteners.tcp.default = 5672management.tcp.port = 15672mqtt.listeners.tcp.default = 1883Default MQTT with TLS port is 8883mqtt.listeners.ssl.default = 8883anonymous connections, if allowed, will use the defaultcredentials specified heremqtt.allow_anonymous  = truemqtt.default_user     = guestmqtt.default_pass     = guestmqtt.vhost            = /mqtt.exchange         = amq.topic24 hours by defaultmqtt.subscription_ttl = 86400000mqtt.prefetch         = 10Copy6.Replace the config file in the container with the new config file:sudo docker cp rabbitmq.conf navvis-rabbitmq:/etc/rabbitmq/CopyFollowComment"


Question: aws site to site vpn private ip vpns over direct connect -- new feature

"https://aws.amazon.com/blogs/networking-and-content-delivery/introducing-aws-site-to-site-vpn-private-ip-vpns/Going through the document, It tells to reserve a 10.0.0.0/24 cidr block on the transit gateway, what is the relevance of this block? where is it exactly used? It is not shown in the diagram in the document.Do we need to carve out a separate cidr for The tunnel IPs, based on the number of tunnels. Is there any special consideration to be followed when assigning the tunnel outside IPs.Any additional documents available on this topic would be helpful.What does that Cidr block do? are IPs from the block used anywhere ( tunnel headend or tailend IPs?). I understand the block is used for routing.How does one decide the Tunnel headend and tail end IPs? do the IPs subnets have anything to do with the CIDR block?If I have a 10G pipe, I am assuming I would be using 8 tunnels (1.25 cap), where do i know what the IPs would be? The IP Schema is dictated by what? Does the CIDR play a role here?FollowCommentChris_G EXPERT8 months agoHello, it's probably a good idea to not leave additional questions/comments as answers as it's less likely someone will provide you an answer as it looks like the question was already solved.   Maybe edit your original question with your additional context and remove the answers you added.Share"

Answer: "01- Going through the document, It tells to reserve a 10.0.0.0/24 cidr block on the transit gateway, what is the relevance of this block? where is it exactly used? It is not shown in the diagram in the document.As in the diagram 10.0.0.0/24 is used as a VPC CIDR for the production VPC while 10.24.10.0/24 is being used a Transit Gateway  CIDR block  which is used to create transport network for VPN2- Do we need to carve out a separate cidr for The tunnel IPs, based on the number of tunnels. Is there any special consideration to be followed when assigning the tunnel outside IPs.You can specify a size /24 CIDR block or larger (for example, /23 or /22) for IPv4, or a size /64 CIDR block or larger (for example, /63 or /62) for IPv6 forTransit Gateway  CIDR block . You can associate any public or private IP address range, except for addresses in the 169.254.0.0/16 range, and ranges that overlap with the addresses for your VPC attachments and on-premises networks.3- Any additional documents available on this topic would be helpful.https://docs.aws.amazon.com/vpc/latest/tgw/tgw-transit-gateways.html#create-tgwTGW CIDR block will decide the tunnel outside Ip address for transportation.CommentShareAnjali_Vanswered 7 months ago"


Question: Using Amazon Device messaging SDK in a regular java application

I have a Spring boot application that's running on an EC2 instance. I want to use push notifications to send messages through SNS to other spring boot applications running on EC2. But I need to register the application with Amazon Device messaging service first in order to get a device token to create an application endpoint with. To do that I need to use the Amazon Device messaging SDK.This SDK can be downloaded here: https://developer.amazon.com/docs/apps-and-games/sdk-downloads.html#adm but I want to download it as a maven dependency.Is the Amazon Device messaging SDK available on mvnrepository.com and if so where can i find it?FollowComment

Answer: "0The Amazon Device Messaging SDK is not available on Maven Central or mvnrepository.com. However, you can still use the SDK as a dependency in your Maven project by manually installing the SDK in your local Maven repository or by using a third-party repository.To manually install the SDK in your local Maven repository, you can follow these steps:Download the SDK from the Amazon Developer portal.Extract the contents of the SDK archive to a local directory.Navigate to the root directory of the extracted SDK and run the following command to install the SDK in your local Maven repository:Copy codemvn install:install-file -Dfile=amazon-device-messaging-X.X.X.jar -DgroupId=com.amazon -DartifactId=amazon-device-messaging -Dversion=X.X.X -Dpackaging=jarReplace X.X.X with the version number of the SDK that you downloaded.Add the following dependency to your project's pom.xml file:phpCopy code<dependency><groupId>com.amazon</groupId><artifactId>amazon-device-messaging</artifactId><version>X.X.X</version></dependency>Replace X.X.X with the version number of the SDK that you downloaded.Alternatively, you can use a third-party repository like JitPack to include the SDK as a dependency in your Maven project. To do so, follow these steps:Add the following repository to your project's pom.xml file:phpCopy code<repositories><repository><id>jitpack.io</id><url>https://jitpack.io</url></repository></repositories>Add the following dependency to your project's pom.xml file:phpCopy code<dependency><groupId>com.github.awslabs</groupId><artifactId>amazon-device-messaging</artifactId><version>X.X.X</version></dependency>Replace X.X.X with the version number of the SDK that you want to use.Note that using a third-party repository comes with its own risks and potential security vulnerabilities, so make sure to use a reputable repository and exercise caution when including external dependencies in your project.CommentShareStupidBoianswered a month ago"


Question: "Bad request: The data we received didn't match the format we expected for the updateJourney operation. Confirm that the information in your request is formatted properly..."

"I have created a very simple Pinpoint journey, but I can't test it. The error provided is: "Bad request: The data we received didn't match the format we expected for the updateJourney operation. Confirm that the information in your request is formatted properly, and then submit your request again."I don't know how to interpret this error. What does "the data we received" refer to? What's causing this and how do I fix it?FollowComment"