Question: Sagemaker Training Job. Python modules installation Error

"I have a problem with Python module installation that requires pre-installation of another module.  Both modules were added to the requirement.txt file. However, the error occurs when installing main module:2022-07-29 01:18:26.460132: W tensorflow/core/profiler/internal/smprofiler_timeline.cc:460] Initializing the SageMaker Profiler."2022-07-29 01:18:26.470589: W tensorflow/core/profiler/internal/smprofiler_timeline.cc:105] SageMaker Profiler is not enabled. The timeline writer thread will not be started, future recorded events will be dropped."2022-07-29 01:18:26.765280: W tensorflow/core/profiler/internal/smprofiler_timeline.cc:460] Initializing the SageMaker Profiler."2022-07-29 01:18:31,908 sagemaker-training-toolkit INFO     Imported framework sagemaker_tensorflow_container.training""2022-07-29 01:18:31,917 sagemaker-training-toolkit INFO     No GPUs detected (normal if no gpus installed)""2022-07-29 01:18:33,117 sagemaker-training-toolkit INFO     Installing dependencies from requirements.txt:"/usr/local/bin/python3.9 -m pip install -r requirements.txtCollecting Cython==0.29.31Downloading Cython-0.29.31-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (2.0 MB)━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 33.1 MB/s eta 0:00:00Requirement already satisfied: wheel==0.37.1 in /usr/local/lib/python3.9/site-packages (from -r requirements.txt (line 2)) (0.37.1)Collecting scikit-image==0.19.2Downloading scikit_image-0.19.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.0 MB)━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.0/14.0 MB 83.1 MB/s eta 0:00:00Collecting parallelbar==0.1.19Downloading parallelbar-0.1.19-py3-none-any.whl (5.6 kB)Collecting albumentations==1.0.3Downloading albumentations-1.0.3-py3-none-any.whl (98 kB)━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.7/98.7 kB 6.6 MB/s eta 0:00:00Collecting tensorflow_addons==0.16.1Downloading tensorflow_addons-0.16.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 54.4 MB/s eta 0:00:00Requirement already satisfied: tensorflow-io==0.24.0 in /usr/local/lib/python3.9/site-packages (from -r requirements.txt (line 7)) (0.24.0)Requirement already satisfied: tensorboard==2.8.0 in /usr/local/lib/python3.9/site-packages (from -r requirements.txt (line 8)) (2.8.0)Collecting universal-pathlib==0.0.12Downloading universal_pathlib-0.0.12-py3-none-any.whl (19 kB)Collecting setuptools==63.2.0Downloading setuptools-63.2.0-py3-none-any.whl (1.2 MB)━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 58.9 MB/s eta 0:00:00Collecting pynanosvg==0.3.1Downloading pynanosvg-0.3.1.tar.gz (346 kB)━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 346.0/346.0 kB 17.5 MB/s eta 0:00:00Preparing metadata (setup.py): startedPreparing metadata (setup.py): finished with status 'error'"error: subprocess-exited-with-error    × python setup.py egg_info did not run successfully.  │ exit code: 1  ╰─> [6 lines of output]      Traceback (most recent call last):        File ""<string>"", line 2, in <module>        File ""<pip-setuptools-caller>"", line 34, in <module>        File ""/tmp/pip-install-1mt2gkfy/pynanosvg_d6162ffce95948abb4262061a011908c/setup.py"", line 2, in <module>          from Cython.Build import cythonize      ModuleNotFoundError: No module named 'Cython'      [end of output]    note: This error originates from a subprocess, and is likely not a problem with pip."error: metadata-generation-failed× Encountered error while generating package metadata.╰─> See above for output."note: This is an issue with the package mentioned above, not pip."hint: See above for details.[notice] A new release of pip available: 22.1.2 -> 22.2.1"[notice] To update, run: pip install --upgrade pip""2022-07-29 01:18:36,187 sagemaker-training-toolkit INFO     Waiting for the process to finish and give a return code.""2022-07-29 01:18:36,187 sagemaker-training-toolkit INFO     Done waiting for a return code. Received 1 from exiting process.""2022-07-29 01:18:36,188 sagemaker-training-toolkit ERROR    Reporting training FAILURE""2022-07-29 01:18:36,188 sagemaker-training-toolkit ERROR    InstallRequirementsError:"ExitCode 1"ErrorMessage ""      ModuleNotFoundError: No module named 'Cython'       [end of output]      note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed  × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details.""""Command ""/usr/local/bin/python3.9 -m pip install -r requirements.txt""""2022-07-29 01:18:36,188 sagemaker-training-toolkit ERROR    Encountered exit_code 1"FollowComment"

Answer: "0Since Cython does seem to be downloaded before the error, I suspect the problem is something in other packages' install process requiring it before pip is done installing it. It looks like others have found similar (non-SageMaker-specific) issues with Cython e.g. here and here.Things I would suggest to try:Explicitly specify Cython (maybe without a version at first) right at the top of your requirements.txt file if you're not already - just in case this can convince pip to treat it properly.Customize the TensorFlow container image you're targeting to pre-install Cython.If you're not sure what base container URI you're using, you can fetch it with sagemaker.image_uris.retrieve(...) (doc here).From that, you can create a minimal Dockerfile something likeFROM XYZ.dkr.ecr.ABC.amazonaws.com/...RUN pip install Cython==0.29.31Once you build this customized container image, and push it to Amazon ECR in your AWS account & region, you can use it by setting the image_uri parameter in your TensorFlow Estimator. Note that the frameworks typically have separate container images for training vs serving, and GPU vs CPU-only, so you may need to create a pair of containers if wanting to do inference too.If you're working inside SageMaker Studio you won't directly be able to docker build, but you can install the sm-docker build solution based on AWS CodeBuild. The "Prepare custom training and inference containers" section of this notebook gives an example of similar approach.If you'd really like to avoid touching containers and ECR, you could instead remove your requirements.txt and install dependencies within the script via something like subprocess.check_call(["pip", "install", ...]). It's hacky, but this way you could run a pip install just for Cython first... Then install all the other dependencies in one other command.CommentShareEXPERTAlex_Tanswered 10 months ago"


Question: Git Default/Core Editor - Nano

"Each time my cloud9 ec2 instance is booted up,  it changes my git core.editor to "nano". I want my git core.editor to be "vim".I have tried to set it up by directly editing the ~/.gitconfig file and also issuing the command git config --global core.editor "vim".  While that works temporarily, it reverts back to "nano" when the ec2 instance is rebooted either by me or by aws.How do I permanently change my git core.editor to "vim" in Cloud9?FollowComment"

Answer: "0Accepted AnswerThe .bashrc of the Linux user of Cloud9 contains a setting to force nano, so you can force vim by making the following changes.$ vim ~/.bashrc  ～omission (of middle part of a text)～# modifications needed only in interactive modeif [ "$PS1" != "" ]; then    # Set default editor for git    #git config --global core.editor nano                      ## <--- Comment out    git config --global core.editor 'vim -c "set fenc=utf-8"'  ## <--- AddCommentShareEXPERTRiku_Kobayashianswered 20 days ago"


Question: Quicksight invitations failing with Missing Attributes error

"For the past week or so, I have been able to send out invitations to new Quicksight users.  However, when those new users click on the "accept invitation" link in the invitation email, they are given a blank page that states "Missing Attributes: This page requires several GET attributes and/or cookies to be set."  This error occurs on several machines, on both Chrome and Edge and with or without incognito mode.FollowComment"


Question: KMS key with an EMR Notebook

Can we use a customer managed KMS key with an EMR Notebook to encrypt the local file system?FollowComment

Answer: "0Accepted AnswerAs local file system encryption on EMR is based on EBS encryption mechanism and it supports encryption using customer managed KMS key, you can use it.See:https://docs.aws.amazon.com/kms/latest/developerguide/services-ebs.htmlhttps://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-data-encryption-options.htmlCommentShareMODERATORAWS-User-4101143answered 3 years ago"


Question: Menu item missing from Storage Gateway Console

"Just after a bit of help.Have just tried to deploy a new Storage Gateway in a VPC, and run into an issue configuring it. Have done this previously with no issues.I need to change the DNS servers the Gateway uses. It is sitting in a VPC with internal only DNS (specfied by DHCP options on the VPC)  and I want to point it towards an external DNS resource. When previously depolying these I have been able to console on the Storage gateway and change the DNS settings. That option now appears to have disapearred from the menu.Menu on my older VPC hosted gateway the menu ahs the following options:1: HTTP/SOCKS Proxy Configuration2: Network Configuration3: Test Network Connectivity4: View System Resource Check5: License Information6: Command PromptOn the one depolyed today it has:1: SOCKS Proxy Configuration2: Test Network Connectivity3: Gateway Console4: View System Resource Check (0 Errors)0: Stop AWS Storage GatewayThe SSH user also seems to have changed from admin to sguser, and admin doesn't seem to exist on the new gateway.Any ideas how I can change DNS settings now? Or a user that has the correct options?ThanksFollowComment"

Answer: "0Hello,I'm Mike with the SGW team.  A couple of questions...Sounds like you've deployed on EC2, were the previous deployments also done on EC2?What region are you deploying in?What kind of gateway were you trying to deploy?  File? Volume/Tape? (They have different images.)It almost sounds to me like you may have accidently deployed a Volume/Tape image or that you may have deployed from an older image.  I suggest quickly deploying another gateway from the most recent image and verify you've chosen the correct type of gateway in the console.If you continue to have issues, please let me know or open a support case with our Premium Support team.  A developer support contract requires minimal outlay and can be turned back off, if desired, so you're only charged for the single month.CommentShareMike-HAWSanswered 2 years ago0Hi Mike,Thanks - Yes EC2 instance in eu-west-2. Previous ones are a mixture of EC2 in eu-west-2 and locally hosted ones on Hyper-V, all file gateways.I have re-deployed as suggested. I think the issue was the image. I'd forgotten how I'd deployed the EC2 image previously, and just went to EC2 - launch image - searched for it and select the ami from the marketplace. Have re--deployed now using the launch ami option from the storage gateway page and it looks better! Have configured it the same as the previous one I have deployed and it's now passing connectivity tests.While I have this open - a couple of other quick questions, if you don't mind;Previous documentation suggests that these file gateways have to run through a web proxy if they dont have public internet access, and need to go through a storage gateway endpoint. Is still the case? Whilst playing with that marketplace image, it seemed to talk directly to an storage gateway endpoint, without a proxy.Will the file storage gateways talk to S3 via the new interface endpoints for S3 (rather than gateway s3 endpoint)? if so do they just need to resolve s3.eu-west-2.amazonaws.com in DNS or do they need to be able to resolve individual bucket FQDNs?Thanks again,MartinCommentSharemtredwellanswered 2 years ago0Hello, my responses are in-line below:Previous documentation suggests that these file gateways have to run through a web proxy if they don't have public internet access, and need to go through a storage gateway endpoint. Is still the case? Whilst playing with that marketplace image, it seemed to talk directly to an storage gateway endpoint, without a proxy.---Yes, this is still the case for on-premise file gateways that need to talk to a VPC endpoint for private communication.  The HTTP proxy is still needed.  For EC2-based file gateways, the http proxy is not required.Will the file storage gateways talk to S3 via the new interface endpoints for S3 (rather than gateway s3 endpoint)? if so do they just need to resolve s3.eu-west-2.amazonaws.com in DNS or do they need to be able to resolve individual bucket FQDNs?--->The file gateway doesn't yet support the new interface endpoints for S3 but you are not the only customer asking this question and we're discussing internally how to best get it on our roadmap.  Once implemented, the gateway would need to resolve and communicate with the S3 interface endpoint (along with the SGW endpoints).Good questions, let me know if you have more.   Mike H.CommentShareMike-HAWSanswered 2 years ago"


Question: How can I make a boto3 call to describe vpcs to return vpcs that have a Network Firewall attached?

"I have been reading over the boto3 documentation and trying various solutions. So far I have the sample code below.`    endpoint = ec2_client.describe_vpc_endpoints(            Filters=[                {"Name": "vpc-endpoint-type", "Values": "GatewayLoadBalancer"},                {"Name": "vpc-id", "Values": vpc_id},                {"Name": "tag", "Values": "AWSNetworkFirewallManaged"}            ]        )`Issue I am running into (or maybe I'm missing something) is this returns the vpc endpoints even if it doesn't match the filter.I want to make sure I am not missing anything and this is syntactically correct followin Boto3 standards for the Filter specified here in the documentation - https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#EC2.Client.describe_vpc_endpointsIt does not seem to be working for me and I am not sure why.Any guidence or suggestions will help.FollowComment"

Answer: "0This might not be the full answer but this line doesn't look quite right:{"Name": "tag", "Values": "AWSNetworkFirewallManaged"}The documentation you linked says the syntax for this is{"Name": "tag:some-tag-name", "Values": "some-tag-value"}Or if you just want to match presence of a specific key without caring about its value, then{"Name": "tag-key", "Values": "some-tag-name"}CommentShareEXPERTskinsmananswered 6 months agorePost-User-8984971 6 months agoSo this would be the right syntax?{"Name": "tag:Key", "Values": "AWSNetworkFirewallManaged"}Is this only specific to the tags key?Shareskinsman EXPERT6 months agoIf you just need to filter on the AWSNetworkFirewallManaged tag being present, then the right syntax is:{"Name": "tag-key", "Values": "AWSNetworkFirewallManaged"}If you need to filter on the AWSNetworkFirewallManaged tag having a specific value, e.g. AWSNetworkFirewallManaged=true, then the right syntax is:{"Name": "tag:AWSNetworkFirewallManaged", "Values": "true"}Share"


Question: Why does ELB need one public IP address for each public subnet?

"Hi,I'm creating my first scalable application on AWS. For that, I'll use a Network Load Balancer so I can balance traffic to some container instances spread in two availability zones.Basically, I need to do something like this.https://aws.amazon.com/it/premiumsupport/knowledge-center/public-load-balancer-private-ec2/#I see I need to create one subnet for each availability zone and that's fine, but I'm a bit puzzled about why they need to be public and have their own public IP address.I mean, when I establish a TCP connection to the Network Load Balancer from the internet, couldn't it forward packets to private subnets directly? Why does it need to go through the public subnets first?There's some technical reason I fail to see here since I don't know how the Network Load Balancer is built.Thanks,MorenoFollowComment"

Answer: 0Hi thereAs you probably know load balancers distribute traffic from Clients to the instances in your Availability Zones. Since clients communicate with load balancer via internet (public network) your load balancer must be in the public subnet of your VPC. And it must have targets instances to forward traffic to. Private addresses are for communication within the VPC and public subnets are used to communicate over the internet.When you create a Network load balancer to be internet facing it will have a public IP and by default it will come with nodes (each node per AZ) depending on the number of AZs you have. The nodes will be the one having a private IP to communicate internally with instances.Here is a link where you can read more about the Network Load Balancer: https://docs.aws.amazon.com/elasticloadbalancing/latest/network/introduction.htmlPlease feel free to give me back any feedback or if you would like more clarity on certain things.Thank youHlulanibCommentShareHlulanibanswered 4 years ago


Question: Regarding Amazon Textract big file process

"I want to use Amazon Textract process my PDF file. My file have lot of images so file size expecting 50MB to 300MB what is the max file  size I can process use Amazon Textract?.One more question also If Amazon Textract  not support MS Word(doc,docx format)  how to process those file , Do I need to convert to PDF and process ? Please adviseThanks in advanceFollowComment"

Answer: "1You can find the Textract limits on the AWS documentationhttps://docs.aws.amazon.com/textract/latest/dg/limits.htmlFor PDF the limits are 10MB and 1 page for synchronous operations.  500MB and 3000 pages for asynchronous operations.About MS Word... are you sure that you need and OCR? You can access directly to the text of  doc and docx files without using a OCR.CommentShareCarlos Garcesanswered 9 months agoMartin Schade _AWS_ 9 months agoCorrection: It is actually 1 page for synchronous operations, not 10.Some customers benefit from the Tables, Forms or Queries features even for Word documents or use the OCR geometry information. You can convert to PDF and then run against Textract.ShareCarlos Garces 9 months agoThanks @Martin Schade AWS fixed.Share0Thanks for quick response. As per my understanding only single page PDF we can go for synchronous operations. More than one page PDF we need to go for asynchronous irrespective of file size. Is it correct? Please adviseCommentSharerePost-User-6761812answered 9 months ago"


Question: Is it possible to map an S3 static website to a public static IP address?

"Hi All,A customer is using S3 to host a simple static HTML website (just a bunch of HTML pages and images).The challenge they are having is that they are not using Route53 but they need to use their own government DNS service which doesn't support alias mappings.  As they can only map the site address to a static IP.They are asking if there is a way to expose the S3 website via a static IP so that they can configure the host (A) record on their government DNS service to point to that IP.If anybody has done something similar, it would be much appreciated if I could get some advice on this scenario.FollowComment"

Answer: "0Accepted AnswerHi,It's unfortunate that they can't use Route53 :-).Global Accelerator >> ALB >> Redirect ("Native" or with Lambda functions if you want to do granular redirects) to your S3 bucket.Global Accelerator will provide the (2) public IP(s) [https://aws.amazon.com/global-accelerator/]Connect the GA to an ALB Endpoint [https://docs.aws.amazon.com/global-accelerator/latest/dg/about-endpoints-adding-endpoints.html]In the ALB, configure the redirection to your static S3 website [https://docs.aws.amazon.com/elasticloadbalancing/latest/application/load-balancer-listeners.html#redirect-actions]It's not the best architectural pattern, but it is an option that addresses your use case.Regards,CommentShareAWS-User-0009850answered 3 years ago"


Question: Unknown key - no errorr?

"This code works fine as long as there is a row in the table with the given key. However if a key ('email' here) is given for which no corresponding row exists, no error occurs, instead 'data'  is an empty object ({}).FollowComment"

Answer: "0Hi,I believe you are performing GetItem API on your DynamoDB table. Please correct me if I am mistaken here.As per GetItem API call, it is expected that if the item does not exist for that primary key then it returns empty response.Excerpt from documentation:The GetItem operation returns a set of attributes for the item with the given primary key. If there is no matching item, GetItem does not return any data and there will be no Item element in the response.Reference: https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_GetItem.htmlHope it helps you.Should you have any other concerns, do let us know. We'd be happy to help you.CommentShareAWS-User-8262921answered 4 years ago"


Question: "Multiple Origins for Cloudfront, not allowing me to change Behaviors Order"

"Hi,I have two S3 buckets that can be used by one site, therefore I am trying to combine the two with Cloudfront by adding the S3 buckets to the origins in Cloudfront settings. However, I have an issue when it comes to changing the Precedence order. I wish that the newly added Behaviors is the second one ( Precedence 1 ) however once it's created the option to move up the first Behavior its greyed out. I'm not able to find documentation to why this option is greyed out. Any advice or help, please?Both these s3 buckets have the same folder structure which is /wp-content.Thank youFollowComment"

Answer: "1When you have only two cache behavior, you can't change the order because the default one is always the last to be processed.Could you share a bit more details on what you're trying to achieve?CommentShareYury Yakubovanswered 8 months ago0You have two buckets with same folder structure ie /wp-content but the path pattern when configuring the behavior has to be unique and the first origin created would map to the default (*) path. The closest you can come to changing the order is to swap the origins for paths with precedence 0 and 1 (in behavior tab). That would also reverse the path pattern mappings. (so you need to understand what you want to accomplish in terms of path pattern matches by changing the precedence since it's not clear with info provided)You can also add a path pattern for bucket 1 and bucket2 respectively and leave the default path set to either of the buckets. But again that depends on what path pattern matching you want to set up.--SydCommentShareSydanswered 8 months ago"


Question: Permission Deny Occurs When Attempting to Back Up Files from EC2 to S3

"Permission Deny Occurs When Attempting to Back Up Files from EC2 to S3ex) # aws s3 cp /aaa/bbb/ccc.tar.gz s3://abucketupload failed: /aaa/bbb/ccc.tar.gz to s3://abucket/ccc.tar.gz An error occured (AccessDenied) when calling the PutObject operation: Access DeniedWe set up the environment as below.EC2 EnvironmentPrivate VPC (Private Network)VPC Endpoint Usage and Policy for S3Add resources you want to allow to the policy =>principle: IAM ID, add S3 bucket(abucket) nameAllow S3:* for the Action portion of the policyUse the same VPC as the EC2 VPC you want to communicate withIAM usedThe IAM account is allowed to have full privileges on EC2 and S3.SCP is not set for this IAM account.S3 bucket to approachACLBucket owner: Object [Listed, Written] / Bucket ACL [Read, Written]Everyone (public access): Object [Listed, Write] / Bucket ACL [Read, Write]Block public access (bucket settings)Block all public accessSame if you try with PublicCan you tell me which part I need to check more and why?FollowCommentalatech EXPERT3 months agoHave you associated an IAM role to the ec2 instance allowing PutObject permission on the bucket?Share"

Answer: "0Hello,Can you try the belowAssign a S3 bucket policy as below example policy that allows the ec2 instance to write.If you already have a role assigned to ec2 then you can use the same in the policy, else create new assume role for ec2 and assign that role to ec2 and use that role arn in below policy.the second statement in the policy is basically a best practice to allow only https (not related to the error you are facing){    "Version": "2012-10-17",    "Statement": [        {            "Effect": "Allow",            "Principal": {                "AWS": "arn:aws:iam::123456789:role/role_that_is_assigned_to_ec2"            },            "Action": [                "s3:ListBucket",                "s3:GetObject",                "s3:PutObject",                "s3:PutObjectAcl"            ],            "Resource": [                "arn:aws:s3:::bucket-name",                "arn:aws:s3:::bucket-name/*"            ]        },        {            "Sid": "RestrictToTLSRequestsOnly",            "Effect": "Deny",            "Principal": "*",            "Action": "s3:*",            "Resource": [                "arn:aws:s3:::bucket-name",                "arn:aws:s3:::bucket-name/*"            ],            "Condition": {                "Bool": {                    "aws:SecureTransport": "false"                }            }        }    ]}CommentSharegokul_Ganswered 3 months ago"


Question: Importing dataset files to encrypted s3 bucket

"Sagemaker Canvas allows updating files in S3 bucket either by drag'n drop or using "Select files from your computer" features. When the s3 bucket used (similar to sagemaker-<region>-<account-number>) in encrypted with custom KMS key, the upload fails with "Upload fails" (HTTP 400).Is using KMS key encrypted bucket possible? We already have a KMS key policy in place allowing these actions for canvas IAM role:"kms:ReEncrypt*","kms:GenerateDataKey*","kms:Encrypt*","kms:Describe*","kms:Decrypt*"Something else needed?FollowComment"

Answer: "0Hello,Thank you for contacting us and for using Amazon Sagemaker.I understand that you encountered an "Upload fails" (HTTP 400) message when trying to upload your dataset file from custom KMS key encrypted bucket to Sagemaker Canvas.This error might be seen when the kms bucket policy or the role isn't properly configured.Since as you mentioned, you do already have a KMS key policy in place allowing these actions for canvas IAM role: "kms:ReEncrypt", "kms:GenerateDataKey", "kms:Encrypt", "kms:Describe", "kms:Decrypt*", we would need to further investigate into the same.To be able to replicate and troubleshoot into this further, we'd need your IAM role arn, KMS key arn and Sagemaker Studio details. Hence, for further investigation on this issue, I'd recommend you to open a case with SageMaker Support Engineering team so that you can share above mentioned details securely.Open a support case with AWS using the link:https://console.aws.amazon.com/support/home?#/case/createCommentShareSUPPORT ENGINEEROjasvi_Banswered a year ago"


Question: LiteAgent.exe consumes high memory

"Hi,I'm running several C5.Large (Windows 2016) and recently started to encounter severe performance issues with my applications there.When I started to investigate, I've found that LiteAgent.exe is consuming a lot of the physical memory and also virtual memory.One of the events in the servers was:Windows successfully diagnosed a low virtual memory condition. The following programs consumed the most virtual memory: LiteAgent.exe (1836) consumed 14489743360 bytes and svchost.exe (1148) consumed 1381900288 bytes.The same error is shown on multiple instances and during the same time the Cloudwatch Agent stopped responding and send guest metrics.The SSM agent version: 2.2.355.0FollowComment"

Answer: "1Hello all,Thank You for contacting AWS Forums!The Lite Agent is a component of the AWS PV Driver package which is specifically responsible for handling Shutdown and Restart events from AWS APIs.However, this agent is not used on Nitro platform based instances (T3/M5/C5/R5, etc.) and as such, can be safely disabled. This is because, Nitro based instances use ACPI signals to perform the Reboot and Shutdown events.More information can be found here:https://docs.aws.amazon.com/AWSEC2/latest/WindowsGuide/xen-drivers-overview.html#xen-driver-awspvAs mentioned in the document linked above, "When running on Nitro generation instances, the AWS PV drivers are not used and the LiteAgent service will self-stop starting with driver version 8.2.4. Updating to the latest AWS PV driver also updates the LiteAgent and improves reliability on all instance generations."So based on the above information, to resolve the issue here, we have the following two options:Install the latest version of AWS PV drivers (even if your instance uses ENA driver for networking)Disable the LiteAgent Service altogether (as long as you are on a Nitro instance type)Please refer the instructions here to upgrade the Drivers:https://docs.aws.amazon.com/AWSEC2/latest/WindowsGuide/Upgrading_PV_drivers.htmlIn case you want to disable the service, you can run the following commands in powershell:PS C:>Set-Service AWSLiteAgent -StartupType DisabledPS C:>Stop-Service AWSLiteAgentShould you face any memory related issues with the agent even after disabling/updating it, please let us know.I hope this helps. Please let us know if you have further questions or concerns. We would be happy to help!CommentShareAWS-User-5986324answered 4 years ago0I am experiencing the same thing with several m5.large Windows 2016 instances.  Killing the process does not seem to do anything so the only way I've been able to solve it is to restart.Is there a solution for this?CommentSharepdoyle003answered 4 years ago"


Question: Domain not restored after reactivating suspended AWS account

"We had a domain, EC2 instance and hosted zone in our account. Our account was suspended due to pending payment charges. After clearing all the due amounts, EC2 instance and hosted zone is recovered. But Domain is still missing. Any advice on how we can get the domain restored?FollowComment"

Answer: 0Please raise a case with our support team - this forum is here to give you the best advice possible but we can't assist at that level and the support team can.CommentShareEXPERTBrettski-AWSanswered a year ago


Question: Unable to correctly import an OpenAPI 3.0 to API Gateway v2

"Trying to import an OpenAPI 3.0 definition generated by FastAPI. The API only gets imported partially, and these warnings are listed in the response:"Warnings": [    "Parse issue: attribute components.schemas.Place.items is not of type `object`",    "Parse issue: attribute components.schemas.Place.items is missing",    "Unable to put method 'PUT' on resource at path '/place/': Part of the given route key path is empty Ignoring.",    "Unable to put method 'GET' on resource at path '/schedule/': Part of the given route key path is empty Ignoring.",    "Unable to put method 'PUT' on resource at path '/schedule/': Part of the given route key path is empty Ignoring.",    "Unable to put method 'POST' on resource at path '/schedule/': Part of the given route key path is empty Ignoring.",    "Unable to put method 'POST' on resource at path '/booking/': Part of the given route key path is empty Ignoring."]The process is importing only 1 method per route. As a workaround I can use the old REST API, but if anyone has any idea on how to fix this for the HTTP that would be helpful. Thanks!FollowComment"

Answer: "0Please check if any of the limitations mentioned in this document https://docs.aws.amazon.com/apigateway/latest/developerguide/api-gateway-known-issues.html under the section "API Gateway supports most of the OpenAPI 2.0 specification and the OpenAPI 3.0 specification, with the following exceptions:" apply to you.Is your imported API working correctly when using REST API as opposed to HTTP API. In that case, using REST API is probably a better option for you. You can use this document https://docs.aws.amazon.com/apigateway/latest/developerguide/http-api-vs-rest.html to see the differences between the two and make an informed decision.CommentShareEXPERTIndranil Banerjee AWSanswered 8 months agoscezar 8 months agoThose limitations don't seem to apply. Also that document only talks about REST and WebSocket APIs, and REST works fine so I'll probably use that for now. But the HTTP API seems to be more fit for my application.ShareIndranil Banerjee AWS EXPERT8 months agoYes if REST is working for you, please go ahead with REST. Functionally there is very little that can be done with HTTP that cannot be done with REST. But interested to know why you think HTTP API is a better fit for your application.Share"


Question: What permissions are required on each resource when using QuickSight + Athena + Amazon S3 bucket that uses symmetric CMK from KMS

"When creating a new data set in QuickSight, I receive an error:[Simba][AthenaJDBC](100071) An error has been thrown from the AWS Athena client. Access denied when writing to location: s3://<data lake bucket>/athena-workgroups/<data mart-specific prefix>/output/<guid>.csv [Execution ID: <guid>]I have the QS service role--arn:aws:iam::<account id>:role/service-role/aws-quicksight-service-role-v0. I do not have a role with the name aws-quicksight-s3-consumers-role-v0.That role has the 4 policies that are created when you attach Athena & an S3 bucket to QS:AWSQuickSightIAMPolicyAWSQuickSightRDSPolicyAWSQuickSightRedshiftPolicyAWSQuickSightS3PolicyAWSQuickSightS3Policy contains this:{    "Version": "2012-10-17",    "Statement": [        {            "Effect": "Allow",            "Action": "s3:ListAllMyBuckets",            "Resource": "arn:aws:s3:::*"        },        {            "Action": [                "s3:ListBucket"            ],            "Effect": "Allow",            "Resource": [                "arn:aws:s3:::<data lake bucket>"            ]        },        {            "Action": [                "s3:GetObject",                "s3:GetObjectVersion"            ],            "Effect": "Allow",            "Resource": [                "arn:aws:s3:::<data lake bucket>/*"            ]        },        {            "Action": [                "s3:ListBucketMultipartUploads",                "s3:GetBucketLocation"            ],            "Effect": "Allow",            "Resource": [                "arn:aws:s3:::<data lake bucket>"            ]        },        {            "Effect": "Allow",            "Action": [                "s3:PutObject",                "s3:AbortMultipartUpload",                "s3:ListMultipartUploadParts"            ],            "Resource": [                "arn:aws:s3:::<data lake bucket>/*"            ]        }    ]}I've added the following policy/policies to the KMS key used on the data lake S3 bucket:{    "Sid": "Allow access to data for Athena.",    "Effect": "Allow",    "Principal": {        "Service": "athena.amazonaws.com"    },    "Action": [        "kms:Decrypt",        "kms:Encrypt",        "kms:GenerateDataKey*"    ],    "Resource": "*"},{    "Sid": "Allow access to data for QuickSight.",    "Effect": "Allow",    "Principal": {        "AWS": "arn:aws:iam::<account id>:role/service-role/aws-quicksight-service-role-v0"    },    "Action": [        "kms:Decrypt",        "kms:Encrypt",        "kms:GenerateDataKey*"    ],    "Resource": "*"},{    "Sid": "Allow access to data for QuickSight.",    "Effect": "Allow",    "Principal": {        "Service": "quicksight.amazonaws.com"    },    "Action": [        "kms:Decrypt",        "kms:Encrypt",        "kms:GenerateDataKey*"    ],    "Resource": "*"}I'm at a bit of a loss for how to continue. I've got what feels like wide open permissions, but I still receive that error while trying to create a data set that targets anywhere in that S3 bucket.FollowComment"


Question: External Id Authentication for Eventbridge cross account events

"Hi,i have 2 aws accounts and i use eventbridge to emit events from x account to y account.i have configured the respective roles on both emitting side and receiving side and they work perfectly well.As a security measure i want to use an external id when giving access to resources for other accounts, which is recommended in aws iam docs.i have surfed the internet for a while but couldn't find any examples or guides that helps me in achieving this.i know that i can add a condition on receiving role policy with that external id from docs but unable to figure out how to send the external id when calling the put events.i use python with boto3 sdk. the answer need not by language specific. i would be glad if an approach is suggested.FollowComment"

Answer: "0You pass the ExternalId when you assume the role. See:assume_roleAssume a role with AWS STS using an AWS SDKWhen should I use an external ID?You should always specify the external ID in your AssumeRole API calls. Check this link, assume_role, for an example code on passing the ExternalId when assuming the role.So, the code running in account-x wants to put an event in account-y. The code in account-x just needs to add the ExternalId as a part of the assume role call to get credentials for account-y.CommentShareEXPERTkentradanswered 2 months agoPrasanth 2 months agocan you guide me to do this with some code examples using python?i have gone through those docs previously also. but couldn't find what is the exact implementation that has to be changed.from emitting side we are just calling the event bridge put events method.also i am curious that is this external id passing applicable to eventbridge events as its basically an aws serviced and not a third party serviceShare"


Question: Audio Debugging Audio Area Entity in LY?

"Hello,I had a question about debugging an Audio Area Entity. In this tutorial using Cryengine they use commands in the console to help the player see when the audio triggers using s_drawaudiodebug abcde and s_audioimplname CryAudioimplWwise. I looked on here and LY docs and I cant seem to find anything explaining the LY version of s_audioimplname CryAudioimplWwise. Can someone please help?Thank you,-JeffFollow"

Answer: "0Accepted AnswerHi @REDACTEDUSERYou don't need to be setting the implementation name. You'd only need to use that if your team had written, say, an FMOD integration and wanted to use that instead of Wwise. That said, on Lumberyard, the cvar is named s_AudioSystemImplementationName.For debug drawing audio-related information on screen, you can use s_DrawAudioDebug. As you've seen, the characters you pass as options are like flags. Type s_DrawAudioDebug ? to see the help info about the command, or simply type the command without any options to see the current value.If you want to see the red spheres and text where sounds are playing, then abcde should be fine. Another helpful flag combo that I use is vw which shows active audio objects and events in a list. If you are having any issues with banks, use x to show the currently loaded soundbanks. And finally, to turn off the display, just pass zero (0) to the command.Hope this helps!SharerePost-User-2819140answered 6 years ago0The docs should have a list, but the simpler way to see the audio-related ones is by using the console directly. Audio cvars are all prefixed the same, just start typing s_ in the console and hit <TAB>, it will show you all the audio commands. If you want to get help on any command, enter it with a ? as I mentioned before.SharerePost-User-2819140answered 6 years ago0@REDACTEDUSERAwesome! Thank you. Let me test this out and confirm.Also while we are on the subject is there a list of all the flags on LY somewhere preferably audio flags :)?Thanks again-JeffSharerePost-User-1007683answered 6 years ago0Ahh ok, sounds good.Thank you very much !SharerePost-User-1007683answered 6 years ago0@REDACTEDUSERSharerePost-User-1007683answered 6 years ago"


Question: Where can I find AWS Support charges?

"I m trying to find the AWS Support monthly charges in Bills page or Cost Explorer, but fail.The AWS account I m working on is a member of an AWS Organization, our Support Plan was upgraded to Business in June 2022. I logged in as an IAM user with some permissions (aws-portal:*, ce:*) in Bills page and Cost Explorer.Following a knowledge center article 'How am I billed for AWS Support?' (https://aws.amazon.com/premiumsupport/knowledge-center/support-billing/ , see content quoted below), I cannot find Support section in Bills page anyway.How am I billed for AWS Support?I want to sign up for a paid AWS Support plan, and I want to know how I'm charged for it.ResolutionWhen you sign up for a paid AWS Support plan, your payment method is charged a prorated minimum monthly service charge on your first monthly bill. If applicable, usage charges that exceed the monthly minimum charge are also billed at the end of the month.You can see your monthly charges, including your prorated charges, by expanding the Support section on your Bills page.My Question: is there any suggestion for finding AWS Support monthly charges of an AWS Organization member account?Thanks.FollowComment"

Answer: "0Accepted AnswerIt depends which Organization structure you have, so it's likely that only the support team (when you open the billing support case) will be able to advise you as they'll see how you are subscribed, so I suggest opening a support case and ask. Note that support is charged based on your monthly usage amount, and NOT the number of support cases you open, I just wanted to clarify it just in case :)In some cases for support plans such as Business or Enterprise, the support charges will be reflected ONLY on the Management Payer account of the Organization. That of course depends on the plan, and whether you were subscribed with any special agreement that you might have with AWS (either via your company, or via partner / reseller / solution provider your company is working with). If you don't see your support charges throughout the month, then most likely these charges are going only to the Payer account in your Organization.CommentShareEXPERTNataliya_Ganswered a year agorePost-User-8151521 a year agoThanks for the suggestion.SharerePost-User-8151521 10 months agoOur situation was answered in an AWS support case, we can get support plan charges info via our solution provider (payer account in Organization), not directly in our account. Thanks again.Share0As you only upgraded to Business Support in June 2022 (you don't specify which support plan you had previously, I'm guessing Basic Support) - this will only show in the July bill for your account.This will be generated early in July, so should appear in your account in the next week or so if not already there.At this point the instructions you quoted in your initial post should work.CommentShareGreg_Hanswered a year agorePost-User-8151521 a year agoThe Support Plan of our AWS account was upgraded to 'Business' from 'Basic', on June 10, 2022. I will check Bills page this month. Thanks.SharerePost-User-8151521 a year agoBesides the AWS account mentioned in the question, I also check another 2 accounts and have finding as followsAWS Account #2: is a member of an AWS Organization and has joined Support Plan 'Business' for months. In an IAM user logged-in session, no Support section is shown in Bills page.AWS Account #3: is not a member of any AWS Organizaton. Joined Support Plan 'Developer' yesterday (July 5). In an IAM user logged-in session, Support (Developer) section is shown in Bills page today (July 6).Share0Recently redesigned bills page.We can view AWS support charges from the "Charges by Service" tabCommentSharehayao-kanswered a year ago0Thanks for your reply. I cannot find AWS support charges in 'Charges by Service' tab in 'Bills' page anyway.CommentSharerePost-User-8151521answered a year ago"


Question: Samples Project Windows Launcher not opening (Crashing)

"OK, so the editor works, the levels load on the editor, I've exported to engine, but when I open it, I get this screen: (Also I'm using Windows 7 64bit and VS2015) {I also tried on my Windows 10 machine and it doesn't even open at all}REMOVEDUPLOADThis is the error code:  Problem signature:Problem Event Name:APPCRASHApplication Name:SamplesProjectLauncher.exeApplication Version:1.14.0.0Application Timestamp:5b0c2fa5Fault Module Name:Gem.LegacyGameInterface.3108b261962e44b6a0c1c036c693bca2.v1.0.0.Fault Module Version:0.0.0.0Fault Module Timestamp:5b0c2bf5Exception Code:80000003Exception Offset:0000000000022883OS Version:6.1.7601.2.1.0.256.1Locale ID:2057Additional Information 1:148aAdditional Information 2:148a282940dc16ccc54f56c52c05d06dAdditional Information 3:6473Additional Information 4:6473e062662d7c7a39276b7dde55ed84OK, so I can see that it's a problem with a gem, but how would I resolve this?Thanks,DanFollow"

Answer: "0Accepted AnswerOK, so I figured it out, and it appears that it was exactly what the error said, I removed the LegacyGameInterface gem and a few others, rebuilt the project and it had no problems. The launcher opens.SharerePost-User-9232254answered 5 years ago0I was launching the editor from that folder, the problem is the SamplesProjectLauncher.exe isn't opening and I am using that one. Also what about the problem with Windows 7?SharerePost-User-9232254answered 5 years ago0I have just spent 4 hours using the **lmbr_waf build_win_x64_vs*2017*_profile -p all **command and still nothing has come of the executable. It just won't open (This is using Windows 10 now)SharerePost-User-9232254answered 5 years ago0If you compiled with vs2017 you need to launch the editor from the bin64vc141 folder. Also I cannot open the editor compiled with vs2017 15.7, using the 15.6 build works just fine.SharerePost-User-4372553answered 5 years ago"


Question: Runtime error on f1 instance: [XRT] ERROR: No devices found

"Hi!I am new to FPGA development, and I am working on a project with Vitis on an AWS instance. Both the host and kernel code is written in C/C++, and it successfully passed software and hardware emulations in Vitis.For synthesis and emulations, I am using a c4.4xlarge instance with the FPGA Developer AMI - 1.8.1. After doing a system hardware build, creating an AFI, and waiting for the AFI to be available, I stop the c4.4xlarge instance, and changed it to a f1.2xlarge instance.Then in the f1.2xlarge instance, I followed the steps in Link: https://github.com/aws/aws-fpga/blob/master/Vitis/README.md to source the vitis_runtime_setup.sh script, sourcing this script showsINFO: XRT Runtime setup DoneINFO: XRT Install, non-devINFO: Starting MPDINFO: Vitis runtime check PASSEDThen I do $ systemctl status mpd to check mpd status, and it shows● mpd.service - Xilinx Management Proxy Daemon (MPD)Loaded: loaded (/etc/systemd/system/mpd.service; disabled; vendor preset: dis      abled)Active: inactive (dead)Then I execute the host code by doing ./host ./binary_container_1.awsxclbin. and the error arises:Current working dir: /home/centos/Vitis-tutorial/aws-fpga/Vitis/toolsFile opened successfully!XRT build version: 2.3.0Build hash: 9e13d57c4563e2c19bf5f518993f6e5a8dadc18aBuild date: 2020-02-06 15:08:44Git branch: 2019.2PID: 3639UID: 1000[Tue Jun 30 15:24:36 2020]HOST: ip-172-31-18-64.ec2.internalEXE: /home/centos/Vitis-tutorial/aws-fpga/Vitis/tools/host[XRT] ERROR: No devices found../src/xcl2.cpp:48 Error calling err = cl::Platform::get(&platforms), error code is: -1I am not sure where the problem could be since I am using the latest version of the fpga developer AMI which should have the corresponding XRT pre-installed? Please let me know if more details should be provided, and thank you for reading through this post!Any help is greatly appreciated!!Thank you,OwenFollowComment"

Answer: "0Accepted AnswerHi Owen,Are you by any chance running as 'centos'? To run the application, once mpd has started, you can check:sudo systemctl status mpd● mpd.service - Xilinx Management Proxy Daemon (MPD)   Loaded: loaded (/etc/systemd/system/mpd.service; disabled; vendor preset: disabled)   Active: active (running) since Tue 2020-07-07 18:21:57 UTC; 3min 11s ago Main PID: 1891 (mpd)   CGroup: /system.slice/mpd.service           └─1891 /opt/xilinx/xrt/bin/mpdJul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: [0:0:1d.0] read 72 bytes out of 72 bytes from fd 5, valid: 1Jul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: AwsDev: 0000:00:1d.0(index: 0)Jul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: [0:0:1d.0] mpd daemon: request 11 received(reqSize: 24)Jul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: [0:0:1d.0] write 2104 bytes out of 2104 bytes to fd 5Jul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: [0:0:1d.0] msg arrived on mailbox fd 5Jul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: [0:0:1d.0] retrieved msg size from mailbox: 48 bytesJul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: [0:0:1d.0] read 80 bytes out of 80 bytes from fd 5, valid: 1Jul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: [0:0:1d.0] mpd daemon: request 10 received(reqSize: 32)Jul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: AwsDev: 0000:00:1d.0(index: 0)Jul 07 18:22:10 ip-172-31-39-217.ec2.internal mpd[1891]: [0:0:1d.0] write 524360 bytes out of 524360 bytes to fd 5After that you can source the runtime setup script as root:[centos@ip-172-31-39-217 aws-fpga]$ sudo -E /bin/bash[root@ip-172-31-39-217 aws-fpga]# source vitis_runtime_setup.shINFO: Setting up environment variablesINFO: Changing AWS_FPGA_REPO_DIR from /home/centos/src/project_data/aws-fpga to /home/centos/aws-fpgaINFO: Sourcing sdk_setup.shINFO: Setting up environment variablesDEBUG: AWS_FPGA_REPO_DIR=/home/centos/aws-fpgaEntering /home/centos/aws-fpga/sdk/userspace/utilsrm -f *.o *.a ../lib/libutils.acc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g -std=gnu99 -fPIC -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I. -I../include -I/usr/include   -c -o io.o io.ccc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g -std=gnu99 -fPIC -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I. -I../include -I/usr/include   -c -o log.o log.ccc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g -std=gnu99 -fPIC -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I. -I../include -I/usr/include   -c -o logger-kmsg.o logger-kmsg.cmkdir -p ../libar rcs ../lib/libutils.a io.o log.o logger-kmsg.oEntering /home/centos/aws-fpga/sdk/userspace/fpga_libs/fpga_pcirm -f *.o ../../lib/libfpga_pci.acc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g -std=gnu99 -fPIC -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I. -I../../include -I/usr/include   -c -o fpga_pci.o fpga_pci.ccc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g -std=gnu99 -fPIC -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I. -I../../include -I/usr/include   -c -o fpga_pci_sysfs.o fpga_pci_sysfs.cmkdir -p ../../libar rcs ../../lib/libfpga_pci.a fpga_pci.o fpga_pci_sysfs.oEntering /home/centos/aws-fpga/sdk/userspace/fpga_libs/fpga_dmarm -f *.o ../../lib/libfpga_dma.acc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g -std=gnu99 -fPIC -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I. -I../../include -I/usr/include   -c -o fpga_dma_utils.o fpga_dma_utils.cmkdir -p ../../libar rcs ../../lib/libfpga_dma.a fpga_dma_utils.oEntering /home/centos/aws-fpga/sdk/userspace/fpga_libs/fpga_mgmtrm -f *.o ../../lib/libfpga_mgmt.a ../../lib/so/libfpga_mgmt.so.1.0.0cc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g -std=gnu99 -fPIC -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I. -I../../include -I/usr/include   -c -o fpga_mgmt_cmd.o fpga_mgmt_cmd.ccc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g -std=gnu99 -fPIC -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I. -I../../include -I/usr/include   -c -o fpga_mgmt.o fpga_mgmt.ccc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g -std=gnu99 -fPIC -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I. -I../../include -I/usr/include   -c -o fpga_hal_mbox.o fpga_hal_mbox.cmkdir -p ../../libfor library in ../../lib/libfpga_pci.a ../../lib/libutils.a ../../lib/libfpga_dma.a; do ar -x $library; donear rcs ../../lib/libfpga_mgmt.a *.omkdir -p ../../lib/socc -o ../../lib/so/libfpga_mgmt.so.1.0.0 -shared fpga_mgmt_cmd.o fpga_mgmt.o fpga_hal_mbox.o -Wl,-soname,libfpga_mgmt.so.1 -Wl,--whole-archive ../../lib/libfpga_pci.a ../../lib/libutils.a ../../lib/libfpga_dma.a -Wl,--no-whole-archive -lrt -lpthreadln -sf libfpga_mgmt.so.1.0.0 ../../lib/so/libfpga_mgmt.soEntering /home/centos/aws-fpga/sdk/userspace/fpga_mgmt_tools/srcrm -f *.o *.a fpga-local-cmd static-fpga-local-cmdcc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g  -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I../../include/hal -I../../include -I../. -I.   -c -o fpga_local_cmd.o fpga_local_cmd.ccc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g  -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I../../include/hal -I../../include -I../. -I.   -c -o fpga_local_cmd_parse.o fpga_local_cmd_parse.ccc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g  -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I../../include/hal -I../../include -I../. -I.   -c -o virtual_jtag_pcie.o virtual_jtag_pcie.ccc -DCONFIG_LOGLEVEL=0 -DFPGA_PCI_BARS_MAX=64 -DCLI_VERSION='"1.4.14"' -g  -Wall -Werror -W -Wno-parentheses -Wstrict-prototypes -Wmissing-prototypes -I../../include/hal -I../../include -I../. -I.   -c -o virtual_jtag_server.o virtual_jtag_server.ccc -o fpga-local-cmd fpga_local_cmd.o fpga_local_cmd_parse.o virtual_jtag_pcie.o virtual_jtag_server.o -L../../lib/so -lfpga_mgmtcc -o static-fpga-local-cmd fpga_local_cmd.o fpga_local_cmd_parse.o virtual_jtag_pcie.o virtual_jtag_server.o -L../../lib -lfpga_mgmt -lrt -lpthreadBuild complete.Executing as root...AWS FPGA: Copying Amazon FPGA Image (AFI) Management Tools to /usr/binAWS FPGA: Installing shared library to /usr/local/lib64libfpga_mgmt.so.1 (libc6,x86-64) => /usr/local/lib64/libfpga_mgmt.so.1AWS FPGA: Installing python bindings for FPGA management libraryInstalled /usr/lib64/python2.7/site-packages/fpga_dma.pyInstalled /usr/lib64/python2.7/site-packages/fpga_mgmt.pyInstalled /usr/lib64/python2.7/site-packages/fpga_pci.pyAWS FPGA: Done with Amazon FPGA Image (AFI) Management Tools install.Done with SDK install.INFO: sdk_setup.sh PASSEDINFO: You are using instance with installed vivado tools. determining VIVADO version for runtime setup...INFO: VIVADO_TOOL_VERSION is 2019.2INFO: Installed kernel version : 3.10.0-1062.4.1.el7.x86_64INFO: kernel version 3.10.0-1062.4.1.el7.x86_64 has been validated for this devkit.INFO: Xilinx Vivado version is 2019.2INFO: XRT installed. proceeding to check version compatibilityINFO: Installed XRT version : 2019.2:9e13d57c4563e2c19bf5f518993f6e5a8dadc18aINFO: XRT version 2019.2:9e13d57c4563e2c19bf5f518993f6e5a8dadc18a is supported.INFO:  Now checking XOCL driver...INFO: Found 'xocl Driver is installed and running. 'XILINX_XRT      : /opt/xilinx/xrtPATH            : /opt/xilinx/xrt/bin:/home/centos/aws-fpga/shared/bin/scripts:/opt/Xilinx/Vitis/2019.2/bin:/opt/Xilinx/Vivado/2019.2/bin:/sbin:/bin:/usr/sbin:/usr/bin:/srv/git/centos-git-commonLD_LIBRARY_PATH : /opt/xilinx/xrt/lib:PYTHONPATH     : /opt/xilinx/xrt/python:/home/centos/aws-fpga/shared/lib:/home/centos/aws-fpga/shared/bin/scripts:/opt/Xilinx/Vitis/2019.2/bin:/opt/Xilinx/Vivado/2019.2/bin:/sbin:/bin:/usr/sbin:/usr/bin:/srv/git/centos-git-commonINFO:  XRT Runtime setup DoneINFO: XRT Install, non-devINFO: Starting MPDINFO: Vitis runtime check PASSED<Run your application now>Hope this helps.-DeepCommentShareDeep_Panswered 3 years ago0Hi Owen,XRT is preinstalled on the FPGA Developer AMI.It seems like MPD failed or did not start in this case. Could you run:sudo systemctl start mpdsudo systemctl status mpdIf it still isn't running, could you share the output of:sudo journalctl -u mpdThat way we can get more information on why MPD failed to start. Also, what region are you running this in? For MPD, we have to load a default AFI to change the PCI Device ID that the driver binds to, so another thing to check is to see is the device id on the slot.Thanks,DeepEdited by: awsdeep on Jun 30, 2020 2:07 PMCommentShareDeep_Panswered 3 years ago0Hi Deep,Thank you so much for your reply! I am running in us-east-1 region (N. Virginia). I tried the first two commands but mpd is still not running...The output of $ sudo journalctl -u mpdshows -- No entries --Could you please let me know how I can check the device ID? I also tried starting another f1 instance (without changing from c4.4xlarge). On that instance, everything works fine: mpd starts successfully and the program runs successfully.However, I would still prefer being able to change the c4.4xlarge instance to f1 instance to execute the program. This way I don't have to keep two copies of the EBS storage space... Please let me know if there is anything that I can do.Thank you,OwenCommentShareOwenooolanswered 3 years ago0I am working on a project with Vitis on an AWS instance. I followed the instructions of helloworld lab in website: https://github.com/Xilinx/Vitis-AWS-F1-Developer-Labs/blob/master/modules/module_01/lab_01_vitis_env_setup.mdWhen I run "make run TARGET=hw", it showed:[XRT] ERROR: No devices foundIt is because MPD wasn't started.I checked the status of MPD, it showed:ConditionDirectoryNotEmpty=/dev/xfpga was not metIt seems the same problem of this, but I cannot find how you resolved the problem of "ConditionDirectoryNotEmpty=/dev/xfpga was not met" and launched MPD successfully.Could you help me?CommentSharecclanswered 12 days ago"


Question: Unable to Display go version

"Dear Community,I'm using Amazon Linux to connect my Mac Terminal. While following Step 4.1 "Install Package" - so far I'm able to view the Output of "Sudo Docker Version" and "sudo /usr/local/bin/docker-compose version".(https://docs.aws.amazon.com/managed-blockchain/latest/hyperledger-fabric-dev/get-started-create-client.html)When comes to "go version" - I keep getting Error message:-bash: go: command not foundBut I have installed the latest Go and tried to Run it:[ec2-user@ip-172-31-22-105 ~]$ cd go[ec2-user@ip-172-31-22-105 go]$ lsCONTRIBUTING.md  PATENTS    SECURITY.md  api  codereview.cfg  lib   pkg  testLICENSE          README.md  VERSION      bin  doc             misc  src[ec2-user@ip-172-31-22-105 go]$ go version-bash: go: command not foundAny idea how to solve this? Thanks.FollowCommentDidier_AWS a month agoFirst thing to check: is the 'go' command in your $PATH env var ?so, type 'echo $PATH' and check if the path to go binary is in the listIf not, add it permanently by following: https://linuxize.com/post/how-to-add-directory-to-path-in-linux/SharerePost-User-7775189 a month agoHi @Didier_AWS, thanks for getting back to me. When I type 'echo $PATH' in the linux terminal (connected to my Mac Terminal), the Output is this --> /usr/local/go/bin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/home/ec2-user/go/src/github.com/hyperledger/fabric-ca/bin:/usr/local/go/binAs for the link provided, have read through it and did an update my  "/.bash_profile". But still the same.[ec2-user@ip-172-31-22-105 ~]$ source ~/.bash_profile[ec2-user@ip-172-31-22-105 ~]$ go version-bash: go: command not foundKindly refer to the copied and paste of the content "/.bash_profile"Update PATH so that you can access the go binary system wideexport PATH=$GOROOT/bin:$PATHexport PATH=$PATH:/home/ec2-user/go/src/github.com/hyperledger/fabric-ca/binexport PATH=$PATH:/usr/local/go/binexport PATH="$HOME/bin:$PATH"SharerePost-User-7775189 a month ago@Didier_AWS,User specific environment and startup programsPATH=$PATH:$HOME/.local/bin:$HOME/binGOROOT is the location where Go package is installed on your systemexport GOROOT=/usr/local/goGOPATH is the location of your work directoryexport GOPATH=$HOME/goDoes the above might affect it?SharerePost-User-7775189 23 days agoHi @Didier_AWS - thanks for getting back to me but the problem has been resolved. All is because that the Linux Terminal Processor is running as aarch64 - ARM64 whereby I've installed the AMD instead.Right now, I'm able to display the go version already.Thanks again.Share"


Question: Amazon beanstalk deployment suddenly very slow. Any idea why?

"Recently, we have seen the deployment time required for our Amazon Elastic Beanstalk go from 4 minutes to over 15 minutes. We're on a customized version of the canned Tomcat server (customized to add JDK, where the standard version only has JRE).The WAR files haven't changed significantly in size (they're all around 82.2M).Anybody have any idea what could be going wrong?FollowComment"

Answer: "0It turned out to be something we were doing (unnecessarily, as it turns out), that was taking longer because it was suddenly processing more information.CommentShareTouchtonecorpanswered 4 years ago"


Question: Workmail not displaying email

"My workmail is not displaying emails. However, I did setup an incoming rule in SES, to save incoming emails to my workmail account to s3. The emails are getting saved to s3, however the emails are not showing up in my workmail inbox.FollowComment"

Answer: "0Hi,I'm sorry to hear you're experiencing problems receiving mail. Maybe the SES rule to save to S3 has a stop condition?Kind regards,RobinCommentShareMODERATORrobinkawsanswered 6 months ago"


Question: Emergency Floating Point Logic Error Repairs?

"Dear Corretto,We have been encountering brickwall problems trying to interact with Oracle, the JCP and the OpenJDK in terms of Java floating point, since they are refusing to interact with us, discuss, or be persuaded.  This leaves no options at all, in a necessary and obligate sitation.From what we have gathered, both ourselves and more widely, IEEE 754 has a blind spot in it. An incompletion where either right or wrong can creep in. This is towards the right hand side of float or double arithmetic and StrictMath method calls, where you can have a straddling value for the last decimal place. At that point there is presently room for confusion between the decimal and the binary; the decimal, which the human and further logic, mathematics or software needs, and the binary, which is converterted to and away from, that the computer needs to perform operations on.Since binary is for computers, and decimal is for humans, the most important root fact anyway, dealing with both of them means that you should deal with them one at a time, or convert them, entirely, one to the other. This is exactly what Java floating point does not do. It deliberately confuses the two, at the wrong time, with denormals and pronormals, at the last unit place in float and double decimal numbers, leading to what is accurately referred to as a 'floating point errors', even though no Java exception objects are thrown at the time.When the Java switch statement was enhanced, so that programmers could immediately switch via a String, and could also coelesce switch options using the -> operator, there was no split in Java because of an incompatability. The fact that people had cause to learn something different and new about switch was no problem either. The two compatability options, one of which was a technical enhancement, only improved the circumstances for everyone; the programmers, users and vendors.The BigInteger, BigDecimal, https://github.com/eobermuhlner big-math workarounds waste too much memory too much speed, both. The superior approach for floating point types, aside from problems with Arbitrary Precision on their own, is to just plain correct floating point errors by means of SSE hardware in the CPU floating point unit, the Maths Co-Processor, which almost all PCS have these days, at the point of 2022; in fact they have successors past SSE, since SSE itself is all the way up to version 4.2.The thing with a patch is that it is not the main stream, the primary product. People have the specific option to include one or not. Who could want or need a denormal or pronormal value, exactedly? Any speed difference between accurate or innacurate is negligible because of SSE and similar anyway. Why should all ubiquity Java Developers have no broader choice about how they react about an incomplete, therefore incorrect and flawed standard, and implementation? Present workarounds are only that, workarounds; while within float and double ranges, these workarounds are even slower and larger in RAM than needs be. A patch can leave the writing or reading or exchange of float and double between Java code spaces exactly the same, or enhanced, providing complete choice between two Java floating point operation modes.Most importantly, what should happen about floating point error correction should Oracle, OpenJDK, JCP et al, the ideal points for improvement on FP errors, never listen, and persist in leaving these errors and program operations problem intact? Surely it would be better for a downstream vendor to offer a patch for the problem, which is lower, even really no risk and apart from their mainstream OpenJDK and Open JRE, than this error problem remain ongoing and neglected in place, with its present crazy consequences, forever.If these are the needs and the circumstances,  Corretto should still consider a special Floating Point patch for Corretto Java, despites everything so far?FollowComment"


Question: Why am I getting this error: MessageRejected MessageRejected: Email address is not verified. The following identities failed the check in region US-WEST-2

"I run the sample AWS Go SES code, and I get the following error:MessageRejected MessageRejected: Email address is not verified. The following identities failed the check in region US-WEST-2: scott.XXXXXXo@sXXXXXXXXXs.com, scott@yaXXXXXXy.comMy SES account is in production mode, not sandbox, which should eliminate this problem. But I verified the address anyway, and the error is still happening.Link to AWS SES code used: https://docs.aws.amazon.com/sdk-for-go/v1/developer-guide/ses-example-send-email.htmlThank you for your help in advance,ScottFollowComment"

Answer: "0Hi,Have a look at this troubleshooting guide: https://aws.amazon.com/premiumsupport/knowledge-center/ses-554-400-message-rejected-error/CommentShareEXPERTalatechanswered 4 months agoSavUp 4 months agoThank you, and I have already reviewed this guide.Sharealatech EXPERT4 months agoSo above steps did not work and error is the same?Share0That is correct.CommentShareSavUpanswered 3 months ago0Was your account removed from the sandbox in the us-west-2 region, or a different region? According to the SES documentation, "the sandbox status for your account is unique per each AWS Region." So if you were removed from the sandbox in, say, us-east-1, then you'll see failures when you try to send through us-west-2.CommentShareEXPERTBrentAtAWSanswered 3 months ago"


Question: "CDK Action allows only one Input, but I need two"

"Hi all,my project repository setup is like this:../lambda./infrastructureI am using CDK with Java and I have a maven build both in the "lambda" sub-folder (which contains my lambda code) and in the "infrastructure" folder (which contains my CDK code).In my CodeCatalyst workflow, I was planning to execute my "mvn package" (which builds the lambda jar file) and save this artifact. Then, this artifact needs to be used in the "cdk deploy" action. But as the "cdk deploy" action also needs the "source" input, I would need two inputs.CodeCatalyst denies that with an error message:Action InfrastructureDeployment declares 2 input artifacts which is more than the maximum count (1)Does anyone have an idea on how to resolve that?Thanks!Johannes  BaseInfrastructureDeployment:    Identifier: aws/cdk-deploy@v1    Configuration:      CdkRootPath: infrastructure      Region: eu-central-1      StackName: BaseStack    Compute:      Type: Lambda    Environment:      Connections:        - Role: CodeCatalystPreviewDevelopmentAdministrator-z4s5g1          Name: "916032256060"      Name: alpha    DependsOn:      - Build    Inputs:      Variables:        - Name: CODEBUILD_SRC_DIR_LambdaBuildOutput          Value: /artifacts/BaseInfrastructureDeployment/lambda_build/lambda/target/lambda-1.0.0-jar-with-dependencies.jar        - Name: xxx          Value: test      Artifacts:        - lambda_build      Sources:        - WorkflowSourceFollowComment"

Answer: "1Hi Johannes,We are working on a fix for this issue and will post an update as soon as we have the fix deployed. You should be able to define multiple inputs - only one in the Sources section, but up to 2 in the Artifacts section. Additionally, we are also working on the ability to catch these types of constraints when you commit the workflow instead of waiting till the workflow is run.CommentShareMODERATORRanjithanswered 5 months agoLockhead 5 months agoHi RanjithThanks for the feedback!Is there an ETA on this?It blocks me from moving my personal project over :-)Working with "monorepos" (Where infrastructure, application code, UI code are in one repository) seems to be challenging in CodeCatalyst - or is there a best practice on how to set up projects "correctly"?ShareLockhead 4 months agoAny updates on this one, @Ranjith?Share0Accepted AnswerHi Johannes,We have removed the restriction on the CDK deploy action to have both input source and artifacts. Let us know if you are able to build and deploy your Lambda application?CommentShareMODERATORRanjithanswered 4 months agoLockhead 4 months agoHI RanjithThanks, this works now and I am able to move on!Great stuff!Thanks again for your support!Share0Hi Johannes,On the CDK issue, we'll get back to you with a timeline early next week.Regarding monorepos, can you elaborate what you are trying to achieve? You can have a workflow per service in your monorepo by configuring the FilesChanged attribute in the Trigger section to start a workflow run on changes in specific folders. Let us know if the Examples section helps you.CommentShareMODERATORRanjithanswered 4 months agoLockhead 4 months agoWell, essentially if you use a monorepo you neeed to do a lot of "changing directories" in CodeCatalyst today as I see it - going from one to another directory to execute parts of the deployments and stuff like that. I am not sure that my comment is making sense and it might come down to the "project setup" (and the used build tool) to resolve this to be honest.The idea to have a specific workflow triggered for "FilesChanged" -- will look at that and see if it makes things easier for me.Share0Johannes, thanks for the quick response. I'm glad to hear that you were able to get your workflow to work.CommentShareMODERATORRanjithanswered 4 months ago"


Question: I ask you a question about pre-payment.

"I'd like to use AWS service in advance.How can I pay in advance? There is an option called 'Advanced Pay' in the manual, but I don't know where the billing console is.The first attached photo is related to the manual.The second picture attached is the billing console I am looking at.Is the pre-payment method a method of using as much as the pre-payment and additional payment is made for the additional part of the service? Or is the service suspended if I use all the pre-paid ones? If possible, I would like to use the latter method, is it possible?FollowComment"

Answer: "0Hi TherePer https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/manage-advancepay.htmlAdvance pay is in public preview for AWS Billing and Cost Management and is subject to change. This feature is available for a select group of customers.As for your question about what happens after the funds are depleted, it is likely that the services will continue to run as normal and you will still be responsible for the charges.CommentShareEXPERTMatt-Banswered 4 months agorePost-User-1919222 4 months agoHello. Thank you for your answer. It helped me a lot in the progress of the AWS research project at the university.However, I have additional questions after seeing your answer.I think the current pre-payment method only applies to some groups, but is there any way I can use AWS service as a pre-payment method? I don't understand it intuitively when I saw the guide. Please answer me!Share"


Question: Can AWS Amplify be deployed inside a VPC?

Can AWS Amplify be deployed inside a VPC?FollowComment

Answer: 0This is currently not supported. You may like to elaborate your scenario to understand if any alternative solution can help.CommentShareEXPERTHrushi_Ganswered 3 months ago


Question: ElastiCache for Redis load distribution

"We are using ElastiCache for Redis with cluster mode disabled, scaled up for all 5 nodes using cache.m6g.large, connecting to the reader endpoint of the cluster from a multi-instance Node.js application running in ECS. Application instances seem to be assigned to reader nodes randomly, resulting a random distribution of load between the nodes. This works out as an even distribution sometimes, some other times one or two nodes cap out at 100% engine CPU utilization (crashing our application) while others run idle. Please advise, how should we distribute connections evenly at all times?FollowComment"

Answer: 0Have you ever figured out what was causing this problem with distributing reads?CommentSharePiotranswered 3 months ago


Question: Cannot configure Guardduty 'findings export options' to an S3 bucket

"Under Guardduty > Settings there's an option to export findings to an S3 Bucket. It requires KMS and a KMS key that has been configured. I consistently get the following error: "Failed to configure export options because GuardDuty does not have permission to the KMS key, the S3 bucket, or the specified location in the bucket."To fix this I've tried:Changing the ACL for the S3 bucketRegenerating the KeyCreated the key following these instructions: (see Step 3) https://docs.aws.amazon.com/guardduty/latest/ug/guardduty_settingup.htmlFollowComment"

Answer: "0Hi There,As the error message - 'Failed to configure export options because GuardDuty does not have permission to the KMS key, the S3 bucket, or the specified location in the bucket', mentions the permission related issue. There are couple of things to confirm to resolve this error -Check if your configuration to export the findings is region-specific.That means, your S3 bucket and KMS key should be in the same region, where you are performing this action.Correct S3 and KMS Key Polices.In the key policy, GuardDuty needs the following permission [1]:{   "Sid": "Allow GuardDuty to use the key",   "Effect": "Allow",   "Principal": {       "Service": "guardduty.amazonaws.com "           },           "Action": "kms:GenerateDataKey",           "Resource": "*"}To export Guardduty findings to S3 bucket which is encrypted with KMS key, certain permissions are required. Please refer the below documentation link for the same.Permissions required to configure findings export: [2]==================References==================================[1] Granting GuardDuty permission to a KMS key: https://docs.aws.amazon.com/guardduty/latest/ug/guardduty_exportfindings.html#guardduty_exportfindings-permissions[2]Granting GuardDuty permissions to a bucket : https://docs.aws.amazon.com/guardduty/latest/ug/guardduty_exportfindings.html#guardduty_exportfindings-key-policy[3] Console Procedure - exporting findings to a bucket with the Console: https://docs.aws.amazon.com/guardduty/latest/ug/guardduty_exportfindings.html#guardduty_exportfindings-s3-policies[4] To know more about the option of exporting Guardduty findings, please refer the documentation - https://docs.aws.amazon.com/guardduty/latest/ug/guardduty_exportfindings.htmlhttps://docs.aws.amazon.com/guardduty/latest/ug/guardduty_exportfindings.html#guardduty_exportfindings-new-bucketPlease note that I personally value your feedback, please accept this answer if you find it helpful to you.CommentShareMfaneloanswered a year ago"


Question: Pitch and Modulation Controls

"Hi, The Pitch and Modulation controls on the AWS-branded keyboard don't have any impact.Has anyone got them to work?Thanks!FollowComment"

Answer: "0Oh, I guess I should RTFMhttps://docs.aws.amazon.com/deepcomposer/latest/devguide/what-it-is-keyboard.htmlCommentShareColin Braceanswered 3 years ago"


Question: Redshift-Managed VPC endpoint getting stuck in 'Creating' status.

"Hi,when I'm creating a Redshift-Managed VPC endpoint in an account to connect to a redshift cluster in another account, it gets stuck in the 'Creating' phase for several hours. It eventually fails to be created and disappears from the list.I followed the instruction in this document: Working with Redshift-managed VPC endpoints in Amazon Redshift and have granted all VPCs from the endpoint account access to the cluster.Any idea how to solve this issue?FollowComment"

Answer: "0Can you check if you are hitting any limits: https://docs.aws.amazon.com/redshift/latest/mgmt/amazon-redshift-limits.html#amazon-redshift-limits-quotaCloudtrail logs for "CreateVpcEndpoint" event needs to be checked to know why it is failing, you can try creating endpoint with CLI and check the response received.https://docs.aws.amazon.com/awscloudtrail/latest/userguide/view-cloudtrail-events-console.htmlIf you have a support plan, I will suggest to open a support case and support can assist you with checking the logs.CommentShareKaushal_Panswered 4 months ago"


Question: Websockets on ALB not connecting (404 not found)

"Edit: I accidentally submitted this twice. I'm marking this one as solved because I guess I can't delete posts.I'm building a Django application on an ec2 that sits behind an application load balancer directing https traffic.The ALB listens for https traffic and forwards it to the target group (http1, port 80) that contains the ec2 instance.The Django app is running asgi through Daphne. Pretty simple configuration; host 0.0.0.0, port 80.Https traffic works fine. No problems there. However I can't seem to get a simple websocket handshake.in Firefox I get this error: GET wss://my_dns.com/ws/chat/lobby/ (HTTP/1.1 404 Not Found)Firefox can’t establish a connection to the server at wss://my_dns.com/ws/chat/lobbyThe security group for the ALB is allowing all inbound traffic on all ports.I did have the target group originally set up without stickiness. I tried load balancing stickiness (1 day, 300 second deregistration delay, 0 slow start duration) and that didn't seem to work either.All traffic, https and websockets is going through Daphne. I don't have any nginx reverse proxies or anything apache. It's just ALB and the ec2 instance and Daphne. I'm really hoping I have something incorrectly configured. haha.Anyone have any thoughts where to begin troubleshooting this?Thanks!Edited by: BirdThunderford on Apr 14, 2021 7:54 PMEdited by: BirdThunderford on Apr 14, 2021 7:58 PMFollowComment"

Answer: 0This is a duplicate question.CommentShareBirdThunderfordanswered 2 years ago


Question: No logs when Site-to-Site VPN  connection Tunnel logs enabled

"Hi,I've created a new s2s VPN connection, but my tunnels are down. Therefore, I've enabled logs to check what's wrong. I created Log group, enabled logs, however there are no logs. There's just one Log Stream called log_stream_created_by_aws_to_validate_log_delivery_subscriptions which has the following entryWhat am I doing incorrectly ?FollowComment"

Answer: "0I know you said it's a new connection, but how new?  VPN Connection Logging was released only late last year and we found that for an existing tunnel you may need to trigger software update & endpoint replacement to kick logging into gear. Also at the connection level you may need to include doing a "Modify VPN Connection" and saving it (can be without changes).CommentShareEXPERTskinsmananswered 2 months agorePost-User-2148365 2 months agoCreated 2 weeks ago, so I assume software update is not the case here.Share"


Question: ECS container best practices

"I have 10 docker images that our system uses which are meant to be portable between different container management systems.  To provide the first iteration of AWS capable images, I have created the repository for each of them in AWS and the necessary roles and resources to run them.  I have successfully brought them up as services in a cluster and gotten them to talk to each other and accessed the NGINX container service from the internet.How can I replicate the cluster without having to build it by hand every time?  Is there a component of AWS that I can use to model what I have then pull that in and run it?  In other words is there an equivalent to Docker-Compose that I can use to run against, and it stands up the containers as services and brings in the necessary resources?FollowComment"

Answer: "0Accepted AnswerHello :)You are doing the right thing to have an ECR Repo per service image, that allows each of these to evolve over time on their own.Creating and updating ECS services all the time can be cumbersome, especially if you are starting with AWS & ECS. As per your docker-compose question, there is ECS Compose-X which does just that (and more!). You will be able to use the docker compose format to define your services, sidecars if you need to, and what it does is generate the AWS CloudFormation templates to use and deploy all your services. We use it in our CICD pipelines and it orchestrates everything we need to do.It also allows to define other AWS resources you might need (new or existing ones) that your services need access to, and grant least-privileges permissions to the IAM roles automatically.There are plenty of examples/guides in the labs to get started, and if you have any issues, feel free to join the Slack Channel to ask for help, or raise an issue in GitHub.Hope this helps,CommentShareJohnPrestonanswered 2 months ago0Wow!  Thanks.  That is what I was looking for.  Just starting out with this, I didn't know if I was going down the wrong path doing everything by hand and there were screens somewhere that did it for me but I just couldn't find them.  Now it seems that there really aren't any.  The support guy gave me a link:https://aws.amazon.com/blogs/containers/automated-software-delivery-using-docker-compose-and-amazon-ecs/which also took me down a similar path but with a different outcome.  I already popped over to compose-x and it seems extremely helpful and also what I am looking for.CommentShareChrisanswered 2 months ago"


Question: GREENGRASS AND NODE RED NOT CONNETING

"I have installed the Greengrass in my VirtualBox ubuntu device and installed the MQTT bridge, moquette Mqtt, and node-red components in it. when I try to connect the AWS IoT core from node-red the nodes are not connecting  AND MQTT broker erroeFollowCommentGavin_A 2 months agoHi, to provide help, can you describe how NODE-Red is connecting (that is, to the local Greengrass Core or directly to AWS IoT Core)? What credentials and clientId are you using? Finally, your last sentence was cut off. Could you also provide the error messages seen (by the Nucleus or CloudWatch)?Share"


Question: LAMBDA_RUNTIME Failed to get next invocation. No Response from endpoint

"This error occurs at random rate for example 1 out of 5 times i get this errorBelow is my stack traceRuntimeError: Failed to get next  File "bootstrap.py", line 480, in <module>    main()  File "bootstrap.py", line 462, in main    event_request = lambda_runtime_client.wait_next_invocation()  File "lambda_runtime_client.py", line 49, in wait_next_invocation    response_body, headers = rapid_client.next()And my Dockerfile looks likeFROM public.ecr.aws/lambda/python:3.8RUN yum install -y gcc gcc-c++ git libxml2 libxml2-devel libxml2-python libxslt libxslt-devel mesa-libGL mesa-libGL-devel wget nss nss-util zip unzip \ pango atk at-spi2-atk gtk3 libXcomposite libXcursor libXdamage libXext libXi libXtst cups-libs libXScrnSaver libXrandr GConf2 alsa-libARG PIP_INDEX_URLCOPY requirements/base.txt ./requirements.txtCOPY requirements/test.txt ./test_req.txtRUN pip install -r requirements.txtCOPY service.py ./COPY local-chromium /var/task/local-chromiumRUN python3.8 -m spacy download en_core_web_smRUN python3.8 -m spacy download es_core_news_smENV PYTHONPATH=$(pwd)CMD ["service.handler"]FollowComment"


Question: Can and Can't install php7.4 on Amazon Linux 2 with user-data

"I'm trying to install wordpress(latest version) with php7.4 on Amazon linux 2 by using following user-data.#!/bin/bashyum update -yamazon-linux-extras enable php7.4yum clean metadatayum install -y httpd mysql php php-{pear,cgi,common,curl,mbstring,gd,mysqlnd,gettext,bcmath,json,xml,fpm,intl,zip,imap,devel}wget http://wordpress.org/latest.tar.gz -P /tmp/tar zxvf /tmp/latest.tar.gz -C /tmpcp -r /tmp/wordpress/* /var/www/html/chown apache:apache -R /var/www/htmlsystemctl enable httpd.servicesystemctl start httpd.serviceHowever, I got issue about php7.4 installation.Some EC2 instances can't enable amzn2extra-php7.4 repo, then use amzn2-core.php 5.4 will be installed.================================================================================Dec 24 17:42:04 ip-10-0-0-43 cloud-init: Package                Arch      Version                   Repository     SizeDec 24 17:42:04 ip-10-0-0-43 cloud-init: ================================================================================Dec 24 17:42:04 ip-10-0-0-43 cloud-init: Installing:~~Dec 24 17:42:04 ip-10-0-0-43 cloud-init: php                    x86_64    5.4.16-46.amzn2.0.2       amzn2-core    1.4 MDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-bcmath             x86_64    5.4.16-46.amzn2.0.2       amzn2-core     58 kDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-cli                x86_64    5.4.16-46.amzn2.0.2       amzn2-core    2.8 MDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-common             x86_64    5.4.16-46.amzn2.0.2       amzn2-core    563 kDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-devel              x86_64    5.4.16-46.amzn2.0.2       amzn2-core    602 kDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-fpm                x86_64    5.4.16-46.amzn2.0.2       amzn2-core    1.4 MDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-gd                 x86_64    5.4.16-46.amzn2.0.2       amzn2-core    127 kDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-intl               x86_64    5.4.16-46.amzn2.0.2       amzn2-core     98 kDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-mbstring           x86_64    5.4.16-46.amzn2.0.2       amzn2-core    505 kDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-mysqlnd            x86_64    5.4.16-46.amzn2.0.2       amzn2-core    172 kDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-pear               noarch    1:1.10.12-9.amzn2         amzn2-core    359 kDec 24 17:42:04 ip-10-0-0-43 cloud-init: php-xml                x86_64    5.4.16-46.amzn2.0.2       amzn2-core    125 k~~~~~[root@ip-10-0-0-43 ~]# php -vPHP 5.4.16 (cli) (built: Oct 31 2019 18:34:05)Copyright (c) 1997-2013 The PHP GroupZend Engine v2.4.0, Copyright (c) 1998-2013 Zend TechnologiesSome EC2 instances can enable amzn2extra-php7.4 repo,php 7.4 will be installed.Dec 24 17:42:07 ip-10-0-0-147 cloud-init: ================================================================================Dec 24 17:42:07 ip-10-0-0-147 cloud-init: Package               Arch     Version               Repository           SizeDec 24 17:42:07 ip-10-0-0-147 cloud-init: ================================================================================Dec 24 17:42:07 ip-10-0-0-147 cloud-init: Installing:~Dec 24 17:42:07 ip-10-0-0-147 cloud-init: php                   x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   3.2 MDec 24 17:42:07 ip-10-0-0-147 cloud-init: php-bcmath            x86_64   7.4.21-1.amzn2        amzn2extra-php7.4    68 kDec 24 17:42:07 ip-10-0-0-147 cloud-init: php-cli               x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   4.9 MDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-common            x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   1.1 MDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-devel             x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   1.3 MDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-fpm               x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   1.7 MDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-gd                x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   182 kDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-intl              x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   220 kDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-json              x86_64   7.4.21-1.amzn2        amzn2extra-php7.4    71 kDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-mbstring          x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   514 kDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-mysqlnd           x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   241 kDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-pear              noarch   1:1.10.12-9.amzn2     amzn2-core          359 kDec 24 17:42:08 ip-10-0-0-147 cloud-init: php-xml               x86_64   7.4.21-1.amzn2        amzn2extra-php7.4   199 k~~[root@ip-10-0-0-147 ~]# php -vPHP 7.4.21 (cli) (built: Jul  7 2021 17:35:08) ( NTS )Copyright (c) The PHP GroupZend Engine v3.4.0, Copyright (c) Zend TechnologiesI launched 10 EC2 instances with the "same" configuration as test.7x EC2 instances:  php5.4 was installed3x EC2 instances:  php7.4 was installedI'm using  default Amazon linux AMI (Amazon Linux 2 AMI (HVM) - Kernel 5.10, SSD Volume Type )ami-0218d08a1f9dac831 ( region: ap-northeast-1)I have no idea why this happens..FollowComment"

Answer: "0Have you checked the logs? If your script did not accomplish the tasks you were expecting it to, or if you just want to verify that your script completed without errors, examine the cloud-init output log file at /var/log/cloud-init-output.log and look for error messages in the output.CommentShareRoBanswered a year ago"


Question: HTTPS Security Group not allowing access to EC2 instance when tried using HTTPS URL

"Security GroupsHi All,i am doing basic hands on regarding EC2 instance i created a inbound Security group for HTTPS on port 443 to be allowed from anywhere.My EC2 instance has a web server running and it just displays a hello message.When i am trying to access the EC2 instance using my public IPv4 address using HTTPS it gives me "Unable to connect" error .Can anyone please point me whats wrong?FollowComment"

Answer: "1Can you connect to the web server from the instance itself? Doing something like telnet 127.0.0.1 443 and then telnet <instance private IP> 443? Next, set up another instance in the same subnet and see if you can connect from the second instance to the first instance.You can use VPC Reachability Analyzer to confirm that your routes and security groups are set up correctly but it can't determine if there is an issue on the instance itself which is what the tests above are there to confirm.CommentShareEXPERTBrettski-AWSanswered a year ago0Hey AWS-User-2681063,One of the ways to tackle this is as follows:You will need a custom domain to created a hosted zone in Amazon Route 53. Make sure that your custom domain has the same name servers (ns) that your hosted zone has.Request an SSL certificate in Amazon Certificate Manager (ACM), which is free by the way (Steps here).Validate the domain, either with DNS validation or Email validation. ACM will create the Route 53 records for you to be able to perform a DNS validation.Then, once the domain is validated, you can create an Application Load Balancer (ALB) with a security group that allows both trafic via port 80 (HTTP) and 443 (HTTPS)In the ALB, create a listener that listens on port 443 and attach the certificate requested in step 2 (Steps here).Create a alias record in Route 53 to use your custom domain on top of your ALB DNS name. Choose your ALB DNS name as the endpoint (Steps here).Make sure that your EC2 instance security group inbound rule has the security group of your ALB as the source. Security best practice is to have your ALB as the only point of entry.Access your website by typing in the browser: https://<your_customer_domain>CommentShareDunieski Otanoanswered 8 months ago"


Question: CloudWatch CPUUsage does not match top

"Since Aug. 1st CloudWatch reports a higher CPU usage as normal of one of our servers (T3.mocro). I have checked the server and there is no special process running. Even when I stop all custom services and only run the linux Ubuntu 20 system, the CPUCreditBalance is getting lower and lower. Linux reports me a CPU usage of about 1.2% while CloudWatch reports a usage of more than 5%. I have stopped and started the instance, but except that I lost some additional CPUCredits (the first time about 80 and the second time again 140) nothing changed. This is how CloudWatch looks likeYou can see the 2 stops and starts of the instance and the startpoint off the higher CPU usage reproted by CloudWatch. We have an other server with the same configuration running without any problems. Both servers are an instance of T3.micro. Any change to get out why CloudWatch messure a higher CPU utilization than I can see on the Linux level to find out, what is causing this problem.Thanks AndiFollowComment"


Question: Didn't get OTP to my phone number

"I'm from Myanamar. When I want to schedule AWS exam, there is need to create Amazon account. When I creating Amazom account, I didn't get any OTP to my phone number.FollowComment"

Answer: 0Have you tried using the email option to receive the OTP code?CommentShareAWS-User-9543277answered a month ago


Question: Full DKIM Records Needed

"Hello, I have been approved for the AWS SES production environment.I need to add DKIM records to my domain, but the DKIM records I download from my AWS SES dashboard are incomplete according to my web host.Specifically one of the records i missing the "value".Please can you provide me the the 'value' for the DNS records below.The records below are the only records I was able to view/download from my AWS SES dashboard.Type,Name,ValueTXT,_amazonses.team@info.domain.com,TXT,team@info.domain.com,amazonses:FollowCommentossniper a year agoDownload the CSV file for MX & CNAME records and add to your DNSShare"

Answer: 0Shame I really get you. The support from AWS is ridiculous. You are left on your own. I see only a handful of views on your issue and no replies. I guess it's better to find a different supplier. They force you to pay $29 or similar for a monthly support plan. I'm just testing the system for now. Definitely moving away in the next day or so. They don't realize we have 500+ VPS servers in South Africa we need to switch over but definitely not going for them anymore.CommentShareCindyanswered 9 months ago


Question: Aws certification exam is cancelled due to invalid ID proof

"Hello Everyone ,It's very urgent for me to know details.I tried to attempt aws exam yesterday but my id proof is not valid and then exam was cancelled and she created case and she share id with me and contact number of aws support. But i don't know where to check cases filed  and i want to know how to reschedule my exam again.FollowComment"

Answer: 0Try to Contact AWS Training and Certification support via link : https://support.aws.amazon.com/#/contacts/aws-trainingHope it helps.CommentShareVikasanswered 2 months agoEXPERTalatechreviewed 2 months ago


Question: DynamoDB result is not structured the way I want

"Hello,I am doing a simple command to list all the items in my table. However, the data I am getting back is not structured the way I want. I want a simple JSON structure but DynamoDB is turning the results into nested objects.DynamoDB gives me below response:/// What I am currently getting[  {    id: { S: '8' },    lastName: { S: 'Perry' },    firstName: { S: 'Matthew' }  },  {    id: { S: '3' },    firstName: { S: 'Joan' },    lastName: { S: 'Peter' }  }]But I want this:/// What I want[  {    id: 8    lastName:  'Perry' ,    firstName: 'Matthew'   },  {    id: 3,    firstName: 'Joan' ,    lastName:  'Peter'   }]How can I achieve the later result set. Below is my code:const { ExecuteStatementCommand } = require('@aws-sdk/client-dynamodb') const { ddbDocClient, memberTableName } = require('./client.js')const selectAll = async () => {    const params = {        Statement: `SELECT * FROM ${memberTableName}`,        Parameters: [{ S: '3' }]    }    console.log(params)    return await ddbDocClient.send(new ExecuteStatementCommand(params));}selectAll().then(d => console.log(d.Items))ddbDocClient was created like this: const ddbDocClient = DynamoDBDocumentClient.from(ddbClient);FollowComment"

Answer: "1This is because you are using the low level client. You need to use the document client or use the unmarshalling util. I think you'll be much happier with the document client. Here is an example of what you want to do.CommentShareKirk-AWSanswered a year ago0Hi, @GilbertSYou can do martial / unmarshal between native JSON and DynamoJSON by using the "@aws-sdk/util-dynamodb" module.https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/modules/_aws_sdk_util_dynamodb.html#unmarshall-1CommentShareEXPERTiwasaanswered a year agoiwasa EXPERTa year agoI wrote the following verification article. Please have a look.https://dev.classmethod.jp/articles/js-dynamodb-json-marshall-unmarshall/Share"