Question: About the EC2 persistent instance retirement scheduled

"Hello,I'm using an EC2 instance in the ap-southeast-1 region, I see a retirement scheduled announcement on 2023-01-20 06:00:00 UTC. I'm using some service on this instance and it needs to be up and running. I have a few questions about this:The data on my old local instance-store volumes will be lost,  will they be transferred to the new instance-store volume? Do I need to create a snapshot for backup?How long does this event last?If I create a new instance in region ap-southeast-1, will the new instance be affected when the event calendar arrives? Can I use the current instance's public IP for the new instance?Thank you.FollowComment"

Answer: "0Accepted AnswerIt's difficult to answer some of your questions because I don't know the reason for the instance retirement - for example, it could be that the hardware is impaired; or we could be removing older hardware to make way for newer hardware. You also haven't specified the instance type so that limits my answers to being general:Instance storage is ephemeral and it is a customer responsibility to ensure that data on instance storage is backed up. As an example: If the hardware that your instance is running on were to suddenly fail and it was configured for instance recovery then the instance would be restarted on new hardware but the instance storage would need to be reinitialised by you. So yes, make sure your data is backed up and as per an answer I provided the other day you should check to see that the instance storage is initialised correctly at every operating system boot.I can't answer that question - but the support team may be able to.Without knowing the reason for the retirement I can't say. But if this event is about hardware impairment or retirement then creating a new instance should be ok. It's only if we're retiring an instance class then you'll need to choose a new instance type. I'd note that moving to newer instance types is a good idea anyway - you generally get higher performance for lower cost. You can move an Elastic IP from one instance to another; but not if it is a Public IP.I'd also add that building resilience into your application on AWS (e.g. instance auto-recovery; auto-scaling; etc.) is a good thing (if possible). That way, events such as hardware failure, power outages, network isolation means that your environment can recovery automatically.CommentShareEXPERTBrettski-AWSanswered 5 months ago"


Question: I am using pixel streaming using AWS Where was the runAWS_WithTURN file??

Where was the runAWS_WithTURN file?? I am using Unreal Engine 4.27FollowComment


Question: Does SageMaker with Triton Inference Server support ensembles or BLS + automatic memory time sharing? How does model loading and unloading work in this case?

"I am wondering how SageMaker handles model loading and unloading when dealing with Triton ensemble models or Triton BLS. The model actually being invoked is the Triton ensemble, so will SageMaker automatically tell Triton to load each of the models called by the ensemble? Similarly, is Sagemaker able to tell which models are called from a particular BLS model? Is load balancing/memory time-sharing negatively affected in this case?Second question: if multiple ensembles have a model in common, will the number of model instances still be the number in Triton config? How does Sagemaker deal with model loading when multiple ensembles or BLS models use the same model?FollowComment"


Question: What will be pricing after lowering number of CPUs while creating ec2 instances?

"While launching a new ec2 instance; there is an option to reduce the number of CPUs and threads.I need to find out what will be the pricing for ec2 then?e.g. I am creating an instance type a1.4xlarge (16, 32 GiB) which will cost $0.408 on-demand.But if i reduce the CPUs to let's say 12 or 8 with same 32 GiB memory; then what will be the pricing?FollowComment"

Answer: "3EC2 instances are priced according to instance type, regardless of the number of CPUs enabled. Disabling vCPUs does not change the cost of the instance type.CommentShareEXPERTMichael_Fanswered a year ago2Accepted AnswerThe instance cost is fixed per hour cost depending on the type you have chosen. So it will be 0.408/hour regardless if you disable all CPU or don't use the instance, if its powered on you will be billed for it.You can utilize spot instances or Saving plans to reduce the per hour cost, but keep in mind the caveats of those. e.g Spot instances can be terminated by AWS on 60 seconds notice, so make sure your workload can handle that termination.CommentSharehameedullahanswered a year ago"


Question: is it possible to run just the model packaging step in sagemaker pipeline?

"I have set up few steps in sagemaker pipeline , to process and train data. but in the event where i need a custom script for inference , i want to able to just run the model re-packaging step. is it possible to just run this step in the pipeline? if not, are there any other alternatives to do model packaging via lambda or something similar ? also, is it possible to view , which tool or script does sagemaker uses to package the model. is it possible to use the same tool outside the sagemaker?FollowComment"


Question: AWS DMS task is failing on source endpoint timeout

We are running DMS task which is ingesting from the on-prem mssql table with over 200mil records and has LOBs in it. Ingestion takes ~ 33 hoursOn-prem DB has a backup that happens after midnight and the task is failing right after that. Below are the logs:[SOURCE_UNLOAD ]D: Network error encountered[SOURCE_UNLOAD ]D: Is connection error? TRUE[SOURCE_UNLOAD ]D: Endpoint is disconnected [1020414] (endpointshell.c:3807)[SOURCE_UNLOAD   ]W:  Error was encountered while FETCH-ing data from table ...[SOURCE_UNLOAD ]D: Error executing source loop [1020414]I haven't tried the executeTimeout in the source endpoint connection attributes yet and wanted to ask what would be the suggested option to get around the timeout on the source issueFollowComment

Answer: "0mostly this could be due to connections from dms are killed or timed out due to backup job. by itself backup command shouldnt disconnect the connection. it basically freezes other db connections for some time.I would suggest using executeTimeout on source endpoint connection attribute in seconds with a value greater than backup time. Being said that do set the remote query timeout to similar value by referring to https://docs.microsoft.com/en-us/sql/database-engine/configure-windows/configure-the-remote-query-timeout-server-configuration-option?view=sql-server-ver15#:~:text=Using%20SQL%20Server%20Management%20Studio,-To%20configure%20the&text=In%20Object%20Explorer%2C%20right%2Dclick,to%20wait%20before%20timing%20out.CommentShareAWS-User-8174525-subhashanswered a year agoDenys a year agoThank you for the answer. I have added executeTimeout to the source however it hasn't changed the behavior and the task failed again. I have noticed following in the debug logs:[SOURCE_UNLOAD ]D: Setting connection timeout as : '8' (ar_odbc_conn.c:533)Not sure what setting is controlling this parameter. I haven't checked the source DB yet - passed it to the customer.ShareAWS-User-3275247 6 months agoHi,It's been some time since posted, but did you or your customer find any solution for this?Share"


Question: AWS SSO Required permission to run aws sts get-caller-identity

"For an AWS SSO user, when they run`aws sts get-caller-identity`the following error occurs`An error occurred (ForbiddenException) when calling the GetRoleCredentials operation: No access`I can't find any reference as to what permission the user needs to execute this command.The user has the following policy:arn:aws:iam::aws:policy/ReadOnlyAccess and this inline policy:    {            "Sid": "sts",            "Effect": "Allow",            "Action": "sts:GetServiceBearerToken",            "Resource": "*",            "Condition": {                "NumericEquals": {                    "sts:DurationSeconds": 43200                },                "StringEquals": {                    "sts:AWSServiceName": "codeartifact.amazonaws.com"                }            }        }    ]FollowComment"

Answer: "0Are you using AWS SSO Permission Sets to assign IAM policies to your users? https://docs.aws.amazon.com/singlesignon/latest/userguide/iam-auth-access-overview.html. As you suggest you are applying an inline policy I would assume not (since inline policies only apply to IAM users)?If you are using SSO Permission Sets, then the read only permission set AWSReadOnlyAccess which uses the AWS Managed Policy arn:aws:iam::aws:policy/job-function/ViewOnlyAccess does not specifically include STS:* as a permission. Therefore I would assume that it is being implicitly denied.If you could clarify it would help greatly.CommentShareAlex_AWSanswered a year ago"


Question: How can I file bugs against Redshift?

"Hello,I regularly run into bugs I can work around with AWS RedShift, is there some way to issues to the AWS team? We're a startup and don't have a deep support plan where I can just hand it over to an account manager.For instance, RedShift will return a message this type of correlated subquery isn't supported due to an internal error when doing a correlated subquery on a table where the correlated subquery column doesn't exist in the table, rather than return the column doesn't exist. I have like 10 of these.FollowComment"

Answer: "0From the AWS console, on the bottom left bar you should see a Feedback link. From there choose amongst Type: Feature request, General feedback, Report an issue, Support/Account/Billing, UI feedback and proceed from there.CommentShareMilindOkeanswered 7 months ago"


Question: Failed to COPY parquet files from S3 to Redshift

I uploaded my parquet (.snappy.parquet) files to S3 bucket and run COPY command to my Redshift cluster and have following errorsDetail:error:  Assertcode:      1000context:   false - Type not supported.query:     3406location:  dory_type_helper.hpp:388process:   padbmaster [pid=374]-----------------------------------------------The COPY command isCOPY  "tempTable" from 's3://redshift-testing/3172530462e49cd23e3ea46488706041746780f85/'CREDENTIALS'aws_access_key_id=**;aws_secret_access_key=*'FORMAT PARQUETThere is no related error in STL_LOAD_ERRORS.Does it mean my parquet files are not supported?FollowComment

Answer: 0That might be an internal Redshift error! I'd start by checking that all files in that S3 path are in valid ORC format. Also Make sure no other files have accidentally been included. You might want to remove all but one file in that location and progressively add the other files to find which one(s) are causing the problem. I wonder whether you could test the file format by using Amazon Athena. Try querying the file by AthenaCommentShareSoumith Avunoorianswered 9 months ago


Question: Lake Formation (Database Snapshot) blueprint creates a workflow that does not work. "Internal service error: Invalid Input Provided"

"I have followed the guide in this blog post https://aws.amazon.com/blogs/big-data/integrating-aws-lake-formation-with-amazon-rds-for-sql-server/I am using an RDS mysql instance in the eu-west-1 region.The blueprint and subsequently the workflows, jobs and crawlers are created sucessfully.The worklow runs the crawler jobs successfully and the tables in Glue are populated.But then the workflow fails when reaching the ETL jobs with the error message "failed to execute with exception Internal service error: Invalid Input Provided".I have looked at the job definition itself and the code behind the script and the input seems to match.EDIT:I found out where the error is coming from. The ETL job created by Lake Formation is using "Glue 1.0" and that simply doesn't work.It works running an empty spark job using Glue 3.0 and the same job using Glue 1.0 fails with the error "Internal service error: Invalid Input Provided".FollowComment"

Answer: "0Be sure that the column name lengths don't exceed 255 characters and don't contain special characters. For more information about column requirements, see Column.Check for malformed data. For example, if the column name doesn't conform to the regular expression pattern "[\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\t]", then the crawler doesn't work.Check for columns that have a length of 0. This happens when columns in the data don't match the data format of the table.If your data contains DECIMAL columns with the "(precision, scale)" format, then be sure that the scale value is less than or equal to the precision value.In the schema definition of your table, be sure that the Type of each of your columns isn't longer than 131,072 bytes. For more information, see Column structure.If your crawler fails with either of the following errors, then be sure that the total schema definition of your table is not larger than 1 MB:    "Unable to create table in Catalog"    "Payload size of request exceeded limit"CommentShareNishAWSanswered 9 months ago"


Question: Auto-renewal of SSL cert with HSM

"Hello, we are looking at setting up SSL on our website with an HSM to store the keys.I read this article: https://aws.amazon.com/blogs/security/using-aws-cloudhsm-backed-certificates-with-microsoft-internet-information-server/But there I do not see anything about auto-renewal of the cert. Everything is done manually. How would we automatically renew the certificate with AWS cloud HSM?I also saw these guides, which show that there are commands for renewing a cert...is there some util for autorenew, or I would just have to write a script for it?https://docs.aws.amazon.com/cloudhsm/latest/userguide/ssl-offload-enable-traffic-and-verify-certificate-windows.htmlhttps://docs.aws.amazon.com/cloudhsm/latest/userguide/key_mgmt_util-reference.htmlFollowComment"

Answer: "0Hi. The certificate is a convenient vehicle for the client to verify [using standard SSL tools] that it is talking to its own cluster, before sending across login credentials. There is no mechanism to rotate the cluster certificate, as the HSM has no notion of a root CA or chain of trust. The customer CA key pair IS that root of trust from the clusters point of view. Therefore, there is no signficance to the certificate expiring and the expiry date is not checked in our stack.CommentShareJorgeCastilloManswered 25 days ago"


Question: How to refer arn for an S3 bucket created using cfn resource in cdk python ?

"I have created an s3 bucket using CfnBucket construct like below. I am using cfn constructs due to strict requirement.`bucket=s3.CfnBucket(            self,            "someId",            bucket_name="some_name")`How to I refer to this bucket's arn in some other construct ? For eg I am trying something like below to refer to this bucket's arn in a firehose stream I am trying to create.kinesisfirehose.CfnDeliveryStream(            self, "SomeId",       s3_destination_configuration=kinesisfirehose.CfnDeliveryStream.S3DestinationConfigurationProperty(                bucket_arn=f"arn:aws:s3:::{ksuite_analytic_bucket}",            )        ))This is not working and I am getting an error that s3 arn is not valid.What's the correct way of doing this ?FollowComment"

Answer: 0There's an attribute called attr_arn that returns the ARN of the bucket. You could simply pass bucket.attr_arn as a parameter. See the CDK python documentation about the attribute.CommentShareEXPERTTasioanswered a year ago


Question: Can I download AWS voices with Polly Player for Windows?

"I've successfully installed Polly Player for Windows.However, I only see the option "Say It" to hear the audios.Can I download the audio files, as I download them from the web?FollowComment"

Answer: "0Hi Maicart,Unfortunately the current Polly Player is unable to allow you to download the voices. It is a simple tool for you to test out how the voice sounds.However, you may be able to download the voices via the Windows Application that you will be using with Polly. Also, here is an article to demonstrate a possible use case of Polly and a Windows Application: https://aws.amazon.com/blogs/machine-learning/using-amazon-polly-in-windows-applications/Hope this helps!CommentSharejunkaianswered 6 months ago"


Question: AWS GLUE ERROR: File already exists

"I have this code to write in RedsfhitdinamycFrame = DynamicFrame.fromDF(df, glueContext, df)try:    glueContext.write_dynamic_frame.from_jdbc_conf(frame = dinamycFrame,                                                       catalog_connection = "Redshift PROD",                                                       connection_options = {"preactions": "truncate table dim_areas_master;","dbtable": "dim_areas_master", "database": "mydb"},                                                       redshift_tmp_dir = "s3://bucket-sample-name/XXXXXXXXXX", transformation_ctx="dim_areas_master")except TypeError:    passan i have this errorAn error occurred while calling o197842.pyWriteDynamicFrame. File already exists:s3://bucket-sample-name/XXXXXXXXXX/cf31dfbc-d1c5-43f6-9029-b274b3c980cd/part-02052-0968ebe2-57d1-468e-8cb2-c16ee515c9f8-c000.csvI have no idea how to solve this problem.In cloudwatch logs show:Thanks for helpFollowComment"


Question: Disable of purchased service in aws lightsail

"Hi ,How to disable the cloudwatch in aws light sail.ThanksgowthamFollowComment"

Answer: 0Standard metrics cannot be stopped.Why do you want to disable the metrics?CommentShareEXPERTRiku_Kobayashianswered a month ago


Question: How To Transfer an encrypted AMI to Another User Account

"Hi,I have two instances which were in Lightsail (1. Windows Server 2. Ubuntu Linux), and I need to transfer them to another AWS account. I got instructions from support on how to go about it.Create snapshotsCreate an EC2 instance from the snapshotUse the AMI as a baseline snapshot to transfer the server's instance to another accountThe problem I'm facing in the last step is when I try to transfer the instance, I get the notification that the server's partitions are encrypted. I'm not sure how to go about fixing this.Has anyone been able to solve this?FollowComment"

Answer: "0You can try to use Image Builder and share resources via RAM (Resource Access Manager). See below:https://docs.aws.amazon.com/imagebuilder/latest/userguide/cross-account-dist.htmlhttps://docs.aws.amazon.com/imagebuilder/latest/userguide/manage-shared-resources.htmlHope it helps.CommentShareEXPERTalatechanswered 4 months ago0There are full-proof ways, but I would suggest you try this https://aws.amazon.com/blogs/security/how-to-share-encrypted-amis-across-accounts-to-launch-encrypted-ec2-instances/CommentShareTarun Tiwarianswered 4 months ago"


Question: Dash-Outputs with QVBR always exhaust the maximum bit rate allowed

"Hi, we are creating HLS- and DASH-Outputs via MediaConvert (1080p, 720p, 480p, 360p).While testing our transcoded playlists on Bitmovin's test environment, we noticed that our DASH content is always loaded with the bitrate which we set as the maximum value for QVBR (Single Pass HQ, no fine tuning). In contrary our HLS content is loaded with a variable bitrate which was considered suitable by MediaConverts rate control mode QVBR (so I think).Since our encoding settings for DASH and HLS  are identical, we wonder if that behaviour is "correct".If someone could take a look at this issue, it would be much appreciated.In the following you'll find a  Hls-Playlist (Bitmovin-Hls-Link) and Dash-Playlist (Bitmovin-Dash-Link) if required for further investigation.Kind Regards,RivaFollowComment"

Answer: "1Thank you for the provided insights :)CommentShareRivaanswered a year ago0Hi Riva,I looked at the DASH and HLS content. Both streams have identical sized segments (.ts for HLS and .mp4 for DASH) and amount to 4-5 Mbps average based on segment length. The reason you are seeing different bandwidth values in the player is most likely because the player is not calculating actual bitrate but showing whats indicated in the manifest.For DASH it is picking the bandwidth attribute from the Representation tag<Representation id="1" width="1920" height="1080" bandwidth="8000000" codecs="avc1.640028">and for HLS it is picking the average bandwidth attribute#EXT-X-STREAM-INF:BANDWIDTH=8350133,AVERAGE-BANDWIDTH=4952555,CODECS="avc1.640028,mp4a.40.2",RESOLUTION=1920x1080,FRAME-RATE=25.000,AUDIO="stereo"As far as the actual segment bandwidth is concerned, it looks consistent between HLS and DASH.filebandwidthhlsvideo_1080_00002.ts3.4MBhlsvideo_1080_00001.ts5.4MBdashvideo_1080_000000002.mp43.3MBdashvideo_1080_000000001.mp45.3MBCommentShareDev_Kanswered a year ago"


Question: Parse application logs via Athena and Glue catalog

"I have log files in my onpremise application, Individual file size is 100 MB (file rollover/appender defined in Log4J in onpremise application) and 50 such files get generated on daily basis which is 5 GB total. We then zip these files at day end and push to S3 bucket manually today.We dont want to use cloudwatch agent in onpremise application to push logs to CloudWatch (as onpremise applications are not having CPU/Memory and running at peak)We zip the files at day end else we have to do 50-55 S3 Copy manually each day (yes we can create some script for this - but again not elegant)Yes Elasticsearch is an option but we are building solution which will take 2-3 months to ingest data to Elasticsearch and use ELK stackNow till 1 year, whenever we get customer complaint we have to extract specific file. We know the date, but unfortunately we have to download all 5 GB for that day and extract the required file and content.As part of this usecase wanted to check:If Athena works for Log4J log files (from JBoss, Websphere) - do we have Serde's (serialization / deserialization libraries) for the same, glue catalog for the sameFollowComment"

Answer: 0Have you had a look at the GROK SerDe?This may help you?https://docs.aws.amazon.com/athena/latest/ug/grok-serde.htmlExample 2 uses log4j format.Hope this helps.CommentShareDennis_Aanswered a year ago


Question: HIVE_BAD_DATA converting BZ2 to Parquet

"Hello,There are similar questions on the forum and most recommendations are to override the data type but I wanted to give context on what I'm trying to achieve in case there's a better solution.I have a number of large CSV files which I've compressed with BZ2 (splittable compression) to then convert to Parquet and query in Athena. I've done this in glue using S3 data source and then S3 output to Parquet with snappy compression (again splittable) which is working fine in terms of actually completing conversion and surfacing in Athena. However, there are issues with data in terms of the quality of data being a mismatch of types, for isntance, ids are detected by the crawler on the BZ2 CSVs as sting for some ids and longs for others, and then once converted to Parquet, Athena complains about binary data in bigint fields.HIVE_BAD_DATA: Field diagnosis1's type BINARY in parquet file s3://bucket_name/parquet/run-S3bucket_node3-1-part-block-0-r-00011-snappy.parquet is incompatible with type bigint defined in table schemaI don't want to convert to binary as the field is primarily a bigint field (snomed code). Would appreciate any guidance in terms of achieving what I want to achieve, and possibly even adding better sampling to the original crawler so fields are detected correctly.Glue script for conversion follows but I have used visual editor to create the jobs.import sysfrom awsglue.transforms import *from awsglue.utils import getResolvedOptionsfrom pyspark.context import SparkContextfrom awsglue.context import GlueContextfrom awsglue.job import Jobargs = getResolvedOptions(sys.argv, ["JOB_NAME"])sc = SparkContext()glueContext = GlueContext(sc)spark = glueContext.spark_sessionjob = Job(glueContext)job.init(args["JOB_NAME"], args)# Script generated for node S3 bucketS3bucket_node1 = glueContext.create_dynamic_frame.from_catalog(    database="input_database",    table_name="input_table_name",    transformation_ctx="S3bucket_node1",)# Script generated for node Change Schema (Apply Mapping)ChangeSchemaApplyMapping_node1672958072003 = ApplyMapping.apply(    frame=S3bucket_node1,    mappings=[        ("id", "string", "id", "string"),        ("patientid", "string", "patientid", "string"),        ("providerid", "string", "providerid", "string"),        ("primarypatientinsuranceid", "string", "primarypatientinsuranceid", "string"),        (            "secondarypatientinsuranceid",            "string",            "secondarypatientinsuranceid",            "string",        ),        ("departmentid", "long", "departmentid", "long"),        ("patientdepartmentid", "long", "patientdepartmentid", "long"),        ("diagnosis1", "long", "diagnosis1", "long"),        ("diagnosis2", "long", "diagnosis2", "long"),        ("diagnosis3", "long", "diagnosis3", "long"),        ("diagnosis4", "long", "diagnosis4", "long"),        ("diagnosis5", "long", "diagnosis5", "long"),        ("diagnosis6", "string", "diagnosis6", "string"),        ("diagnosis7", "string", "diagnosis7", "string"),        ("diagnosis8", "string", "diagnosis8", "string"),        ("referringproviderid", "string", "referringproviderid", "string"),        ("appointmentid", "string", "appointmentid", "string"),        ("currentillnessdate", "string", "currentillnessdate", "string"),        ("servicedate", "string", "servicedate", "string"),        ("supervisingproviderid", "string", "supervisingproviderid", "string"),        ("status1", "string", "status1", "string"),        ("status2", "string", "status2", "string"),        ("statusp", "string", "statusp", "string"),        ("outstanding1", "long", "outstanding1", "long"),        ("outstanding2", "long", "outstanding2", "long"),        ("outstandingp", "long", "outstandingp", "long"),        ("lastbilleddate1", "string", "lastbilleddate1", "string"),        ("lastbilleddate2", "string", "lastbilleddate2", "string"),        ("lastbilleddatep", "string", "lastbilleddatep", "string"),        ("healthcareclaimtypeid1", "long", "healthcareclaimtypeid1", "long"),        ("healthcareclaimtypeid2", "long", "healthcareclaimtypeid2", "long"),    ],    transformation_ctx="ChangeSchemaApplyMapping_node1672958072003",)# Script generated for node AWS Glue Data CatalogAWSGlueDataCatalog_node1672991131491 = glueContext.write_dynamic_frame.from_catalog(    frame=ChangeSchemaApplyMapping_node1672958072003,    database="output_database",    table_name="output_table_name",    additional_options={        "enableUpdateCatalog": True,        "updateBehavior": "UPDATE_IN_DATABASE",    },    transformation_ctx="AWSGlueDataCatalog_node1672991131491",)job.commit()FollowComment"

Answer: "0To solve this problem for the time being, I have used the apply mapping node to override all datatypes to strings. I can then cast them later if necessary, which is fine for exploratory analysis and most datatypes, espcially on CSV. However, open to other solutions for the problem. I believe for this solution to work you have to have a unique output directory for each csv to parquet translation in s3.Revised code example below.import sysfrom awsglue.transforms import *from awsglue.utils import getResolvedOptionsfrom pyspark.context import SparkContextfrom awsglue.context import GlueContextfrom awsglue.job import Jobargs = getResolvedOptions(sys.argv, ["JOB_NAME"])sc = SparkContext()glueContext = GlueContext(sc)spark = glueContext.spark_sessionjob = Job(glueContext)job.init(args["JOB_NAME"], args)# Script generated for node S3 bucketS3bucket_node1 = glueContext.create_dynamic_frame.from_catalog(    database="input_database",    table_name="input_table",    transformation_ctx="S3bucket_node1",)# Script generated for node ApplyMappingApplyMapping_node2 = ApplyMapping.apply(    frame=S3bucket_node1,    mappings=[        ("start", "string", "start", "string"),        ("stop", "string", "stop", "string"),        ("patient", "string", "patient", "string"),        ("encounter", "string", "encounter", "string"),        ("code", "long", "code", "string"),        ("system", "string", "system", "string"),        ("description", "string", "description", "string"),        ("type", "string", "type", "string"),        ("category", "string", "category", "string"),        ("reaction1", "long", "reaction1", "string"),        ("description1", "string", "description1", "string"),        ("severity1", "string", "severity1", "string"),        ("reaction2", "long", "reaction2", "string"),        ("description2", "string", "description2", "string"),        ("severity2", "string", "severity2", "string"),    ],    transformation_ctx="ApplyMapping_node2",)# Script generated for node S3 bucketS3bucket_node3 = glueContext.getSink(    path="s3://my_bucket/parquet/output_csv_parquet/",    connection_type="s3",    updateBehavior="UPDATE_IN_DATABASE",    partitionKeys=[],    compression="lzo",    enableUpdateCatalog=True,    transformation_ctx="S3bucket_node3",)S3bucket_node3.setCatalogInfo(    catalogDatabase="output_database", catalogTableName="output_csv_parquet")S3bucket_node3.setFormat("glueparquet")S3bucket_node3.writeFrame(ApplyMapping_node2)job.commit()CommentSharerePost-User-5514646answered 5 months ago"


Question: The usage of MariaDB RDS suddenly spiked up to 60%.

"We have been providing AR web services since March 17th. Normally, the RDS CPU usage was only up to 4-5%, but there was a history of it using up to 60% today, so we are investigating the cause. Currently, RDS is created in a private area, and we understand that it can only be accessed by EC2 created in the same VPC. We checked the access logs of the Ubuntu EC2, but it seems that only two workers accessed the EC2 with their IP addresses. We are wondering if there is any other way to access the private RDS, and if CPU resources can be used like this when automatic RDS backups are performed. The RDS specification is db.m5.large, and MariaDB and the EC2 specification is c5n.2xlarge Ubuntu. Approximately 1 minute later, CloudWatch logs showed [Warning] Aborted connection numbers to db: 'unconnected' user: 'rdsadmin' host: 'localhost' (Got an error reading communication packets).FollowComment"

Answer: "0I am not exactly sure what your question is, but there is no relationship to CPU usage on the RDS instance with the backup process.CommentShareMODERATORphilawsanswered 2 months ago"


Question: Greengrass v2 IPC subscriptions

"Hi. I'm writing some lambdas to run in greengrass v2. I have several energy monitoring systems running AWS Freertos and publishing to GG. According to https://docs.aws.amazon.com/greengrass/v2/developerguide/ipc-publish-subscribe.html#ipc-operation-subscribetotopic , in component aws.greengrass.ipc.pubsub (operation aws.greengrass#SubscribeToTopic) "This topic string doesn't support MQTT topic wildcards (# and +).". I didn't understood why. The component aws.greengrass.ipc.mqttproxy supports without problem. Can anyone explain me how make my subscriptions more general? Thanks in advance.FollowComment"

Answer: "0Hello,MQTT wildcards are indeed supported when subscribing to a MQTT topic. The topic which you subscribe to must be a subset of the allowed topics which are listed in the "resources" section of the access control policy.I will work to get this clarified in the documentation.For example:If you are allowed to subscribe to a/b/+/d in the resources section of the access control policy, then you may subscribe using the IPC call to a/b/c/d, a/b/e/d, or a/b/+/d.You may also use * in the resources section to allow subscribing to any topic.Edit clarification:Local PubSub is a different set of APIs; local pubsub is not MQTT, and thus it does not support MQTT-style wildcards.If you wish to allow publishing and subscribing for local pubsub topics without specifying each topic individually, then you should use the wildcard *CommentShareEXPERTMichaelDombrowski-AWSanswered a year agoAWS-User-2940457 a year agoHi, Michael. Thanks for the fast response. But I tried, and this doesn't works for aws.greengrass.ipc.pubsub.In my component configuration I use (just like explained in documentation):accessControl:aws.greengrass.ipc.pubsub:com.simemap.GG-EMU-pg-db-insert:pubsub:1:operations:- "aws.greengrass#PublishToTopic"- "aws.greengrass#SubscribeToTopic"policyDescription: "Allows access to publish/subscribe to all topics."resources:- "*"In my code: (not working)topic = "Simemap/POC/1/1/+/eletric/data"request = SubscribeToTopicRequest()request.topic = topicrequest.qos = QOS.AT_MOST_ONCEhandler = StreamHandler()operation = ipc_client.new_subscribe_to_topic(handler)future = operation.activate(request)However, if I usetopic = "Simemap/POC/1/1/POC_2/eletric/data"works fine.I confirm wildcards works well for aws.greengrass.ipc.mqttproxy. But not for aws.greengrass.ipc.pubsub.ShareMichaelDombrowski-AWS EXPERTa year agoHello, as I said, local pubsub (subscribe to topic) is not the same as MQTT, therefore it does not use MQTT wildcards. You can subscribe to a topic called a/b/+/c, but that is subscribing to literally a topic called a/b/+/c, it doesn't subscribe with a wildcard. Wildcard subscriptions are not supported in anyway for local pubsub, you must subscribe to the specific topic.Share"


Question: My domain name is hijacked even though I set up DNSSEC

"Hi, I registered my domain on Route53. Several days ago, my domain name was hijacked to a malicious website. I have then set up the DNSSEC. However, it cannot solve the issue. By using the dnsviz, I can see three bogus items are shown using alidns.com as NS server. How can I defeat the hijacking? I am using Alicloud free https certificate for my website.  It is urgent for my business. Please help!FollowComment"


Question: LightSail instance

"I'm aware I cannot update RAM in an AWS LightSail instance - is this correct? IN order to have an instance with more RAM, how can I copy the contents of this existing instance so I can have a new one with more RAM?  A snapshot would work?Thanks.FollowComment"

Answer: "2Accepted AnswerGreetings,I understand that you currently trying to increase/Update the RAM in a LightSail Instance and also want to understand how you can copy the content of the existing instance with more RAM.Yes, it is possible to increase the RAM of a LightSail Instance. For this you will need to change the current LightSail Plan [1]. However, Currently the LightSail Instances can have a maximum of 32 GB Memory/RAM for Linux or Windows machines.The Prerequisites is to scale your LightSail instance, block storage disk, or database for this you take a snapshot of the resource and use the snapshot to create a new, larger version of that resource. Kindly refer to document [2] for the detailed steps on how to create a larger instance.I hope I was able to provide you with meaningful information. Should you have additional questions or concerns, please get back to us and we will be happy to assist you.References:[1] https://aws.amazon.com/premiumsupport/knowledge-center/change-lightsail-plan/[2] https://lightsail.aws.amazon.com/ls/docs/en_us/articles/how-to-create-larger-instance-from-snapshot-using-consoleCommentShareAWS-Nitishanswered 3 months ago"


Question: Does a completed training job incurr charges?

"Hello.As you can see in the screenshot below, there are couple of completed jobs in sagemaker. (Similar in the processing jobs and training jobs menu.)If I select one and click the actions button, the Stop menu is inactivated, as you can see.Does this kind of completed job incurr charges?If so, what do I have to do to Delete or Stop this job?Thank you.FollowComment"

Answer: "0Hi there. No, completed jobs don't incur charges. They only incur charges for the time they were running.CommentShareHeikoanswered 10 months ago"


Question: Fetch a list of users in Cognito UserPools using their email addresses in boto3

"I have a list of email addresses of users that I want to get user details of from Cognito.I want to make a batch call, not a sequential call for each email address.How is that possible in boto3, cannot seem to find a proper method.FollowComment"


Question: injecting "ECS_IMAGE_PULL_BEHAVIOR=prefer-cached" into /etc/ecs/ecs.config

"Hello,I have a working managed ComputeEnvironment and I would like to add "ECS_IMAGE_PULL_BEHAVIOR=prefer-cached" into /etc/ecs/ecs.config in order to assurethat the container is not reloaded from ECR for each job submit.I have tried with the following LaunchTemplate which is defined among other Resourcesin my cloudFormation file:"mwmLaunchTemplate": {"Type" : "AWS::EC2::LaunchTemplate","Properties" : {"LaunchTemplateData" : {"UserData"       : { "Fn::Base64" : { "Fn::Join" : ["", ["Content-Type: multipart/mixed; boundary="==MYBOUNDARY=="\n","MIME-Version: 1.0\n","\n","--==MYBOUNDARY==\n","Content-Type: text/x-shellscript; charset="us-ascii"\n","MIME-Version: 1.0\n","Content-Transfer-Encoding: 7bit\n","\n","#!/bin/bash\n","echo "ECS_IMAGE_PULL_BEHAVIOR=prefer-cached" >> /etc/ecs/ecs.config\n","\n","--==MYBOUNDARY==--"]]}}}}}The stack creation fails (rolling back without any message) if I am using mwmLaunchTemplate inside of my ComputeEnvironment:"mwmComputeEnvironment": {"Type": "AWS::Batch::ComputeEnvironment","Properties": {"Type": "MANAGED",......"launchTemplate": {"LaunchTemplateId" : {"Ref": "mwmLaunchTemplate"}},}....}mwmComputeEnvironment works well without the three lines:"launchTemplate": {"LaunchTemplateId" : {"Ref": "mwmLaunchTemplate"}},Thanks for your attentionWalter SteffeFollowComment"

Answer: "0Hello,  something changed in AWS batch since my previous post.Today I retried to create my stack with the LaunchTemplate inside of the AWS::Batch::ComputeEnvironment. This time I got an error message referring to the raw:"launchTemplate": {"LaunchTemplateId" : {"Ref": "mwmLaunchTemplate"}},So I understood that there was a case error: I should have written "LaunchTemplate": (with initial uppercase).In the meantime I have also corrected the LaunchTemplate definition which now is:"mwmLaunchTemplate": {"Type" : "AWS::EC2::LaunchTemplate","Properties" : {"LaunchTemplateData" : {"UserData"       : { "Fn::Base64" : { "Fn::Join" : ["", ["MIME-Version: 1.0\n","Content-Type: multipart/mixed; boundary="==MYBOUNDARY=="\n","\n","--==MYBOUNDARY==\n","Content-Type: text/x-shellscript; charset="us-ascii"\n","\n","#!/bin/bash\n","echo ECS_IMAGE_PULL_BEHAVIOR=prefer-cached >> /etc/ecs/ecs.config\n","\n","--==MYBOUNDARY==--"]]}}}}},After that the creation of my Batch Environment went well without any error.RegarsWalter SteffèCommentSharesteffewanswered 4 years ago"


Question: 502 errors with Application Load Balancer Idle Timeout / Apache2 Keep-Alive Timeout

"I've been getting 502/504 errors since setting up my Application Load Balancer. After reviewing logs with https://repost.aws/knowledge-center/elb-alb-troubleshoot-502-errors, my issue is The target closed the connection with a TCP RST or a TCP FIN while the load balancer had an outstanding request to the target.I have a 5 second keep-alive on Apache2 to keep memory down, but the website also has some long-running queries that fail unless I increase the load balancer idle timeout beyond 1 minute (currently at 3 minutes).Is my only option to resolve the 502 errors by increasing my keep-alive timeout to be longer than 3 minutes? It does not seem recommended to increase keep-alive to such a long duration and keep so many connections open.FollowComment"

Answer: "0Take note Application load balancer IP addresses are allocated dynamically. These IP addresses change when load balancer scales in or scales out. Therefore with the current setup of having External Application load balancer connecting to an Internal application load balancer using target group type IP is not recommended as the target group of the External load balancer can reference Old/ IP addresses of an internal load balancer.  When this happens the External load balancer will throw error 502 timeout errors.  I would recommend connecting Target/Backend instance directly to the External Application Load Balancer. With this setup you will not need to change the target group IP, every time the IP addresses on internal load balancer are refreshed."Keep-Alive" is a header part of the Http Protocol. The Keep-Alive header will allow multiple Http Requests to be send over a single connection instead of using multiple. The "Keep-Alive-Timeout" decides how long theses “Keep-Alive” connections are allowed to stay open. According to Apache documentation , Once a request has been received, the timeout value specified by the Timeout directive applies (The standard Timeout, not the Keep-Alive-Timeout). The Timeout decides the maximum amount of time the server will wait for a client's response, and its default in Apache is 60 seconds.The Connection Idle Timeout in ALB, which its default value is 60 Seconds as well, works as the “standard” timeout. So If no data has been sent or received by the time that the idle timeout period elapses, the load balancer closes the connection. I strongly recommend you to configure the idle timeout of your application to be larger than the idle timeout configured for the load balancer. In this way, you avoid that the Load Balancer closes a connection before the application.I’ve also linked an interesting link about HTTP Keep Alive, please have a look at [2].Should you have any other queries or concerns related to this case, please feel free to write back and I will be happy to clarify your questions!Apache KeepAlive Timeouthttps://httpd.apache.org/docs/2.4/mod/core.html#keepalivetimeoutHTTP Keep Alive https://blog.stackpath.com/glossary-keep-alive/CommentShareRam_AWSanswered 2 months ago"


Question: Grafana Geomap - Change Base layer

In the Grafana Geomap panel. You cannot change the base layer as it states "The base layer is configured by the server admin." How can we alter this base layer to a different tile maPFollowComment

Answer: "0For Amazon Managed Graphana, the base layer option is not configurable at this point as you noted. You can follow Amazon Managed Graphana public roadmap in this GitHub repository. Of course, this limitation is with Amazon Managed Graphana, so using a self-hosted Graphana can help use the base layer option.CommentShareTaka_Manswered 10 months ago"


Question: rds migration from on premises MySQL 8

"Hello all,I have MySQL database on premises, MySQL 8I want to export it and import it into RDSI tried mysqldump added the dump file to S3 bucket and run restore from S3 i got:Incompatible-restoreI tried xtrabackup (as advised in some aws kb) and i uploaded the backup folder to S3 bucket againi got Incompatible-restoreI tried xtrabackup with gz (gzip -c > /backup/xtrabackup.tar.gz) produced a gunzip tar file uploaded it to S3 and again same thing:Incompatible-restorethe database is very small less than 100 mb , what is your recommendations? and is there any way to get more details from RDS regarding to the Incompatible-restore error ? a full log or something ?Thanks.FollowComment"

Answer: "0Accepted AnswerHello,You are doing the right steps in migrating the backup by using S3. Below are a few considerations before you do the same.The following are some limitations and recommendations for importing backup files from Amazon S3:You can only import your data to a new DB instance, not an existing DB instance.You must use Percona XtraBackup to create the backup of your on-premises database.You can't import data from a DB snapshot export to Amazon S3.You can't migrate from a source database that has tables defined outside of the default MySQL data directory.You must import your data to the default minor version of your MySQL major version in your AWS Region. For example, if your major version is MySQL 8.0, and the default minor version for your AWS Region is 8.0.28, then you must import your data into a MySQL version 8.0.28 DB instance. You can upgrade your DB instance after importing. For information about determining the default minor version, see MySQL on Amazon RDS versions.Backward migration is not supported for both major versions and minor versions. For example, you can't migrate from version 8.0 to version 5.7, and you can't migrate from version 8.0.28 to version 8.0.27.You can't import an on-premises MySQL database from one major version to another. For example, you can't import a MySQL 5.7 database to an RDS for MySQL 8.0 database. You can upgrade your DB instance after you complete the import.You can't restore from an encrypted source database, but you can restore to an encrypted Amazon RDS DB instance.You can't restore from an encrypted backup in the Amazon S3 bucket.Importing from Amazon S3 is not supported on the db.t2.micro DB instance class. However, you can restore to a different DB instance class, and change the DB instance class later. For more information about instance classes, see Hardware specifications for DB instance classes.When you restore the database, the backup is copied and then extracted on your DB instance. Therefore, provision storage space for your DB instance that is equal to or greater than the sum of the backup size, plus the original database's size on disk.User accounts are not imported automatically. Save your user accounts from your source database and add them to your new DB instance later.Functions are not imported automatically. Save your functions from your source database and add them to your new DB instance later.Stored procedures are not imported automatically. Save your stored procedures from your source database and add them to your new DB instance later.Time zone information is not imported automatically. Record the time zone information for your source database, and set the time zone of your new DB instance later.Verify the above & check if it helps !!ThanksChiragCommentShareSUPPORT ENGINEERAWS-User-Chiraganswered 8 months ago0Thank you!, its worked, after second try following your guide lines, first time i exported using databases= its exported successfully, but did not work with RDS, got same compatibility error, second time i exported the whole with Xtraback, uploaded the folder to S3, and its worked perfectly, thank you again.CommentSharerePost-User-3348574answered 8 months ago"


Question: How can I implement 'login with aws' for a web application?

"We are building a web application that asks users to login using their aws account and uses the auth token generated to access specific resources from the user's aws account.This is similar to the support in Azure and GCP:https://learn.microsoft.com/en-us/azure/active-directory/develop/quickstart-register-apphttps://developers.google.com/identity/sign-in/web/sign-inWhat is the correct way of implementing this for aws?Investigation done so far:Aws Cognito - We explored aws cognito and it seems like it is a solution to manage our own user pool. Users will need to sign up and signed-in users can sign in. We are looking to access the aws user pool, instead of managing our own user pool.Aws STS - STS has APIs to generate temp credentials for an IAM role, but the STS SDK itself needs to be initialized using our aws credentials. So this scenario is not feasible for web applications.We are looking for a way which uses the oAuth2 protocol to authenticate the user and return an access token to the web application.FollowComment"

Answer: 0AWS has the ability to connect OIDC identity providers. Check out this link below:https://docs.aws.amazon.com/cognito/latest/developerguide/cognito-user-pools-oidc-idp.htmlYou can create and manage the user pools through the instructions below.https://docs.aws.amazon.com/cognito/latest/developerguide/cognito-user-identity-pools.htmlCommentSharerePost-User-venkyanswered 3 months ago


Question: Cognito otpauth name using hosted UI

"HI,I'm using the hosted Cognito UI for login/reset/TOTP and I want the google authenticator code to show my custom application name, but it shows 'AWSCognito'.I understand using the API only I can amend AWSCognito as seen hereotpauth://totp/AWSCognito:${email}?secret=${code}&issuer=https://cognito-idp.ap-southeast-2.amazonaws.com/Is there a way with the hosted UI?ThxDanFollowComment"

Answer: "0Accepted AnswerThis has been solved. For those needing it:import {  Authenticator,  Heading,  Text,  ThemeProvider,  Theme,  useTheme,  View,  useAuthenticator,  Button,} from '@aws-amplify/ui-react'then wrap your app in the auth provider <Authenticator          hideSignUp={true}          formFields={formFields}          components={components}        >          <Layout>            <main>              <Component previousPathname={previousPathname} {...pageProps} />            </main>          </Layout>        </Authenticator>and configure formFieldconst formFields = {  setupTOTP: {    QR: {      totpIssuer: `CompanyName - ${process.env.NEXT_PUBLIC_ENV}`,      totpUsername: email,    },...  },}ThxDanCommentShareDanBanswered 5 months ago"


Question: Server Crashed for 5000 Users

"We have given access to 5000 users today in our portal, and Server Crashed.I don't know where it went wrong.FollowComment"

Answer: "2Accepted AnswerHi, you'll need to provide a lot more information!  What's the architecture and AWS services you're using?  Did it scale out as expected?  What do your CloudWatch metrics and your logs indicate happened?CommentShareEXPERTskinsmananswered 4 months ago2By "Mango DB" do you mean MongoDB Atlas?Here are some things you need to look into:What's the load on the database, is it reaching any CPU, memory or storage limits?  Does it autoscale (I'm not familiar with this DB)?What's the load on your NodeJS Back-end which I think you mean is running in EC2?  Does it autoscale?  Is it behind a load balancer?Same for your Angular Web Servers.Where are the servers (all 3 tiers) loggin, and what errors are in the logs?Forgive me if I'm mistaken but when I asked for metrics and logs you sent Billing information which makes me think you've been dropped in the deep end here and really don't know much about AWS or the application.  I think you're going to have to do some basic training on both before you can get anywhere; bringing you up to speed that far is beyond the scope of this forum.  Sorry if that sounds blunt.Best of luck!CommentShareEXPERTskinsmananswered 4 months ago0Hello Skinsman,Thanks for making an effort to reply.**What's the architecture? **We have developed our backend in Node J and the front end in the Agular Platform.Hosted our Application in AWS Server, using Mango DB to fetch the Database.AWS services you're using?I have included Our Mango DB Plan and AWS Plan.**What do your CloudWatch metrics and your logs indicate that happened?**User Login AttemptI hope I have given all the details you requested. Please let me know if you need anything else.CommentShareARUNKUMAR GANESANanswered 4 months ago"


Question: AWS IoT Thing provisioning fails on Windows during certificate loading

"Hello,I have a problem during the provisioning of the IoT thing using claim certificates. We are using the fleet provisioning by claim mechanism. We are following the steps described in this PDF: https://d1.awsstatic.com/whitepapers/device-manufacturing-provisioning.pdfWhen we start the provisioning process, we are providing the AwsIotMqttConnectionBuilder with the claim certificate and claim private key(which are generated in previous step). The problem comes when we are building the MqttClientConnection with which to make the request to the AWS IoT core for the provisioning.Here is a detailed exception:Exception occurred during fleet provisioning by claimat com.iav.de.ota.provisioning.flow.FleetProvisioningByClaimFlowExecutor.execute(FleetProvisioningByClaimFlowExecutor.java:50)at com.iav.de.ota.provisioning.ProvisioningFacade.provision(ProvisioningFacade.java:60)at com.iav.de.ota.provisioning.ProvisioningFacade.provisionToDeviceManagementCloud(ProvisioningFacade.java:54)at com.iav.de.ota.provisioning.ProvisioningFacade.provision(ProvisioningFacade.java:39)at com.iav.de.ota.Main.main(Main.java:42)Caused by: software.amazon.awssdk.crt.CrtRuntimeException: TlsContext.tls_ctx_new: Failed to create new aws_tls_ctx (aws_last_error: AWS_IO_FILE_VALIDATION_FAILURE(1038), A file was read and the input did not match the expected value) AWS_IO_FILE_VALIDATION_FAILURE(1038)at software.amazon.awssdk.crt.io.TlsContext.tlsContextNew(Native Method)at software.amazon.awssdk.crt.io.TlsContext.<init>(TlsContext.java:24)at software.amazon.awssdk.crt.io.ClientTlsContext.<init>(ClientTlsContext.java:26)at software.amazon.awssdk.iot.AwsIotMqttConnectionBuilder.build(AwsIotMqttConnectionBuilder.java:502)at com.iav.de.ota.mqtt.MqttConnectionFactory.create(MqttConnectionFactory.java:44)at com.iav.de.ota.provisioning.flow.FleetProvisioningByClaimFlowExecutor.execute(FleetProvisioningByClaimFlowExecutor.java:42)Going throught the error, I have found that this error AWS_IO_FILE_VALIDATION_FAILURE(1038) indicates that the expected claim private key/certificate is not matching the ones which we are giving it to it. So, I started going further into the issue and found that the library which we are using for reading the private key(bouncy castle) is reading a key which different than the input one. In other words, when I inspect the claim private key with Notepad and compare it with the one which the BouncyCastle has read - they are different.The problem is more interesting because this does not happen on Linux machines and only on Windows machines.I have even tried to read the claim private key as plain string from the file and pass it to the MqttConnection and this works. Unfortunately, this is not a solution because later on(after the provisioning) we are storing the real certificate and private key, for later on communication with the AWS IoT Core, in a KeyStore which we are reading with BouncyCastle, again. So, we need the library(BouncyCastle or other) in order to read the private key/certificate in any moment of the execution of the progam(either during the provisioning or later on during the other AWS IoT Core calls with the real certificates).Forgot to mention, the claim private key and claim certificate are stored in PEM format.Could you tell me what can be done here?Is there any AWS supported library for reading the claim private key/certificate without using BouncyCastle?Any suggestions here are welcomed because we are stucked and the requirements are that each AWS IoT Things will be running on Windows OS.Thanks a lot,EnchoFollowCommentJan_B EXPERTa year agoHow do you instantiate the AwsIotMqttConnectionBuilder? By using one of the factory methods?AwsIotMqttConnectionBuilder.newMtlsBuilderFromPath(certPath, keyPath)Or do you set the tlsOptions by hand?Share"

Answer: "1Hi Encho,Can you please take a look at the pem files and check whether they are certificate chains? (It has more than one certificate) If it does, this is a known issue in aws-c-io and a fix has been submitted. If you'd like to manually apply the fix yourself before a new version is released, it's a single line change.In aws-c-io -> source -> windows -> windows_pki_utils.c change line 606 fromif (i != cert_count - 1 || !add_result) {toif (i != 0 || !add_result) {That should fix the issue and unblock you for now until this is propagated into a release.CommentShareSteve Kimanswered a year agoEncho Belezirev a year agoHello,Thanks for the answer. When the fix is expected to be released?Something more, is this library used by the Java SDK? We are using Java(sorry if I forgot to mention this)Currently, we are partially blocked(because from the team, I am the only one working on Windows machine).Thanks!ShareSteve Kim a year agoHi Encho,the fix may be a little ways off as we need to also implement unit testing before pushing it to main. The fix is in the CRT so it should apply to all higher level languages, java included as long as you're using the v2 SDKs. In the meanwhile, could you provide me with logs from the CRT as well as the certificates that are being used in your testing?Thanks!ShareEncho Belezirev a year agoHello Steve,I can provide the logs but the only ones which I see are part of the Java stacktrace of the execution. Could you tell me how to enable the logs of the CRT?Thanks!ShareSteve Kim a year agoHi Encho, you can look at how the CRT handles logging here: https://github.com/awslabs/aws-crt-java/blob/main/src/main/java/software/amazon/awssdk/crt/Log.javaPlease set the following properties:-Daws.crt.debugnative=true-Daws.crt.log.destination=File-Daws.crt.log.level=Trace-Daws.crt.log.filename=<path and filename>Share"


Question: Over the Air update feature for Raspberry PI

"Hi,I'm trying to implement the OTA feature to update a Linux application on Raspberry Pi3. To start with I found the below demo.https://github.com/aws/aws-iot-device-sdk-embedded-C/tree/main/demos/ota/ota_demo_core_mqttDoes the OTA require FreeRTOS as a prerequisite? Because The raspberry Pi3 runs on raspbian OS and no support for FreeRTOS. Please guide me to implement the OTA on Raspbian OS using the Demo libraries.Thanks,BalaFollowComment"

Answer: "1HI Bala,you are correct in that the sample you looked at requires FreeRTOS. If you want to implement OTA for RaspberryPi you can follow this sample: https://github.com/aws-samples/aws-iot-jobs-full-system-updateCheers,MassimilianoCommentShareEXPERTMassimilianoAWSanswered 7 months agorePost-User-3675045 7 months agoThanks Massimiliano for sharing the details, this will be really useful for my work. Looks like it has the process to update the complete image on Raspberrypi using an agent and this agent is different from OTA agent. Can I use the same goagent for custom upgrade of any linux application running on raspberry pi over the air?Share"


Question: Setting column width in pivot table - Quicksight

"I am trying to modify the column width of the pivot table. When I refresh the page, the changes I have made are not updated in the table. Is there any way to prevent the pivot table from resizing?FollowComment"

Answer: "0Hi ,Are you using free form, as described in this blog post or the default view?If yes can you please describe a bit better the situation?Also, for QuickSight related questions we have launched a fully dedicated community; in case you want to check there to see if there are further answer to your questions.hope this helps,CommentShareEXPERTFabrizio@AWSanswered a year ago"


Question: Automatically SNS Unsubscribe Confirmation

"Hello everyone,Some colleagues reported recently that they stopped to receive SNS topic notifications, and also they receive many automatic e-mails from AWS related to "unsubscribe confirmation", even though they didn't manually unsubscribe these topics.Has anyone faced a similar issue? From our side, we didn't directly made any changes that could trigger this behaviorBest regards,FollowComment"

Answer: 0Take a look at the CloudTrail logs for the unsubscribe events to see who initiated these. See: Viewing events with CloudTrail Event history.CommentShareEXPERTkentradanswered a month agojkalandarov 2 days agoChecked CloudTrail logs. There was not unsubscribe event.Share


Question: Delayed shutdown of ECS Fargate tasks?

"Hello,I have a problem with delayed shutdown of ECS Fargate tasks, let me explain by example:in a Docker image at the very last line of the entrypoint script I have simple echo statement. It's being logged at 11:18:22.004I have another process, which is checking ECS tasks statuses on some events, an it's logged that at 11:18:30.023 (8 s later execution of last line of entrypoint) both last and desired statuses of the task are RUNNINGSo my question is it expected that ECS Fargate takes more than 8 secs to shutdown task, specially considering that desired status also remains RUNNING after that time.FollowComment"

Answer: "0An ECS/Fargate tasks stops when the application in your container stops (or for that matter if a critical container exits for any reason). If your container doesn't shut down, the task will keep on running. It would be good to take a closer look and see if there are any additional processes that continue to run in this case.CommentShareMatsanswered a year agoA-Shevchenko a year agoThanks for this guess. Indeed in the middle of the entrypoint I launch some 3rd party software, which might be spawning process(es). I'll try to verify that and decrease stopTimeout of container to see if it helps.Share"


Question: Upgrade platform Coretto 11

"Hello,We have an application on elastic beanstalk which is on a java 8/Amazon linux 1 platform. A few months ago Amazon sent us an email telling us that Amazon linux 1 will no longer be supported by the end of June.We tried to recreate an environment on the Correto 11/Amazon linux 2 platform, and although the site is accessible and the requests go through, the application status is still indicated as severe.Here are the causes :Overall:100.0 % of the requests are erroring with HTTP 4xx. Insufficient request rate (12.0 requests/min) to determine application health.ELB processes are not healthy on all instances.ELB health is failing or not available for all instances.i-07a5c574732d43842:100.0 % of the requests are erroring with HTTP 4xx. Insufficient request rate (12.0 requests/min) to determine application health.Process default has been unhealthy for 2 days (Target.ResponseCodeMismatch).\nProcess secure has been unused for 2 days (Target.NotInUse).Is there something we can do?Thank you in advance for your help.FollowComment"


Question: not able to deactivate services

I created Amazon Active Directory by mistake as simple AD option was not shown.Now I am not able to deactivate or delete or stop.I have hardl explored AWS and I am seeing a bill projection of approx 20$Please helpFollowComment

Answer: 0Hi ThereCan you post a screenshot or paste the specific error you are seeing when trying to remove the Managed AD?CommentShareEXPERTMatt-Banswered 2 months ago


Question: "DNS validation remains pending in ap-southeast-1, but succeeds in us-east-1"

"Hi,DNS validation fails in ap-southeast-1, but succeeds for the same domain in us-east-1.We try to use Amazon Certificate Manager (ACM) to generate a certificate for two domains (both in one certificate). Let's say:example.com*.example.comfoobar.com*.foobar.comWe use the DNS validation method for this process and created the needed validation records in both name servers.We want to deploy the certificate to CloudFront and to a load balancer in ap-southeast-2, so we requested the certificate at ACM in the us-east-1 region and also in the ap-southeast-2 region. It worked perfectly fine in the us-east-1 region (which proves that the DNS entries exist and are valid). However, the same certificate request (same domains) does not go through in ap-southeast-2. The validation status remains "pending" for one of the two domains.Given a certificate was issued at ACM in the us-east-1 region, this can not be a problem with the DNS validation record. We also followed the checks documented here:https://aws.amazon.com/premiumsupport/knowledge-center/acm-certificate-pending-validation/...and I can confirm that the record has propagated:dig TXT +short +noshort ...We also deleted the pending cert request and created another one (using the option to automatically write the CNAME record to our hosted zone) but to no avail. The pending status of the certificate has not changed after more than 24 hours.We would appreciate any feedback and I am happy to provide domains names, ARN, etc. in a non-public communication.FollowComment"

Answer: "0The certificate request expired after 72 hours. However, I was able to resolve the issue as follows:Delete the expired certificate (that was never validated)Delete the validation CNAME records from the DNS (Route 53)Generate a new certificate request at ACM (same two domains)Let ACM (re-)create the validation recordsA new certificate with both domains has been generated, validated and is now available. Needless to say that the records in Route 53 are exactly the same as they were before (I double and triple checked).CommentShareCerebrumanswered 4 years ago"


Question: CloudFront support of HTTP3 protocol

"Does anybody know when CloudFront will support http3 in the "Supported HTTP Versions" of "Distribution Settings"?Google, Cloudflare, etc. all support it now.FollowComment"

Answer: "0any news here?CommentSharechristianhalleranswered a year agoKrishna 9 months agoCloudFront now supports HTTP/3: https://aws.amazon.com/blogs/aws/new-http-3-support-for-amazon-cloudfront/Share0As far as I know, AWS has a roadmap for HTTP 3 support in this year. Also, I guess this roadmap has proved by that started TLSv1.3 support from last year.Hope this helps!CommentSharehedyanswered 2 years ago0Look like it's in progress: https://twitter.com/cloudfront/status/1494406437958651911?lang=enCommentSharebennettanswered 10 months ago0CloudFront now supports HTTP/3: https://aws.amazon.com/blogs/aws/new-http-3-support-for-amazon-cloudfront/CommentShareKrishnaanswered 9 months ago"


Question: "AWS Config PutConformancePack -- 500 InternalFailure error, null error message"

"I have been working with AWS config for conformance pack compliance and as of today it is no longer allowing me to deploy a conformance pack via an s3 template upload. The error occurs only when deploying via s3 template, using a sample pack is fine.I have been using the same s3 bucket and IAM user for some time to perform these tasks and have not changed anything regarding permissions. Config has read access to the bucket and the bucket policy I am using is the one noted in the docs for allowing Config access, I am deploying in the same region as the bucket (us-east-1), and the IAM user account I am using in the code has the relevant permissions outlined in the docs. I have even tried making the bucket completely public but still no dice.The failure is happening both via the AWS Java SDKv2 and in the portal.Error Message:null (Service: AmazonConfig; Status Code: 500; Error Code: InternalFailure; Request ID: d116e7a3-c268-423c-a28a-8f2802e92125; Proxy: null)Java Error:null (Service: Config, Status Code: 500, Request ID: e7174ac8-cfae-49b4-a64c-08667f2db10b, Extended Request ID: null) software.amazon.awssdk.services.config.model.ConfigException: null (Service: Config, Status Code: 500, Request ID: e7174ac8-cfae-49b4-a64c-08667f2db10b, Extended Request ID: null)Dev Console Message:{"payload":null,"message":"null (Service: AmazonConfig; Status Code: 500; Error Code: InternalFailure; Request ID: d116e7a3-c268-423c-a28a-8f2802e92125; Proxy: null)","errorCode":"InternalFailure","statusCode":"STARLING_FAILED"}The lack of description is not giving me much to go off of, this error is not listed in the AWS docs for putConformancePack anywhere beyond this section in the "common issues" for Config:InternalFailureThe request processing has failed because of an unknown error, exception or failure.HTTP Status Code: 500There is a CloudTrail configured and it is logging Config events but no events are registering when uploading via s3 uri, the events only appear when deploying using Sample Templates.Has anyone seen this/have any ideas on how to debug it?FollowComment"


Question: Cloudwatch Event ECS payload?

"I see that I can run ECS tasks in response to Cloudwatch Events, such as a PutObject event in an S3 bucket. Like this:https://docs.aws.amazon.com/AmazonCloudWatch/latest/events/CloudWatch-Events-tutorial-ECS.htmlMy use case is that I'd like to run an ECS task in response to S3 PutObject events, so that a container can do some work on an object whenever that objects gets uploaded to S3.Does Cloudwatch Events send the event payload to ECS, the same way it sends event payloads to Lambda? If so, how is the event payload exposed to an ECS task? If possible I'd like my ECS task to be able to parse the event payload, inside the container of the ECS task, to determine the S3 object key which triggered the event which started the task.FollowComment"

Answer: "0https://medium.com/@bowbaq/trigger-an-ecs-job-when-an-s3-upload-completes-3559c44c37d1I think the above will unblock me.Edited by: jrobison-sb on Apr 15, 2019 11:02 AMCommentSharejrobison-sbanswered 4 years ago"


Question: Please add TLD ".stream" to Route 53

Please consider adding ".stream" to Route 53FollowComment

Answer: "0Hello There,Currently, the NEW TLD request are need to create a Feature Request via Customer Support (CS)/ Technical support (TS). I would suggest you to open a case with the CS for the same.Regards,CKCommentShareChethan SEanswered 10 months ago"


Question: Succesful deployment on Windows server but still can't access app

"After creating a pipeline with CodePipeline with all the attendant resources (CodeCommit, CodeDeploy, EC2, IAM Roles, etc.), my pipeline has run successfully but I still can't access my EC2 instance online ("This site can't be reached error").My code is very simple, I just want to run a starter app to learn how to use the pipeline; in fact, I'm using the SampleApp_Windows structure downloaded from this Github repo https://github.com/quangit/aws-codedeploy-samples-master/tree/master/applications. I didn't change anything in the code and my pipeline is showing success in all of the stages. But when I try to access the EC2 instance via the public DNS address provided, nothing happens.I've already gone through the process of successfully deploying the SampleApp_Linux from the same Github repository and was able to access the app there (and since I'm using the same security group on my new Windows instance I don't think it's a firewall issue), so I really don't know what the issue could be other than there's something about how a Windows server works with CodePipeline that I don't know.Any ideas would be appreciated!FollowComment"

Answer: "0When everything looks like it's working there's always an easy answer: launching the instance from the console using the public DNS address seems to always adds an https:// out front (even when you can't see it), but forcing that to be http:// let everything work! So, the moral of the story is to always check the protocol.CommentSharerePost-User-7513372answered 2 months ago"


Question: Endpoint for IOT services?

"How does an AWS IOT device know what endpoint to hit in order to access the IOT instance associated with my AWS account?Do all devices just hit the same endpoint, and IOT figures it out based on their certificate? Or do I need to program my device with an endpoint, or some other information to tell it to communicate with my account?Thanks.FollowComment"

Answer: "0Accepted AnswerThe endpoints are based on the account you're using and the region you're connecting to. It is up to you to determine which endpoints your device will reach out to. Here's an example on how the API/SDK uses endpoint and portTo determine the endpoint for a region use the following command documented here. Best way to see it in action would be to create a thing in AWS IoT Core and download the starter kit. You can do that through the AWS IoT Core Console Page > Connect > Getting Started > Onboard a deviceaws iot describe-endpoint --endpoint-type iot:Data-ATSCommentSharePronoy_Canswered a year agoFrank a year agothat worked, thanks!Share"


Question: Device Farm Video is not showing application interaction

"Hi,I am running my test on device farm. From the test specification log, it shows that my test has passed. However from the video recording, it is always stuck on the default mobile homescreen.How do i get the video recording to capture the test interaction instead of just the homescreen.thanks![TestNG] INVOKING CONFIGURATION: "Command line test eca2ebbd-c83a-4609-84f0-bb52a16b1afc" - @BeforeTest Tests.LoginTest.setUpPage()[TestNG] PASSED CONFIGURATION: "Command line test eca2ebbd-c83a-4609-84f0-bb52a16b1afc" - @BeforeTest Tests.LoginTest.setUpPage() finished in 118 ms[Invoker 1508395126] Keeping method TestBase.navigateTo()[pri:0, instance:Tests.LoginTest@15975490] for class [TestClass name=class Tests.LoginTest][Invoker 1508395126] Invoking @BeforeClass TestBase.navigateTo()[pri:0, instance:Tests.LoginTest@15975490][TestNG] INVOKING CONFIGURATION: "Command line test eca2ebbd-c83a-4609-84f0-bb52a16b1afc" - @BeforeClass Tests.AbstractBaseTests.TestBase.navigateTo()[TestNG] PASSED CONFIGURATION: "Command line test eca2ebbd-c83a-4609-84f0-bb52a16b1afc" - @BeforeClass Tests.AbstractBaseTests.TestBase.navigateTo() finished in 2846 ms[Invoker 1508395126] Keeping method LoginTest.logOut()[pri:0, instance:Tests.LoginTest@15975490] for class [TestClass name=class Tests.LoginTest][TestNG] INVOKING: "Command line test eca2ebbd-c83a-4609-84f0-bb52a16b1afc" - Tests.LoginTest.loginFail()[Invoker 1508395126] Invoking Tests.LoginTest.loginFail[TestNG] PASSED: "Command line test eca2ebbd-c83a-4609-84f0-bb52a16b1afc" - Tests.LoginTest.loginFail() finished in 7446 ms[Invoker 1508395126] Keeping method LoginTest.logOut()[pri:0, instance:Tests.LoginTest@15975490] for class [TestClass name=class Tests.LoginTest][Invoker 1508395126] Invoking @AfterMethod LoginTest.logOut()[pri:0, instance:Tests.LoginTest@15975490][TestNG] INVOKING CONFIGURATION: "Command line test eca2ebbd-c83a-4609-84f0-bb52a16b1afc" - @AfterMethod Tests.LoginTest.logOut()[TestNG] PASSED CONFIGURATION: "Command line test eca2ebbd-c83a-4609-84f0-bb52a16b1afc" - @AfterMethod Tests.LoginTest.logOut() finished in 827 ms[Invoker 1508395126] Keeping method LoginTest.logOut()[pri:0, instance:Tests.LoginTest@15975490] for class [TestClass name=class Tests.LoginTest]FollowCommentAWS-User-6967798 a year agoSolved, apparently this issue only happens on pixel 3 xl andriod 9Share"


Question: DynamoDB - Is it possible to query with a filter without data types?

Is it possible to omit the data types specification when running a Amazon DynamoDB Query with a QueryFilter or FilterExpression.For example:"AttributeValueList": [ {"S": "No One You Know"} ](from here)I couldn't find a way to do it. Am I missing something?FollowComment

Answer: "0Accepted AnswerThe low-level Query API requires specifying the data type:https://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_Query.htmlHowever, there are higher-level Document Clients available that abstract this for you, allowing you to pass a value (string, number, bool, etc.) as-is to the higher-level query API, and the DocumentClient will translate that to the low-level API for you. Big time saver:https://docs.aws.amazon.com/sdk-for-javascript/v2/developer-guide/dynamodb-example-document-client.htmlhttps://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/DynamoDB/DocumentClient.htmlExample:var params = {  TableName: 'Table',  IndexName: 'Index',  KeyConditionExpression: 'HashKey = :hkey and RangeKey > :rkey',  ExpressionAttributeValues: {    ':hkey': 'key',    ':rkey': 2015  }};var documentClient = new AWS.DynamoDB.DocumentClient();documentClient.query(params, function(err, data) {   if (err) console.log(err);   else console.log(data);});https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/DynamoDB/DocumentClient.html#query-propertyAlso, per docs:QueryFilter - This is a legacy parameter. Use FilterExpression instead. For more information, see QueryFilter in the Amazon DynamoDB Developer Guide.CommentShareAWS-User-9164621answered 3 years ago"


Question: PA API Error 500 when adding credentials

"Hi,For whatever reasons my Amazon Associates Product Advertising API credentials aren't working anymore (they did before). I'd therefore like to generate new ones. However, whenever I click in Associates Central under Tools -> Product Advertising API -> Add credentials, I get an error 500 message: "500 Internal Server Error If you are the administrator of this website, then please read this web application's log file and/or the web server's log file to find out what went wrong." That's directly on the Amazon Associates website, not my own, so I can't really do anything about that internal sever error.And if I try to delete the existing credentials, I get this error message: "We are currently unable to provide the data requested. Please try again later. "Now that's already been for several days and still not working.I've contacted the Amazon Associates Support who unfortunately were less than helpful with this matter.Any ideas of what I could do? Or if you know of a forum that'd be better placed to answer this question?Thanks so much for your help!FollowComment"

Answer: "0That error has been fixed by amazon, question can be closed. Thanks!CommentShareRicoanswered a year ago"


Question: How to license Win2016 EC2s

I instantiated a Windows server image from the market place and configured it appropriately for my use.  I saved it as my own AMI image and I have now spun up 2 copies of it.  The second one does not think it is licensed which I can understand.  How can I get a license for this second (and future) copies?  Or perhaps there is a different way to do what I'm trying to do?FollowComment

Answer: "0Hi There,I understand that you would like to find information on How to license Win2016 EC2.I recommend that you follow the documentation [1].Please also note that windows instances use Microsoft Key Management Service (Microsoft KMS) on Amazon Web Services (AWS) for activation. You might get a Windows activation error message if your instance can’t reach the Microsoft KMS server. Or, there might be an issue with the Microsoft KMS client configuration.To resolve this you can either use an AWS Systems Manager Automation document or follow a manual process to activate Windows.Kindly follow this documentation to implement either one of these solutions [2]===============References=============[2] https://aws.amazon.com/windows/resources/licensing/[1] https://aws.amazon.com/premiumsupport/knowledge-center/windows-activation-fails/Please note that I personally value your feedback and would appreciate it if you accept and thumbs up this response if it satisfies your questionCommentShareMfaneloanswered a year ago"


Question: Not able to convert Hugging Face fine-tuned BERT model into AWS Neuron

"Hi Team,I have a fine-tuned BERT model which was trained using following libraries.torch == 1.8.1+cu111transformers == 4.19.4And not able to convert that fine-tuned BERT model into AWS neuron and getting following compilation errors. Could you please help me to resolve this issue?Note: Trying to compile BERT model on SageMaker notebook instance and with "conda_python3" conda environment.Installation:Set Pip repository  to point to the Neuron repository!pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.comInstall Neuron PyTorch - Note: Tried both options below."#!pip install torch-neuron==1.8.1.* neuron-cc[tensorflow] "protobuf<4" torchvision sagemaker>=2.79.0 transformers==4.17.0 --upgrade"!pip install --upgrade torch-neuron neuron-cc[tensorflow] "protobuf<4" torchvisionModel compilation:import osimport tensorflow  # to workaround a protobuf version conflict issueimport torchimport torch.neuronfrom transformers import AutoTokenizer, AutoModelForSequenceClassificationmodel_path = 'model/' # Model artifacts are stored in 'model/' directory# load tokenizer and modeltokenizer = AutoTokenizer.from_pretrained(model_path)model = AutoModelForSequenceClassification.from_pretrained(model_path, torchscript=True)# create dummy input for max length 128dummy_input = "dummy input which will be padded later"max_length = 128embeddings = tokenizer(dummy_input, max_length=max_length, padding="max_length", truncation=True, return_tensors="pt")neuron_inputs = tuple(embeddings.values())# compile model with torch.neuron.trace and update configmodel_neuron = torch.neuron.trace(model, neuron_inputs)model.config.update({"traced_sequence_length": max_length})# save tokenizer, neuron model and config for later usesave_dir="tmpd"os.makedirs("tmpd",exist_ok=True)model_neuron.save(os.path.join(save_dir,"neuron_model.pt"))tokenizer.save_pretrained(save_dir)model.config.save_pretrained(save_dir)Model artifacts: We have got this model artifacts from multi-label topic classification model.config.jsonmodel.tar.gzpytorch_model.binspecial_tokens_map.jsontokenizer_config.jsontokenizer.jsonError logs:INFO:Neuron:There are 3 ops of 1 different types in the TorchScript that are not compiled by neuron-cc: aten::embedding, (For more information see https://github.com/aws/aws-neuron-sdk/blob/master/release-notes/neuron-cc-ops/neuron-cc-ops-pytorch.md)INFO:Neuron:Number of arithmetic operators (pre-compilation) before = 565, fused = 548, percent fused = 96.99%INFO:Neuron:Number of neuron graph operations 1601 did not match traced graph 1323 - using heuristic matching of hierarchical informationWARNING:tensorflow:From /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages/torch_neuron/ops/aten.py:2022: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.Instructions for updating:Use tf.where in 2.0, which has the same broadcast rule as np.whereINFO:Neuron:Compiling function _NeuronGraph$698 with neuron-ccINFO:Neuron:Compiling with command line: '/home/ec2-user/anaconda3/envs/python3/bin/neuron-cc compile /tmp/tmpv4gg13ze/graph_def.pb --framework TENSORFLOW --pipeline compile SaveTemps --output /tmp/tmpv4gg13ze/graph_def.neff --io-config {"inputs": {"0:0": [[1, 128, 768], "float32"], "1:0": [[1, 1, 1, 128], "float32"]}, "outputs": ["Linear_5/aten_linear/Add:0"]} --verbose 35'INFO:Neuron:Compile command returned: -9WARNING:Neuron:torch.neuron.trace failed on _NeuronGraph$698; falling back to native python function callERROR:Neuron:neuron-cc failed with the following command line call:/home/ec2-user/anaconda3/envs/python3/bin/neuron-cc compile /tmp/tmpv4gg13ze/graph_def.pb --framework TENSORFLOW --pipeline compile SaveTemps --output /tmp/tmpv4gg13ze/graph_def.neff --io-config '{"inputs": {"0:0": [[1, 128, 768], "float32"], "1:0": [[1, 1, 1, 128], "float32"]}, "outputs": ["Linear_5/aten_linear/Add:0"]}' --verbose 35Traceback (most recent call last):  File "/home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages/torch_neuron/convert.py", line 382, in op_converter    item, inputs, compiler_workdir=sg_workdir, **kwargs)  File "/home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages/torch_neuron/decorators.py", line 220, in trace    'neuron-cc failed with the following command line call:\n{}'.format(command))subprocess.SubprocessError: neuron-cc failed with the following command line call:/home/ec2-user/anaconda3/envs/python3/bin/neuron-cc compile /tmp/tmpv4gg13ze/graph_def.pb --framework TENSORFLOW --pipeline compile SaveTemps --output /tmp/tmpv4gg13ze/graph_def.neff --io-config '{"inputs": {"0:0": [[1, 128, 768], "float32"], "1:0": [[1, 1, 1, 128], "float32"]}, "outputs": ["Linear_5/aten_linear/Add:0"]}' --verbose 35INFO:Neuron:Number of arithmetic operators (post-compilation) before = 565, compiled = 0, percent compiled = 0.0%INFO:Neuron:The neuron partitioner created 1 sub-graphsINFO:Neuron:Neuron successfully compiled 0 sub-graphs, Total fused subgraphs = 1, Percent of model sub-graphs successfully compiled = 0.0%INFO:Neuron:Compiled these operators (and operator counts) to Neuron:INFO:Neuron:Not compiled operators (and operator counts) to Neuron:INFO:Neuron: => aten::Int: 97 [supported]INFO:Neuron: => aten::add: 39 [supported]INFO:Neuron: => aten::contiguous: 12 [supported]INFO:Neuron: => aten::div: 12 [supported]INFO:Neuron: => aten::dropout: 38 [supported]INFO:Neuron: => aten::embedding: 3 [not supported]INFO:Neuron: => aten::gelu: 12 [supported]INFO:Neuron: => aten::layer_norm: 25 [supported]INFO:Neuron: => aten::linear: 74 [supported]INFO:Neuron: => aten::matmul: 24 [supported]INFO:Neuron: => aten::mul: 1 [supported]INFO:Neuron: => aten::permute: 48 [supported]INFO:Neuron: => aten::rsub: 1 [supported]INFO:Neuron: => aten::select: 1 [supported]INFO:Neuron: => aten::size: 97 [supported]INFO:Neuron: => aten::slice: 5 [supported]INFO:Neuron: => aten::softmax: 12 [supported]INFO:Neuron: => aten::tanh: 1 [supported]INFO:Neuron: => aten::to: 1 [supported]INFO:Neuron: => aten::transpose: 12 [supported]INFO:Neuron: => aten::unsqueeze: 2 [supported]INFO:Neuron: => aten::view: 48 [supported]---------------------------------------------------------------------------RuntimeError                              Traceback (most recent call last)<ipython-input-1-97bba321d013> in <module>     18      19 # compile model with torch.neuron.trace and update config---> 20 model_neuron = torch.neuron.trace(model, neuron_inputs)     21 model.config.update({"traced_sequence_length": max_length})     22 ~/anaconda3/envs/python3/lib/python3.6/site-packages/torch_neuron/convert.py in trace(func, example_inputs, fallback, op_whitelist, minimum_segment_size, subgraph_builder_function, subgraph_inputs_pruning, skip_compiler, debug_must_trace, allow_no_ops_on_neuron, compiler_workdir, dynamic_batch_size, compiler_timeout, _neuron_trace, compiler_args, optimizations, verbose, **kwargs)    182         logger.debug("skip_inference_context - trace with fallback at {}".format(get_file_and_line()))    183         neuron_graph = cu.compile_fused_operators(neuron_graph, **compile_kwargs)--> 184     cu.stats_post_compiler(neuron_graph)    185     186     # Wrap the compiled version of the model in a script module. Note that this is~/anaconda3/envs/python3/lib/python3.6/site-packages/torch_neuron/convert.py in stats_post_compiler(self, neuron_graph)    491         if succesful_compilations == 0 and not self.allow_no_ops_on_neuron:    492             raise RuntimeError(--> 493                 "No operations were successfully partitioned and compiled to neuron for this model - aborting trace!")    494     495         if percent_operations_compiled < 50.0:RuntimeError: No operations were successfully partitioned and compiled to neuron for this model - aborting trace!Thanks a lot.FollowComment"

Answer: "0The error message in your log shows Compile command returned: -9. This message typically indicates that the compiler process was killed. Normally this is due to the the OOM (out of memory) killer (run by the linux operating system) killing the compilation process due to memory exhaustion. The most recent version of torch-neuron should provide an updated message for -9 errors that reflects the typical cause for this failure mode.We recommend you try compiling on an instance with more memory, such as an inf1.6xlarge. Note: you only need the larger instance for compilation; you can still use a smaller instance (such as an inf1.xlarge) to run inference.Please let us know if compiling on a larger instance resolved the error you’re seeing.CommentSharejoshamazonanswered a year ago"


Question: NICE DCV Feedback? Bug reports?

"How can I give feedback to the NICE DCV folks?Feedback:It looks like y'all are dipping a toe into gaming through the client with the addition of UDP and QUIC as well as gamepad support. There's one glaring issue from my tests so far: when using a mouse-driven game, a lot of these games have a long press and drag to rotate the camera. NICE DCV interprets this long press and drag as actual mouse movement. This causes unexpected camera behavior once the invisible mouse movement reaches the end of the display resolution. An easy reproduction can be seen in Blizzard Entertainment's World of Warcraft. Try out a character and then attempt to long press and drag your mouse. I think the ideal case is that the long press and drag be no longer interpreted as actual system-level mouse movement, allowing the game to properly rotate the camera.FollowComment"

Answer: "0Hi there -Happy to relay your feedback to the DCV team. Can you confirm if you're using the relative mouse mode when you have this issue?CommentShareEXPERTMuraliAtAWSanswered a year agoTrey a year agoIt does work while using relative mouse mode, but that mode is sadly incredibly laggy and unusable. If the lag could be fixed in that mode, it would be a fine compromise.ShareMuraliAtAWS EXPERTa year agoThanks for the follow up - I'll relay it to the DCV team.Share0Hi Trey,Thanks for providing this feedback. We will look into this issue.For this types of issues/feedback in the future, if you have any AWS Support plan, you could submit a technical support ticket with support and they will help troubleshoot and forward to the DCV team if needed. If you don't have a Support plan, posting on re:Post also works.CheersRey from DCV teamCommentShareAWS-Reyanswered a year ago"


Question: "Step by step for IAM Roles Anywhere with your own CA (using openssl) + Cloudformation, CDK Example"

"I struggled a bit getting IAM Roles to work with a CA I created with openssland also to deploy all resources with CDK (or cloudformation)After I figured out everything I wrote this blog, I hope someone will find it useful:check it out:https://medium.com/cyberark-engineering/calling-aws-services-from-your-on-premises-servers-using-iam-roles-anywhere-3e335ed648beThe CDK example uses escape hatches (so CfnResources), so they could easily be used to do CloudFormationFollowComment"

Answer: 0Accepted Answercheck it out: https://medium.com/cyberark-engineering/calling-aws-services-from-your-on-premises-servers-using-iam-roles-anywhere-3e335ed648beCommentShareroybanswered 10 months ago


Question: We removed access to your AWS account because we could not confirm your payment information

"Hello!I've been trying to verify my account since the last Thursday. The scenario is always the same: I get an email from aws-verification@amazon.com, there is a link, and they ask to upload two files which will cover:-- A copy of a recent statement for your VISA ending in 70, including the billing address. -- Your name, phone number, and the email address registered to your AWS account. I do it, and after this, I receive the same new message, with the exact text with zero explanations of what is wrong with my files.What I'm attaching:a cash flow of the card from my internet banking with a card number, my billing address, and my registration address;a PDF file with my personal information.I don't get any explanations, so may anyone help me with this problem?FollowComment"


Question: "Accidentally add in restricted IAM policy, block all access to AWS console"

"I accidentally added in restricted IAM policy (for MFA restriction), which blocked all access to AWS console, and not even able to create case from AWS console.How can we get help from AWS to remove the IAM policy in our account? :(FollowComment"

Answer: 0figure outCommentShareZenYuanswered 2 years ago


Question: Not able to delete a S3 bucket

"Hi,We are not able to delete a S3 bucket - even as root user or an IAM user with FullS3Access permissions. Neither able to list the objects within this bucket nor empty the bucket. We are not able to find out who the owner of this bucket either.Is there any other way to delete this bucket being the root user or IAM user with FullAdmin Access ?The bucket policy looks like this{"Version": "2012-10-17","Statement": [{"Effect": "Allow","Principal": "","Action": ["s3:Get","s3:List*"],"Resource": ["arn:aws:s3:::pol-ctrl","arn:aws:s3:::pol-ctrl/"]},{"Effect": "Deny","Principal": "","Action": "s3:","Resource": ["arn:aws:s3:::pol-ctrl","arn:aws:s3:::pol-ctrl/"],"Condition": {"StringNotLike": {"aws:userId": ["AROAZJDZU5QSGDLXTQ37J:*","AIDAIX4VQCCS2IDFS6LOK","AIDAZJDZU5QSKQAGUZ4XJ","AIDAZJDZU5QSAOPHO4NI2","AIDAJFUCG36HXSSD5E4AA","AIDAZJDZU5QSAZRPTZBOZ","AIDAZJDZU5QSH6S2KG3DM","111111111111"]}}}]}Getting the following error when logged in as root user.You don't have permission to view Object ownership (bucket settings) configurationYou need s3:GetBucketOwnershipControls to view Object ownership (bucket settings) configuration. Learn more about Object ownership in Amazon S3Thanks,VijayFollowComment"

Answer: "0Accepted AnswerBased on the provided information, it seems that the bucket policy is configured to deny all actions on the bucket, including listing objects and deleting the bucket itself. This policy is designed to restrict access to specific users or AWS accounts. Modify the bucket policy: Update the bucket policy to remove the "Deny" statement that prevents deletion. The modified policy should allow the necessary permissions to delete the bucket.You can also visit this part of the documentation: Verifying a bucket owner to check the bucket owner.CommentShareDavid Canswered 13 days agoEXPERTalatechreviewed 13 days agorePost-User-1270551 13 days agoThanks for the quick response David. That worked perfectly.SharerePost-User-1270551 13 days agoThanks David.  I had to delete the bucket policy, then go to Block Public Access and uncheck some of the settings there. When I came back, I was able to edit the Bucket Policy and again to allow access. That worked and I was able to delete this bucket.ShareDavid C 13 days agoBased on the error message you received, it looks like you don't have the necessary permissions to edit the bucket policy, or the existing policy conflicts with the Block Public Access settings. To edit the bucket policy, you need the s3:PutBucketPolicy permission.Additionally, the Deny statement in your bucket policy is blocking all access ("Principal": "") to the "vigilant-pol" bucket ("Resource": ["arn:aws:s3:::vigilant-pol", "arn:aws:s3:::vigilant-pol/"]) except for specific AWS user IDs ("aws:userId" condition).You must ensure that you have the required permissions as a user to modify the bucket policy. If you are certain you have the necessary permissions, you can try removing the Deny statement or modifying it to allow the desired access. Make sure to review your Block Public Access settings as well to ensure they align with your intended policy changes. To modify the bucket policy in such cases, you need to either disable or adjust the Block Public Access settings to allow the desired level of access. However, it's important to carefully evaluate the security implications and only make changes that align with your security requirements and policies.ShareDavid C 13 days agoI'm glad that I could help you.Share"


Question: Sockect Diconnection frequently on EC2 and lightsail

We have SAAS based platform which contains socket based communiction for chats. We are facing the issue of disconnection every now and then. And this exists both for lightsail instances as well as EC2. Please note that even the instances are separate and each instance has its own socket server still sometimes we noticed these go down atonce. Could there be any possiblity that the AWS network cause any such disconnection. Or do we need to add any IP addition in VPC security group or so to make sure the things go smooth. Please advise.Thanks!FollowComment


Question: Timestream write_records is orders of magnitude slower over the last 3 days in eu-west-1

"I have a python lambda streaming data to timestream that has been running for the last few months.The lambda has always run well under a second, with an average of 15-30ms - regardless if the data itself is current (memory store) or historical (magnetic store).This week the lambda is timing out, even when the timeout duration is set to a max of 15 mins.The place its getting stuck is where we make the call to timestream to write the actual records.It just sits here, for a duration of between 30ms to 15mins.The data that gets stuck is always processed on a retry and appears in the DB, so its not a data issue.This is causing our SQS queues to build up, as our lambda failures and timeouts cause throttling, and a reduced concurrency.The line in question :result = write_client.write_records(DatabaseName=DATABASE_NAME,TableName=table_name,CommonAttributes=common_attributes,Records=records)FollowComment"

Answer: 0hello. just to add this is still happening - 40% of the time it executes a write in ~500ms other times 5secs roughly 40% of the lambda times out - up to 15 mins.CommentSharespacemananswered 8 months ago


Question: 500 Error: having trouble using IPv6 on ECS with Fargate

"I've sent in this bug report to the aws terraform provider, but I'll report it here, too.When I try to make an ECS service on an IPv6 only subnet, the AWS API sends me back a 500 server error. I can consistently reproduce this error. The details to reproduce it are in the bug report, all you need are the terraform binary and an AWS API key to configure the provider. I'm completely stuck and I don't know what to do.FollowComment"


Question: I have created a lambda function to query my s3 data using Athena but getting 500 error.

"Hello Developers,I have created a lambda function to query my S3 data using Athena and it is working locally fine but once I pushed it to production I am getting the following error.{"responseCode": 500,"responseMessage": "Internal server error","response": {"errors": [{"errorCode": "UNCAUGHT","errorTitle": "We seems to have a problem!","errorDescription": "Our internal system is having problem, please contact our administrator!","errorDebugDescription": "Query has not yet finished. Current state: QUEUED","errorAttributes": []}]}}What I did in my code is as follows:    const queryExecution = {      QueryString: `SELECT event_target,count(*) as count FROM ${dbAndTable} WHERE room_id = '${storeId}' GROUP BY event_target ORDER BY count(*) DESC LIMIT ${faqSqlLimit}`,      ResultConfiguration: {        OutputLocation: s3Location      }    };   const queryExecutionResult = await client.startQueryExecution(queryExecution).promise();    await checkIsAthenaExecutionRunning(queryExecutionResult.QueryExecutionId);    const athenaResponse = await client      .getQueryResults({ QueryExecutionId: queryExecutionResult.QueryExecutionId })      .promise();    if (!athenaResponse.ResultSet.Rows[1]) {      throw APIError.notFound();    }    const results = formatAthenaResult(athenaResponse);const checkIsAthenaExecutionRunning = async (id) => {  const params = {    QueryExecutionId: id  };  const data = await client.getQueryExecution(params).promise();  if (data.QueryExecution.Status.State && data.QueryExecution.Status.State === 'RUNNING') {    return checkIsAthenaExecutionRunning(id);  }  return data;};Everything is working fine on my local machine but once I pushed my code to AWS It is now working and getting the above error. Any advice?FollowCommentalatech EXPERT5 days agoIs data size different between environments?Share"

Answer: 0No it is same.CommentShareRezaul karimanswered 4 days ago


Question: AWS Pinpoint Push Notifications and Apple Tracking Transparency

"Hi all,I have a short question - I am using AWS Pinpoint for push notification delivery in my React Native App that I am currently developing. Can I use Pinpoint for push notification delivery even if the user denies 3rd party tracking on iOS (Apple Tracking Transparency)? I mean I would even consider to use Pinpoint solely for delivering the pushs but Pinpoint is indeed also a tracking tool…Would love to hear your thoughts.Thanks and best regardsThe Smart Home MakerFollowComment"

Answer: "0Ok after more thoroughly studying the Apple App Tracking Transparency guidelines I see that if I only use tracking for myself but do not share information with other apps or websites, it should still be allowed to track for myself using AWS Pinpoint so there should also be no problem using AWS Pinpoint for push notification delivery even if the user declines app tracking.CommentSharethe-smart-home-makeranswered 2 years ago"