Question: InsufficientDBInstanceCapacity eu-west-1

"Ever since April when I got the "RDS operational notification" regarding our RDS Oracle m3.medium instance I've been trying to upgrade using the recommended upgrade path ( i.e to a t3.medium)However,  each time I do I get a InsufficientDBInstanceCapacity error messageCannot modify the instance class because there are no instances of the requested class available in the current instance's availability zone. Please try your request again at a later time. (Service: AmazonRDS; Status Code: 400; Error Code: InsufficientDBInstanceCapacity; Request ID: 6696291a-8cd2-4005-aafc-ae42570e65cd)I've been trying to do it at maybe 10 different occasions with the same resultAm I missing something?FollowComment"

Answer: "0Are you using VPC or EC2-Classic networking? The M3 supports EC2-Classic whereas the T3 family does not, and confusingly you get the ICE message because that is what EC2 returns to RDS when it asks EC2 to give it a EC2-Classic T3 instance.CommentShareHalTempanswered 4 years ago0Hello,I understand that you are receiving the below error while modifying your RDS instance from db.m3.medium instance to a db.t3.mediumERROR:Cannot modify the instance class because there are no instances of the requested class available in the current instance's availability zone. Please try your request again at a later time. (Service: AmazonRDS; Status Code: 400; Error Code: InsufficientDBInstanceCapacity; Request ID: 6696291a-8cd2-4005-aafc-ae42570e65cd)I would like to inform you that, the above error can occur in two scenarios:Scenario 1: If your current oracle DB instance (m3.medium) is residing in an EC2 classic network-- As you might be aware of, that there are two types of platform supported by RDS instances namely "EC2-VPC and EC2-Classic Platform". The below link will check the environment of your DB instance:[+] Determining Whether You Are Using the EC2-VPC or EC2-Classic Platform - https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_VPC.FindDefaultVPC.html-- In "EC2-Classic Platform", there are only some specific RDS instance class types that are available for this platform.1. db.m3 – Previous Generation Standard Instance Classes2. db.m1 – Previous Generation Standard Instance Classes3. db.r3 – Previous Generation Memory Optimized Instance Classes4. db.m2 – Previous Generation Memory Optimized Instance Classes\[+] Instance Types Available in EC2-Classic -  https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-classic-platform.html#ec2-classic-instance-types    -- Further, the DB instance types belonging to the M5, M4, R4 , T3 and T2 family (current generation instances) can only be launched in a VPC. They cannot be launched in an EC2 classic network(Not in VPC).-- Also, we cannot modify the instance types of existing RDS instances which are not in VPC to either M5 or M4 or T2 or T3 or R4 as these instance types are not supported by the Classic Network. They can be only launched in a VPC. This is the reason why you were receiving an error.-- To be able to modify your DB instance from m3 to t3, you have to move your RDS instance from EC2 Classic to VPC platform. The below links will help you with the same:[+] Moving a DB Instance Not in a VPC into a VPC - https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_VPC.html#USER_VPC.Non-VPC2VPC\[+] Ec2 Classic to VPC with minimal downtime -   https://d0.awsstatic.com/whitepapers/RDS/Moving_RDS_MySQL_DB_to_VPC.pdf    Scenario 2: The DB instance type db.t3.medium is currently not available in the availability zone eu-west-1-- Alternatively, the error can occur times during times where there is high demand for RDS instance types in a given region.-- In other words, the above error arises when the DB instance type db.t3.medium is not available in the availability zone in which the DB instance is residing (i.e. eu-west-1).AWS does try to avoid this and have sufficient capacity for our customers but as this relates to the availability of physical hardware and the instances it takes time for us to physically increase the overall general capacity to meet new trends in customer demand. Unfortunately, we are not able to provide any kind of ETA when the instances will be available in your desired region.-- In this case, you can consider one of the below options:1. Try to upscale without specifying an Availability Zone.[OR]2. Try up-scaling to a different instance type (which you can resize at a later stage).I hope this helps.Thank You.CommentShareAshikaAWSanswered 4 years ago"


Question: How to require signed commits in CodeCommit?

"I'm interested in implementing an added layer of security for a repo using signed commits.  I want to require all commits to be signed, but I do not see a way to do this in AWS/CodeCommit.  Can it be done?  If so, how?FollowComment"

Answer: "0Solution:As of now, there is no way to create a signed commit as shown in the document showing how to create a commit. However, you can use a Git tag to leave a signature on a certain commit and to identify commits easily.https://docs.aws.amazon.com/codecommit/latest/userguide/how-to-create-commit.htmlhttps://docs.aws.amazon.com/codecommit/latest/userguide/how-to-create-tag.htmlCommentShareIsaac_Panswered 10 months ago"


Question: Can we restrict the specific user to not be able to run workflow? - CodeCatalyst

"what I know that on project level, CodeCatalyst provides only 2 roles; Contributor and Project administrator. I think Contributor has almost same access as of administrator except few things(can not remove project, invite other members, etc). Is there any way that we can restrict the invited member to not be able to run the workflow or could restrict them to perform certain actions (eg; create issue, merge pull request etc)?Thanks,FollowComment"


Question: Enrollment of an Existing Account in Control Tower Fails

"I have just stood up Control Tower in my management account, and I'm trying to enroll and existing account, but getting an error:"AWS control tower cannot enroll the account. There's an error in the provisioned product in AWS Service Catalog: No launch paths found for resources:"I have looked around the community for answers like this: https://repost.aws/questions/QUdbDZOOwsQYGsE_DJIJR7hQ/control-tower-enrollment-errorand have gone through the troubleshooting guide, also have the AWSControlTowerExecution role setupAny thoughts on what my issue could be?FollowComment"

Answer: "2Accepted AnswerThis could be an issue with access to Service Catalog:https://docs.aws.amazon.com/servicecatalog/latest/adminguide/catalogs_portfolios_users.htmlYou need to grant access to the proper group/user/roles to AWS Control Tower Account Factory PortfolioAlso, if you're logged in as the root, try doing this as an SSO userCommentShareRoguenanswered 4 months agoEXPERTMatt-Breviewed 4 months ago1Hi ThereAdding to Roguen's answer, Please check https://docs.aws.amazon.com/controltower/latest/userguide/troubleshooting.html#no-launch-paths-foundand ensure you are complying with the 3 bullet pointsYou may be logged in as root. AWS Control Tower does not support creating accounts when you're logged in as root.Your IAM Identity Center user has not been added to the appropriate permission group. You may need to add your IAM Identity Center user to one of these permission groups: AWSAccountFactory (for end-user access) or AWSServiceCatalogAdmins (for admin access).If you are authenticated as an IAM user, you must add it to the AWS Service Catalog portfolio so that it has the correct permissions.CommentShareEXPERTMatt-Banswered 4 months ago"


Question: Why am I getting 404 when I hit my domain?

"Hi, I deployed my web app in AWS Amplify and connected my domain from Route 53 to it, but I'm getting 404 when I attempt to hit the domain in a browser - this is the error I see;This www.unigram95.net page can’t be found No webpage was found for the web address: https://www.unigram95.net/HTTP ERROR 404In Amplify, the status shows available, can you help please?FollowComment"

Answer: "0As described in the following document, please check first whether the URL you are connecting to is correct, etc.https://docs.aws.amazon.com/amplify/latest/userguide/redirects.html#types-of-redirectsTo avoid a broken link message when a user enters a bad URL.To point requests to nonexistent pages of a web app to its index.html page for handling by a client-side router function.CommentShareEXPERTRiku_Kobayashianswered 7 days agoSamson 7 days agoThanks Riku. In my source address I see https://unigram95.net and in my target add I see https://www.unigram95.net, this is for both 301 and 302, am I missing something here? is the target supposed to be the url from Amplify?Share"


Question: Codedeploy from AutoScaling taking long time

"Hi,We trigger autoscaling on a TargetResponseTime threshold. Launch and turning healthy for new EC2 instance takes close to 20 mins. When we check the codedeploy we see two kinds of time, one in Deployment history start time Aug 22, 2019 3:10 PM and end time Aug 22, 2019 3:28 PM. Going to that particular deployment, we see duration as 2 minutes 21 seconds, from ApplicationStop to AfterAllowTraffic. Where is the rest of the time spent? Why is that Deployment history shows 18 mins where as the deployment time is 2 mins 21 sec?Regards,Santhosh I CFollowComment"

Answer: "0We were using a custom windows AMI, changed that to Amazon's windows AMI. Now, the launch and availability of instance is ~5mins.CommentSharesicanswered 4 years ago"


Question: Will UserArn work for any Alexa device that user will have in future

"Hi,When UserArn is created (by CreateUser) and the invite is sent (via SendInvitation), I assume that Users can enable the Private skill on all Alexa devices that they have?Now, what if a device has an issue and they change it, or if User purchase additional devices?  For instance, even if all devices belonging to the User at the time of User creation and the initial enabling of the Skill are changed, would the same UserArn still work?The reasons I'm asking is to ensure whether UserArn can be a UUID for the User no matter what/how-many Alexa devices they will have in future?Thanks.FollowComment"

Answer: "0Accepted AnswerYes, mostly but there is a variable part in the userId.When a skill disabled and enabled again this userId changes.The enrollment link is for a single time use. There is also a time limit the link is valid.CommentShareMilo Oostergoanswered 4 years ago0Correct. The user enables the private skill for their Alexa account and can then access it on any of their Alexa devices.The enrolled users subscription is per enrolled user. It doesn't matter how many devices the user has. The skill is enabled for the users' Alexa account.The userArn is a separate from this and is used to map a users' Alexa account with a specific A4B organization and the email address they are invited on.You can't specify the userARN yourself, but the userARN won't change.I hope this demystifies how the enrolled user model works.Cheers,MiloCommentShareMilo Oostergoanswered 4 years ago0Thanks for the clarifications, milo@aws.Two more follow-up questions:session['user']['userId']for A4B private skill   is  "userId of the users' Alexa account"   not  the  userARN?I wonder if the invite link is onetime use only, or it could be used multiple times?   The person who is receiving the invite via email may enable the skill and then may forward the invite link to others and they may use the same invite link to enable the skill...   So, there is a possibility to have a 1-to-many relationship between  userARN and userId (Alexa accounts), am I correct?Because userARN  is associated with the invite link (the email address of invitee).Thanks.Edited by: AriNm on Nov 13, 2019 10:00 AMCommentShareuseranswered 4 years ago"


Question: Access EBS volume attached to EC2 from EKS pods

How to access the EBS volume mounted on the EC2 instance from the EKS pods (hosted on the same EC2 instance)FollowComment

Answer: "1https://aws.amazon.com/premiumsupport/knowledge-center/eks-persistent-storage/ - This article from AWS Premium support discusses the steps.In case you run into issues, please refer to https://aws.amazon.com/premiumsupport/knowledge-center/eks-troubleshoot-ebs-volume-mounts/If my answer helps you, can I request you to please accept my answer. ThanksCommentShareEXPERTIndranil Banerjee AWSanswered 10 months agoEXPERTToni_Sreviewed 10 months ago"


Question: Make inner queue of an async SageMaker endpoint FIFO

"Hi there,I was wondering if an inner queue of an async endpoint can be FIFO, because I send a lot of invocations to the endpoint and as the amount of requests grow so does the total processing time. It's still fast, but it'll be much better if it could process in a FIFO way so the oldest requests don't time out.If that queue can't be changed, is there another way to make it process as a FIFO?Beforehand, thank youFollowComment"

Answer: "0Hi there,The internal queue is essentially FIFO, requests that are sent to your endpoint are queued in the order they are received by the endpoint. If you only have one instance behind this endpoint then your requests are processed in that same order, if you have multiple instances then requests are distributed evenly amongst them. In this case not all requests may be processed at the same time as the time to perform inference will inevitably vary across all of these instances so there can be discrepancies in the order in which you receive your responses.If your requests are getting timed out then I suggest that you increase your InvocationTimeoutSeconds (refer to the documentation here) to prevent this from happening, however if you have already set this parameter to its maximum value of 3600 seconds then you should consider adding an Autoscaling policy that monitors a metric such as ApproximateBacklogSizePerInstance to scale up the total number of instances you have. Having more instances would mean your requests are processed much faster and would reduce the likelihood of timeout.CommentShareSUPPORT ENGINEERThayin_Manswered a month ago"


Question: Relational mutations in Graphql Amplify

"I have the following Graphql schema with relationship:type Product @model{  id: ID! @primaryKey  name: String!  img: String!  components: [Component]! @hasMany  categories: [Category]! @hasMany}type Component @model{  id: ID! @primaryKey  name: String!}type Category @model{  id: ID! @primaryKey  name: String!}A product can have multiple components and multiple categories.I would like to have a mutations that can allow me to create a Product and also the components and categories associated.Amplify codegen already created the mutation "CreateProduct" but it don't allow me to specify the component and category data in order to create them and link to the product.It seems that i must create the product first and then the component and category separately.I need to write a custom mutation in order to do what i want or it's impossible?If it's possible with a custom mutation, how can I write it?Thank you!FollowCommentAWS-User-1894100 a year agoI have the same problem, I would like to populate all tables starting from a complete json object. I am wondering if there is a way to accomplish thisShare"

Answer: "1Hi!Assuming you want to:Create a new Component (not already persisted on your datasource)Create a new Category (not already persisted on your datasource)Create a new ProductYou could execute multiple mutation in this way:mutation CreateProductAndComponentsAndCategories(...){  product: createProduct(input: {...}){    id  }  # Create product's component  firstComponent: createComponent(input: {...}){    id  }     # Create product's component  secondComponent: createComponent(input: {...}){    id  }     # Create product's category  firstCategory: createCategory...}If instead you intended to call the mutation createProduct and also providing a list of components and categories I think it is not possible.This is because a mutation can be connected to a single DataSource and in your case the models should have 3 different DS:Product -> ProductDSComponent -> ComponentDSCategory -> CategoryDSFor the same reason, even creating a custom mutation mapping template would not solve the problem.Try taking a look at Pipeline Resolvers.You should be able to create a pipeline that takes Product, Components and Categories as input which in turn calls 3 distinct functions.Hypothetically:Function 1: create the componentsFunction 2: create categoriesFunction 3: creates the product by associating the keys of the components and categories of functions 1 and 2I've never tried pipelined mutations, but theoretically they should work! :-)CommentShareNoneNoneanswered a year ago"


Question: Any one has experience on CloudWatch with Zabbix?

"A customer is using Zabbix monitoring AWS resources like EC2, they are asking whether our CloudWatch can send alerts to Zabbix?  Is there any one who have experience on that?Thank you.FollowComment"

Answer: "0Accepted AnswerI've used Zabbix extensively at a previous company.Zabbix collects 'items' which are usually datapoint on a server (eg: available memory in MB at x time).  This would be the same as a CloudWatch Metric.  Those items are evaluated against a criteria that is defined in Zabbix, and an 'Alert' is generated.  Alerts can then trigger Events like notifications etc.Generally an integration can take two approaches:Send all CloudWatch Metrics to Zabbix, and allow Zabbix to create your Alerts.Configure your Alerts in CloudWatch and send them to Zabbix as Items that trigger an Alert.Both will require some heavy lifting.  A general approach for Option 1:Use the Zabbix auto discovery process to configure the receiving Host, and Item keys to match the values in CloudWatch.  You could cobble this together using both the CloudWatch API to gather inventory and the Zabbix API to do configuration.Build a gathering process that gathers metrics from CloudWatch using an API call and sends them to Zabbix using the 'zabbix_sender' library.Configure your Alerts and Events as you normally would within Zabbix.General approach for Option 2:Configure CloudWatch to evaluate your metrics and create an Alert.Tie the alerts action to something that will trigger a zabbix_sender (probably Lambda).Use autodisocvery to configure the listener Host / Item key in Zabbix and trigger an Alert as soon as a single Item is received.There's a handful of projects on Github that do either of these two approaches.  I don't think either is 'right' or 'wrong'.  Really depends where you want to manage the evaluation of your Metrics/Items - In Zabbix or in CloudWatch.  If they are a Zabbix shop they will probably want to use Zabbix and Option 1 is the best bet for them.For the very ambitious a fork of the virtual machine monitoring processes for Zabbix to work against CloudWatch rather than the vCenter SDK would be ideal:https://www.zabbix.com/documentation/3.4/manual/vm_monitoringCommentShareAWS-User-5508656answered 6 years ago0maybe here is an alternativehttps://aws.amazon.com/blogs/aws/cloudwatch-metric-streams-send-aws-metrics-to-partners-and-to-your-apps-in-real-time/CommentSharepanlmanswered a year ago"


Question: Junit- if one test failed the below testcases will fail too

"Good Day,I'm running my script over Appium juint, but I see an issue that when one test case fail the below test cases will be failed too while they are passed.Locally the script is working fine.Can you please support on this issue??https://us-west-2.console.aws.amazon.com/devicefarm/home?region=us-east-1#/projects/775cc224-9353-48d9-94b7-9e4f46f6e8fa/runs/7a39c648-dcaf-4a24-93eb-cd51b0d65ae7/jobs/00000For the above link the the test case 'test.HomePage5' failed and the test cases below it read as failed while they are passed.FollowComment"

Answer: "0Hello,Sorry for the delay, is this still an issue for you?CommentShareAWS-User-1182145answered 4 years ago0Hi Scotttaws,NP :)For me i'm not using the BDD now, I switched to TestNG directly.But I think the issue in general still exist.CommentShareMalhajanswered 4 years ago"


Question: lightsail instance disk performance

why lightsail instance's disk performance is so poor? I've launched 40 usd instance 8gb one it has 30mb/s I/O. my crappy old HDD laptop can max out 100mb/s I/o. AWS charges a premium for the lightsail instance but performance is very poor. is it only me or everyone is getting the same low hardware instance being allocated?FollowComment

Answer: "2Hello,I have tested several VPS and I confirm that lightsail has very low performance discs.Attention that it is not true that EC2 is better from this point of view, from the tests the performances are the same.AWS Lightsail 1CPU 2GB (Frankfurt)Disk write: 67 MB/sDisk read: 68 MB/sAWS EC2 1CPU 2GB (Frankfurt)Disk write: 67,50 MB/sDisk read: 68,10 MB/sReally very low compared to other VPS tested:DigitalOcean AMD 1CPU 2GB (Frankfurt)Disk write: 935,00 MB/sDisk read: 1536,00 MB/sAruba Cloud 1CPU 2GB (Frankfurt)Disk write: 745,00 MB/sDisk read: 1228,80 MB/sCommentSharerePost-User-7457536answered a year ago0Lightsail instances aren't intended for high performance.If you need high performance, you probably want to look into EC2.CommentShareDavid Ganswered a year agoAWS-User-9913437 a year agowell in the same price other cloud providers are giving better performance than ec2 actually, DO has average 600-700mb/s I/o linode has 1gb/s I/o. i'm not looking for a powerful machine with 1gb/s I/o but at least in this modern time 100mb/s should be the standard norm.ShareDavid G a year agoIf you need high performance, and AWS isn't providing the performance/$ ratio you need, switch to the other provider.Every user is different, every application is different, go with the provider that satisfies your requirements the best.ShareFelipo Antonoff a month agoIndeed EC2 has the same low performance detail on disk depending on the used instance.Now I understand that if AWS may not meet the use case, it makes sense to use another Cloud, but I also agree that AWS should improve, even more so for the amounts charged, mainly in terms of bandwidth and disk usage and when compared to other Clouds, some with lower inclusive prices and great uptime.AWS needs to improve mainly on disk and limited CPU Burst in the long term close to other Clouds.In any case, for the majority of use cases it will serve very well and there are always options with more IOPS, with overall more constant overall performance and uptime.Share0The performance of the disks really leaves something to be desired, but perhaps depending on the use case it is not so relevant, but any system that uses disk caching will suffer a lot, I recommend using Redis or Mencached if you use smaller instances and with a lower performance disk.They mainly need to optimize the disks and CPU performance in the long term, which has been inferior to some Clouds.An interesting comparison: https://www.vpsbenchmarks.com/compare/lightsail_vs_doceanIt would be interesting for AWS itself to make Bencharmks of each instance even for the purpose of comparing the options.CommentShareFelipo Antonoffanswered a month ago"


Question: AWS creates snapshots without my knowledge

"I just noticed that AWS has been creating snapshots for two of my volumes periodically since May 22, 2018 at 9:34:37 AM.I have 1575 snapshots at this moment, the lifecycle manager shows no policy is planned, how could be this happen?All I want at this moment is to try to turn it off, so no more snapshots.Can anyone provide any insight into this?Thanks in advance.One of snapshot info like this:Snapshot IDsnap-030de904972a82d99Progress100%StatuscompletedCapacity100 GiBVolumevol-0b8a3f39268c80392EncryptionNot EncryptedStartedJuly 13, 2020 at 9:34:36 AM UTC+8KMS Key IDOwner373426163372KMS Key AliasesProduct codesKMS Key ARNDescriptionFast Snapshot RestoreFollowComment"

Answer: "0Accepted AnswerHello Jerry,I have checked your AWS account and I can see that there are 4 CloudWatch rules scheduled to automate EBS Snapshots.Specifically, the CloudWatch rule which creates snapshots for the EBS "vol-0b8a3f39268c80392" is in the "ap-southeast-1" Region and it has the name "sg-snap"The 4 Rules are:us-east-1: rule/mysql-snapeu-central-1: rule/mysql-alarm-dataeu-central-1: rule/mysql-dbsync-dataap-southeast-1: rule/sg-snapPlease follow the below article to learn more about the specific CloudWatch rule:https://docs.aws.amazon.com/AmazonCloudWatch/latest/events/TakeScheduledSnapshot.htmlThank you,VasosAWSCommentShareAWS-User-5546426answered 3 years ago0Thanks a lot!I'm very grateful to you for your help.CommentShareJerryChinanswered 3 years ago"


Question: Customer is looking for ways to get data into AWS

We are using a pretty complex solution to ETL data from our customers on-prem systems to our API/DB’s and vice-versa. I wonder is there something like AWS Glue could help with that. We don't get direct DB access and usually opt for some sort of nightly data file in CSV format.FollowComment

Answer: "0Accepted AnswerYes and lets break it down it into 3 steps assuming significant data size and processing needs. This is just one way of doing things.Extract - This part as you described in your customer's case is only fetch. Assuming their protocol of transfer is SFTP they use AWS Transfer for SFTP. In Python they can use requests library to make restful API calls to fetch their data as well. This Python can be part of Glue job as Glue supports Python Shell jobs.Once the data is in S3 or in your customers environment they need to transform and load (TL) it or Load it and then transform it (LT).If the end state desired is a data warehouse where this data will be queried, aggregated, analyzed by their users and executives to make business decisions then it would make sense to choose Amazon Redshift as the destination.They can use AWS Glue which is nothing but managed Spark to transform and load to Redshift or simply load to Redshift and then transform the data.Last but not the least they would need a scheduler to tie it end to end hence they can use Apache Airflow or AWS Step FunctionsNote : An alternative for AWS Glue could be the offerings from the Amazon EMR eco system with its own sets of tool and choices but Glue is a managed environment so unless absolutely necessary for a good reason they should not sign up for extra management overhead.CommentShareKunal_Ganswered 3 years ago"


Question: MTurk Worker Account Suspended - Please Help

"Good evening,My account was suspended in May. It's funny because at the time I just rolled my eyes and sighed, assuming that this would all be cleared up by the then-coming weekend. I sent maybe 12-15 emails to the aws-cs-mturk-worker-support-form email address. I got a response to each of them giving me a cut and paste response saying that my case was being looked into and they could not give me any further information on the matter.The justification for why they suspended my account......"We regret to inform you that your Amazon Mechanical Turk account has been suspended. We took this action because; you violated section 3(b) of the MTurk Participation Agreement. Specifically, your account was closed for using robots, scripts, or other automated methods as a substitute for your human intelligence and independent judgment."I wasn't worried about it because I don't use any sort of automation, strange add-ons or scripts. I had faith that Amazon was a legitimate company that wouldn't steal my earnings after I had spent thousands of dollars on their website and worked on Mturk for several years without issue completing over 300K HITs. As such, I foolishly had my earnings set to auto-deposit once a month. Of course it had to happen that my account would be suspended only two days before my earnings would have been withdrawn. This happened to be my best month for earnings on Mturk too, working every day. Amazon stole well over a thousand dollars from me. For weeks I was frustrated but knew that this would all be sorted out because I was an honest and hardworking member. Now I'm lost, frustrated, confused and cheated as I get an email from mturk-account-appeals@amazon.com, saying...."Hello,Unfortunately, we are not able to take any additional action regarding your Amazon Mechanical Turk Worker account suspension, or offer any additional insight. Please refer to our earlier correspondence for details regarding this decision.Your account will not be re-opened. We regret that we have not been able to address your concerns to your satisfaction.Thank you for your understanding.Sincerely,Account SpecialistAmazon Mechanical Turk"Where do I go from here? I've spent months waiting to get my account back. I've replied to the seemingly generic denial email above but they still haven't replied to me. At this point I'm still not convinced that I've had a human look at my account yet. Please help me.FollowComment"

Answer: "0They are literally handing out false suspensions. It's all over reddit and their twitter account. Try contacting them on twitter. Even though most responses are from employees who don't really care about helping you and will just give a basic copy and pasted response, there are people getting help on their twitter.CommentShareKoltredanswered 3 years ago0Hello ,My name is muruganath, my mturk worker account was hold, that team ask my identity, i can send my pancard on june 26, that image was not clear. that team not accept my request, then only i send my clear pancard copy to fax that team, on august 8, and again sent my pancard to today itself, i send many mail but no reply that team please give me solution.regards,Murugananth.oCommentSharemurugananth5577answered 3 years ago0why my account has suspended without any reason.why amazon doing this if there is no mistakeplease restart my accounti have not break any rule then why my acct is suspendedpls reply me back and i want my account working asap.CommentShareaartianswered 2 years ago"


Question: Custom response headers does not support json

"I want to send custom response headers on my distribution related to reporting; so, I created a custom response headers policy in Cloudfront Console.The values of that headers are in json format. In the console looks fine, but the responses are bad:curl -I https://inngresa.com  HTTP/2 200   content-type: text/html; charset=utf-8  content-length: 23265  date: Thu, 11 Nov 2021 14:39:39 GMT  last-modified: Tue, 04 May 2021 23:24:24 GMT  etag: "ed20666c9059ac7707fb2065e9473ffe"  content-encoding: gzip  accept-ranges: bytes  server: AmazonS3  x-xss-protection: 1; mode=block  x-frame-options: DENY  strict-transport-security: max-age=31536000; preload  nel: {"report_to":"default"%2c"max_age":2592000%2c"include_subdomains":true%2c"failure_fraction":1.0}  report-to: {"group":"default"%2c"max_age":10886400%2c"endpoints":\[{"url":"https://aaaaaaa.uriports.com/reports"}]%2c"include_subdomains":true}  reporting-endpoints: default="https://aaaaaaa.uriports.com/reports"  x-cache: Miss from cloudfront  via: 1.1 c07bfe3e13ab3d2465e47a18f1dbb562.cloudfront.net (CloudFront)  x-amz-cf-pop: SCL50-C1  x-amz-cf-id: c-OtlVYpKgL-UOChqBJUMZ6v0wrdPxH4wB_5hgjNMjXluV7-eIlDzg==  the NEL header converts the comma to %2c, obviously it is url encoded; but the header needs to be a valid json.FollowComment"

Answer: "0This issue has already fixed, now the json value it is showing correctlyCommentSharegtux-inngresaanswered 2 years ago"


Question: ssm secret password automation in aws

"please can you advice how can we automatic Secret,password store in parameter store to make process fully automatic and use cli to retrieveFollowComment"

Answer: "0Thank you for answering to that .The question is how can we automat the processCommentShareAWS-User-0503324answered a year agoVincent a year agocould you elaborate more details about the process you mentioned?Share0Hello,If you need to automate the rotation of credentials, then AWS Secrets Manager would be a better fit as it has this feature included. For examples, see the following two blog posts:Rotate Amazon RDS database credentials automatically with AWS Secrets ManagerHow to use AWS Secrets Manager to rotate credentials for all Amazon RDS database types, including OracleYou can then integrate Secrets Manager with Parameter Store so that you can retrieve Secrets Manager secrets when using other AWS services that already support references to Parameter Store parameters.You can use the AWS Command Line Interface (AWS CLI), AWS Tools for Windows PowerShell, and the SDKs to retrieve a secret by using Parameter Store. Example CLI command:aws ssm get-parameter \    --name /aws/reference/secretsmanager/s1-secret:11111-aaa-bbb-ccc-123456789 \    --with-decryptionFor more information, see Referencing AWS Secrets Manager secrets from Parameter Store parameters .Systems Manager Parameter Store does not include automatic rotation and would need to be customized. Although Advanced Parameters in Parameter Store do allow you to specify an expiration and expiration notification policy, for more information see Assigning parameter policies.CommentShareErik_Wanswered a year ago"


Question: Policies does not refresh from console

"Hi! In my organization, we have set up policies that work this way: until you do not have MFA activated, you are just allowed to change password (the default one, see your profile) and activated the MFA in order to gain more access. So far, so good.Once activated, from the web dashboard you can work with instances, buckets and other tools. The issue we are facing is to work from the CLI, although  the credentials are validated to work with the CLI, the message that arises is that the user has not permission to perform that.Our team could not track the problem, we suspect that from the CLI does not know or check for the already activated MFA, so the first policy is not being compliance.Could you please help us somehow? We are running out of ideasFollowComment"

Answer: 1Do you use aws sts get-session-token command when you get the credential for CLI? You have to get temporary session token with MFA.Check out the following blogs!https://aws.amazon.com/premiumsupport/knowledge-center/authenticate-mfa-cli/?nc1=h_lsCommentShareimikyanswered 4 months ago


Question: Convenient way to translate JSON email from SNS Topic to readable format?

"Hi all, hope all is well!I have a domain email address set up using the following architecture:Incoming Amazon SES email -> Publish to SNS topic -> output is in unreadable JSON format.I followed this guide to set it up, but there it seems the unreadable output is the final product.Comments on the guide talk about using a script to translate this, but I'm lost on how to set it up, and it seems there should be an easier way to do this.Does anyone have any recommendations for me?FollowComment"

Answer: "1Hi amarcin,There are two options:Use subscription protocol "Email" instead of "Email-JSON". It has same result but in clear text.Send the notifications to a Lambda which can then send a formatted email via SES. For fan-out pattern and scalability, you could send to SNS->SQS<-LambdaCommentShareEXPERTalatechanswered 4 months agoamarcin 4 months agoThank you! I've found that even using the Email subscription protocol still returns a JSON object. Good tip on using SQS as well. I found this document for using a Lambda function: https://aws.amazon.com/blogs/messaging-and-targeting/forward-incoming-email-to-an-external-destination/Share1I suppose the answer to this question depends on what you want to do with the incoming email. If you need to be able to view incoming messages in an email client such as Outlook, keep in mind that Amazon SES doesn't have an IMAP server.If you want to view incoming messages in an email client, I recommend that you connect Amazon SES to Amazon WorkMail. WorkMail does provide an IMAP server. You can connect your email client to the IMAP server to easily retrieve inbound messages in an email client.CommentShareEXPERTBrentAtAWSanswered 4 months agoamarcin 4 months agoThank you for that perspective! I think I'll take your idea and ditch the Lambda function idea and instead use WorkMail as the hosting IMAP server for an all-AWS architecture.Share"


Question: Timeline for receiving Direct Connect LOA-CFA

What is the approximate timeline for the Direct Connect LOA-CFA to become available once the connection request is submitted?FollowComment

Answer: "0Accepted AnswerThe LOA-CFA download link can become active relatively quickly, however customers need to respond to the email that they will receive from AWS.It can take up to 72 hours for AWS to review your request and provision a port for your connection. During this time, you might receive an email with a request for more information about your use case or the specified location. The email is sent to the email address that you used when you signed up for AWS. You must respond within 7 days or the connection is deleted.Also note that:If the link is not enabled, the LOA-CFA is not yet available for you to download. Check your email for a request for information. If it's still unavailable, or you haven't received an email after 72 hours, contact AWS Support.CommentShareEXPERTSteveS-AWSanswered 6 years ago"


Question: Conflict with a image creation

Good AfternoonWe have a problem when I started to create a Image from a snapshot. The interface show as the next message:"Detected Conflicting billing products for AMI registration "Thank's for the help.FollowComment

Answer: "0Without knowing more about the source AMI from which you are building your new image, and anything about the instance types being used, it's difficult to know where this comes from. But the "AWS Marketplace product codes" section of https://docs.aws.amazon.com/AWSEC2/latest/APIReference/API_RegisterImage.html looks like it may have some pointers that would help you.CommentShareRWCanswered a month ago"


Question: Redshift data encryption performance

"Hello all,We currently have 200+ TB of data in our redshift cluster, but are not using encryption. To use datashares to share this data across redshift instances, it looks like we'll need to switch encryption on, and we are apprehensive to do so because the performance impact isn't clear for changing this setting. It is also unclear what length of time we should expect for the data to be encrypted.Thanks!FollowComment"

Answer: "0Hello,It is very hard to estimate the time to encrypt all that data. That is the reason we don't use any table or reference for the time that will take. On the other hand, you should always perform an operation like that, on a low period for your cluster usage to reduce impact - https://docs.aws.amazon.com/redshift/latest/mgmt/changing-cluster-encryption.htmlOn performance, per my experience there is not a significant impact but the best option is for you to turn encryption on, test and if it doesn't fit your needs, to turn it off.please, also keep in mind to use datashare you have to be running on RA3 node types to support this operation.Hope it helps!CommentShareHugo_Manswered 9 months ago0It is hard to estimate the exact time but The faster Classic resize feature enables an unencrypted cluster to encrypt it much more quickly.As of today, the Faster Classic Resize option to restore an unencrypted snapshot into an encrypted cluster or to change the encryption key is available only through the AWS CLI. When triggered, the restored cluster operates in read/write mode immediately. The encryption state change for restored blocks that are unencrypted operates in the background, and newly ingested blocks continue to be encrypted. Please refer to the following blog.https://aws.amazon.com/blogs/big-data/accelerate-resize-and-encryption-of-amazon-redshift-clusters-with-faster-classic-resize/CommentShareNita_Sanswered 9 months ago0Hello,Have you enabled the encryption for your cluster? how much time it took?we have 900TB in ra3.16x type and want to enable encryption and not sure how to estimate how long the cluster will be unavailableCommentShareYasmeenanswered 8 months ago"


Question: How to deal with zombie Airflow BackfillJobs

"For our MWAA v2.2.2 environment, we are seeing several BackfillJobs with live heartbeats but no corresponding dagruns in a running state. Going to the Browse > Jobs page, we can see these jobs as still running. These backfill jobs in particular may have been caused by running backfill for the same dag, multiple times -- for some reason, they never failed or completed, resulting in a zombie state.Reading the Airflow docs, it looks like we'd need access to the underlying machines to terminate the processes for these backfill jobs. Given that MWAA is a managed service running on fargate, how would we go about terminating these jobs? Is there a way to forcibly cycle all the containers?FollowComment"

Answer: "0Reading the Airflow docs, it looks like we'd need access to the underlying machines to terminate the processes for these backfill jobs. Given that MWAA is a managed service running on fargate, how would we go about terminating these jobs? Is there a way to forcibly cycle all the containers?You can programmatically force a hard reset of the environment following the recommendations provided here (in the top answer). The items listed in the answer will restart MWAA and its containers.CommentShareAndrewanswered 2 months ago"


Question: Bucket still shows many TB of space used in S3 Std after moving everything to Glacier

"We moved our files (~150 TB) from S3 Std to Glacier a few months back but we noticed we were still being billed for use of 21 TB of S3 Std storage.I checked the metrics on the bucket and it agrees with the billing and we still have 21 TB in S3 Std storage.I ran an inventory report and, other than about 200 MB of small chk files, everything is in Glacier.The bucket doesn't have versioning enabled currently and I'm not aware that it ever did, I set this up many years ago.How do I find these apparently hidden files?FollowComment"

Answer: "0Can you please check the status of versioning to see its showing suspended , if it is then versioning was enabled and then suspended.. There is an option within S3 bucket where you can see hidden files , you just have to check show versions and you will be able to see if there are version files or not. Also you can check the storage lens to get deep detail of your objects.If you see versioned objects then have lifecycle policy to move them or expire them as per requirement.CommentShareShashank Abhishekanswered 5 months agorePost-User-1323029 5 months agoThank you for your suggestions.I checked the buckets and all were set to Disabled on Versioning and there was no toggle for Show Versions.I have gone back to the Storage Lens and all the default lens shows me is that we have 21TB of data in S3 Std, no information about what files are in that storage class.I have created a custom lens with the advanced features enabled and now I have to wait 48 hours for it to populate with data.I will update this once I have information in the new custom storage lens.Please let me know if you have any further suggestions.Share0Looping back to provide the answer to this issue.The hidden files ended up being years of "Incomplete multipart upload bytes greater than 7 days".This was caused by our Internet connection sometimes dropping during the upload of files to the buckets.We set up a lifecycle rule in the bucket to clean this up.CommentSharerePost-User-1323029answered 3 months ago"


Question: Sagemker Async inference doesn't run with large payloads and no errors getting logged

"I have an async inference endpoint that I'm calling withpredict_async()When I call this endpoint with a small 650 KB CSV, everything works fine. But when I call the endpoint with a larger 14.1 MB CSV, the input goes to the respective S3 location, but the actual inference code doesn't seem to run at all. There is no errors in cloudwatch or anythingI also have print statements that get printed as soon as the inference code is ran, but still, nothing in cloudwatch is getting printed.Once this happens, nothing can be ran through my Async endpoint. The input will continue to get logged into S3, but my inference code will not get ran. Again this is happening with no errors in cloudwatch, so I have no idea what could be causing this.Any help here is appreciated.FollowComment"

Answer: "0It appears that there is a problem with the size of the payload being sent to the endpoint. While SageMaker supports large payloads, the size of the payload that can be sent is still limited.You can see if adjusting the batch size when sending the payload solves the problem. You should also check the resource limits for your endpoint to ensure they are appropriate for the size of your payload.If neither of these options works, you can try increasing the instance size or number of instances in your endpoint to accommodate the larger payload.Finally, you can use SageMaker's remote debugging feature to investigate what's going on during inference. This allows you to debug your inference code while it is running on the instance.CommentShareEXPERTsedat_salmananswered a month agorePost-User-4955682 a month agoLowering the batch size does fix the problem, but I need to send large batches to the endpoint, so it's a moot point. I tired using larger GPU instances, and that doesn't fix the issue. I'm a little confused as to why async inference claims it's able to process up to a gig of data, when the actual instances fail on payloads less than 20 MB. It seems implied that async inference would automatically partition large payloads to work on given instances, but that doesn't seem to be the case?Sharesedat_salman EXPERTa month agoWhile SageMaker Async Inference can indeed handle large payloads, it doesn't automatically partition the data for you. Instead of using the Async Inference endpoint directly, you can use SageMaker Processing Jobs to preprocess the data and split it into smaller chunks. Then, you can invoke the Async Inference endpoint on each chunk of data separately.Maybe this can be a solution for youhttps://sagemaker-examples.readthedocs.io/en/latest/sagemaker_processing/scikit_learn_data_processing_and_model_evaluation/scikit_learn_data_processing_and_model_evaluation.htmlSharerePost-User-4955682 a month agoI'd prefer not to write a process to break up the data, as that would require quite a bit more logic to get it to work correctly with the async endpoint. Is their anyway to increase CPU amount on GPU's in order to be able to hold more data once the data gets ingested onto the instance? Also, when u say increase the number of instances in my endpoint, are you talking about scaling it out? I'm not sure how that would help, as scaling wouldn't break up the payload.Share"


Question: WorkDocs Drive is shutting down due to an error (Win10)

"Good morning,I've been using WorkDocs for around 6 months. This morning went I went to use WorkDocs, a pop-up in my taskbar showed, "WorkDocs Drive is shutting down due to an error!" I tried to restart WorkDocs and kept getting the same error.I'm running Win 10 Pro (ver 2004), 32GB RAM, 500GB SSD, on a machine that I replaced a month ago on July 2, 2020. OS Build is 19041.388. Also running Norton 360. All Windows Updates have been applied, with the last update being KB4562899 Cumulative Update Preview for .NET Framework 3.5 and 4.8 for Windows 10 Version 2004, installed Aug 8, 2020.The WorkDocs logs show:[code]System.Messaging.MessageQueueException (0x80004005): Message Queue service is not available.at System.Messaging.MessageQueue.Create(String path, Boolean transactional)at AWSWorkDriveClient.Sync.MessageQueueJournal.<>c__DisplayClass24_0.<Create>b__0()at AWSWorkDriveCommon.Util.Functions.<>c__DisplayClass3_0.<ToFunc>b__0()at AWSWorkDriveCommon.Util.RetryStrategy.Call[R](Func`1 callback, OnRetriesExhaustedThrow retryExceptionType)[2020-08-11 15:03:53,483][thread8][INFO ][AWSWorkDriveCommon.Util.RetryStrategy] - Exception is retryable, in 00:00:02 will use retry 2 of 5. Same cause.[2020-08-11 15:03:55,498][thread8][INFO ][AWSWorkDriveCommon.Util.RetryStrategy] - Exception is retryable, in 00:00:04 will use retry 3 of 5. Same cause.[2020-08-11 15:03:59,512][thread8][INFO ][AWSWorkDriveCommon.Util.RetryStrategy] - Exception is retryable, in 00:00:08 will use retry 4 of 5. Same cause.[2020-08-11 15:04:07,526][thread8][INFO ][AWSWorkDriveCommon.Util.RetryStrategy] - Exception is retryable, in 00:00:16 will use retry 5 of 5. Same cause.[2020-08-11 15:04:23,543][thread8][ERROR][AWSWorkDriveClient.WorkDriveClient] - Unhandled exception raised by Name:AWSWorkDocsDriveClient.exeThere are no context policies.System.Messaging.MessageQueueException (0x80004005): Message Queue service is not available.at System.Messaging.MessageQueue.Create(String path, Boolean transactional)at AWSWorkDriveClient.Sync.MessageQueueJournal.<>c__DisplayClass24_0.<Create>b__0()at AWSWorkDriveCommon.Util.Functions.<>c__DisplayClass3_0.<ToFunc>b__0()at AWSWorkDriveCommon.Util.RetryStrategy.Call[R](Func1 callback, OnRetriesExhaustedThrow retryExceptionType)      at AWSWorkDriveClient.Sync.MessageQueueJournal.Create(String queueName, Boolean isCleanStart, RetryStrategy readRetryStrategy)      at AWSWorkDriveClient.WorkDriveClient.<>c__DisplayClass25_0.<CreateJournal>b__0()      at AmazonWorkDocsDriveFramework.Journal.DedupingJournal..ctor(Int32 maxCacheSize, IFeatureManager featureManager, Func1 delegateJournalFactory, MetricsReporter metricsReporter, CacheFactory cacheFactory)at AWSWorkDriveClient.WorkDriveClient.CreateJournal(WinClientOptions options, IFeatureManager fm)at AmazonWorkDocsDriveFramework.WorkDriveFramework.Initialize(SystemType systemType, Options options, AppRestartManager appRestartManager, IncidenceLogManager incidenceLogManager, MetricsReporter metricsReporter, INativeOperations nativeOperations, ISystemNotification systemNotification, List1 customLocalOnlyDeciders, AggregatedAvailabilityTracker availabilityTracker, PeriodicAvailabilityTracker networkAvailabilityTracker, Boolean identifyLocalOnlyFodler, Func2 databaseProviderFactory, Func2 mountPointFactory, Func2 journalFactory, Func2 providerFactory, Boolean performCreateDeleteEliding, String& mountPoint, ManualSwitchAvailabilityTracker& manualSwitchAvailabilityTracker, UserInfo& userInfo, Optional1& logUploadClient, IStorageProvider& storageProvider, JournalChangeReferenceManager& journalChangeManager, IReferenceManager1& refManager, LockManager& lockManager, PathValidator& pathValidator, IResourceNameValidator& resourceNameValidator, IPathConverter& pathConverter, IMetadataManager& metadataManager, IFavoriteDataManager& favoriteDataManager, GarbageCollector& gc, IHardLinkManager& hardLinkManager, IFileRecoverManager& fileRecoverManager, IAsyncFetchFolderManager& fetchFolderManager, IDatabaseProvider& databaseProvider, ICacheManager& cacheManager, IPermissionsManager& permissionsManager, IJournal& journal, Func1& journalTimerFactory, IJournalReader& journalReader, IFeatureManager& featureManager, ITempFilesManager& tempFilesManager, DriveStatusMonitor& driveStatusMonitor)at AWSWorkDriveClient.WorkDriveClient.CompleteInitialization(WinClientOptions options, AppRestartManager appRestartManager, IncidenceLogManager incidenceLogManager, AutoUpdateSingleton autoUpdate, IWindowsSystemNotification winSystemNotification, IWDObserver1 systemPopupNotificationObserver, ITaskExecutor executor, Func1 metricsTimerFactory, String exePath)at AWSWorkDriveClient.WorkDriveClient.<>c__DisplayClass22_0.<run>b__1(Object state)at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)at System.Threading.QueueUserWorkItemCallback.System.Threading.IThreadPoolWorkItem.ExecuteWorkItem()at System.Threading.ThreadPoolWorkQueue.Dispatch()[2020-08-11 15:04:23,551][thread8][INFO ][AWSWorkDriveClient.View.SystemTray.WindowsTraySystemNotification] - WorkDocs Drive is shutting down due to an error![/code]The incidence log shows:[code][2020-08-11 15:00:31,753][thread8][ERROR][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - === end failure info ===[2020-08-11 15:04:23,549][thread8][INFO ][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - Version: '1.0.5378.0'[2020-08-11 15:04:23,549][thread8][INFO ][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - Build Type: 'prod'[2020-08-11 15:04:23,549][thread8][INFO ][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - System Type: 'windows'[2020-08-11 15:04:23,549][thread8][INFO ][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - OS Version: 'MicrosoftWindows10Pro'[2020-08-11 15:04:23,549][thread8][INFO ][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - dotNet Version: '528372'[2020-08-11 15:04:23,549][thread8][INFO ][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - CLR Version: '4.0.30319.42000'[2020-08-11 15:04:23,549][thread8][INFO ][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - Thread Culture: 'en-CA'[2020-08-11 15:04:23,549][thread8][INFO ][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - Thread UI Culture: 'en-US'[2020-08-11 15:04:23,549][thread8][INFO ][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - Storage Provider: 'WorkDocs'[2020-08-11 15:04:23,549][thread8][ERROR][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - === begin failure info ===[2020-08-11 15:04:23,549][thread8][ERROR][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - WinErrorCode='16389'[2020-08-11 15:04:23,550][thread8][ERROR][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - System.Messaging.MessageQueueException (0x80004005): Message Queue service is not available.at System.Messaging.MessageQueue.Create(String path, Boolean transactional)at AWSWorkDriveClient.Sync.MessageQueueJournal.<>c__DisplayClass24_0.<Create>b__0()at AWSWorkDriveCommon.Util.Functions.<>c__DisplayClass3_0.<ToFunc>b__0()at AWSWorkDriveCommon.Util.RetryStrategy.Call[R](Func1 callback, OnRetriesExhaustedThrow retryExceptionType)      at AWSWorkDriveClient.Sync.MessageQueueJournal.Create(String queueName, Boolean isCleanStart, RetryStrategy readRetryStrategy)      at AWSWorkDriveClient.WorkDriveClient.<>c__DisplayClass25_0.<CreateJournal>b__0()      at AmazonWorkDocsDriveFramework.Journal.DedupingJournal..ctor(Int32 maxCacheSize, IFeatureManager featureManager, Func1 delegateJournalFactory, MetricsReporter metricsReporter, CacheFactory cacheFactory)at AWSWorkDriveClient.WorkDriveClient.CreateJournal(WinClientOptions options, IFeatureManager fm)at AmazonWorkDocsDriveFramework.WorkDriveFramework.Initialize(SystemType systemType, Options options, AppRestartManager appRestartManager, IncidenceLogManager incidenceLogManager, MetricsReporter metricsReporter, INativeOperations nativeOperations, ISystemNotification systemNotification, List1 customLocalOnlyDeciders, AggregatedAvailabilityTracker availabilityTracker, PeriodicAvailabilityTracker networkAvailabilityTracker, Boolean identifyLocalOnlyFodler, Func2 databaseProviderFactory, Func2 mountPointFactory, Func2 journalFactory, Func2 providerFactory, Boolean performCreateDeleteEliding, String& mountPoint, ManualSwitchAvailabilityTracker& manualSwitchAvailabilityTracker, UserInfo& userInfo, Optional1& logUploadClient, IStorageProvider& storageProvider, JournalChangeReferenceManager& journalChangeManager, IReferenceManager1& refManager, LockManager& lockManager, PathValidator& pathValidator, IResourceNameValidator& resourceNameValidator, IPathConverter& pathConverter, IMetadataManager& metadataManager, IFavoriteDataManager& favoriteDataManager, GarbageCollector& gc, IHardLinkManager& hardLinkManager, IFileRecoverManager& fileRecoverManager, IAsyncFetchFolderManager& fetchFolderManager, IDatabaseProvider& databaseProvider, ICacheManager& cacheManager, IPermissionsManager& permissionsManager, IJournal& journal, Func1& journalTimerFactory, IJournalReader& journalReader, IFeatureManager& featureManager, ITempFilesManager& tempFilesManager, DriveStatusMonitor& driveStatusMonitor)at AWSWorkDriveClient.WorkDriveClient.CompleteInitialization(WinClientOptions options, AppRestartManager appRestartManager, IncidenceLogManager incidenceLogManager, AutoUpdateSingleton autoUpdate, IWindowsSystemNotification winSystemNotification, IWDObserver1 systemPopupNotificationObserver, ITaskExecutor executor, Func1 metricsTimerFactory, String exePath)at AWSWorkDriveClient.WorkDriveClient.<>c__DisplayClass22_0.<run>b__1(Object state)at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)at System.Threading.QueueUserWorkItemCallback.System.Threading.IThreadPoolWorkItem.ExecuteWorkItem()at System.Threading.ThreadPoolWorkQueue.Dispatch()[2020-08-11 15:04:23,550][thread8][ERROR][AmazonWorkDocsDriveFramework.Logs.IncidenceLogManagerPIIFree] - === end failure info ===[/code]I've uninstalled WorkDocs and have deleted the folder at:C:\Users\[user]\AppData\Roaming\Amazon\AWSWorkDocsDriveClientRebooted, reinstalled workdocs, rebooted again, and then signed in to my WorkDocs account -- to see the same error. I've tried that twice now.I've checked and the MSMQ service is running. I've also killed its PID and restarted the service to see the same WorkDocs error.Help?AlFollowCommentrePost-User-6226800 a year agoEnglish:I've been looking for a solution for months, I found it! Uninstall amazon work docs, rename the Amazon folder to C:\Users\user\AppData\Roaming and reinstall the program! Ready!Share"

Answer: "05 hours later...Uninstalled the Windows Message Queue service: Apps & Features -> (Programs and Features) top right corner -> Turn Windows Features On and Off -> Microsoft Message Queue Service (MSMQ) -- uncheck.Reboot.Do that again, but this time install the MSMQ service.And now I'm back online. Let's hope it runs for a while without dying again. In full disclosure, before I uninstalled the MSMQ service, I tried to install some of its sub-components, which failed.  That led me to the uninstall.CommentSharegiltechanswered 3 years ago0And here I am again, referencing my own notes. Happened to me again, on a new machine. Glad I posted my notes!AlCommentSharegiltechanswered 2 years ago"


Question: Build and Deploy source from git Tag from another account

"Hi Team,I have an AWS Pipeline in my DEV account, I created a second Pipeline In my PROD account.I followed this articles :1 - https://prashant-48386.medium.com/cross-account-codepipeline-that-use-codecommit-from-another-aws-account-9d5ab4c892f62- https://docs.aws.amazon.com/codepipeline/latest/userguide/pipelines-create-cross-account.htmlto make the PROD Pipeline use the Repository of the DEV account.how can I Build the source from a specific git tag, not from a branch name?when  I put the tag number on the Pipeline source stage it fails.I tried to edit the source stage in the pipeline and select 'full clone' option but I had this error :remote repository is empty for primary source and source version 63sdsde73f2e1f6sdsd7564f742csdsds91ssd1f7sdsaas I used a remote repository in another account (DEV).I tried also to do this in my Buildspec :... git-credential-helper: yes....build:    commands:      - echo Build started on `date`      - git config --global user.name $REPO_NAME      - git config --global user.email "$REPO_NAME@xxxx.xxx"      - git clone code_conit_remote_repo_dev_account_url/$REPO_NAME --branch=$TAG_VERSION      - cd $REPO_NAMEgit clone https://codecommit.region.amazonaws.com/xx/xx/xx/$REPO_NAME --branch=$TAG_VERSIONbut I had this error :fatal: unable to access 'https://codecommit.region.amazonaws.com/xx/xx/xx/myRepoName/':  The requested URL returned error: 403Command did not exit successfully git clone https://codecommit.region.amazonaws.com/xx/xx/xx/$REPO_NAME --branch=$TAG_VERSION exit status 128Thanks for your help.FollowComment"

Answer: "2Accepted AnswerNormally (without the full clone option), CodePipeline itself pulls the repo for you, discards the git metadata, and then passes it along to the next step via an S3 bucket.When you use the full clone option, the CodeBuild stage will perform a pull for you so that it can keep the git metadata. Unfortunately, this does not currently work in a cross-account scenario because CodeBuild itself does not have any way to assume a cross-account role, and there is also no mechanism in CodeCommit to allow access from a role in another account.This is why when you switch to a full clone, you are seeing 403 forbidden responses, as CodeBuild is trying to use the CodeBuild service role to connect with CodeCommit.You may be able to work around this as follows:Turn off the full repo cloneSet up an SSH key for your CodeCommit repoStore the private key in AWS Secrets Manager in your CodePipeline accountDuring your build phase, fetch the private key from Secrets Manager using the AWS CLI, place it in ~/.ssh/ with permissions set to 600Again during the build phase, configure ~/.ssh/config based on the key id and file nameFinally, issue the appropriate git clone command to pull the repo, and use git checkout to switch to the specific commit you want. Be sure to use ssh:// on your repo URL instead of https://I have included some of the relevant AWS documentation links below. I'm not aware of a step-by-step guide for this method of manually configuring a cross-account full-clone, however the pieces should all be there. I hope this helps!https://docs.aws.amazon.com/codecommit/latest/userguide/setting-up-without-cli.html : Setup for SSH users not using the AWS CLIhttps://docs.aws.amazon.com/codecommit/latest/userguide/how-to-connect.html : Connect to an AWS CodeCommit repositoryhttps://docs.aws.amazon.com/cli/latest/reference/secretsmanager/get-secret-value.htmlCommentShareSUPPORT ENGINEERWayne_Ganswered a year ago"


Question: Missing Aurora Function after upgrade from aurora pg 12 to pg 13

"Hello,We recently upgraded from aurora pg 12.4 to aurora 13.4 and after that, we noticed that this query stopped working,select sum(allocated) from aurora_stat_memctx_usage()I did not see anything in the change log about this method going away, but I'm unable to call it on any of our aurora 13.4 instances, but it works fine on our aurora 12.4 instance.Any help would be appreciated.FollowComment"


Question: AWS SES - Connection time-out on port 25

"Hello,Our AWS account ID is 592296619356. We have a Java based web-application running on an EC2 instance in Mumbai which sends emails through SMTP server at  Ireland - email-smtp.eu-west-1.amazonaws.com , port 25 (because SES was not available in Mumbai when this account/application was set up).The emails were going out fine till recently but now we cannot connect to the SMTP server at all and are getting connection timed out errors.Exception: com.sun.mail.util.MailConnectException: Couldn't connect to host, port: email-smtp.eu-west-1.amazonaws.com, 25; timeout -1;I tried all the troubleshooting tips at https://aws.amazon.com/premiumsupport/knowledge-center/smtp-connectivity-timeout-issues-ses/ and I am not able to telnet at all which suggested a network issue?I tried by disabling firewall, adding outbound port 25 and inbound 1024-65535 in our security-group, network acl etc. but it is still unable to connect.nmap shows that 25 is open on our ec2 and on the smtp server it shows as 25/tcp filtered smtp.Could you please point me towards a solution to this issue? (Email is an integral part of our application registration/status etc. and without it a user cannot proceed).Thanks a lot.FollowComment"

Answer: 0For anybody still looking into this thread - I found some helpful tips at  https://docs.aws.amazon.com/ses/latest/DeveloperGuide/Welcome.htmlChanging the port to 587 and using explicit tls seems to have resolved the issue.CommentShareraghdranswered 3 years ago0We also started to experience similar behavior. We were using port 465 though. This was happening to about 10% of outcoming mails.We implemented a retry mechanism. If sending fails it will be tried again in 1 minute. This solved this issue (for now).I've also tried to switch to port 587 - but the outcome is the same as on 465.CommentSharequnerdanswered 3 years ago0Hello did you ever get to the bottom of this? I'm suffering through the same issue hereCommentShareUser-8883109answered a year ago


Question: Please support domain registration for .tech domains

"We'd like to consolidate all of our domain registration on AWS Route53. Please add support for registering/transferring .tech domains and take our money. 💶 💵FollowCommentMrPRSTO a year agoSame here, we want to give AWS our business but without this we have to keep paying Go Daddy for our .tech domains!Share"

Answer: 0Thanks for your request on adding .tech top level domains to Route53.CommentShareEXPERTRob_Hanswered a year agoEXPERTHernitoreviewed a year agosamofwise 2 months agoAny possible timeline on this?Share


Question: I cant save neuron model after compile the model into an AWS Neuron optimized TorchScript

"I cant save neuron model after compile the model into an AWS Neuron optimized TorchScript.My code:import tensorflow  # to workaround a protobuf version conflict issueimport torchimport torch.neuronimport torch.nn.functional as Fimport transformersfrom transformers import AutoTokenizer, AutoModelForSequenceClassificationtokenizer = AutoTokenizer.from_pretrained('./data/tokenizer')model = AutoModelForSequenceClassification.from_pretrained('data/model', return_dict=False, torchscript=True)parsed_json_list = [            {"premise": "I have a dog", "hypotheses": ["I love dogs", "I hate dogs"]}        ]model_inputs = tokenizer(    [        parsed_json["premise"]        for parsed_json in parsed_json_list        for _ in parsed_json["hypotheses"]    ],    [        hypothesis        for parsed_json in parsed_json_list        for hypothesis in parsed_json["hypotheses"]    ],    return_tensors='pt',    padding=True,    truncation=True,)pred = model(**model_inputs)example_inputs= model_inputs['input_ids'], model_inputs['attention_mask'], model_inputs['token_type_ids']model_neuron = torch.neuron.trace(model, example_inputs, verbose=1)Neuron log after torch.neuron.trace:INFO:Neuron:Number of neuron graph operations 121 did not match traced graph 101 - using heuristic matching of hierarchical informationINFO:Neuron:Number of arithmetic operators (post-compilation) before = 2131, compiled = 1992, percent compiled = 93.48%INFO:Neuron:The neuron partitioner created 51 sub-graphsINFO:Neuron:Neuron successfully compiled 50 sub-graphs, Total fused subgraphs = 51, Percent of model sub-graphs successfully compiled = 98.0%INFO:Neuron:Compiled these operators (and operator counts) to Neuron:INFO:Neuron: => aten::Int: 398INFO:Neuron: => aten::ScalarImplicit: 2INFO:Neuron: => aten::add: 82INFO:Neuron: => aten::arange: 2INFO:Neuron: => aten::bmm: 47INFO:Neuron: => aten::clamp: 22INFO:Neuron: => aten::contiguous: 71INFO:Neuron: => aten::detach: 144INFO:Neuron: => aten::div: 60INFO:Neuron: => aten::expand: 22INFO:Neuron: => aten::gelu: 13INFO:Neuron: => aten::layer_norm: 26INFO:Neuron: => aten::linear: 97INFO:Neuron: => aten::mul: 38INFO:Neuron: => aten::neg: 11INFO:Neuron: => aten::permute: 71INFO:Neuron: => aten::select: 1INFO:Neuron: => aten::size: 460INFO:Neuron: => aten::slice: 27INFO:Neuron: => aten::sqrt: 36INFO:Neuron: => aten::squeeze: 23INFO:Neuron: => aten::sub: 1INFO:Neuron: => aten::to: 96INFO:Neuron: => aten::transpose: 47INFO:Neuron: => aten::unsqueeze: 29INFO:Neuron: => aten::view: 166INFO:Neuron:Not compiled operators (and operator counts) to Neuron:INFO:Neuron: => aten::Int: 35 [supported]INFO:Neuron: => aten::__and__: 1 [supported]INFO:Neuron: => aten::abs: 1 [supported]INFO:Neuron: => aten::add: 3 [supported]INFO:Neuron: => aten::bmm: 1 [supported]INFO:Neuron: => aten::ceil: 1 [supported]INFO:Neuron: => aten::clamp: 2 [supported]INFO:Neuron: => aten::contiguous: 1 [supported]INFO:Neuron: => aten::detach: 2 [supported]INFO:Neuron: => aten::div: 2 [supported]INFO:Neuron: => aten::embedding: 1 [not supported]INFO:Neuron: => aten::expand: 2 [supported]INFO:Neuron: => aten::gather: 24 [not supported]INFO:Neuron: => aten::gt: 1 [supported]INFO:Neuron: => aten::le: 1 [supported]INFO:Neuron: => aten::linear: 1 [supported]INFO:Neuron: => aten::log: 2 [supported]INFO:Neuron: => aten::lt: 1 [supported]INFO:Neuron: => aten::mul: 2 [supported]INFO:Neuron: => aten::neg: 1 [supported]INFO:Neuron: => aten::permute: 1 [supported]INFO:Neuron: => aten::repeat: 24 [not supported]INFO:Neuron: => aten::sign: 1 [not supported]INFO:Neuron: => aten::size: 10 [supported]INFO:Neuron: => aten::slice: 2 [supported]INFO:Neuron: => aten::squeeze: 2 [supported]INFO:Neuron: => aten::to: 5 [supported]INFO:Neuron: => aten::transpose: 1 [supported]INFO:Neuron: => aten::type_as: 2 [supported]INFO:Neuron: => aten::unsqueeze: 2 [supported]INFO:Neuron: => aten::view: 2 [supported]INFO:Neuron: => aten::where: 2 [not supported]INFO:Neuron:skip_inference_context for tensorboard symbols at /home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/tensorboard.py:305 tb_parseINFO:Neuron:Number of neuron graph operations 468 did not match traced graph 599 - using heuristic matching of hierarchical informationCPU times: user 1min 50s, sys: 13.1 s, total: 2min 3sWall time: 7min 37sAfter i try save my model:model_neuron.save('test.pt')error log:---------------------------------------------------------------------------RuntimeError                              Traceback (most recent call last)/tmp/ipykernel_17776/1444584018.py in <module>----> 1 model_neuron.save('test.pt')~/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch/jit/_script.py in save(self, f, **kwargs)    691             See :func:`torch.jit.save <torch.jit.save>` for details.    692             """--> 693             return self._c.save(str(f), **kwargs)    694     695         def _save_for_lite_interpreter(self, *args, **kwargs):RuntimeError: Could not export Python function call 'XSoftmax'. Remove calls to Python functions before export. Did you forget to add @script or @script_method annotation? If this is a nn.ModuleList, add it to __constants__:/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/native_ops/prim.py(46): PythonOp/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/graph.py(330): __call__/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/graph.py(207): run_op/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/graph.py(196): __call__/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/runtime.py(69): forward/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch/nn/modules/module.py(1098): _slow_forward/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch/nn/modules/module.py(1110): _call_impl/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch/jit/_trace.py(965): trace_module/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch/jit/_trace.py(750): trace/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/tensorboard.py(307): tb_parse/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/tensorboard.py(533): tb_graph/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/decorators.py(482): maybe_generate_tb_graph_def/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/convert.py(513): maybe_determine_names_from_tensorboard/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/torch_neuron/convert.py(200): trace<timed exec>(1): <module>/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/IPython/core/magics/execution.py(1335): time/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/IPython/core/magic.py(187): <lambda>/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/decorator.py(232): fun/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/IPython/core/interactiveshell.py(2473): run_cell_magic/tmp/ipykernel_17776/2573155944.py(1): <module>/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/IPython/core/interactiveshell.py(3553): run_code/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/IPython/core/interactiveshell.py(3473): run_ast_nodes/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/IPython/core/interactiveshell.py(3258): run_cell_async/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/IPython/core/async_helpers.py(78): _pseudo_sync_runner/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/IPython/core/interactiveshell.py(3030): _run_cell/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/IPython/core/interactiveshell.py(2976): run_cell/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/ipykernel/zmqshell.py(528): run_cell/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/ipykernel/ipkernel.py(387): do_execute/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/ipykernel/kernelbase.py(730): execute_request/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/ipykernel/kernelbase.py(406): dispatch_shell/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/ipykernel/kernelbase.py(499): process_one/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/ipykernel/kernelbase.py(510): dispatch_queue/usr/lib64/python3.7/asyncio/events.py(88): _run/usr/lib64/python3.7/asyncio/base_events.py(1786): _run_once/usr/lib64/python3.7/asyncio/base_events.py(541): run_forever/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/tornado/platform/asyncio.py(215): start/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/ipykernel/kernelapp.py(712): start/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/traitlets/config/application.py(982): launch_instance/home/ec2-user/test_aws_inf_neuron/pytorch_venv/lib64/python3.7/site-packages/ipykernel_launcher.py(17): <module>/usr/lib64/python3.7/runpy.py(85): _run_code/usr/lib64/python3.7/runpy.py(193): _run_module_as_mainThanks in advance.FollowComment"

Answer: "1We have not seen this exact serialization issue before, but this model is unlikely to perform well since it has unsupported operators (aten::gather and aten::repeat) evenly distributed throughout the model. When operators are unsupported, they are executed on CPU. For this model, this causes 51 Neuron subgraphs to be produced (with CPU operators in-between) which will most likely cause performance issues due to excessive data transfer between CPU/NeuronCores. We have previously seen an issue like this when using the DeBERTa model which uses gathers/repeats in each model layer.We are looking into the possibility of improving the performance of these models, but currently this will not work well on Inferentia.CommentSharejonathanluntanswered 7 months agoAlekseyIvashov 7 months agoThank for your helpShare"


Question: Need one image to have multiple labels

"Hi, I am looking for a way to create datasets using manifest or auto labeling feature or any other way to allow me to label multiple objects in an image so that each object I select has a label.Tried to create datasets using manifest so that the manifest only has class_id and class-map attributes but not having any boundingbox attributes. I was able to create such datasets. From the dataset GUI, I can see each each image has multiple labels associated. However training fails with error "The manifest file contains too many invalid data objects."I made another attempt by putting same image that has multiple objects in multiple folders that represent their labels. I was able to create datasets and even successfully trained that dataset-pair. But  from viewing the test result, no single image correctly labeled twice.Do you support my scenario?thank you.FollowComment"

Answer: "0Hi, Could I get some expert opinions for my questions? thx.CommentSharemymingleanswered 3 years ago0Hey mymingleUnfortunately the custom labels console does not support attaching multiple labels to a single image using the autolabel feature. I have passed on this feedback to the corresponding team.You can follow the below sample format when manually creating a multi label manifest file (expanding on the example specified here https://docs.aws.amazon.com/rekognition/latest/customlabels-dg/cd-required-fields.html):{"source-ref": "S3 bucket location", # Required"sport0":0, # FIRST annotation"sport0-metadata": { # Required"class-name": "football", # Required"confidence": 0.8, # Required"type":"groundtruth/image-classification", # Required"job-name": "identify-sport", # Not required"human-annotated": "yes", # Required"creation-date": "2018-10-18T22:18:13.527256" # Required},"sport1":1, # SECOND annotation"sport1-metadata": { # Required"class-name": "ball", # Required"confidence": 0.8, # Required"type":"groundtruth/image-classification", # Required"job-name": "identify-sport", # Not required"human-annotated": "yes", # Required"creation-date": "2018-10-18T22:18:13.527256" # Required}}  # end of annotations for 1 imageThe above line attaches labels "football" and "ball" to the same image.You can use any string instead of "sport0", "sport1" etc but you must ensure there is a corresponding "-metadata" field. For e.g. if you use "some-label1", ensure it is followed by a "some-label1-metadata" section.Each "some-label<N>", <some-label<N>-metadata" pair represents ONE annotation.Hope this helps.CommentShareawsrakeshanswered 3 years ago0Reposting example with formatting - {    "source-ref": "S3 bucket location", # Required    "sport0":0, # FIRST annotation    "sport0-metadata": { # Required        "class-name": "football", # Required        "confidence": 0.8, # Required        "type":"groundtruth/image-classification", # Required        "job-name": "identify-sport", # Not required        "human-annotated": "yes", # Required        "creation-date": "2018-10-18T22:18:13.527256" # Required    },    "sport1":1, # SECOND annotation    "sport1-metadata": { # Required        "class-name": "ball", # Required        "confidence": 0.8, # Required        "type":"groundtruth/image-classification", # Required        "job-name": "identify-sport", # Not required        "human-annotated": "yes", # Required        "creation-date": "2018-10-18T22:18:13.527256" # Required    }}  # end of annotations for 1 image Edited by: awsrakesh on Mar 24, 2020 1:56 PMCommentShareawsrakeshanswered 3 years ago0That manifest format works. Thank you.CommentSharemymingleanswered 3 years ago"


Question: SES Production Request

"We have SES configured for transactional emails , however we are not able to take it to productions. Have tried couple of things but nothing is working.  I don't see any button to request for the productionFollowComment"

Answer: "0Are you trying to move out of the SES sandbox? If so, you can follow these instructions.CommentShareNiklasanswered 10 months ago"


Question: Sign In with Apple not sending attributes for users who have previously signed in

"My orginization recently moved to Cognito for user authentication and was previously using native sign in with apple. For the users who had used Sign In with Apple before the move to Cognito, they are experiencing an error:"Invalid user attributes: family_name: Attribute is required. Invalid user attributes: given_name: Attribute is required."It seems that when going through the Sign In with Apple flow with a user that already exists - but does not exist in Congnito yet - Apple is not providing the firstName and lastName attributes in the token. As a workaround I have set family/given_name to map to the "sub" attribute but this is not an ideal solution long term. What are my options here?FollowComment"

Answer: "0You need to configure the Custom Attributes within the User Pool. To achieve this, you would need to go into Cognito > UserPoolName > Sign-Up Experience > Custom attributes > Add the custom Attributes that the app requires (that Apple used to pass). These custom attributes can then be leveraged in the app client configuration.Something important to mention, is that if you require to include these attributes in the token, you would need to create a Post-Authentication Lambda to include the required attributes within the Token being passed to the application.CommentShareMaverickanswered 9 months ago"


Question: Delay in Kinesis video stream builds up over time

"I am currently using https://github.com/awslabs/amazon-kinesis-video-streams-producer-sdk-cpp  (gstreamer sample) to stream video from rpi to kinesis.  The delay is around 10 seconds in the first hour. However, the delay gets built up and goes up to 30 to 40 sec which is not desirable for us. But if I refresh the stream it goes back to 10 sec delay. Could someone help me on how to reduce the delay build up or update the stream if delay is more than 10 sec?FollowComment"


Question: "pcluster create" results in error during startup - How to address ?

"I am attempting to create a small Parallel cluster using OSX and anaconda. I installed and configured parallelcluster with no errors. The resulting simple config file looks like:[aws]aws_region_name = us-east-1[global]cluster_template = defaultupdate_check = truesanity_check = true[aliases]ssh = ssh {CFN_USER}@{MASTER_IP} {ARGS}[cluster default]key_name = newmacbase_os = ubuntu1604scheduler = sgeinitial_queue_size = 2max_queue_size = 2maintain_initial_size = truevpc_settings = default[vpc default]vpc_id = vpc-058cb4b123bf54848master_subnet_id = subnet-04998fb2f4bc80ccccompute_subnet_id = subnet-03c7e26fb2ea81430use_public_ips = falseWhen I went to create the cluster here is what I see:(base) esteban$ pcluster create -c /Users/esteban/.parallelcluster/config first-clusterBeginning cluster creation for cluster: first-clusterWARNING: The configuration parameter 'scheduler' generated the following warnings:The job scheduler you are using (sge) is scheduled to be deprecated in future releases of ParallelCluster. More information is available here: https://github.com/aws/aws-parallelcluster/wiki/Deprecation-of-SGE-and-Torque-in-ParallelClusterCreating stack named: parallelcluster-first-clusterStatus: parallelcluster-first-cluster - ROLLBACK_IN_PROGRESSCluster creation failed.  Failed events:AWS::AutoScaling::AutoScalingGroup ComputeFleet Resource creation cancelledAWS::CloudFormation::WaitCondition MasterServerWaitCondition Received FAILURE signal with UniqueId i-0438bb35816b58aa5Okay so I can still login although there are no SGE binaries installed.$ pcluster ssh first-cluster -i ~/.ssh/newmac.pemSo I just deleted the cluster which appears to have (I hope) cleaned up all the associated services.pcluster delete -c /Users/esteban/.parallelcluster/config first-clusterAny ideas ? ThanksEdited by: Stevie on Jul 23, 2020 11:42 AMEdited by: Stevie on Jul 23, 2020 11:46 AMEdited by: Stevie on Jul 23, 2020 11:47 AMFollowComment"

Answer: "0Hi, Stevie.The error message you posted, MasterServerWaitCondition Received FAILURE signal with UniqueId INSTANCE_ID, means there was an error when one of the nodes in the cluster was running its configuration tasks after booting. Usually this is due to a failure on the head node of the cluster.You can start debugging the issue by first passing the '-nr/--norollbackflag topcluster create` and then, if cluster creation fails again, you can log into the head node and look for the cause of the failure in /var/log/cfn-init.log.This wiki page contains tips for debugging common cluster creation failures: https://github.com/aws/aws-parallelcluster/wiki/Stack-Creation-FailuresLet us know what you find in the logs, and we'll try and provide more specific guidance based on that.~TimCommentShareAWS-User-4920370answered 3 years ago0Thank you. I had to move on to another project for a bit. I will take into consideration the suggested remedies. One thing that I noticed after trying to delete the failed cluster was that although it appeared to have deleted the cluster - I had to go in and manually remove components (VPC, NAT gateway, etc). In my case, it seemed that the failed create impaired the ability of pcluster delete to back out all supporting components.CommentShareStevieanswered 3 years ago0Hi Stevie,How did you created the VPC, NAT gateway and the network components?You can use your own default resources, create them by hand or create them through the pcluster configure command.In any case the pcluster create command expects these resources are already created so the delete command doesn't delete them.It is by design because the same VPC could be used for multiple clusters, and there is a limit on the number of VPC, Elastic IPs, etc the users can create, so we decided to decouple VPC and network resources from the clusters ones, it is not related to the issue with your previous failed creation.Let us know if it helps.CommentShareenrico-awsanswered 3 years ago"


Question: Getting InvalidSignatureException: Forbidden Error When deployed my dockerized Pinpoint Application on EC2.

"I have built an app that creates pinpoint endpoints using aws-sdk and it's working perfectly in my local machine and local docker container but when i deployed the same application on EC2 using docker it's giving me this "Forbidden" Error. why? i mean if it's working fine locally it should work live as well.const AWS = require('aws-sdk');AWS.config.update({    secretAccessKey: process.env.AWS_SECRET_ACCESS,    accessKeyId: process.env.AWS_ACCESS_KEY,    region: 'ap-southeast-2',  });const pinpoint = new AWS.Pinpoint();pinpoint.updateEndpoint(params, function (err, data) {              if (err) {                logger.info('An error occurred.\n');                logger.info(err, err.stack);              } else {                logger.info(                  '>> Endpoint added/pushed Successfully with endpoint ID ' + obj_id                );              }            });FollowComment"

Answer: "0Hello,Its possible that a different IAM entity is being made use of to perform the API call. When the SDK for JavaScript loads, it automatically searches the shared credentials file, which is named "credentials"[1]. Here is the precedence order for NodeJS applications[2]. To find out the identity of the caller, try a GetCallerIdentity call[3] to log the IAM identity making the call on your instance/application.[1] https://docs.aws.amazon.com/sdk-for-javascript/v2/developer-guide/loading-node-credentials-shared.html[2] https://docs.aws.amazon.com/sdk-for-javascript/v2/developer-guide/setting-credentials-node.html[3] https://docs.aws.amazon.com/STS/latest/APIReference/API_GetCallerIdentity.htmlFeel free to raise a support case with the IAM team to perform resource specific troubleshooting. Thanks!CommentShareSUPPORT ENGINEERRajil_Panswered 9 months ago"


Question: Which AWS service to use for receiving REST messages from IOT device

"if an IOT device sends REST messages (in JSON format) to an endpoint using HTTPS. Which particular AWS service should I use to create and test the endpoint. Also, what kind of security and authentication can I implement?Are there any tutorials available to implement this endpoint on AWS?FollowComment"

Answer: "2AWS IoT Core allows for messages to be published over MQTT, Websockets, and HTTP. This would allow your devices to publish to the managed endpoint meaning you wouldn't have to configure any servers or services, you could just get started with using it right away. See the following for reference: https://docs.aws.amazon.com/iot/latest/developerguide/http.htmlFrom there, testing to see if the message comes through is made very simple; the AWS IoT Console contains a test console that allows you to view incoming messages. This is very helpful when building and testing IoT applications. See the following, short video that demonstrates how to use the test console: https://youtu.be/6w9a6y_-T2o?t=299CommentShareEXPERTDavid Maloneanswered 10 months ago0Take a look at AWS API Gateway - https://aws.amazon.com/api-gateway/Is your backend already implemented in AWS as an HTTPS end-point. If that's the case, API Gateway can use that backend as its integration.If you need to implement the backend application to process the REST API calls coming from your IoT devices, you can use AWS Lambda functions (https://aws.amazon.com/lambda/). API Gateway can also directly integrate with a number of other AWS services directly as wellYou can find tutorials for API Gateway here - https://docs.aws.amazon.com/apigateway/latest/developerguide/api-gateway-rest-tutorials.htmlFor authentication in API Gateway, there are multiple options available. Those are discussed at a high level - https://docs.aws.amazon.com/apigateway/latest/developerguide/apigateway-control-access-to-api.htmlMost commonly used mechanisms areLambda Authorizers - https://docs.aws.amazon.com/apigateway/latest/developerguide/apigateway-use-lambda-authorizer.htmlCognito User Pools - https://docs.aws.amazon.com/apigateway/latest/developerguide/apigateway-integrate-with-cognito.htmlAWS IAM - https://docs.aws.amazon.com/apigateway/latest/developerguide/permissions.htmlCognito Identity Pools - https://aws.amazon.com/blogs/compute/secure-api-access-with-amazon-cognito-federated-identities-amazon-cognito-user-pools-and-amazon-api-gateway/You can use this workshop - https://auth.serverlessworkshops.io/ if you want to get a good handle on authentication with AWS API GatewayCommentShareEXPERTIndranil Banerjee AWSanswered 10 months agorePost-User-8624595 10 months agoHi Indranil,Really appreciate your detailed response. Currently, I don't have any integrations on AWS. I'm pretty much new to AWS and Basically I'm gathering an information about the following situation:If an IOT device sends REST messages to an endpoint using HTTPS. In order to confirm that the messages are being properly sent or can be received, how would I set a testing endpoint in AWS?ShareIndranil Banerjee AWS EXPERT10 months agoAPI Gateway does not have to use Lambdas or AWS Services or HTTP(S) endpoints running inside AWS as the integration. API Gateway can invoke any public HTTP(S) endpoint even if it is not running inside AWS.Having said that, if your backend service is running outside of AWS and you just want to set up a mock inside AWS for testing purposes, you can use a mock integration to generate a hard-coded response that matches your response from the actual backend but with dummy values - https://docs.aws.amazon.com/apigateway/latest/developerguide/how-to-mock-integration.htmlShareIndranil Banerjee AWS EXPERT10 months agoYou can export your API swagger definition from your actual backend service and import the swagger into API Gateway to create your API definitions in API Gateway - https://docs.aws.amazon.com/apigateway/latest/developerguide/api-gateway-import-api.htmlYou can then swap the backends with mock implementations using the AWS API Gateway consoleShare"


Question: Correct Root CA for aswIoT mqtt server

"Hi All,I am using cc3100 wifi chip from TI and I have ported the awsiot sdk for our project. I have one confusion regarding the correct root ca.I tried these following root ca so far-RSA 2048 bit key: Amazon Root CA 1.ECC 256 bit key: Amazon Root CA 3.RSA 2048 bit key: VeriSign Class 3 Public Primary G5 root CA certificateCross-signed Amazon Root CA 1Cross-signed Amazon Root CA 3These certificates did not work at all. No signer error was coming. Then I was told to use starfield root ca and then I downloaded this one-Starfield Class 2 Certification Authority from here -https://aws.amazon.com/blogs/security/how-to-prepare-for-aws-move-to-its-own-certificate-authority/This is working. Can anyone explain to me what's the difference between all these roots ca and why this one is working and not the amazon root ca? And, what's the expiry date of this root ca?ThanksAkhileshFollowComment"

Answer: "0Accepted AnswerHi Akhilesh,Thank you for reaching out.The Starfield Root CA certificate is a publicly trusted root certificate that has been in existence for a while and is present in most standard trust stores. The other Amazon root CAs are also publicly trusted root certificates, but are slightly newer additions to trust stores. As you mentioned, they are cross-signed by the Starfield root to provide a seamless transition while the Amazon root certificates are becoming ubiquitously included in trust stores.The IoT servers will present a certificate chain containing the cross-signed ATS root CA as well as the Starfield intermediate CAs. As per our documentation on server authentication, some clients will allow authentication if and only if the root CA certificate is in the trust store. Using an intermediate certificate on these clients will yield an authentication failure.The Starfield root CA has an expiration date of Dec 31 23:59:59 2037 GMT. CA certificates have an expiration date after which they cannot be used to validate a server's certificate. CA certificates might have to be replaced before their expiration date. We recommend that you make sure that you can update the root CA certificates on all of your devices or clients to help ensure ongoing connectivity and to keep up to date with security best practices.CommentShareAWS-User-9229789answered 3 years ago"


Question: How to disable frame counter check when using AWS Iot for LoRaWAN ABP

"Hello.If the frame counter deviates when using ABP for LoRaWAN, data cannot be received by the security check.The ABP device I am using resets the frame counter to zero every time it is powered on, which is causing the problem.Is there a way to disable the frame counter check like TTN or ChirpStack?FollowComment"

Answer: "1Accepted AnswerHi. There's no way to disable the frame counter check at this time, but you can reset the counter for a device using UpdateWirelessDevice.CommentShareEXPERTGreg_Banswered 4 months agorePost-User-6440101 4 months agoThanks for letting me know.How far off does the frame counter have to be to be rejected for a frame counter to deviate?Share"


Question: Do I need to create a distribution group to use ssl?

"Hello,I am using lightsail to run a wordpress instance.  I have successfully migrated the site to lightsail from a different host.  I have also successfully pointed a domain to the instance.Now, I want to add ssl (http to https) so I ran bitcert without creating a distribution group.The bitcert process went through, but I noticed the site doesn't seem to be stable. Sometimes it will be secure and other times it won't be. At first, I thought that maybe the changes haven't propagated fully but I think it has something to do with not creating a distribution group. I'm not sure.Therefore, in order to use SSL, do I need to set up a distribution group for every site I want to have SSL with lightsail? Or is there something else thatI'm missing?Please advise and thank you..FollowComment"


Question: How to prevent OTP spamming on CUSTOM_AUTH flow using SMS/Email

"I've set up a CUSTOM_AUTH flow within Cognito that generates and sends OTP via sms/text and email.Works quite well, very reliable.However,  this has got me wondering how to approach abuse / spamming.Each time the InitiateAuth action on Cognito is triggered, an OTP is generated and sent via email or text.This could result in abusers spamming the system, causing a lot of message to be sent and driving up costs.Is there any way in which Cognito can be configured to prevent spamming of a CUSTOM_AUTH flow?Alternatively I suppose rate limiting could be achieved by using some kind of persistent storage like dynamoDB. A throttling mechanism could be introduced as part of the define-auth or create-auth Lambda.FollowComment"

Answer: 0Cognito now supports AWS WAF natively. So you can put AWS WAF in front of Cognito and leverage WAF's rate limiting capabilities.[1][1] https://aws.amazon.com/about-aws/whats-new/2022/08/amazon-cognito-enables-native-support-aws-waf/CommentShareAWS-User-7083746answered 9 months ago


Question: SES smtp authentication fail

I am having ses  smtp 535 failed authentication.How do I authenticate my SES credential?  I created a new SES credential to and I have added the username and key to my .env file. however it is failing authentication. I do not know the step that I am missing.I have done:created  new ses credentialI have put password into .env on my website.FollowCommentlp901 9 months agoDoes the STMP host match the region that the SES credential was created for?Share