Question: Customer looking for cost effective way to migrate 200TB of files to EFS IA directly

I am  looking to transfer 200TB of on prem files to EFS IA directly or in the most optimized way. Few questions:1)Is snowball into s3 cheaper than datasync?2)Can snowball be used to copy files directly to efs?3)What is the data journey on the most optimized approach? Example : from on prem to s3. From s3 to efs using data sync.ThanksFollowComment

Answer: "0Accepted AnswerHi Karthik,Snowball is usually cheaper (no per-GB charge), but depending on your bandwidth may take longer, and requires a bit more effort.You will need 3 Snowball Edge Storage Optimized devices for 200TB, at $300 each, vs. $2,560 to copy the data with DataSync (public pricing in us-east-2).All Snow Family transfers land in S3 Standard and have to be copied from there.Most optimized approach is DataSync directly to EFS (Intelligent Tiering so the data lands in Standard for good copy performance and gets tiered down to Infrequent Access).CommentSharekdavydanswered a year ago"


Question: Using Rekognition to process a batch of images on an S3 bucket

"Hey all. I'm looking for guidance on using the AWS CLI to scan a batch of images on an S3 bucket with Rekognition. I've been able to successfully 'detect-labels' on a single image stored on my bucket. The goal is to identify images in adult content and move them into a separate folder to moderate manually. I've not seen anywhere in the docs how to scan a folder, only a single image, and it can't possibly be that I should need to use yet another AWS service to do the same exact operation on a folder instead of a single file? Thanks for reading.FollowComment"

Answer: 1HelloJust curious if you have looked into Lambda to do the processing of those images when they are uploaded? Links to tutorials & blog:https://docs.aws.amazon.com/rekognition/latest/dg/tutorials.htmlhttps://aws.amazon.com/blogs/compute/creating-a-serverless-face-blurring-service-for-photos-in-amazon-s3/CommentSharerePostfanclubanswered a year ago


Question: Plans for more allowing more than 2 other regions for secondary clusters in Elasticache for Redis Global Datastore?

We would like to have more than 2 regions for additional secondary redis clusters for closer geolocated reads in our application. Are there plans to increase this limitation?FollowComment

Answer: "0Hello,Thank you for using Elasticache.As you mentioned, Global Datastore in Amazon ElastiCache for Redis is currently limited to two cross-region replica clusters.We do not comment on launch plans or incoming features. I have submitted your feature request to the Elasticache team, so they can prioritize their work according to customers necessities.I suggest regularly checking https://aws.amazon.com/new (or subscribe to the RSS feed on the same page) for services and features announcements.I am sorry for not being able to provide a more detailed answer at this moment.CommentShareSUPPORT ENGINEERTulio_Manswered a year ago"


Question: AWS Textract security - sharing data

"Hello,I'm exploring security of AWS. My project use AWS Textract to scan invoices and extracts relevant data. When I open FAQ of Textract, I can find there "Q. Are document and image inputs processed by Amazon Textract stored, and how are they used by AWS?"When I read the answer, I'm not sure if I understand, because it looks like Amazon use my invoices and data to improve their existing invoice model. For me, it's unacceptable to use any of my data even for improving their model.The next thing they wrote there is:We do not use any personally identifiable information that may be contained in your content to target products, services or marketing to you or your end users.What does it mean?https://aws.amazon.com/textract/faqs/ThanksFollowComment"

Answer: "3Accepted AnswerThe same document mentions the following - "You may opt out of having your document and image inputs used to improve or develop the quality of Amazon Textract and other Amazon machine-learning/artificial-intelligence technologies using an AWS Organizations opt-out policy. For information about how to opt out, see Managing AI services opt-out policy."CommentShareEXPERTIndranil Banerjee AWSanswered 8 months agoEXPERTAWS-User-Nitinreviewed 7 months agoEXPERTBrettski-AWSreviewed 8 months ago"


Question: Return-Path in Amazon WorkMail

"We've got our e-mail hosted by Amazon WorkMail, and have configured the MAIL-FROM for our domain.We have a particular use case for a 3rd party which is certifying e-mails for particular purposes. In order to authenticate the sender, this 3rd party uses the "Return-Path" header, which needs to match the "Mail-From" header. But the "Return-Path" will use the configured MAIL-FROM (which is a subdomain of our main domain) and a random username.From: user@domain.comReturn-Path: 010203925faf32ae-95c44234-8042-4d27-94c0-9d44d3702d30-000000@mail.domain.comIs there any way that WorkMail can be set up, so that the Return-Path will be the same as the From header?Thanks in advanced for your help!FollowComment"

Answer: "0Hi,I'm sorry to inform you that currently this behavior cannot be changed. I will +1 the feature request for with the service team.Kind regards,RobinCommentShareMODERATORrobinkawsanswered 4 months ago"


Question: Python Boto3 S3 multipart upload in multiple threads doesn't work

"Hello,I am trying to upload a 113 MB (119.244.077 byte) video to my bucket, it always takes 48 seconds, even if I use TransferConfig, it seems that multythread uploading does not work, any suggestions?def upload_to_s3(file_name, bucket,path_s3):    config = TransferConfig(multipart_threshold=1024 * 25,                            max_concurrency=10,                            multipart_chunksize=1024 * 25,                            use_threads=True)    try:        start_time = time.time()        _ = s3_client.upload_file(file_name, bucket, path_s3, Config=config)        elapsed_time = time.time() - start_time        print(f"Time:  {elapsed_time}")    except ClientError as e:        logging.error(e)        return Falsepath_s3  = "something"config = Config(connect_timeout=5,  retries={'max_attempts': 0},max_pool_connections=25) s3_client = boto3.client('s3', aws_access_key_id=ACCESS_KEY, aws_secret_access_key=SECRET_KEY, region_name=REGION_NAME, config=config)# Set here the path of the filepath_file_to_upl = "./data/80e12098-ec85-59db-6e36-82e04e884439.mkv"#Uploadupload_to_s3(path_file_to_upl, BUCKET_NAME,path_s3)With the above code I take 48/49 seconds, if I set use_threads=False the time increases to 71 secondsFollowComment"

Answer: "0Accepted AnswerOne way to check if the multipart upload is actually using multiple streams is to run a utility like tcpdump on the machine the transfer is running on. If multipart uploading is working you'll see more than one TCP connection to S3. If it isn't, you'll only see a single TCP connection.Given that there is a speed difference (48 seconds vs 71 seconds) when you enable/disable multi-threading I think that multipart upload is working.The main reason for using multipart upload is to better utilise the available bandwidth that you have because (in general, and I'm skipping a lot of detail) TCP doesn't use all of the bandwidth due to latency, data windows and so on. Even then, there will be a maximum transfer speed based on the bandwidth available.Is it possible that you are using all of the bandwidth and that 48 seconds is the best time that is possible here? You haven't specified where you're uploading from (EC2 or somewhere external AWS); nor the latency to S3 so it's difficult to tell.I assume that your question is "how can I make my transfer go faster" but without other information it's not possible to say.Adding here because it's neaterAs a measure of "good" I'd try using the AWS CLI to do the same transfer and see what time you get from that.For now, if you can transfer 115 MB in about 48 seconds that puts your upload speed at about 25 Mb/s (assuming very low latency to the region). What is the bandwidth on your home network to the Internet?CommentShareEXPERTBrettski-AWSanswered 9 months ago0I usually upload files that are about 130GB.  It's possible your exception handling might be the problem, too.  Here's the code I use:        config = TransferConfig(multipart_threshold=1000 * mb, max_concurrency=int(psutil.cpu_count() / 2),                                multipart_chunksize=1000 * mb, use_threads=True)        metadata = {'BackupTS': str(tstamp), 'Backup_Info': backup_info}        extra_args = {'Metadata': metadata}        for item in get_files_in_dir(source, mod_time, logging_root):            if item.strip() != '':                copy_response = copy_to_s3(s3, item, destination, str(item)[2:].replace('\\\\', '\\'),                                           extra_args, None, config, tstamp, logging_root)def copy_to_s3(s3, source, destination, key, extra_args, callback, config, tstamp, logging_root):upload_file_response = {}try:upload_file_response = s3.upload_file(source, destination, key, ExtraArgs=extra_args, Callback=callback,Config=config)except s3.exceptions.ClientError as err:    generic_exception_handler("S3 Exception (upload file ClientError)", logging_root)    raise errexcept botocore.exceptions.ClientError as err:    generic_exception_handler("botocore Exception (upload file ClientError)", logging_root)    raise errCommentSharejschwar313answered 9 months agoSaRomano 9 months agoI don't think it's a problem with the try, I tried the code even removing the try but nothing.The code looks the same to me, but for a 115 MB file it takes me 48 seconds.Could there be something I have to do at system level or configure the bucket on S3?Sharejschwar313 9 months agoMy point is that you specify except ClientError, when you should be saying either except s3_client.exceptions.ClientError or except  botocore.exceptions.ClientError or both.  Try that.Sharejschwar313 9 months agoMaybe this will help.  https://boto3.amazonaws.com/v1/documentation/api/latest/guide/error-handling.htmlShareSaRomano 9 months agoThe problem is not exceptionShare0Why do you have the function defined as def upload_to_s3(file_name, bucket,path_s3):, but the call doesn't have three parameters.I use python to upload to S3 regularly with multipart uploads and it seems to work just fine.CommentSharejschwar313answered 9 months agoSaRomano 9 months agoYes sorry the parameter is missing but that's not the problem, I copied and simplified my code just to mention the important parts, I defined another function because I do other things before loading the file. Did you also try with a 115MB file?  My upload is very slow I'm connected via ethernet with 19 Mbps uploadSharejschwar313 9 months agoMy upload rate is about the same, if not a little lower.  It can take more than a day to upload my large files.Share0Also, if you are using multipart uploads, you might want to set a lifecycle rule to delete failed multipart uploads.  They are kept in your s3 bucket and you might be paying for them.  If your costs go down after implementing this, you will also want to ask AWS for a refund of those costs.  Open a case with them.  They will want to know how long back to go in your account for the refund.  It says to use 7 days for the rule, but I would use 1 day, otherwise you'll have to wait 7 days for it to take affect and you'll pay for that storage all that time, too.https://aws.amazon.com/blogs/aws-cloud-financial-management/discovering-and-deleting-incomplete-multipart-uploads-to-lower-amazon-s3-costs/CommentSharejschwar313answered 9 months agoSaRomano 9 months agoI don't have these problems nowShare0My bandwidth is this:If I use the CLI the time is sameCommentShareSaRomanoanswered 8 months agoBrettski-AWS EXPERT8 months agoLooks like 20 Mb/s is the maximum you can get; so your upload speed you're achieving right now is maxing out your connection. No amount of optimisation is going to make it any better.Share0Yes my question is "how can I make my transfer go faster" , I am trying to upload videos of about 115 MB , I am using a classic PC connected to the home network. Yes it seems to me that whatever parameter I put in the method , e.g. threshold or number of threads, the time always remains 48 sec there seems to be something acting as a bottleneck. Do you have any advice?-It seems too long to upload such a small file, I can tell you that I am uploading to an aws region that is the same as the one I am in geographicallyCommentShareSaRomanoanswered 9 months ago"


Question: Simulate conversation with using two different voices?

"Hello.I'd like to turn a text (dialog) into an audio file. Amazon Polly offers a bunch of different languages and voices, but I was not able to find a way to use two different voices (languages) to speak text one after the other to simulate a conversation between two people. Is there any way to do it with Polly?FollowComment"

Answer: "0Unfortunately, no.Amazon Polly is only configured to do one voice at a time.  The developers decided not to support the SSML <voice> tag which would have made it easy to change voices for one encoding.  Microsoft and Google support this so perhaps one day Amazon Polly will, too?For now, you can manually combine two .mp3 files together relatively easily through a Command line. If you do a Bing/Google search you'll find the commands to do this.CommentSharevabtmanswered 2 years ago"


Question: Google BigQuery Connector for AWS Glue

Does connection reading from BigQuery source use TLS/SSL encryption?FollowComment

Answer: "0Accepted AnswerHi,Yes, according to BigQuery documentation, data is encrypted in transit when it moves over the internet.To protect your data as it travels over the Internet during read and write operations, Google Cloud uses Transport Layer Security (TLS)CommentShareMikel Del Tioanswered 11 days ago"


Question: How to achieve data replication between two DBs with no connection between two accounts

"I'm reading the user guide for AWS DMS and in particular there is this pointCreate source and target endpoints that have connection information about your data stores.https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Introduction.HighLevelView.htmlMy use case is to send database replication or snapshots from one AWS account A to another AWS account B. The issue is that the two accounts cannot be connected and I'd preferably send it through the AWS network/backbone. But from this quoted point from the user guide, my impression is I cannot use AWS DMS whatsoever.The two DBs are AWS RDS postgres databases.FollowComment"

Answer: "0This re:Post answer could be an option, though I recommend reading through the limitations listed.https://repost.aws/knowledge-center/rds-snapshots-share-accountCommentSharecyrkanswered 24 days ago"


Question: Cloudwatch Evidently API quota limit

"Hi, I am exploring Cloudwatch Evidently, I see a max of 50 tps for the EvaluvateFeature API. Could this be increased? How this will be used for applications that get higher TPS(like in thousands)?FollowComment"

Answer: "0Hello,it seems to be a hard limit, in the documentation it is not specified, but in the service servicequotas it is not present:https://eu-central-1.console.aws.amazon.com/servicequotas/home/services/evidently/quotasYou could open a ticket to AWSThanksJoelCommentShareJoelanswered a year ago"


Question: AWS CRR Monitoring solution

"HI,a client has implemented the following solution.https://aws.amazon.com/solutions/implementations/cross-region-replication-monitor/No error at installation, however some fields of the dynamoDB table are not updated (replication status being one of them). I have been trying to find what could be the reason but without success.wondering if any one faced the same issue before ?ThanksFollowComment"

Answer: "0Cloudwatch provides the replication metrics as a part of the S3 and needs to be enabled.  It may be a good idea to check if this meets your requirement and build a Cloudwatch dashboard using cross region-cross account which is available oob.https://docs.aws.amazon.com/AmazonS3/latest/userguide/replication-metrics.htmlhttps://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/cloudwatch_xaxr_dashboard.htmlHope this will address the scenario being provided by the solution template.CommentSharePhani_Lanswered a year agoLaurent a year agoThanks Phani, it is true that you can get some details on the replication but not the one requested by this customer. The AWS solution provided works well. I feel it could be permission related in the client set-up.Share0after some troubleshooting, the solution was to update some S3 permissionsCommentShareLaurentanswered a year ago"


Question: Cognito custom authentication flow - initiateAuth giving error

"I am trying to make a custom authentication flow using AWS Cognito so that i can send MFA codes via email instead through the cognito triggers. I am using the  initiateAuth() method to do this which is correct according to the documentation;https://docs.aws.amazon.com/cognito-user-identity-pools/latest/APIReference/API_InitiateAuth.htmlhttps://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/CognitoIdentityServiceProvider.html#initiateAuth-propertyMy payload seems to be valid but when i try login with a user i get the error 't.getauthparameters is not a function'I've had a look through some other stackoverflow posts but nothing is helpingAny ideas what is going wrong?This is a snippet from my code below:const payload = {  AuthFlow: 'CUSTOM_AUTH',  ClientId: 'my client id',   AuthParameters: { USERNAME: $('input[name=username]').val(), PASSWORD: $('input[name=password]').val(), CHALLENGE_NAME: 'SRP_A'  }};cognitoUser.initiateAuth(payload, {onSuccess: function(result) {// User authentication was successful},onFailure: function(err) {// User authentication was not successful},customChallenge: function(challengeParameters) {// User authentication depends on challenge responsevar verificationCode = prompt('Please input OTP code' ,'');cognitoUser.sendCustomChallengeAnswer(verificationCode, this);},        });FollowComment"

Answer: "1Accepted AnswerHi,You shouldn't add CHALLENGE_NAME in your payload and you should use the API cognitoUser.authenticateUser instead of InitiateAuth (since you are using SRP-based authentication then adding a custom challenge).Here is a some what similar example that uses the same SDK that you are tying to use to implement custom auth flow. If you would like to use Amplify instead of the cognito-identity-sdk then here is a blog post that implements something similar.CommentShareEXPERTMahmoud Matoukanswered a year agoSAGE a year agoHey Mahmoud, Thanks for the reply! Followed the similar example you sent me and it has workedSharejavabroom 10 months agoHi Mahmoud, I'm trying to do something similar, but instead of getting the user input from a prompt in the customchallenge callback, I would like to get it from a textbox within the authentication flow itself, similar to this: https://stackoverflow.com/questions/46472827/reactjs-aws-cognito-getting-user-input-mid-execution.Do you know if this is possible via the SDK? Thanks!Share"


Question: Is there any way to get user current location using amplify geo without accessing GPS of device?

"I don't want to implement map to my app, I just want to track user location without gps access. I'm developing app in android platform there are many libraries to acess location but adding libraries for different api level(android version) with if else statements is a big headache for me. So I just want to access location without all headaches so i want to access current location using amplify geo with GPSFollowComment"

Answer: 1Accepted AnswerOne method of geo-location is to use the IP address of the client - but that isn't always accurate and is (at best) accurate to a city.You haven't mentioned what level of accuracy you need - if it needs to be better than that then GPS is the way to go.CommentShareEXPERTBrettski-AWSanswered 8 months agoAmplify_lover 6 months agoI just want to know the country name?ShareBrettski-AWS EXPERT6 months agoMy answer stands: IP address might be able to give you the country name (there are many IP-to-geo databases available) but it's not 100% accurate.Share


Question: Cant login to aws console. Stuck in login loop

Forgot to update the payment for a clients Aws account.. Now services are off ..Payment haven't been made in 3 months. I have to update the account debit card but stuck ..The login page takes me to account suspended page and anything i click there takes me back to login page. Thats Payment and AWS support links.. They all take me back to the login pageFollowComment

Answer: 0Hi i understand that you cant login your account is suspended due to missed paymentsClearly you need to contact the billing team to be able to reinstate your account[1]https://aws.amazon.com/premiumsupport/knowledge-center/reactivate-suspended-account/call support they will be able to resolve your issue[2]https://us-east-1.console.aws.amazon.com/support/home#/case/create?issueType=customer-service&type=account_billingCommentSharerePost-User-9017359answered a year agoAWS-User-0765722 a year agoI have been chatting with billing team and they said they couldn't helpShare


Question: Unable to connect to S3 from EC2 - PHP SDK

"I am having an issue with my EC2 instance connecting to our S3 Bucket.On my ec2 instance, I have php, httpd, aws-cli, aws-sdk installed. I am able to reach the index page where the code is located. Credentials file is set up /usr/share/httpd/.aws/credentialsCode I am using from the Getting Started Basic Usage Guide: https://docs.aws.amazon.com/sdk-for-php/v3/developer-guide/getting-started_basic-usage.html  $sharedConfig = \[      'profile' => 'default',      'region' => 'us-west-1',      'version' => 'latest',      'debug' => true  ];    // Create an SDK class used to share configuration across clients.  $sdk = new Aws\Sdk($sharedConfig);    // Use an Aws\Sdk class to create the S3Client object.  $s3Client = $sdk->createS3();    // Send a PutObject request and get the result object.  $result = $s3Client->putObject(\[      'Bucket' => 'my-bucket',      'Key' => 'my-key',      'Body' => 'this is the body!'  ]);    Using the debug mode results in a large text dump. I believe that the main error belongs to the s3 bucket refusing connection from the code.  Entering step attempt, name 'ApiCallAttemptMonitoringMiddleware' ------   no changes ** Trying 52.219.120.97... ** TCP_NODELAY set ** Immediate connect fail for 52.219.120.97: Permission denied **   Closing connection 0 <- Leaving step attempt, name 'ApiCallAttemptMonitoringMiddleware' --------- error was set to array(13) { \["instance"]=> string(32) "0000000078dd756a0000000053d619cb" \["class"]=> string(28) "Aws\S3\Exception\S3Exception" \["message"]=> string(241) "Error executing "PutObject" on "https://ec2-server-test.s3.us-west-1.amazonaws.com/my-key";   AWS HTTP error: cURL error 7: (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://ec2-server-test.s3.us-west-1.amazonaws.com/my-key" \["file"]=> string(58) "/var/www/vendor/aws/aws-sdk-php/src/WrappedHttpHandler.php" \["line"]=> int(195) \["trace"]=> string(1925) "#0 /var/www/vendor/aws/aws-sdk-php/src/WrappedHttpHandler.php(100)    Curl error 7: Failed to connect() to host or proxy.When connecting via SSH to my instance, I am able to correctly run the aws-cli s3 commands and receive the proper response.This code also works locally on my machine hosting via xampp.I've been looking for the past couple of days to no avail. Thank you for lookingFollowComment"

Answer: "0The issue is that the webserver, httpd, was not able to communicate with outside networks. That's why I could use the aws cli and telnet/ ping from the command line, but it was unreachable from the browser.After running the command setsebool -P httpd_can_network_connect 1, I was able to connect to my s3 buckets.CommentSharerobustoanswered 2 years ago"


Question: 'refusing to create funny ref' error when pushing

"I have a code commit repository, that I am using as a mirror backup for a self hosted gitlab repository. When I try to  git push --mirror to the code commit repository, I am getting the errorremote: error: refusing to create funny ref 'refs/keep-around/12b32218d03ff85ec051a3c0d9bd7272b50b5741' remotely.If I try to delete the above ref, then I get the error for another ref under refs/keep-around. Google bard suggested that AWS does not support refs/keep-around, but that is incorrect because I tried manually pushing some of the refs under refs/keep-around and the error is thrown only for some of the refs.I checked git source for references to funny ref, and it is thrown when the reference name contains invalid characters. And the above ref name is valid, as per the checks.https://github.com/git/git/blob/dadc8e6dacb629f46aee39bde90b6f09b73722eb/builtin/receive-pack.c#LL1466C37-L1466C57https://github.com/git/git/blob/dadc8e6dacb629f46aee39bde90b6f09b73722eb/refs.c#L143 * Try to read one refname component from the front of refname. * Return the length of the component found, or -1 if the component is * not legal.  It is legal if it is something reasonable to have under * ".git/refs/"; We do not like it if: * * - it begins with ".", or * - it has double dots "..", or * - it has ASCII control characters, or * - it has ":", "?", "[", "\", "^", "~", SP, or TAB anywhere, or * - it has "*" anywhere unless REFNAME_REFSPEC_PATTERN is set, or * - it ends with a "/", or * - it ends with ".lock", or * - it contains a "@{" portionWhy is it still failing?FollowComment"

Answer: "3I have added these ref links for your reviewhttps://outlandish.com/blog/how-to-purge-sensitive-data-from-gitlab/https://gitlab.com/gitlab-org/gitlab/-/issues/4894The error message "refusing to create funny ref" typically indicates that Git has encountered a reference name that it considers invalid or unusual.refs/keep-around is one of them and is used internally by GitLab for housekeeping purposes, specifically for preventing certain objects from being garbage collected.using --mirror option with git push can overwrite refs on the remote repository that don't exist in your local repositoryYou could try pushing to CodeCommit without the 'refs/keep-around' references. This can be achieved by using the 'git push' command with an explicit refspec that only includes the refs you want to pushCommentShareEXPERTsedat_salmananswered 23 days agoJoyce Babu 22 days agoThank you for your response.The error message "refusing to create funny ref" typically indicates that Git has encountered a reference name that it considers invalid or unusual.The ref name that is refused, does not contain any unusual characters. I have verified it by passing the ref name to the check_refname_component C function.refs/keep-around is one of them and is used internally by GitLab for housekeeping purposes, specifically for preventing certain objects from being garbage collected.Not every ref under refs/keep-around is failing. So refs/keep-around prefix itself is not the issue.using --mirror option with git push can overwrite refs on the remote repository that don't exist in your local repositoryThis is meant as a additional backup copy, so I want it to be an exact copy. So overwriting is the intended behaviour here.You could try pushing to CodeCommit without the 'refs/keep-around' references. This can be achieved by using the 'git push' command with an explicit refspec that only includes the refs you want to pushI don't mind losing the refs under refs/keep-around, but I don't want it to miss any other ref. Can I do this with a negative refspec, that only exclude everything under refs/keep-around?Share"


Question: General questions regarding RDS SQL Server Read Replicas

"Can I stop/resume replication for a RDS SQL Server Read Replica, like we do with on-prem SQL Server?is there any recommended max db size for a replication to occur smoothly?is there any recommended max source change rate for a replication to occur smoothly?FollowComment"

Answer: "1Accepted AnswerNo. Read replicas for RDS SQL Server are implemented using the built-in Distributed Availability Groups feature in SQL Server. Read replcias do not use the replication feature provided by Microsoft SQL Server.Read replicas have the same size limitations as the primary instance in terms of size. A read replica is created from a snapshot of the source instance upon creation and after that it's synchronized asynchronously. Recommendation is to make sure that the source DB instance and its read replicas are sized properly, in terms of computing power and storage, to suit their operational load. As long as you have comparable instance type/size (RAM, CPU) and storage type (EBS volume type and IOPs), synchronization should be smooth. Similar note in the documentation here.Note that read replicas use asynchronous data movement from the source. So make sure read replicas have similar resources to the primary instance so they can catchup with the rate of change on the primary.CommentShareAWS-User-6759983answered 3 years ago"


Question: Endpoint timing out with curl

"HiI'm having real problems with a VPC endpoint I'm trying to configure in connection with a Managed Blockchain network. Please note, I'm new to AWS.I have reached the stage where I am trying to connect from my client instance to the network via curl or telnet (as per step 3.2 in the link below), and any method I try times out. I have verified that my instances, vpcs etc meet the requirements given in the documentation, and I have attempted restarting the process from the ground up to no avail. I'm confident I haven't missed anything out that's in the documentation, but given my newbie-ness when it comes to AWS generally (and networking too), it's possible I missed something simpler that more knowledgable folks take for granted.I'd appreciate any suggestions for ways to proceed, diagnosis help, or any pages people can point me at with relevant information. Commands which are timing out include (both as per the documentation for step 3.2):curl https://CAEndpointURL:30002/cainfo -kcurl https://CAEndpointURL:30002ThanksMarkhttps://docs.aws.amazon.com/managed-blockchain/latest/managementguide/get-started-create-client.htmlFollowComment"

Answer: "0Accepted AnswerCheck below things.a--Fabric client (EC2 instance is in same VPC used in creating VPC Service endpoint).b--Fabric client (EC2 instance is using same Security Group used in creating VPC Service endpoint).c--Port 30001 to 30004 are allowed in inbound rules in the security group.2ndly there is a mistake in AWS documentation, the 2nd url should be used with telnet, instead of Curl. it should be:telnet CAEndpointURL 30002I have already pointed out this mistake to AWS Support and they confirmed that they will update the documentation.One thing more is that the port is not guaranteed to be 30002, but the exact value will be returned in the get-member API.Edited by: Ikram on Feb 3, 2019 5:59 PMCommentShareIkramanswered 4 years ago0Thanks, it was the security group TCP port not being open that was the issue. In retrospect, it seems clear, but a combination of my own lack of network experience and the documentation not mentioning it meant I missed it. Thank you for the help. I suggest that this be added this to the prerequisites section of the documentation too.CommentShareMarkInSpaceanswered 4 years ago"


Question: RDS MySQL: "table does not exist"

"Hello,Our database hasn't been properly working for a few hours. Users notified us that they couldn't access a page, that's how we noticed.For some reason, a single table from our database logs "table xxx.xxx does not exist". We haven't changed anything that could cause this. It's pretty weird since we can fetch said database name with "SHOW TABLES". However, the schema doesn't seem to load correctly.After trying to restore the database with a couple of backups made by AWS, the error didn't disappear, although the affected table changed?I don't know how to approach this error and the table that it is affecting is critical... please help!RaúlFollowComment"

Answer: "1After messing around and researching all possible options, I managed to solve the error by disabling and enabling foreign key checks.For those that may encounter this error in the future, I noticed that it was due to foreign keys after opening the database error logs and finding the following lines:InnoDB: Load table xxxx.xxxx failed, the table has missing foreign key indexes. Turn off 'foreign_key_checks' and try again.InnoDB: Cannot open table xxxx/xxxx from the internal data dictionary of InnoDB though the .frm file for the table exists. Please refer to http://dev.mysql.com/doc/refman/5.7/en/innodb-troubleshooting.html for how to resolve the issue.RaúlEdited by: misu on Jun 18, 2021 4:24 AMEdited by: misu on Jun 18, 2021 4:25 AMCommentSharemisuanswered 2 years ago"


Question: AWS Config advanced query for EC2 instance backups Report

"Dear All,Can you assist me in obtaining the backup report for an Amazon EC2 instance, I am trying to get it but it is not working properly. The following are the queries I am using.SELECTconfiguration,configuration.Status,configuration.CreationDate,configuration.CompletionDate,configuration.BackupVaultName,configuration.RecoveryPointTags,configuration.BackupSizeInBytes,configuration.ResourceName,configuration.Lifecycle,accountId,resourceId,awsRegion,resourceName,resourceTypeWHEREresourceType IN ('AWS::Backup::RecoveryPoint','AWS::EC2::Instance')ANDconfiguration.CreationDate = date(-24h)FollowComment"

Answer: "0Greetings!It looks like you're attempting to retrieve the backup report for an Amazon EC2 instance using a query. However, there are a few things that could be causing issues with your query. Here are a few suggestions:Make sure you have the necessary permissions: To retrieve backup reports for an EC2 instance, you'll need to have the appropriate permissions in your AWS account. Specifically, you'll need the "AWSBackupServiceRolePolicy" and "AWSBackupServiceLinkedRolePolicy" policies attached to your IAM role. If you don't have these permissions, you won't be able to retrieve the backup report.Check your query syntax: There are a few issues with your query syntax that may be causing problems. First, it looks like you're using "date(-24h)" to retrieve backup reports for the past 24 hours. However, the correct syntax for this would be "date_sub(now(), INTERVAL 24 HOUR)". Additionally, you'll need to specify which columns you want to retrieve in your SELECT statement. Here's an updated query that should work:SELECT backupsizeinbytes, backupvaultname, completiondate, configuration, configurationstatus, creationdate, lifecycle, recoverypointtags, resourcename, resourcetypeFROM "AWSBackup"."<backup_table>"WHERE resourcetype = 'AWS::EC2::Instance' AND configuration.CreationDate >= date_sub(now(), INTERVAL 24 HOUR)Note that you'll need to replace "<backup_table>" with the actual name of the backup table in your AWS account.Check your backup settings: Finally, make sure that backups are actually being performed for your EC2 instance. You can check this by going to the AWS Backup console and verifying that your EC2 instance is included in the backup plan. If backups are not being performed, you won't be able to retrieve a backup report.I hope these suggestions help you retrieve the backup report for your Amazon EC2 instance!Please let me know if i answered your questionCommentShareZJonanswered 3 months agoArts 3 months agoThanks, Zokir, it's not working, there an error on syntax error at line 16, column 62 ( AND configuration.CreationDate >= date_sub(now(), INTERVAL 24 HOUR)) and Error FROM clauses are currently not supported in aggregatorShareZJon 3 months agoIt seems that  AWS Backup does not support running SQL queries directly. To obtain the backup report, you can use the AWS Management Console, AWS CLI, or SDKs. Lets try through the AWS CLI approach.First, make sure you have the AWS CLI installed and configured with the proper access keys and region. If you haven't installed it yet, follow the instructions here: https://aws.amazon.com/cli/Once you have the AWS CLI set up, you can use the following command to list all the recovery points for a specific backup vault:aws backup list-recovery-points-by-backup-vault --backup-vault-name YOUR_BACKUP_VAULT_NAME --query "RecoveryPoints[?CreationDate>=`date -24h`]"Replace YOUR_BACKUP_VAULT_NAME with the name of the backup vault you're using.The command above will return a list of recovery points created within the last 24 hours. You can use additional filters in the --query parameter to further refine the results.Next, to obtain the details of an EC2 instance, you can use the following command:aws ec2 describe-instances --instance-ids YOUR_INSTANCE_IDReplace YOUR_INSTANCE_ID with the ID of the EC2 instance you want to get the details for.You can then parse and manipulate the JSON outputs from the above commands to create a backup report in your desired format. Alternatively, you can use SDKs (e.g., Boto3 for Python) to programmatically access this information and generate the report.Try this and let me knowShare"


Question: RDS for SQL. List of supported system_procedures

"Hi, I have a customer looking for a list of "system procedures for rds for sql". I could locate the one for mysql but not for sql. Can someone point me to a list.FollowComment"

Answer: 0Stored Procedures? Find the list in the link belowhttps://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_SQLServer.htmlCommentShareSandeepVudataanswered a year ago


Question: "Device Farm: Appium iOS test never launches app, WebdriverAgent shows error "Failed to get automation session""

"Problem: my tests are not running and eventually get terminated.  While I see both the app and WDA getting installed in the video, the app will never get launched.Testspec output does not reveal any meaningful info, only shows "Terminated: 15".  Reviewing the syslog output, I'm able to see a couple of issues with WDA:WebDriverAgentRunner-Runner(WebDriverAgentLib)[416] <Notice>: Enqueue Failure: Application 'test.bundle.id.here' has not loaded accessibility /Users/saaandr/Downloads/WebDriverAgent-2.20.8/WebDriverAgentRunner/UITestingUITests.m 38 1andWebDriverAgentRunner-Runner(WebDriverAgentLib)[416] <Notice>: Enqueue Failure: Failed to get automation session for test.bundle.id.here:0: Timed out while requesting automation session for test.bundle.id.here (pid:0)ARN run: arn:aws:devicefarm:us-west-2:223051165180:run:c248fb2e-1df2-4c2c-8499-5bf7523ce683/4e9ab72e-c9d7-4081-ad7d-9341c4d10eb2As far as desired capabilities, I am not modifying anything from the default capabilities.  Also, the testspec yml uses the latest testspec for iOS (v 7.0) as a starting point, modified only with a custom py.test command.This is the behavior that I see when I choose to run test on an iOS14.0, or 13.3.1 device.  Executing the xcodebuild -version command in the install phase of the testspec shows that it is running Xcode 11.7,  which was released back in Sept 2020.  The test run eventually gets terminated by the WebDriverAgentRunner not being able to find the app running.But when I attempt to run on a device with iOS14.8 or 15.x, the setup fails within 2 minutes, since the app cannot be installed due to a resigning issue, similar to this post.Worth mentioning, this same test runs with no problems on an Android device.  Any help is appreciated.FollowComment"

Answer: "0Hi There,Thanks for reaching out through re:Post!Based on the data you have provided, it doesn't seem that the issue is with Appium or the Device ( I double checked there was no issues with the device you used, The TearDown suit completed successfully after executing the test ). The App being installed means Appium already started the session, but seems the failure was caused by the App failing to launch. I am inclined that error "has not loaded accessibility" could be the reason for the session to time out.I am suspecting either the app to be having an issue ( problem launching on a the device OS ) or that Xcode is actually having a bug.Can you please test the same app on a remote session and see if you can launch it with no problems ?If it launch with no issues, please could you check with a different Appium version ( We select a different version of Xcode and WDA based on the Appium version selected ), I would recommend "Appium version 1.16.0 or 1.17.1" for iOS devices running 13.3.1  and 1.18.0 for devices running  OS14.Could you please confirm if your App runs fine locally on the same Appium/ Physical Device configuration ?CommentShareWassimanswered a year agoforchettafork a year agoHello Wassim,Thanks for following up on my post.  I certainly tried the same build on different iOS versions as well via Remote Session.  Here are the arn urls for these attempts:iOS14 on iPhone XR: arn:aws:devicefarm:us-west-2:223051165180:session:78ecb244-3ae4-4676-9491-87a864f87307/2c9a8783-ea97-47b4-9c0b-f056de1409fb/00000On this run I never saw the app icon appear on the screen and I never saw the splashcreen show up.iOS 13.1.3 iPhone 11:  arn:aws:devicefarm:us-west-2:223051165180:session:78ecb244-3ae4-4676-9491-87a864f87307/b4508423-862b-47c0-89b4-ad01bf4a5bc2/00000On this run the app gets installed and you'll see the app launched for a second.  Looks like it crashes immediately after at the 1:36 mark in the video.iOS 15.02 on iPhone 12 Pro:arn:aws:devicefarm:us-west-2:223051165180:session:78ecb244-3ae4-4676-9491-87a864f87307/ef24c59a-cb2b-459d-abcf-36362fb12048/00000The app never launched on this attempt.iOS 13.1.3 on iPhone 11 Pro:arn:aws:devicefarm:us-west-2:223051165180:session:78ecb244-3ae4-4676-9491-87a864f87307/9ae5f68e-246c-4193-809a-855bffea07d8/00000You'll see the app is installed, but it seems to crash at 1:14 in the video.Tried two different .ipa files, both signed for app store distribution.Shareforchettafork a year agoRegarding your question of testing a different version of appium via the testspec file, I will try that next.I can confirm that the same test runs locally on a physical device.  The difference is that in the local environment, I am specifying the .app build within the DerivedData directory.  Locally, I've been using Appium 1.20 and 1.19.1.Is there any guidance in how to sign the .ipa files that get uploaded for automated device farm sessions?  Should it be Adhoc vs. App Store?Share"


Question: How to whitelist an RDS endpoint

"I need to whitelist an RDS Postgres endpoint in my security group. But the form only accepts CIDR block, SecurityGroup ID or Prefix list. How can I work around this?FollowComment"

Answer: "2When you add the security group rule, choose Custom, then input the ID of the RDS's Security Group (sg-abcdefg)https://docs.aws.amazon.com/vpc/latest/userguide/VPC_SecurityGroups.html#adding-security-group-rulesIn this way, you are whitelisting all instance that use that particular Security Group sg-abcdefg (Including the RDS instance)To avoid over whitelisting, I would also suggest creating a dedicated Security Group for the RDS instance.CommentShareRichardFananswered a year ago"


Question: Attach more than one lifecycle configuration to a notebook instance

"I have implemented the auto-stop-idle and persistent-conda-kernels lifecycle configurations and they both work. However, I cannot seem to find how to attach both to a single notebook instance. How can I do that?Lifecycle configuration scripts found in aws sample scripts.FollowComment"

Answer: "0Hi, you'll have to merge both into a single script and attach it to the notebook instance.CommentShareDurga_Sanswered 10 months agorePost-User-3149619 10 months agoI have seen someone create a new script that will run two shell scripts :script 3 : sh script1.sh && sh script2.shbut that would work in normal shell.How could I create a third lifecycle script that runs the ARN paths of the other lifecycle configurations instead? I think copy pasting them all into one is rather unclear.Share"


Question: Change OpenSearch Dashboard domain name

Hi I'm new to AWS and currently using OpenSearch for log analytics. What I want to do is change the domain name. whats the path i should look to change the domain name?Standard one is https://search-mydomain-1a2a3a4a5a6a7a8a9a0a9a8a7a.us-east-1.es.amazonaws.com/cant we change it from search as well.i mean remove search from the URLLike  https://"MyDomain".es.amazonaws.com/FollowComment

Answer: "0Hi,The domain name you have shared is the auto generated one and cannot be changed. Opensearch does allow you to specify a custom endpoint; details for which you can find hereBasically you'll need to provide a new FQDN, SSL certificates and create the corresponding DNS records--SydCommentShareSydanswered a year ago"


Question: Access Lightsail Bucket from AWS Console

I have created an S3 bucket in AWS Lightsail. I want to create an event notification on that bucket to trigger a Lambda. I cannot see the bucket in AWS Console.FollowComment

Answer: "0Hi.Unfortunately there is no option to configure event notifications on Lightsail buckets.Also, you cannot configure event notifications to Lightsail buckets using the S3 API.I thought of an alternative.By periodically syncing event notifications from your Lightsail bucket to a configured S3 bucket, you'll lose a bit of real-time, but you'll be able to trigger detection events in the near future.The verification results are summarized below (sorry it's in Japanese, please translate it)https://dev.classmethod.jp/articles/lightsail-s3-bucket-sync/CommentShareEXPERTiwasaanswered 8 months ago"


Question: not showing information on ec2 instance via public ip after saving them

can anyone help me in this point in awsenter image description hereI was expecting adding all the enter image description here that should be added wih AWSFollowCommentalatech EXPERT3 months agoWrong images?ShareJayanth 3 months agoThere might be some issue with the instance configuration. Have you tried rebooting the instance?Shareadam2040 3 months agohow to launch with Opt out to the old experience in ec2Share

Answer: "0Looks like there might be some configuration mishaps, have you tried rebooting the instance?CommentShareJayanthanswered 3 months agoadam2040 3 months agohow to launch with Opt out to the old experience in ec2Share"


Question: Not receiving Gsuite Emails MX records are not working on AWS.

I am using godaddy domain and Gsuite account for my emails that is connected to godaddy domain. 2 days ago Ive created a hosted zone on route 53 and add that name servers in godaddy by removing their name servers. From that time I am not be able to send or receive emails on my domain emails. Ive updated MX records on route 53 but still no luck.FollowComment


Question: Cache in AWS instance

"Hello,I've created an EC2 instance and used Bitnami image.My setup looks like this:1 EC2 instance T1 VPC1 route table (public hosting zone)1 network ACL1 elastic IP4 security groups all connected to that 1 VPC (3/4 groups are bitnami, 1 is default)1 internet gateway1 DHCP option setI am experiencing issues which could be connected with caching.I thought that by rebooting and even stopping and re-starting the instance would clear the cache, but that doesn't seem to be the case.My question is: how can I check if there are any cache systems like CDN and how exactly I can clear the cache from the server/instance/VPC.Admittedly, I am not an infra expert. For this reason, I'd appreciate very much precise (if possible step-by-step) instructions on how to clear the cache.Thank you!FollowComment"

Answer: "0can you elaborate what is the symptom you are facing?CommentShareNikoanswered 3 months agofibonaccius 3 months agoThanks for your reply. The issue is with translations I am doing in Loco translate, which are not reflected on the site. Workdpress theme developer tested the translation files on their system and it works. They are suspecting it is a caching issue on the server and are asking me to clear all cache. Please let me know if you need any additional information.Share"


Question: CloudWatch logs for our Aurora Cluster using the Management Console

"Is there a way to filter Log Group searches to a Log Stream Name pattern? I know I can do that using the CLI, but it seems the UI only offers all log streams under a group, or a specific one.  The filter seems to be only on the events themselves.Basically does the UI allow me to look at all logs for a given instance?FollowComment"

Answer: "1Accepted AnswerIf you are using a log Insights query, then @logStream is a discovered field.(https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_AnalyzeLogData-discoverable-fields.html).This means you can use it in a filter command, something likefilter @logStream like /xraydaemon/(https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_QuerySyntax.html)CommentShareAWS-SAanswered 10 months ago"


Question: activity timing out on large exception

"As there is 32K limit on activity result I see activities just timing out when result is larger while it is OK for normal cases, in case when activity is throwing an exception I cannot see the error reason.Specifically we are using SWF Java Flow Framework. Besides we use Hibernate with Spring. When data access layer throws  exception, its text (including all the stack) is longer than 32K. In this case we see no activity failure, but just timeout. We could resolve it using custom serializer, but I would prefer a solution using fewer custom components.Is there such a solution?FollowComment"

Answer: 0I'm not sure what generic solution would help here. Due to the size limit some information must be lost. IMHO logging the exception from the activity and returning a different exception that misses the stack trace (or part of it) is a reasonable workaround.CommentSharemfateevanswered 4 years ago0Thank you Maxim!Is there any standard mechanism to implement a "stardard global" exception handler in between completion of activity and activity worker process?Thank youCommentShareAlex2answered 4 years ago0It looks like (https://github.com/aws/aws-swf-flow-library/blob/master/src/main/java/com/amazonaws/services/simpleworkflow/flow/pojo/POJOActivityImplementation.java#L100) that DataConverter is used to serialize the exception. So you can create a custom DataConverter to implement this logic.CommentSharemfateevanswered 4 years ago0Thanks a lot. We'll go that way.CommentShareAlex2answered 4 years ago


Question: Submit EMR serverless jobs from SageMaker notebook

"I am processing a dataset and need to submit a job to EMR serverless for the dataset to be processed in a distributed way.  I have created an application in EMR studio. I would like to submit jobs to that application. I found the command to submit jobsaws emr-serverless start-job-run \    --application-id application-id \    --execution-role-arn job-role-arn \    --job-driver '{        "sparkSubmit": {            "entryPoint": "s3://us-east-1.elasticmapreduce/emr-containers/samples/wordcount/scripts/wordcount.py",            "entryPointArguments": ["s3://DOC-EXAMPLE-BUCKET-OUTPUT/wordcount_output"],            "sparkSubmitParameters": "--conf spark.executor.cores=1 --conf spark.executor.memory=4g --conf spark.driver.cores=1 --conf spark.driver.memory=4g --conf spark.executor.instances=1"        }    }'But how can I run the above command from a Python 3 Data Science Notebook in SageMaker studio. Basically what endpoint do I need to use to submit the job.FollowComment"

Answer: "0Hello,Instead of using the CLI to submit your job, have you tried using the boto3 Python library? https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/emr-serverless.html .  All of the configuration parameters you've shared can be passed in EMRServerless boto3.CommentShareEXPERTChris_Ganswered 8 months ago0Hello,You can use below method to submit job for EMR serverless.=>Running jobs from the EMR Studio console=>Running jobs from the AWS CLIhttps://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs.htmlSubmittion of EMR serverless jobs from SageMaker notebook is not supported yet.CommentShareSUPPORT ENGINEERrePost-User-5788027answered 8 months ago"


Question: Grafana SSO login redirects to public/build/*.js.map

"Grafana suddenly started having this error a couple of days ago when we try to login via SSO and we get Login Failed Internal Server Error. When I look at the console, SSO redirects to a url that matches: https://****.grafana-workspace.us-east-1.amazonaws.com/public/build/1762.43d785e7398c7cdf4250.js.mapFollowComment"


Question: Does an IaaS architecture also include services such as AWS (IoT) analytics?

"Hello,I have a question regarding cloud service types (IaaS, PaaS & SaaS).For an internship, the company I work at has asked me to look into a specific cloud solution. I wish to create a scalable IoT-capable cloud solution for customers.So in turn, I have done quite a bit of research on cloud/edge computing for the past few weeks. However, one thing still confuses me a little.If I used an IaaS cloud architecture, would I still be able to use services like AWS (IoT) analytics, or would this mean it isn't an IaaS architecture anymore?I looked all over, but I can't find an answer for this specific question. I hoped to find some IaaS/PaaS/SaaS cloud architecture diagrams to gain some clarity, but haven't found these.Could someone help me clarify this?Thank you very much!FollowComment"

Answer: "1Accepted AnswerAWS IoT services are indeed used to create scalable IoT cloud solutions for customers.  A typical AWS IoT architecture will combine IoT services (like AWS IoT Core or AWS IoT Analytics) with services for compute (like AWS Lambda), database (like Amazon DynamoDB or Amazon Aurora), and storage (like Amazon S3).You can find example IoT architectures on our IoT Solution Repository.I'm not sure I understand the reason why you're looking to classify the services in those terms, which have different meanings to different people.  Instead, start from the use case that needs to be solved and work backwards from there to understand the most appropriate solution.CommentShareMatt_Panswered a year agoHopTech_vdr a year agoHi Matt,This clarifies it quite a bit for me, thank you very much.I'm quite new with cloud computing. So I first wanted to dive deeply into it, so I could learn all about it.After asking my question, I dove further into services on AWS, which helped me to further understand the differences between the cloud service types.As for why I want to classify the services, I was asked to give the company some advices about which cloud solution works best.Therefore, I really want to make sure I fully grasp everything about cloud computing.Thank you very much for your response and help. I will definitely check out the IoT Solution Repository.This will really enable me to continue working on building an ideal IoT cloud solution for the customers!Share"


Question: CodeBuild project fails on time out. Stuck in QUEUED state

"Since two days ago my codebuild projects that I have not been touching for a while started to fail in us-east-1 region.Example failure from CLI "startTime": "2023-01-09T21:00:13.773000-08:00",            "endTime": "2023-01-10T05:00:28.257000-08:00",            "currentPhase": "COMPLETED",            "buildStatus": "FAILED",            "projectName": "", // reducted            "phases": [                {                    "phaseType": "SUBMITTED",                    "phaseStatus": "SUCCEEDED",                    "startTime": "2023-01-09T21:00:13.773000-08:00",                    "endTime": "2023-01-09T21:00:13.863000-08:00",                    "durationInSeconds": 0                },                {                    "phaseType": "QUEUED",                    "phaseStatus": "TIMED_OUT",                    "startTime": "2023-01-09T21:00:13.863000-08:00",                    "endTime": "2023-01-10T05:00:28.257000-08:00",                    "durationInSeconds": 28814,                    "contexts": [                        {                            "statusCode": "BUILD_TIMED_OUT",                            "message": "Build has timed out in the queued phase"                        }                    ]                },                {                    "phaseType": "COMPLETED",                    "startTime": "2023-01-10T05:00:28.257000-08:00"                }No logs created or any other info given, which makes it hard to debug the issue.Anybody has idea how to debug or what could be the root cause?FollowComment"


Question: How many concurrent total limit of users in IVS Default

Good day i just want to ask what is the total of concurrent user limit in IVS Interactive Video Services as default thanksi read some quotas resource on IVS Docs it seems there is  nothing listed here is the reference thankshttps://docs.aws.amazon.com/ivs/latest/userguide/service-quotas.html#quotas-resourceFollowComment

Answer: "0Thank you for using the Amazon Interactive Video Service. You can find the quota details for concurrent views and streams at Contribution and Playback Quotas positioned below the  Resource Quotas.Highly reviewed IVS quotas are 15000 - Concurrent Views, 100 - Concurrent Streams, 5000 - Channels.CommentShareAWS-Sathia-Saithanyaanswered a year ago"


Question: Unable to create/select existing Security groups while launching DB instanc

"I am trying to launch a MySQL DB instance.I had created the Security group for my RDS instances before I launched them as I wanted to attach the existing SG to multiple instances. But the existing SG does not show up in the section while launching the DB instances.I contacted the support. Since I do not have premium support, the agent had reached out to an engineer and told me to create a new SG while launching, which I am also unable to do since there is no option to create a new one while launching.I have made sure that SGs and instance I am trying to launch are in the same region and same VPC. Since I am new to AWS, I am unable to figure out what the issue might be. I have also attached the screenshots below.Thanks in advanceFollowComment"

Answer: "0It seems that there is a bug in the new RDS creation console (I have just tested here I got the same behavior), you can change back to classic just changing the lw=classic attribute in the URL, as below:<https://ap-south-1.console.aws.amazon.com/rds/home?region=ap-south-1&lw=classic#launch-dbinstance:gdb=false;s3-import=false >Let me know if it works.And in the classic RDS console you can create a new SG during RDS creation too.CommentShareZaccaanswered 3 years ago0Hey,Thanks for looking into this. Yes, the older version of the console allowed to create/choose from existing SG options enabled and worked fine.Will you please let me know how you changed it back to the previous version? In EC2, there is switch in the left to change the console version. Wasnt able to find something similar in RDS console.Thank you in advanceCommentShareHarshaVardhanGanswered 3 years ago0For me in RDS Console page there is a blue banner in the top of the page with a link to switch between both types.If it's not the case for you, maybe you have closed the banner in the X and it does not appear anymore.But if you add "&lw=classic" to the URL, it works the same way. And "&lw=single-page" switches back to the new interface.I hope it solved the issue.CommentShareZaccaanswered 3 years ago"


Question: migrate a linux with overlayfs to AWS

"Has anyone successful migrate a linux VM, which using overlayfs (read only) to AWS EC2?FollowComment"

Answer: "0Hello and thank you for reaching out with your question.In short, YES, it is possible to migrate your Linux VM with overlayfs to AWS. To do this you will need to import your source root disk image as a snapshot to create an AMI (Amazon Machine Image) and then use that AMI to run your EC2 servers. Note, due to the nature of this custom AMI setup, it may require you to debug any issues that may occur when booting up from your end.  I will attach some links to documentation with further information below. https://docs.aws.amazon.com/vm-import/latest/userguide/vmimport-import-snapshot.htmlhttps://docs.aws.amazon.com/AWSEC2/latest/UserGuide/creating-an-ami-ebs.html#creating-launching-ami-from-snapshothttps://docs.aws.amazon.com/AWSEC2/latest/UserGuide/LaunchingAndUsingInstances.htmlPlease reach out if you have any further questions.CommentSharerePost-User-8939786answered 10 months ago"


Question: New WorkMail account cannot connect with Outlook

I have recently setup WorkMail and while webmail works I cannot get Outlook to connect. It fails autodiscover setup even though the DNS entries are present & valid.When I attempt manual setup (I know 2016 & 2019 doesn't technically support it) I get the prompt to allow this website to configure settings only to get an EAS failure "the server cannot be found"FollowComment

Answer: "0HiI have the same difficulty. It seems Microsoft Outlook for Mac does not support Microsoft Exchange?CommentShareContour Mediaanswered 2 months agorobinkaws MODERATOR2 months agoHi,Yes, sadly the free version of Mac Outlook does not support Exchange. For this you will need the licensed version. You can configure this version with IMAP. (Details for configuring can be found hereRobinShareContour Media 2 months agoHi. Yes, I have the premium version and eventually used IMAP. Thank you.ShareContour Media 2 months agoCan you please help with the settings to setup IMAP in Microsoft Outlook App on iOS?I've been trying to use the Help articles to no avail.Article 1: https://docs.aws.amazon.com/workmail/latest/userguide/mobile-client.html#connect_ios_deviceArticle 2: https://docs.aws.amazon.com/workmail/latest/userguide/using_IMAP.htmlShare0I used this article as guide (Setting up EU West):Setting up Microsoft Outlook for Android and iOShttps://docs.aws.amazon.com/workmail/latest/userguide/mobile-client.html#setting_up_microsoft_outlookEmail – Email aliase: email@organisation.awsapps.comPassword –Enter your Amazon WorkMail account password.Server – https://mobile.mail.eu-west-1.awsapps.com/Microsoft-Server-ActiveSyncDomain – Enter your Amazon WorkMail address' domain.Username – Enter your Amazon WorkMail addressCommentShareContour Mediaanswered 2 months ago-1Hi,I'm sorry to hear you're experiencing problems with the outlook set-up. WorkMail does not support EAS connections from Outlook and therefor manual set-up will not work. To troubleshoot your auto discover configuration you can add a mail alias with the awsapps.com to your user and try to configure Outlook with that email address. If successful Outlook will use the primary email address to configure the profile.Kind regards,RobinCommentShareMODERATORrobinkawsanswered 3 months agoMarkG 3 months agoThanks Robin, that does work and makes sense; awsapps.com is not authoritative for our domain. Honestly that's common enough that it should be in the documentation.Share"


Question: ECS network mode bridge not behaving like docker networks

"The ECS developer guide claims...If the network mode is bridge, the task utilizes Docker's built-in virtual network which runs inside each container instance.This appears to be 100% false.  If it were true, a container named "database" would resolve to an IP if I reference it with any application; i.e. behave like an A record was created for me.Is there something that I have control over that would could cause this to NOT work like a docker network?Thanks.FollowComment"

Answer: "3Thanks for the candid feedback. For context, K8s and ECS are not that different. They both have a built in service discovery that can resolve a "service" name. With K8s, if you deploy the core-DNS component, it is done automatically and by default while with ECS you need to click on "Enable Service Discovery" when you create the ECS service. For example if you create an ECS service called mywebapp that fires up 3 ECS tasks underneath and you have defined a namespace called local all other tasks deployed in the cluster will be able to reach either one of those 3 tasks by referencing mywebapp.local. The differences in the networking layer are more substantial. K8s uses a network overlay which on AWS usually means AWSVPC (the same model you'd use for ECS if not using bridge). For ECS we have enabled ENI trunking which allows you to multiplex an ENI for multiple tasks. In addition ECS uses the traditional Docker "bridge" model but service discovery there does not work with standard A records because you need to also declare a port you want to reach (so you have to use SRV records). If I remember correctly Docker allowed internal A record style service discovery in swarm internal networks because they implemented an overlay as well (but I may be wrong I have not been looking into it in ages).  All these techniques described is what Docker implemented in their new CLI under the covers to deploy to ECS. Which is similar to what Compose-X does (as described by John).With all this said, if you feel more familiar and "at home" using K8s (hopefully Amazon EKS), you should totally use it. I will pass on the feedback to the ECS team which will definitely make good use of it. Thanks a lot.CommentShareEXPERTmreferreanswered a year agoTrentonDAdams a year agoYes, and my main point is this creates bad DX (What I call Developer Experience).  It's not behaving like native docker networks.  In native docker, you create a network, place tasks within that network, and they instantly get DNS resolution with "service-name".  In UX, people talk about how it's terrible to make people click more than they need to, for example.  I would expect a service like ECS to automatically create a network and place that task in that network, so that I don't have to do some special thing like creating a "local" discovery service, and referencing by "service-name.local".ShareTrentonDAdams a year agocreating a namespace of "local" doesn't make sense because it could only be used with one ECS cluster.  The namespace names are unique.  For the sake of argument I tried it anyway, and nope, it didn't do anything.  And this makes sense, because bridge mode can't have A records, only SRV records.Share1Accepted AnswerIf both your containers run on the same EC2 node then iirc, you should be able to do the resolve (been a long time since I last used bridge mode with ECS).However, with that said, I would recommend against using the bridge mode (unless there is a strong reason to use it, i.e. to maintain compatibility with running in ECS Anywhere) ?I would very highly recommend to move over to using AWSVPC networking mode, which would allow you to go from running on ECS or Fargate with 0 change in the way you then manage the network access between services (I'd advise on Security Group per service). When using the AWSVPC mode you have a high level of network isolation between containers running on a same host, which could be very valuable from a security point of view.To maintain a docker-compose like naming of services to talk to each other, you can use AWS CloudMap which will automatically work with ECS to register your tasks and associate DNS records accordingly to allow this kind of DNS names resolution.If in case you are using docker-compose locally today and want a way to do docker-compose up but against AWS ECS, try out ECS Compose-X which deals with network configurations, service-to-service ingress, additional AWS Resources, IAM etc. See examples / walkthrough here.Advantage over Copilot  is that you keep full docker-compose syntax compatibility to go from local to cloud. We use it everyday in dev/staging/prod and our devs are very autonomous as a result to do their local testing and without other changes, take it to CICD and therefore into production.CommentShareJohnPrestonanswered a year agoTrentonDAdams a year agoAWSVPC is very limited in the number of ENIs you can use when using smaller instances I think.If both your containers run on the same EC2 node then iirc, you should be able to do the resolve (been a long time since I last used bridge mode with ECS).Nope,this does not work at all.  I'm running two containers in one task to ensure that they are running on the same host, and they can't see each other.I'm seriously thinking that ECS is simply subpar, for one primary reason: The networking consistently works in it's own special way, and nothing like you'd expect for a docker application.  I learned k8s in about 2 days, simply because the network works the way one would expect if they have learned docker/docker-compose. I've been playing with ECS for about 1 to 1.5 weeks and haven't gotten anywhere with how the networking works, because  it's not documented, and my guesses are incorrect.  Not to mention it works entirely differently when run in different ways (EC2 vs fargate).  One of the reasons it takes so long too is that deployments are 5-10 minutes; but that's a general AWS cloudformation problem. Boy I sure hope they fix that.Imagine if ECS container X could resolve container Y, in the same cluster, no matter what mode it was configured to use?  Oh, right, that would be k8s. :DShareTrentonDAdams a year agoI've accepted your answer, because it at least helps validate how convoluted ECS really is.Share1If you run multiple containers in the same task that uses bridge networking, you can reference one container from the other by name by configuring the appropriate links in the container definition.For example, if you have a Task Definition with a container named main and another called sidecar, you can publish the IP address of sidecar in the /etc/hosts file of the main container like so:        "containerDefinitions": [            {                "name": "main",                "links": [                    "sidecar"                ],                ...            },            {                "name": "sidecar",                ...            }         ]In the main container, you will see the IP published:127.0.0.1       localhost::1     localhost ip6-localhost ip6-loopbackfe00::0 ip6-localnetff00::0 ip6-mcastprefixff02::1 ip6-allnodesff02::2 ip6-allrouters172.17.0.4      sidecar sidecar ecs-EcsBridgeContainerNameTestStackTaskDefBF06B5D6-6-sidecar-c2ad99be83f489e00c00172.17.0.5      mainSee also the ECS Task Definition documentation under "Network Settings".CommentShareEXPERTMichael_Fanswered a year agoTrentonDAdams a year agoGood answer, that would probably work; I'm not going back to test it mind you. I'm back to using AWSVPC. But, this is a classic example of how ECS expects you to know "special stuff" to be able to use it.  With k8s, everything works the same way docker does.  i.e. EVERY container can access EVERY other container in the same network, by name, without additional configuration.ShareTrentonDAdams a year agoJust a reminder: "The --link flag is a legacy feature of Docker"Share"


Question: How do DataSync incremental transfers work?

"A customer is planning to use DataSync to copy data to EFS and a question came up about incremental transfers:If a single byte is changed on a source file after an initial transfer, does DataSync transfer the entire file or just the changed bytes during a subsequent transfer? The documentation states only files that have been added, modified, or deleted are transferred. This suggests to me that an incremental transfer copies an entire file if it has changed, not just a delta of changed bytes. Is that the case or does it work like rsync and transfers only the changed bytes?FollowComment"

Answer: "0Accepted AnswerDataSync transfers data at the file level, not at the block level.  So in this case, the full file would be transferred.CommentShareJeff_Banswered 3 years ago"


Question: Use multiple API Gateway authorizers

"Hello All,Is there a way to use multiple authorizers in API Gateway or chain the authorizers. For instance, check the signed headers with the default "AWS IAM" authorizer and check a custom token with a custom authorizer executing a Lambda?If this is not possible, what would be the best way to achieve it?FollowComment"

Answer: "1Accepted AnswerYou can only have a single authorizer on every endpoint. If you need more than one, you will need to use a Lambda authorizer to verify both.In addition to the authorizer you can specify a resource policy, include WAF and use mutual TLS. All pf these apply to all endpoints and they are evaluated in addition to the authorizer.CommentShareEXPERTUrianswered 10 months ago"


Question: AWS Cloudwatch - spamming of Fallback messages

"Just recently we have a webserver cluster having disk space issues, and it's the awslogs.log file.  These are all Ubuntu 20.04 LTS servers, and recently the drives are filling due to the awslogs.log file.  These servers host a bunch of small websites, each vhost writes its own log, but now all the sites are spamming hundreds of warnings per minute with a warning such as;2023-04-12 16:02:24,806 - cwlogs.push.reader - WARNING - 1266967 - Thread-4 - Fall back to current time: {'timestamp': 1681329744806, 'start_position': 1149160L, 'end_position': 1149310L}, reason: timestamp could not be parsed from message.I commented all the sites in the config, so it is just the syslog (not doing it) and just one site and it starts right back.  The odd thing is I am getting real data to cloudwatch, so it's a spam of warnings, then a success like this;2023-04-12 16:02:18,931 - cwlogs.push.publisher - INFO - 1266967 - Thread-3 - Log group: websites, log stream: secure-website.access, queue size: 0, Publish batch: {'skipped_events_count': 0, 'first_event': {'timestamp': 1681329733796, 'start_position': 1148714L, 'end_position': 1148865L}, 'fallback_events_count': 1, 'last_event': {'timestamp': 1681329733796, 'start_position': 1148714L, 'end_position': 1148865L}, 'source_id': 'e15231b897d06bbd6ca96b06bb81994e', 'num_of_events': 1, 'batch_size_in_bytes': 176}Then more spamming.    I am running the CloudWatch agent - 1.247358.0b252413, AWS CLI is aws-cli/2.11.11.Apache Vhost logging looks like this;LogFormat "%h %l %u %t "%r" %>s %b "%{Referer}i" "%{User-Agent}i"" combinedLogFormat "%{X-Forwarded-For}i %l %u %t "%r" %>s %b "%{Referer}i" "%{User-Agent}i"" proxySetEnvIf X-Forwarded-For "^......." forwardedCustomLog "/var/log/apache2/secure.website.com-access.log" combined env=!forwardedCustomLog "/var/log/apache2/secure.website.com-access.log" proxy env=forwardedAnd the AWS conf for this looks like;[/var/log/apache2/secure.website-access.log]datetime_format = %b %d %H:%M:%Sfile = /var/log/apache2/secure.website.com-access.logbuffer_duration = 5000log_stream_name = secure-website.accessinitial_position = start_of_filelog_group_name = websitesAny help or suggestions is appreciated.FollowComment"


Question: Advice for developing locally in python for Greengrass core

"Getting to know Greengrass. My current development flow is to write the code in a Cloud9 session and copy the code to S3. From there I revise my component to use the latest version file and deploy that to a core device (Raspberry Pi in this case). I really hate this since there is quite a bit of friction or doing to get the code to a test core machine. Takes at least 5 minutes to test the simplest change.I am looking for advice on writing code and running so I can get immediate feedback. Two things complicate this a bit:I need to interact with greengrass components in my code.In the case of the Raspberry PI I need to get inputs from the GPIO.The second case is simple, I could just use the keyboard to simulate inputs and when I go to do the final development update the code to use GPIO and test by deploying.I love using GUI development style and really dislike (but sometimes have to) using VIM style development. IDE's have a lot to offer.I am using Windows as my work station.I started experimenting with Jupyter yesterday but quickly ran into the "I don't know what I am doing" wall. I tried to use code that imports import awsiot.greengrasscoreipc and that module cannot be found. I did make my windows machine a core device but not sure what to do next???Anybody have any recommendations for a quicker workflow the write, revise, deploy and test?FollowCommentMassimilianoAWS EXPERT8 months agoHi, when you say that you started using Jupyter, have you deployed Jupyter as a component (eg using the Jupyter Lab component)?Share"

Answer: "0Hi flycast,my preferred way to experiment with component development in Greengrass is to use Jupyter Lab running as a component in Greengrass. You can use Jupyter Lab community component as a starting point. Don't forget to set the accessControl configuration according to which Greengrass IPC APIs you want to use.Once deployed, you need to create an ssh tunnel with the device to forward the remote port on your local machine. Then you can connect to the Jupyter Lab UI on http://localhost:8888 on your workstation.Once in the Jupyter Lab UI, can interact with the device using Python, but you need first to install the awsiotsdk using !pip install awsiotsdk.Cheers,MassimilianoCommentShareEXPERTMassimilianoAWSanswered 8 months agoflycast 8 months agoI was interested in trying that out. There is no Jupyter component listed in public components list in deploy. When I looked at deploying Jupyter It didn't make sense to me. I see you are a contributor at github on this. I see the following:You need to upload both community.greengrass.jupyterlab and community.greengrass.libffi to your account, but you need to include only community.greengrass.jupyterlab in your deployments.Where do I find the files? I don't see them in the project. Where would I upload them to? Can you point me to a tutorial or something?Share0Hi flycast,you find several examples howto develop components in our AWS IoT Greengrass V2 workshop.Cheers,PhilippCommentSharePhilipp Sanswered 8 months ago"


Question: Understanding SES Historic Complaint rate "Percentages"

"Is the SES Complaint rate % based on the overall number of emails sent?For example if I sent 100 emails and had 10 complaints, my Historic complaint rate is 10%.If I send another 100 emails and had 5 complaints, shouldn't my Historic complaint rate decrease to 7.5%?My first email campaign was sent to 5159 recipients & after 30 hours the complaint rate was about 0.36%. This puts me above "Warning" but below "At Risk." I spent a few hours removing all the addresses that bounced or had complaints from my subscription list & acquired new subscribers (all new subscribers must verify emails).A week later I sent another email campaign to the remaining 4915 subscribers and from that number I had less than 10 complaints, but my Historic complaint rate increased. I did some more cleaning on my list but acquired new subscribers.Yesterday I sent a 3rd campaign to 4,948 recipients and again I had less than 10 complaints.My Historic bonce rate decreased, but the Historic complaint rate keeps increasing despite the number of complaints per campaign being less. I am now at 0.46% Historic complaint rate (just 0.04% from being At Risk).I don't believe my Historic complaint rate is being calculated based on a percentage my total emails sent via SES.Am I incorrect?If not, what steps should I take to bring attention to this?Best regards.FollowComment"


Question: AWS Step Functions: how to deal with AWS API endpoints which support pagination

"Hello,I am using AWS Step Functions with the new AWS SDK integrations. I am wondering how to deal with API endpoints which return only a limit number of items like for instance "rds:describePendingMaintenanceActions" so that following requests using the "NextToken" value are required to get all data. Is there any construct/suggestion available how to model this. I am aware that I can use a Choice state in order to check if "NextToken" is empty or not and to act accordingly (go back to the API request step and repeat the whole process with the NextToken value) but this feels somehow clumsy. Thank you very much for any information.FollowComment"

Answer: "0Lambda supports up to 15 min execution time as of October 18, 2018. You could process the next tokens in the function itself.CommentShareRodney Lesteranswered a year ago0We use the same technique: We want to load > 1 million data sets from a database and process it with different lambda functions and do some other stuff with it. Therefore, we use a choice state with a loop within the step functions and have an "iterator" step that is loading new data right after the choice.Seems like I can not add an image here, I'm sorry :)I would NOT go the way Rodney Lester suggests to do the looping in Lambda as you do not have retries over certain batches for example.CommentShareBernhard Keprtanswered a year ago-1Accepted AnswerWhat you suggest is the right way to go at the moment, i.e., run the loop yourself and use a Choice state to check if the NextToken is empty as an exit criteria from the loop. If you need to do it in different places, maybe it is possible to do it with a nested workflow to run the loop.CommentShareEXPERTUrianswered a year agoSoenke Ruempler a year agoLooping by using the NextToken is currently not working within Step Functions and SDK Integration, since the NextToken only works within the same IAM Session, but Step Functions assumes a new IAM Session/Role at each SDK Integration step/task.So the workaround is to call a Lambda which calls the API and the handles possible NextTokens.Share"


Question: Unable to delete my Elastic Beanstalk environment

I can't delete one of my environments because it says "Unable to look up root device name for image 'ami-xxx'". I probably accidentally deleted the AMI while the environment was still spinning up. Now I can't even go into the environment. Is there a way someone from support can delete the environment for me?FollowComment

Answer: "0Can someone from support please look over my request? I would like to delete the environment, but I can't. Thanks.CommentSharednguyen41answered 3 years ago0I figured it out on my own. I just ran the following commands in PowerShell for AWS:To get the EnvironmentId:Get-EBEnvironment | Where EnvironmentName -like "Your environment" | Select EnvironmentIdTo terminate the environment:Stop-EBEnvironment -EnvironmentId xxxxCommentSharednguyen41answered 3 years ago"


Question: Unexplained error setting up policy for S3 Cross-Region Replication

"Hi, I'm following the instructions on this page for setting up the roles for CRR: https://docs.aws.amazon.com/AmazonS3/latest/dev/setting-repl-config-perm-overview.htmlI have a role (we'll call it ReplRole) with the exact trust policy listed on that page, and an access policy that looks like this:{    "Version": "2012-10-17",    "Statement": [        {            "Effect": "Allow",            "Action": [                "s3:GetReplicationConfiguration",                "s3:ListBucket",                "s3:GetObjectVersion",                "s3:GetObjectVersionAcl",                "s3:GetObjectVersionTagging",                "s3:ReplicateObject",                "s3:ReplicateDelete",                "s3:ReplicateTags"            ],            "Resource": [                "arn:aws:s3:::our-s3-bucket-prefix-*",                "arn:aws:s3:::our-s3-bucket-prefix-*/*"            ]        }    ]}It doesn't look exactly like the policy provided, but the main difference is that I use wildcards for the resources specified. I also group the actions together. But if I understand IAM access policies correctly, this should suffice for the purpose.S3 allows me to create the Cross-Region Replication rule, but then I get this error message:The CRR rule is saved, but it might not work.There was an error with setting up the IAM policy for the selected IAM role GobsCrossRegionReplicationRole. Ensure that you have set up the correct policy, or select another role.What did I do wrong?FollowComment"

Answer: "0What I found was that the cross-region replication was actually working, despite the error message. When I checked back the next morning, the objects were successfully replicated to the backup bucket.CommentSharejampanswered 4 years ago"


Question: S3 Multi-region Access Point using Rails Active Storage

"Hi,We are having trouble finding a way to make requests to an S3 Multi-region Access Point (MRAP) using Rails Active Storage (we have no issues using Active Storage to access S3 buckets by their name + region).Any help is much appreciated.FollowCommentmullermp 2 months agoTo use MRAP, you need to install the aws-crt gem and have the latest aws-sigv4 gem. You should be able to use the MRAP bucket ARN as the bucket name, and any region. Do you have a stack trace or any other information that can help debug the issue?Share"

Answer: "0Hello,As mentioned by mullermp@ earlier, you can install aws-crt gem and have the latest aws-sigv4 gem to use the MRAP.https://rubygems.org/gems/aws-crt/https://rubygems.org/gems/aws-sigv4/versions/1.0.0Can you please provide any logs or stack trace to help debug the issue you are facing on your end?CommentShareSUPPORT ENGINEERYash_Canswered 2 months ago"


Question: How does Continuous Backup work?

"Hi everyone, I would like to know how the continuous backup functionality of DynamoDB works. Are there events that are triggering a backup or is there anything else that is causing a backup?Best,jackvFollowComment"

Answer: "0No, there are no events. As the name implies continuous backups is doing just that, continually backing up the database to a secure location on your behalf. You do not have to manage anything for the backups to happen once you enable it.If you want to trigger an on-demand full backup manually or automatically via AWS Backups you can, but that is outside of continuous backups with point in time recovery.CommentShareKirk-AWSanswered 3 years ago0Thank you :) I needed verification of this information.CommentSharejackvanswered 3 years ago"


Question: Help with Athena error: GENERIC_INTERNAL_ERROR: S3 service error

"I am trying to analyze CloudFront standard logs using Amazon Athena. I get the following error after running a query:GENERIC_INTERNAL_ERROR: S3 service errorThis query ran against the "<DatabaseName>" database, unless qualified by the query.Can anyone explain what this error means and how to resolve it?FollowComment"


Question: Increase quota Synchronous payload on AWS Lambda to receive large video file?

"Hi Everyone,Currently we have dedicated microservice API to upload video. this API is not frequently being called by client. Only around 20 times per month. So I plan to move it to Lambda API (with 15 minutes timeout) and integrate it to current Application Load Balancer.So the stack will become like :Application Load Balancer -> Lambda API -> S3I verified already, this lambda API can store small video file like 500 KB, but when I want to upload large video (like 80 MB), I get this error : "413 Request Entity Too Large". Although I set Lambda function memory 2 GB & storage 2 GB.My Question :Do I need to request to increase quota Synchronous payload on AWS Lambda? or maybe any other service quota under AWS Lambda that I need to increase?Thank You.FollowComment"

Answer: "2Hi,For this kind if operation, I would suggest to have the client directly upload to S3. You can even use S3-Accelaration to reduce the upload time a bit (depending on client and bucket location).To grant your client access to S3, you have several choices:You are already using Cognito Identity Pool: Your client will receive temporary credentials upon login. Adapt the role policies to allow S3 PutObject and have the client uploading the file via it's AWS-SDKHave your API return a presigned URL on which the client can do a POST.Have a trigger on S3 (Object Created) that kicks-off a Lambda to process the fileHope this helps,Regards,DanielCommentShareDaniel Mulleranswered 4 months ago2You can't increase the payload size to a Lambda function. The limit is 256KB for asynchronous invocations and 6MB for synchronous invocations (as from ALB).The recommended approach is to generate a presigned URL and upload the file directly to S3 from the client using that URL.CommentShareEXPERTUrianswered 4 months ago0Hi Daniel & Uri,Thanks for the answers. After read your answer, we did some exploration.We plan to use EFS together with existing ECS.Right now, we still exploring how to link those.Thank You.CommentShareAWS-User-6022443answered 3 months ago"


Question: Pearson's OnVue exam client is reported as containing a virus

"Today from my Windows 10 computer I did the Pearson VUE online CCP exam. It involved downloading and installing Pearson's OnVUE-3.6.41.exe client. Windows Defender reported it as containing a virus called "Casdet!rfn". See attached Defender report.Is this a known false positive ?If it is indeed infected then this is big issue particularly because Pearson asks the exam taker to first disable any anti-virus software.Edited by: DeclanMullen on Oct 23, 2019 12:27 AMFollowComment"

Answer: "0Thank you DeclanMullen for your post. I will investigate and provide more information once available.-KimCommentShareKimWD-AWSanswered 4 years ago0DeclanMullen,We have confirmed with Pearson VUE that the Windows Defender block was a false positive and the issue has since been resolved.Thank you again for notifying us of the issue. If you have any questions/concerns about your experience, please, do not hesitate to reach out.-KimAWS CertifcationCommentShareKimWD-AWSanswered 4 years ago"


Question: SSH to new Lightsail instance

"I just started using AWS, and I don't think I have upgraded my Lightsail instance properly  I started out with a free tier small instance running Ubuntu.  It is working just fine, but I had some memory issues and decided to upgrade to the next size up on the free tier.  I followed the instructions in this article:  https://lightsail.aws.amazon.com/ls/docs/en_us/articles/how-to-create-larger-instance-from-snapshot-using-console.  The process seemed to work properly, but I can't connect to the instance directly with the browser-based ssh client.  If I use the browser connection, I get a CLIENT_UNAUTHORIZED [769] error.  I looked at this article:  https://aws.amazon.com/premiumsupport/knowledge-center/lightsail-resolve-ssh-console-errors/, but it didn't seem to apply as both instances are running Ubuntu 22.04.1 LTS and /etc/ssh/sshd_config had CASignatureAlgorithms set to ssh_rsa (CASignatureAlgorithms +ssh-rsa).  If I use PuTTY, I can connect.  What can I/should I do to get the ssh link to work?I tried rebooting, and I tried deleting and recreating the instance.  Neither allowed me to connect with the browser-based ssh client in my lightsail dashboard.  I normally connect with PuTTY, but the original instance was working fine a couple of days ago with the browser-based client.  I've never been able to use the browser-based client to connect to this new instance.Thanks for any help and suggestions--AlFollowComment"

Answer: "0Hello, your problem can be resolve by adding the following properties and values to /etc/ssh/sshd_configTrustedUserCAKeys /etc/ssh/lightsail_instance_ca.pubPubkeyAcceptedKeyTypes +ssh-rsa-cert-v01@openssh.com,ssh-rsaPubkeyAcceptedAlgorithms +ssh-rsa-cert-v01@openssh.com,ssh-rsaCASignatureAlgorithms +ssh-rsaAfter you update the config file, you can run the following command to make sure you have a good configsshd -TAfter that, you can run the following command to restart sshdsudo systemctl restart sshdbrowser based ssh would be recover for your instance.CommentShareyujieanswered 6 months ago"


Question: [Announcement] EMR Studio is now upgraded to JupyterLab v3.1.4

"Amazon EMR Studio is an integrated development environment (IDE) that makes it easy for data scientists and data engineers to develop, visualize, and debug big data and analytics applications written in R, Python, Scala, and PySpark. With EMR Studio, you get fully managed notebooks based on JupyterLab. JupyterLab is the next-generation web-based user interface for open source Project Jupyter. Today, we are excited to announce that EMR Studio is now upgraded to JupyterLab v3.1.4, providing an enhanced user experience and new usability features.With this upgrade, you have the ability to search through the cell outputs in notebooks, view the execution time and duration of a cell, and view the table of contents auto-generated from notebook markdown cells for easy navigation within the notebook. This new version also provides you with a visual indicator to identify cells in which the code has changed since the last execution. This upgrade is automatic and no action is required at your end.EMR Studio is available in US East (Ohio), US East (N. Virginia), US West (Oregon), Canada (Central), Europe (Ireland), Europe (Frankfurt), Europe (London), Europe (Paris), Europe (Stockholm), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), and South America (Sao Paulo) Regions.You can learn more by reading our Amazon EMR Studio documentation, visiting the Amazon EMR Studio detail page, or watching the Amazon EMR Studio demos.FollowCommentNguyen_M SUPPORT ENGINEERa year agoThis is an announcement migrated from AWS Forums that does not require an answerShare"


Question: CORE DNS PODS IN KUBE-SYSTEM NOT WORKING

I have a fargate class in EKS but my Core DNS pods are in a pending state. How do I go about the issue?FollowComment

Answer: "1Hello Joash,By default, CoreDNS deployment manifest will have an annotation eks.amazonaws.com/compute-type : ec2 which will make sure that coredns pods get scheduled only in nodes with EC2 type. As you are trying to run the coredns pods in Fargate nodes, you will have to remove this annotation.To do this manually, use the following kubectl command line interface (CLI) commands, in sequential order, after you create the Amazon EKS cluster:kubectl patch deployment coredns -n kube-system --type=json -p='[{"op": "remove", "path": "/spec/template/metadata/annotations", "value": "eks.amazonaws.com/compute-type"}]'kubectl rollout restart -n kube-system deployment corednsAlso, please make sure that your cluster has a fargate profile available for the kube-system namespace.If you are still having issues after checking the above suggestions, please share the coredns pod describe output.Hope this is helpful!CommentShareSUPPORT ENGINEERVenkat Penmetsaanswered 5 months agoJoash 5 months agoIt was helpful. Thank youDo I need different fargate profiles for my frontend and backend?How can I deploy my backend and frontend in EKS?ShareVenkat Penmetsa SUPPORT ENGINEER5 months agoHey Joash, you can create one fargate profile with a specific namespace and run both your frontend and backend workloads in that namespace to run them on EKS fargate.Share0If any pods are stuck in the Pending state, confirm that your node instance type is listed in limits.goCommentShareAnirban Chakrabortyanswered 5 months ago"


Question: lightsail with LAMP stack with php 8.* or with AMI support

"Hi Team,I am trying to create lightsail instance with LAMP stack with PHP version 8.* support but i do not find it in the available options. Any idea when php 8 will be available and supported on lightsail?Other thing i tried to do is try to use - https://aws.amazon.com/marketplace/pp/prodview-6g3gzfcih6dvu  AMI to create lightsail instance but looks like that's not possible?So considering php 8 is widely used and one of the critical requirement now a days in LAMP stack, it would be good if it is supported as an option in lightsail or allow user to select the AMI to launch lightsail instance similar to EC2.Thank you.FollowComment"

Answer: 0I'll bring up this item as a feature request to our product team for future road map discussion.CommentShareAWS-User-2776000answered a year agoltanase 7 months agoAny news regarding this request? Is there any calendar for upgrading Lightsail Lamp-stack to PHP 8.0 or above?Share


Question: Role is not valid

"Hello everyone,I am using Code Pipeline to trigger a Code Deploy deployment. The setup is working for the same application in 2 other different AWS accounts, but not on the 3rd account.When the deployment is triggered, it fails immediately with "Role is not valid". I have no more information about why the role is not valid.What I already tried that gave me same result:recreate the pipeline with a different nameclone another pipeline and then reconfigure the new onedelete the Code Deploy deployment configuration and recreate ittook the JSON value of a working policy attached to the Role, compared it to the role generated by the pipeline, no differenceschoose a shorter name for my pipeline (and the role automatically generated)--> How to get more information about why the role is not valid ?--> Any suggestions to solve my problem ?I would be very grateful ! ThanksNotes:the deploy action I am triggering is "Amazon ECS (Blue/Green)"I am using this king of setup: https://docs.aws.amazon.com/codepipeline/latest/userguide/tutorials-ecs-ecr-codedeploy.htmlFollowComment"

Answer: "2Hi again,I resolved the issue.After contacting AWS Support I got some suggestion to resolve the issue:"one possible cause of this error is the ECS Task Execution Role, defined in the task definition. It is possible that the arn of the ECS task execution role has an error or typoThis could occur, for example, if the task definition is the same as in another account - the role provided may be from that account."Indeed, the role is cause was not the role used to create the pipeline, or the "ECS Task Execution Role" itself (defined in the AWS account). The problem was the dynamic configuration I was providing to code deploy in "taskdefinition.json". I had to fix the value I provide for the attribute "executionRoleArn".Suggestion to AWS: display a more explicit error message (tell at least which role is in cause).Cheers,TonyCommentSharetonyengineeringanswered 3 years ago0I bumped into the same error message while operating via CI.It turned out that I forgot to assume the user role before calling ECS operation.CommentSharemkalinovitsanswered 2 years ago"