Question: AWS Connect Send Message Via API

"Hey all,When users open an chat and does not do anything for a while (1 hour after last message) I want to send a message to them via API. Is there any way to participate a chat with a known Connect Id? I could not see any method in participation apis. If user does not reply in 15 min. I want to stop chat. I found api for this.Can you help me how can I join an existing chat?Thank you.FollowComment"

Answer: "0Does this help?https://docs.aws.amazon.com/connect/latest/adminguide/chat.htmlIt talks about chat timeouts etc.I assume you can pickup the chat in the connect agent app?  So if the chat is still live, then that must mean you can do something from the flow.  As mentioned above.  It's not really via an api - but you can definitely configure an action to do something at a certain point.CommentSharecodek-dfpanswered a year ago0Hey, Thank you for your answer, but here I have to connect "Wait block" to another block. But in my case, user can stop responding at any moment. (Probably in Lex bot interaction) So I cannot use this feature:(Anyway, thank you for your help :)CommentSharebbolekanswered a year ago"


Question: Can I use the 'WITH' clause in Athena UNLOAD

"I'm trying to run an UNLOAD query that starts with several 'WITH' clauses in Athena, but no matter what I try I keep getting syntax errors, has anyone have been able to run the UNLOAD operation with this kind of queries? (links and/or examples are welcome)Thanks!FollowComment"

Answer: "-1Hello,The below Athena UNLOAD query with the WITH clause worked fine for me.UNLOAD(select * from table)to 's3://bucket/'with(format='parquet',compression='snappy')You can find some examples hereCommentShareSUPPORT ENGINEERChiranjeevi_Nanswered 10 months agorePost-User-8488128 10 months agoThanks for your answer, but I mean the "classic" SQL WITH clause (for aliasing whole queries), not the with clause for adding the UNLOAD options.Something like:WITH table1 as (SELECT raw.field1, raw.field2, raw2.field1, raw2.field1 from raw, raw2 ....),table2 as (SELECT raw3.field1, raw3.field2, raw3.field3 from raw3)UNLOAD (SELECT * from table1, table2 ....)to 's3://bucket/'with(format='parquet',compression='snappy')Share"


Question: I cant create AWS glue crawler

"please tell me what is this error, I have created enough permissions for the role but still can't create crawlerFollowComment"

Answer: 0Is the account part of an organization? You could have an SCP denying you access to Glue crawlers creation.Have you created the IAM role policy or used an AWS managed policy?Have you used the IAM policy simulator to validate your policy.Do you have access to the S3 bucket?What do you see in CloudTrail?CommentShareYair Carelanswered 5 months ago


Question: Transit Gateway and SD-WAN

"A customer would implement a multi account, multi VPC infrastructure and use Transit Gateway to connect all the Account/VPC.The customer would also connect his on-premises dc to the transit gateway by a DX connection.He would use SD-WAN device to improve the connection between the on-premises dc and the AWS cloud.Do we have a reference architecture on how to use SD-WAN devices and transit gateway?FollowComment"

Answer: "0Accepted AnswerHave a look at Aviatrix, they have integration with Transit Gateway:https://aws.amazon.com/blogs/apn/how-to-use-aviatrix-orchestration-of-aws-transit-gateway-for-network-operations-and-compliance/Also consider the recently release Transit Gateway Connect feature: https://aws.amazon.com/blogs/networking-and-content-delivery/simplify-sd-wan-connectivity-with-aws-transit-gateway-connect/CommentShareMODERATORAWS-User-1802700answered 4 years ago"


Question: Current limit of fleets of 0 have been reached.

"When trying to create a new gamelift fleet, the following error occurs:"An error occurred (LimitExceededException) when calling the CreateFleet operation (reached max retries: 2): Current limit of fleets of 0 have been reached."This happens independently of instance type. On the service quota dashboard, the limit is 20. Does anyone have any idea on what could be causing this issue? We have been using gamelift for over a year and this is the first time anything like this has occurred.FollowCommentznnxzz a year agoHello!We are facing the same problem. AWS Support Team keeps sending the boilerplate answer, and it is not helpful at all...Did you manage to solve this issue?Share"

Answer: "-1Thanks for using GameLift. Please follow the below steps to reach out to AWS customer support, and they can help you increase your limits.Go to https://us-east-1.console.aws.amazon.com/support/home?region=us-east-1#/case/createSelect "Service Limit Increase"In "Limit type", select "GameLift"In "Requests", select your region. If you need multiple regions, select "Add another request" and select more regionsIn "Case description", specify the following informationInstance typeDesired limitSubmitCommentShareJamesM_AWSanswered a year agoSmashcart Ultra a year agoThe limit should not be the problem, it's set at the default which is 20. In fact, when I try to increase it, it asks me for a number bigger than 20.Share"


Question: Manage Greengrass-V2 Components in central account

"I'm currently trying to create a component in a tenant account using the artifact packaged in a central account S3 bucket.  The tenant account and central account are in the same AWS Organization. I've tried the following settings to enable the tenant accounts to access the S3 bucket:On the central account S3 bucket (I wasn't sure what Principal Service/User was trying to test this access, so I just "shotgunned" it):{    "Version": "2012-10-17",    "Statement": [        {            "Effect": "Allow",            "Principal": {                "Service": [                    "greengrass.amazonaws.com",                    "iot.amazonaws.com",                    "credentials.iot.amazonaws.com"                ]            },            "Action": [                "s3:GetObject",                "s3:GetObjectVersion"            ],            "Resource": "arn:aws:s3:::MY-CENTRAL-ACCOUNT-BUCKET/*"        },        {            "Effect": "Allow",            "Principal": {                "AWS": "*"            },            "Action": [                "s3:GetObject",                "s3:GetObjectVersion",                "s3:GetObjectTorrent",                "s3:GetObjectVersionAcl",                "s3:GetObjectAcl"            ],            "Resource": "arn:aws:s3:::MY-CENTRAL-ACCOUNT-BUCKET/*",            "Condition": {                "StringEquals": {                    "aws:PrincipalOrgID": "o-abc123def456"                }            }        },        ...    ]}On the GreengrassV2TokenExchangeRole in the tenant account, I've added the AmazonS3FullAccess AWS Managed policy (just to see if I could eliminate this Role as the blocker)I've verified that, as a User in the tenant account, I have access to the object in S3 and can do aws s3 cp as a tenant User (so the bucket policy doesn't seem to be blocking things).Whenever I try creating the Component in the tenant account, I'm met with:Invalid Input: Encountered following errors in Artifacts: {s3://MY-CENTRAL-ACCOUNT-BUCKET/com.example.my-component-name/1.0.0-dev.0/application.zip = Specified artifact resource cannot be accessed}... using either the AWS IoT Greengrass Console and the AWS CLI.What am I missing? Is there a different service-linked role, I should be allowing in the S3 Bucket Resource Policy?It just seems like an access-test during Component creation and not an actual attempt to access the resource. I'm fairly certain if I assumed the Greengrass-TES role, I'd be able to download the artifact too (although I haven't explicitly done that yet).FollowCommentCasey a year agoMore things that don't work:I've tried using a presigned URL (just to see if it's even possible) - doesn't workI've tried adding the following other service principals: ["automation.amazonaws.com","iam.amazonaws.com","credentials.iot.amazonaws.com","iotanalytics.amazonaws.com","account.amazonaws.com","iotevents.amazonaws.com","iotthingsgraph.amazonaws.com","iot.amazonaws.com","access-analyzer.amazonaws.com","greengrass.amazonaws.com","iotsitewise.amazonaws.com"] - don't workI have updated the S3 Bucket Policy to add s3:ListBucket to all the attempted service principals.ShareCasey a year agoI've confirmed using the aws cli that if I assume the GreengrassV2TokenExchangeRole in a tenant account, I can both s3:GetObject and s3:ListBucket on the artifact in the central account.ShareCasey a year agoI even made the artifact bucket public with public access and still can't create a component using the artifact...ShareCasey a year agoThe issue seems to be that my buckets are in us-east-2 and I'm trying to create the components in IoT-Core us-east-1... even within the same account I can't use an artifact from a bucket in us-east-2 to create a component in IoT-Core us-east-1.ShareCasey a year agoTurns out this is purely a region issue. A cross-account S3 bucket can be used to create a component as long as the bucket is in the same region as the IoT-Core you're working in... is this a known thing that I missed?Share"

Answer: 0Accepted AnswerCross account artifacts do seem to work as long as the S3 bucket and IoT-Core regions match. Trying to create a Component in us-east-1 using an artifact from an S3 bucket in us-east-2 does not work (no matter which account the S3 bucket lives in...).@AWS is this a known issue and are there plans to fix this? It doesn't seem like desirable behavior. For now I'll set up cross-region replication in my central account I guess...CommentShareCaseyanswered a year ago


Question: Use CodePipeline variable as State Machine input

"Hi,I need to use CDK to put below variable as state machine input.However, CDK doesn't allow me, since StateMachineInput.literal() only accepts a json object. What should I do?#{OutputVariableFromPreviousStage.OutputVariableKeyFromPreviousStage}FollowComment"


Question: ECS service deployment stuck in deadlock due to deleted target group

"Hi, we recently came across a problem with ECS service deployments, which is in our view a lack of robustness.Our setup roughly looks like this:We have an ECS service, which is reachable via different domains, which may change (even if not often).Due to technical reasons, the requests for the different domains are routed to the service task containers via separate target groups.Changes to the service are done with a deployment configuration allowing a minium of 100% and a maximum of 200%.In the automation, when switching the domains, a target group associated with the service might be deleted before the deployment has deregistered the existing container targets.As a result, the deployment is stuck in a state, where it can't remove the old task anymore.This can be observed in CloudTrail:{    ...    "eventSource": "elasticloadbalancing.amazonaws.com",    "eventName": "DescribeTargetGroups",    "awsRegion": "eu-central-1",    "sourceIPAddress": "ecs.amazonaws.com",    "userAgent": "ecs.amazonaws.com",    "errorCode": "TargetGroupNotFoundException",    "errorMessage": "One or more target groups not found",    ...}We are aware that our solution should handle this situation better, i.e. the target groups should not be deleted too early and we are already looking into this.However we were a bit surprised, that the deployment was completely stuck in this case, blocking all subsequent deployments due to the min/max configuration.Could this be handled in a more robust way on AWS side? And any suggestions how to handle this in our automation? We would not like to have a "polling configuration" waiting for the service tobe in steady state with each change as we would like to keep this async.Thanks in advanceFollowCommentVoesch 2 months agoUpdate: It seems like ECS handles this error correctly, if only one target group is wired to the ECS service.It will print the error event in the events view, but does not get stuck.But if there are e.g. two target groups attached and one of these is deleted prematurely, the situation described above occurs.Share"


Question: Issue with UI

"HiAs of this afternoon I'm experiencing issues with the UI. If I try to upload a new version the "choose file" button is not doing anything. I can see in the console there is a JS error, see below.TypeError: q.diff is not a functionat beanstalk-xp_en.min.js:244at angular.min.js:141at m.$digest (angular.min.js:153)at m.$apply (angular.min.js:156)at k (angular.min.js:107)at v (angular.min.js:113)at XMLHttpRequest.y.onload (angular.min.js:113)(anonymous) @ angular.js:15697angular.js:15697 Possibly unhandled rejection: {}Please help us fix this, there is no other way to update our app. It started happened a few hours ago.Thx.FollowComment"

Answer: 0It was an issue with Chrome. Just make sure your chrome is updatedCommentSharejardinesanswered 2 years ago


Question: Cannot create table with Geojson schema

"Hi there,I'm trying to create a AWS Glue json table using the geojson schema published in https://geojson.org/schema/GeoJSON.jsonI created the schema in the schema registry without problems, however when trying to create a table using this schema I get the errorInvalidInputException (status: 400): Unable to parse the schemaDoes anybody have a clue how can I try to find a solution? (are there any logs that I should consult?)PD: AWS Glue gives the most unhelpful errors everThanks in advance.FollowComment"


Question: EKS Multi Cluster Strategy

"We want to separate applications by accounts for security purpose and billing as well. What's best approach whether create central cluster with workloads in individual accounts communicating through networking medium (TGW, VPC peering / subnet sharing) or separate cluster for each workload ?FollowComment"

Answer: "0There are many ways to design and build a multi-tenant SaaS solution on Amazon EKS, each with its own set of trade-offs. You might employ a cluster-per-tenant model to isolate their tenants. This would have a simple isolation story, but may also come with a hefty price tag.Other is shared compute model where all tenants are combined within the cluster and namespace and isolation is handled at the application level. As this achieves a great deal of operational and cost efficiency, it also represents a less compelling isolation model.In the middle of these two extremes is namespace-per-tenant isolation, where each tenant is deployed into the same cluster but separated from one another using namespaces and a series of native and add-on Kubernetes constructs. This is what’s commonly referred to as a “silo” model where tenant resources are not shared by tenants.The below document will walk through the key architectural elements of the EKS sample architecture. How to isolate tenants within an EKS cluster, automate tenant onboarding, manage tenant identities, and support routing of tenant workloads. https://aws.amazon.com/blogs/apn/building-a-multi-tenant-saas-solution-using-amazon-eks/Further you can refer the below Document for Multi-tenant design considerations for Amazon EKS clusters https://aws.amazon.com/blogs/containers/multi-tenant-design-considerations-for-amazon-eks-clusters/Below is a public guide that covers both the Soft and Hard multi-tenancy and the EKS Shared Responsibility Model: https://aws.github.io/aws-eks-best-practices/ https://aws.github.io/aws-eks-best-practices/security/docs/multitenancy/Hard-tenant design can be achieved creating different namespaces, roles + role bindings, and network policies for this logical separation between tenants.A basic best practice for handling multiple tenants is to assign each tenant a separate namespace. However, keep in mind that, for example in some cases, the same team might need multiple namespaces for hosting different builds of their application. You will be able to block the traffic between namespaces using different network policies.In order to provide proper isolation from users k8s uses a RBAC authorization model, which AWS applies via IAM Users and Roles. It is important to consider while sharing a Cluster, is to set Resource Quotas between the users. This will provide a fair access to the resources that they need (CPU, storage, memory, etc).--- EKS Best Practices Guides // Soft Multi-tenancy - https://aws.github.io/aws-eks-best-practices/security/docs/multitenancy/#soft-multi-tenancy --- EKS Best Practices Guides // Hard Multi-tenancy - https://aws.github.io/aws-eks-best-practices/security/docs/multitenancy/#hard-multi-tenancy--- Multi-tenant design considerations for Amazon EKS clusters - https://aws.amazon.com/blogs/containers/multi-tenant-design-considerations-for-amazon-eks-clusters/When yo use multiple namespaces - https://kubernetes.io/docs/concepts/overview/working-with-objects/namespaces/#when-to-use-multiple-namespaces Network Policies - https://kubernetes.io/docs/concepts/services-networking/network-policies/ Using RBAC Authorization - https://kubernetes.io/docs/reference/access-authn-authz/rbac/ RoleBinding and ClusterRoleBinding - https://kubernetes.io/docs/reference/access-authn-authz/rbac/#rolebinding-and-clusterrolebinding Cluster authentication - https://docs.aws.amazon.com/eks/latest/userguide/managing-auth.html Managing users or IAM roles for your cluster - https://docs.aws.amazon.com/eks/latest/userguide/add-user-role.html Resource Quotas - https://kubernetes.io/docs/concepts/policy/resource-quotas/CommentShareRam_AWSanswered 2 months ago"


Question: To set up elastic search for our MySQL databas

We would like to set up elastic search for our MySQL database. Could you please share the how to references. We are using AWS EC2 instance.FollowComment


Question: Transfer ownership of a NIC (Network Interface Card) to another AWS account

"Is it possible to transfer ownership of a NIC to another AWS account in the same availability zone?For context, I have moved/transferred ownership of an AMI instance and now I want to transfer the ownership of the original NIC associated with the instance, that is to enable us to use the same MAC address association for licensing purposes.FollowComment"

Answer: 1Unfortunately it is not possible to move an ENI to another account. Neither is it possible to define the MAC address for an ENI. Please note: You can create a network interface in a subnet. You can't move the network interface to another subnet after it's created. You must attach a network interface to an instance in the same Availability Zone (has to be in the same account)CommentShareEXPERTTushar_Janswered 9 months agoEXPERTToni_Sreviewed 9 months ago


Question: DMS - Oracle Binary Reader Latency

"When using Oracle as a source for DMS and using the binary reader for CDC, what is the latency of the binary reader reading the REDO logs? Does the binary reader read the REDO logs in real time?FollowComment"

Answer: 0Accepted AnswerPolling frequency is 5 seconds from DMS Replication Instance.CommentShareEjazanswered 5 years ago


Question: AWS TimeStream Does TimeUnit influence the Query performance?

"Hi all,I'm curious if the TimeUnit on the timestamp affects the query performance.For example I have 1M records saved, and I only care about the minute they where saved ( second and bellow are irrelevant to my application ).Would using the TimeUnit as second or miliseconds make any difference in query performance?Kind regards,FazelFollowComment"

Answer: "0Yes, the TimeUnit on the timestamp can affect the query performance. If you only care about the minute the records were saved, then using the TimeUnit as second or miliseconds will make a difference in query performance.When you use a lower TimeUnit, the query engine has to scan more data to find the records that match your criteria. This can lead to slower query performance.For example, if you have 1M records and you use the TimeUnit as second, the query engine will have to scan 60 times more data than if you used the TimeUnit as minute. This can lead to a significant performance difference, especially for large datasets.To improve query performance, you should use the highest TimeUnit that is still accurate enough for your application. In your case, since you only care about the minute the records were saved, you should use the TimeUnit as minute.CommentShareEXPERTsedat_salmananswered a month agoFazel a month agoThanks for your reply,How the Query Engine knows the data unit it's querying against if it's configured per-write?One table can have records of different dataUnits, will it use the smallest of all records in the table?Share"


Question: Cleaning a bucket with purge_s3_path with Glue console.

"With the Glue Console (Glue 3.0 - python and spark), I'm need to overwrite the data of an S3 bucket in a automated daily process. I tried with the glueContext.purge_s3_path(  "s3://bucket-to-clean-path/", { "retentionPeriod": 1, "manifestFilePath": "s3://bucket-for-manifest-path/" } )  function, but it is not cleaning the bucket before sending the data.The idea is to create a process to transform some data, send it to the bucket, sent it to QS throught a manifest and repeat the process daily. All the script works as it should, it is just that the bucket keeps the data from the previous runs.Does someone knows what could be causing this problem?Edit: I tried changing the retention period to one hour (several hours after the data was upload), but it still doesn't remove the files. If I remove the script non relate with emptying the bucket, the job allways takes one minute.In the manifest appears a partition in success and another in failure, but none of them are from the files that should be removed.Example of the partition: run-1639727067782-part-r-00000FollowCommentAWS-User-0992661 a year agoThe problem was due to lack of permissions for deleting objets in the role created for the jobs. Once revised the roles permissions, the query worked correctlySharerePost-User-5193523 a month agoSorry to revive this old thread.Could you help me know how did you setup the permission?Thanks a lot,HaoranShare"

Answer: "0Accepted AnswerUnder options there are two parms.  One is retention period and the other is manifest file.  The retention period is 7 days by default and manifest file path might show what files are deleted successfully and which ones failed.  Hope that helps.  https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-crawler-pyspark-extensions-glue-context.htmlCommentSharejschwar313answered a year agoAWS-User-0992661 a year agoThank you for your help, it gave me a hint of should I look. Unfortunatelly, I wasn't able to fix it yet. It seems like none of the files appears in the manifest folder, just some partitions that I'm not sure of what they represent.Share0Hopefully you worked this out at the time, but I just also hit this issue. It appears you have to over-right the retention period set to 0 to delete immediately.glueContext.purge_s3_path("s3://my_bucket/path_to_purge/", options={"retentionPeriod": 0}, transformation_ctx="")CommentShareDamienanswered a month ago"


Question: Adding SPF to Route53

"Morning All,I'm a beginner with route53 and I need some help about a SPF register.I've a subdomain like : subdomain.domain.com.I've searched throught AWS DOCS how do add it.I tried in route53 to add this following Record Set :subdomain.domain.com   | SPF  |  "v=spf1 include:subdomain.domain.com ~all"But it doesn't work when I tested it (host command on rhel 7).Does anybody can help me please ?Thank you per advance.Edited by: Anth0ny on May 13, 2019 5:01 AMEdited by: Anth0ny on May 13, 2019 5:02 AMFollowComment"

Answer: "0Hi again,After several more searches, I found the SPF type recordset. Now I added:"v=spf1 ip4:xxx.xx.xx.xxx/16 -all"Thank you per advanceCommentShareAnth0nyanswered 4 years ago0Finally I found it !domain.com    |   TXT   |   "v=spf1 ip4:xxx.xx.xx.xxx/16 ~all"CommentShareAnth0nyanswered 4 years ago"


Question: apigateway websocket using posttoconnection in client side

"hello,I'm trying to use apigateway websocket in chat room.Is it okay to use following usecase?join room .get user's connectionids in chat room from lambda.send messages to users in chat room directly, using posttoconnection in client side.I know I can do this, but I was curious about security perspective.Is it okay to give users(I'm using cognito identity role) IAM policy of execute-api:manageconnection directly?FollowComment"

Answer: "0Accepted AnswerHi,I would actually avoid using api gateway for websocket purposes as it gets very tricky and manual to set itu p. You need lambda functions, dynamodb to store sessions etc..I would suggest to take inspiration from serverlessspresso workshop: https://workshop.serverlesscoffee.com/0-introduction/1-overview.html which leverage IOT Core which may be more resilient and better as choice.Hope it helps ;)CommentShareEXPERTalatechanswered a month ago0It does not seem like the right approach. You should send the message to the server and have a Lambda function to send it to the other participant.CommentShareEXPERTUrianswered a month ago"


Question: Sharing My Original Music and Sound FX - Over 2000 Tracks

"Hi everyone,I've created over 2000 tracks of original music and sound fx that you re welcome to freely use in your games. All I ask is to be attributed as indicated on my website:soundimage.org/I sincerely hope some of my work is helpful. :slight_smile:Follow"

Answer: "0@REDACTEDUSERThat's awesome! Thank you for sharing!SharerePost-User-7951591answered 2 years ago0Hi Ajia,You're very welcome! I hope some of my tracks are helpful in your games!  :slight_smile:SharerePost-User-5133794answered 2 years ago0So I’ve finally begun my quest to begin expanding the ambient sounds section of my website… sound effects, too. Both sections really need it and it’s taken much too long to get around to it, but life has been hectic.Anyhow, you’ll find new suburban daytime ambience here:https://soundimage.org/amb-suburban-ambience/And some new sounds effects here:https://soundimage.org/sfx-vehicles/Lots more on the way. Enjoy!SharerePost-User-5133794answered 2 years ago0Greetings Fellow Creatives!This week’s new sounds are on my SFX – Weather page.LIGHT RAIN + THUNDER (1-4)https://soundimage.org/sfx-weather/If you feel that my 2000+ free tracks of music and sound effects are helpful, please consider making a small donation on my website to help support my efforts. Soundimage is 100% community supported.Thanks in advance and have a good week!SharerePost-User-5133794answered 2 years ago0Happy Start of Summer!To kick things off, this week’s new free music tracks are:On my Action 3 page:THE PIXELTOWN GRAND PRIX 2 – (Looping) – More wild fun!https://soundimage.org/action-3/On my Chiptunes 5 page:DOWNTOWN PIXELTOWN – (Looping) – A nice, happy-go-lucky track that might sound nice in an upbeat 2D game.https://soundimage.org/chiptunes-5/And on my Funny 8 page:CARTOON CHAOS – (Looping) – That’s some of the best kind of chaos!https://soundimage.org/funny-8/Fun stuff!So if you find that my 2000+ free tracks of music and sound effects are helpful, please consider making a small donation on my website to help support my efforts. Soundimage is made possible by financial support from the creative community.Thanks and enjoy!SharerePost-User-5133794answered 2 years ago0Hi everyone,This week’s new free music tracks are:On my Fantasy 12 page:“THE LAND OF DESPAIR”https://soundimage.org/fantasy-12/And on my Sci-Fi 10 page:“DIGITAL GRUNGE”https://soundimage.org/sci-fi-10/Don’t forget to check out my higher-quality Ogg music packs containing all of my tracks from various genres. They’re super reasonable and a cool way to support my efforts.Enjoy and have a good weekend!SharerePost-User-5133794answered 2 years ago0Does anyone need some custom music created? My keyboard synthesizers are built for rapid music creation so tracks that used to take days to create can be done in a few short hours. That means a huge cost savings to everyone. Feel free to contact me…I can work with almost any budget.  :-)https://soundimage.org/custom-work/That said, this week’s new free-to-use-with-attribution tracks are:On my Sci-Fi 10 page:“DIGITAL CHATTER”“DIGITAL CHATTER 2”https://soundimage.org/sci-fi-10/And please don’t forget to check out my higher-quality Ogg music packs. Each one contains all of my tracks from a particular genre.Enjoy and have a good week!SharerePost-User-5133794answered 2 years ago0These are so awesome especially for an indie developer, thanks for sharing!SharerePost-User-7108006answered 2 years ago0You're very welcome...I hope some of my music is helpful!  :slight_smile:Hi Folks,I just opened a brand new page, Puzzle Music 7, with this week’s new free tracks:LIGHT PUZZLES 8LIGHT PUZZLES 9LIGHT PUZZLES 10https://soundimage.org/puzzle-music-7/Please know that they don’t have to be used for puzzle-related things…it’s just what came to mind when I created them. Same for all my tracks throughout my site.CUSTOM WORKDoes anyone need some custom music created? My keyboard synthesizers are built for rapid music creation so tracks that used to take days to create can be done in a few short hours. That means a huge cost savings to everyone. Feel free to contact me…I can work with almost any budget.https://soundimage.org/custom-work/Have a good week!SharerePost-User-5133794answered 2 years ago0Greetings Fellow Creatives,This week’s new free-to-use-with-attribution music tracks are:On my Fantasy 12 page:SWEET DREAMINGSWEET DREAMING_v001https://soundimage.org/fantasy-12/On my Puzzle Music 7 page:SNOWY PUZZLERSNOWY PUZZLER_v001https://soundimage.org/puzzle-music-7/And on my Sci-Fi 10 page:GALACTIC RENAISSANCEhttps://soundimage.org/sci-fi-10/Enjoy and have a productive week!SharerePost-User-5133794answered 2 years ago0It’s been a busy week, but I managed to create a couple of cool new music tracks for your projects. They live on my Techno page:"TechnoTronic""TechnoTronic 2"https://soundimage.org/dance-techno/As always, they are 100% free to use with attribution. Attribution information is here:https://soundimage.org/attribution-info/Don’t forget about my higher-quality Ogg music tracks and packs…they really help a lot to support my site.  :-)Enjoy…and please stay safe and healthy.SharerePost-User-5133794answered 2 years ago0Well, another busy week…been working on some client music…but here are a couple of new free music tracks for your projects:On my Puzzle Music 7 page, we have:LIGHT PUZZLES 11 – (Looping)https://soundimage.org/puzzle-music-7/And on my Sci-Fi 10 page:CYBER GRUNGE – (Looping)https://soundimage.org/sci-fi-10/As always, they are 100% free to use with attribution.Enjoy and please share!SharerePost-User-5133794answered 2 years ago0Greetings everyone!Here are some brand new music tracks for ya. Free to use with attribution:On my Funny 8 page, we have:SLIMY WEIRDNESS – (Looping)https://soundimage.org/funny-8/And on my Puzzle Music 7 page, we have:QUIRKY QUARKS – (Looping)https://soundimage.org/puzzle-music-7/Don’t forget about my premium Ogg music packs. They sound great, are super reasonable and can save you a ton of time.Enjoy and please share!SharerePost-User-5133794answered 2 years ago0A SPECIAL REQUESTIf you find my 2000+ tracks of free music and sound effects helpful, please consider making a small donation on my site to help support my efforts. I don't allow advertising on the site because I feel it would be distracting to my visitors so I pay for everything myself and donations from the community really help me a lot.https://soundimage.org/I also have Ogg music packs for sale that are super-reasonable and help to support the site as well.https://soundimage.org/ogg-music-packs-2/Lastly,  if you happen to need some original music created, I do that as well at very low cost to everyone. One of my goals with this project is to make good-sounding music available to anyone. More information is here:https://soundimage.org/custom-work/That said, this week’s new free music track is:On my Epic / Battle page:ANCIENT CRUSADEShttps://soundimage.org/epic-battle/As always, it’s 100% free to use with attribution.Enjoy and please stay safe!SharerePost-User-5133794answered 2 years ago0Lots of stuff going on this week:THEMED MUSIC PACKSThemed music packs are on the way and will be available in higher-quality Ogg format. This should make the task of finding music for your projects a lot easier.NEW HIGHER-QUALITY OGG TRACKSMy Funny/Quirky/Weird page now has higher-quality Ogg versions of the tracks on it. There are some seriously quirky tracks on that page…lol. I’m working on doing the same with my other funny pages.https://soundimage.org/funnyquirky/That said, this week’s new free MP3 music tracks are:On my Chiptunes 5 page:BOARDWALK ARCADE 2https://soundimage.org/chiptunes-5/And on my Puzzle Music 7 page:COOL PUZZLE GROOVIN’ 2https://soundimage.org/puzzle-music-7/I sincerely hope some of my tracks are helpful.  And, as always, feel free to share your projects if you wish…I love to see how creative people are using my music!SharerePost-User-5133794answered 2 years ago0Hey Creatives,Well, I can’t believe August is almost over. Soon Fall will be here (my favorite time of the year.)Anyhow, this week’s new free MP3 music tracks are:On my new Rock page:ROCK DRAMA’80s SUMMERTIMEhttps://soundimage.org/rock/Please don’t forget about my higher-quality Ogg music tracks and packs. They sound great and are a cool way to support my efforts.See you in September!SharerePost-User-5133794answered 2 years ago0Hey Everyone,I have a couple of cool new tracks for you:On my Chiptunes 5 page:CYBERPUNK ARCADE 2https://soundimage.org/chiptunes-5/And on my Sci-Fi 10 page:CYBERPUNK BARShttps://soundimage.org/sci-fi-10/No, I’m not obsessed with cyberpunk music….well…yeah I am…sort of…lol.Anyhow, enjoy (and please consider donating to support my efforts if you can.):-)SharerePost-User-5133794answered 2 years ago0Wow, I can't believe we're half way through September already. After a long summer, I'm really looking forward to some cooler weather.So let's see...More progress with my new Rock page. We have:"SASSY COUNTRY GIRLS""HOMETOWN NOSTALGIA"https://soundimage.org/rock/And higher quality Ogg versions of my tracks are now available on my Funny 2 page.https://soundimage.org/funny-2/As always, my music is 100% free to use with attribution.Enjoy...stay safe...and please share my site!  :-)SharerePost-User-5133794answered 2 years ago0Happy End of September…Halloween will be here in no time!So this week has been very hectic (and it’s not over yet) but I did manage to create a new free music track to add to my new Jazz / Big Band page:BIG BAND MAN – When he’s not out fighting crime, he’s conducting a big band. Pretty cool…and classy, too!https://soundimage.org/jazz-big-band/This track, like my 2000+ other tracks, is 100% free to use with attribution.Attribution information is here:https://soundimage.org/attribution-info/Please stay healthy and I'll see you in October!SharerePost-User-5133794answered 2 years ago0Hey Folks,Another very hectic week (ugh!) but I did manage to create a new free music track to share:ELECTRIC OCEAN SUNSEThttps://soundimage.org/sci-fi-10/As always, it’s 100% free to use with attribution, just like my 2000+ other tracks.Enjoy and keep creating!SharerePost-User-5133794answered 2 years ago0Greetings Everyone,I released 2 new music tracks this week:“GALACTIC POLE POSITION”“RUINS ON RIGEL 3”They’re 100% free to use with attribution, like my 2000+ other tracks.You’ll find them here:https://soundimage.org/sci-fi-10/Enjoy and please share my site!SharerePost-User-5133794answered 2 years ago0Hey there fellow creatives,Here are this week’s new free music tracks:On my Funny 8 page:“SLIME INVADERS”https://soundimage.org/funny-8/On my Horror 2 page:“STRANGENESS IN THE NIGHT”https://soundimage.org/horror-2/And on my Sci-Fi 10 page:“CYBER STREET CRUISING”https://soundimage.org/sci-fi-10/HALLOWEEN MUSICIf anyone needs some Halloween music and sounds, be sure to check out these pages on my site:https://soundimage.org/dark-ominous/https://soundimage.org/dark-ominous-2/https://soundimage.org/horrorsurreal/https://soundimage.org/sfx-creepy/Everything is 100% free to use with attribution.Stay healthy and please share my site!SharerePost-User-5133794answered 2 years ago0Greetings Everyone,This week’s new free music tracks are:On my new Sci-Fi 11 page:CREEPY LAB DRONES (1-3)https://soundimage.org/sci-fi-11/On my Sci-Fi Ambience page:WEIRD LAB LOOPS (1-5)https://soundimage.org/amb-sci-fi-ambience/As always, they’re completely free to use with attribution.If you can, please consider making a small donation on my site to support my efforts.And don’t forget about my Ogg music packs and tracks. They’re a cool way to support my efforts, too.Stay healthy and have a good week!SharerePost-User-5133794answered 2 years ago0Hey Fellow Creators,This week’s new free MP3 music tracks are:On my Dark/Ominous 2 page:“NIGHT THINGS”https://soundimage.org/dark-ominous-2/And on my Sci-Fi 11 page:“UNEASY ANTICIPATION”“UNEASY ANTICIPATION_v001”https://soundimage.org/sci-fi-11/CUSTOM MUSICNeed some custom music created for your project? I try very hard to keep it affordable for everyone. Info is here:https://soundimage.org/custom-work/OGG MUSIC PACKS AND TRACKSFor those of you who are new to my site, many of my tracks are also available in Ogg format.Why use Ogg tracks?They tend to loop better in games.They sound fantastic…almost as good as the original WAV recordings (but are much smaller in size…perfect for games and apps.)They’re a cool way to support my efforts.The MP3 versions, as always, are 100% free to use.So enjoy, stay healthy and keep creating!SharerePost-User-5133794answered 2 years ago0Another busy week, but I managed to get a couple of new tracks done. Free to use, as always, with attribution:On my Funny 8 page, we have:“CARNIVAL OF STRANGENESS”https://soundimage.org/funny-8/And on my Puzzle Music 7 page:“PUZZLE TECHNICA”https://soundimage.org/puzzle-music-7/Enjoy!SharerePost-User-5133794answered 2 years ago0Greetings Creative Souls,This week’s new free-to-use-with-attribution music tracks are:On my Sci-Fi 11 page:CYBERPUNK ARCADE 3https://soundimage.org/sci-fi-11/And on my Rock page:CROSS COUNTRY TRUCKIN’https://soundimage.org/rock/OTHER NEWSI’m working on an Ogg music pack for my Funny/Quirky/Weird music. It shouldn’t be too much longer before it’s done.COMPILATION ALBUMSI’ve had a good number of people from the community tell me that they enjoy listening to my music while doing other things, like coding their games, so I’m considering creating some albums from my music. If anyone has requests or suggestions, feel free to message/email me.Enjoy my free assets…and keep being creative!SharerePost-User-5133794answered 2 years ago0Big News!All 191 music tracks on my Funny pages are now available as higher-quality Ogg downloads. You can download them individually or all-at-once as a music pack. There are lots of chiptunes-style tracks in that collection that would work in 2D games as well as all kinds of quirky, odd and strange pieces that can be used in all kinds of things.Here’s the link:https://soundimage.org/funnyquirky/That said, this week’s new free MP3 tracks are:On my Rock page:“OUTDOOR ADVENTURES”“HAPPY HOUR”https://soundimage.org/rock/Enjoy…and keep creating!SharerePost-User-5133794answered 2 years ago0I'm working on Themed Music Packs in higher-quality Ogg format which I hope will be helpful. This week’s pack is "Fantasy Settings," which contains Earthy-sounding music tracks for locations like villages, bogs, forests, castles and other settings. The tracks are contained in a Zip folder so they can be downloaded all at once. You’ll find it on this page on my site:MUSIC PACKS AND COLLECTIONShttps://soundimage.org/ogg-music-packs-2/Lots more to come!In the meantime, this week’s brand new free MP3 tracks are:On my Chiptunes 5 page:ARCADE ADVENTURES 2https://soundimage.org/chiptunes-5/And on my Funny 8 page:WINDLE’S WHIMSICAL WORLDhttps://soundimage.org/funny-8/Enjoy, and keep being creative!SharerePost-User-5133794answered a year ago0Hi everyone,In keeping with the holiday spirit, I’ve created a couple of new frosty-sounding tracks for your projects. Free, as always, to use with attribution. They are:On my Fantasy 12 page:“MAGIC SNOWFALL”https://soundimage.org/fantasy-12/And on my Puzzle Music 7 page:“ARCTIC PUZZLER”https://soundimage.org/puzzle-music-7/If you can, please consider making a small donation on my site to support my efforts. Soundimage is 100% community supported.Enjoy!SharerePost-User-5133794answered a year ago0Greetings and Happy Holidays!Here are two more frosty-sounding tracks on my Fantasy 12 page:WINTER STAR – (Looping) – Shining bright, watching over the night.FROSTY NIGHTS – (Looping) – So peaceful.https://soundimage.org/fantasy-12/If you can, please consider making a small donation on my site to support my efforts.In the meantime, enjoy my free assets and have a joyous and safe holiday!SharerePost-User-5133794answered a year ago0Greetings!I have some new music to share...free, as always, to use with attribution:On my Chiptunes 5 page:ARCADE ADVENTURES 3 – (Looping) – This one might sound cool in a fast-paced arcade-style space game…or perhaps something else.https://soundimage.org/chiptunes-5/And on my Sci-Fi 11 page:CYBERPUNK HEROES – (Looping) – Superheroes of the future?https://soundimage.org/sci-fi-11/Enjoy!SharerePost-User-5133794answered a year ago0Happy 2022!A big THANK YOU to those of you who supported my efforts in 2021...this wouldn't be possible without you.You rock!That said, here's some brand new free music to start off the new year:On my Fantasy 12 page, we have:"ANCIENT GAME MENU"https://soundimage.org/fantasy-12/And on my Puzzle Music 7 page:"MIND BENDER 2"https://soundimage.org/puzzle-music-7/Enjoy, stay safe and keep creating!  :-)SharerePost-User-5133794answered a year ago0Hey Folks,I had another very busy week, but I did manage to create a new track for everyone:ACOUSTIC ROCK DRAMA – (Looping)100% free to use with attribution, it's on my new Rock page...here's the link:https://soundimage.org/rock/If you can, please consider making a small donation on my site...they really help a lot.Enjoy!  :-)SharerePost-User-5133794answered a year ago0Greetings Fellow Creatives,Please don't forget to check out my Ogg music collections containing hundreds of my tracks in higher-quality Ogg format. They sound great, loop better in game engines and are a cool way to support my site.Right now "Fantasy" and "Sci-Fi" seem to be the most popular but many of my other genres are available as well...so enjoy!That said, this week's new free MP3 tracks are:On my Puzzle Music  7 page:"GLISTENING PUZZLES" – (Looping)https://soundimage.org/puzzle-music-7/On my Jazz/Big Band page:"SLAPSTICK" – (Looping)https://soundimage.org/jazz-big-band/And on my Rock page:"CLOSURE" – (Looping)https://soundimage.org/rock/Stay healthy, have a good week and keep creating!SharerePost-User-5133794answered a year ago0Hi Everyone,This week's brand new free music tracks are:On my Chiptunes 5 page:TECHNOCADE – (Looping)https://soundimage.org/chiptunes-5/And on my Events/Travel 2 page:DREAMING OF ITALYhttps://soundimage.org/events-travel-2/Does anyone need some custom music created? Just give me  a shout!  :-)In the meantime, please stay healthy and safe.SharerePost-User-5133794answered a year ago0Happy February Everyone,To begin the new month, I'm sharing some brand new sound effects and ambient sounds that I recorded. They are 100% free to use with attribution, just like my music tracks. You'll find them on my Urban Ambience page:"STREET AMBIENCE 7""PASSENGER TRAIN ARRIVING AT STATION "https://soundimage.org/amb-urban-ambience/Enjoy and have a good week!  :-)SharerePost-User-5133794answered a year ago0Greetings Fellow Creatives,This week's new free-to-use-with-attribution music tracks are both on my Puzzle Music 7 page:MIND BENDER 2_LoFiPUZZLE TECHNICA_LoFihttps://soundimage.org/puzzle-music-7/Please keep in mind that they can, of course, be used for all kinds of other things besides puzzle games.And please don't forget about my Ogg tracks and collections.Enjoy and keep creating!  :-)SharerePost-User-5133794answered a year ago0Hi everyone,If anyone is interested in checking out some cool videos featuring my music tracks, here's a link to my my YouTube channel:https://www.youtube.com/channel/UC6mnTEE6xP74YcZDpkKGy-A/videosPlease feel free to like and subscribe.That said, more new music tracks are ready for your projects...100% free to use with attribution. They are:SKY PUZZLE_LoFiCOOL PUZZLER_LoFiBUBBLE GUM PUZZLER_LoFiThey all live on my Puzzle Music page:https://soundimage.org/puzzle-music/Attribution information is here:https://soundimage.org/attribution-info/Enjoy...stay healthy and keep creating!  :-)SharerePost-User-5133794answered a year ago0Hey Everyone,Just wanted to share a couple of cool new tracks on my City/Urban pages. They are:"STAGE DOOR"_LoFihttps://soundimage.org/city-urban/"SODIUM VAPOR_v001"_LoFihttps://soundimage.org/city-urban-2/As always, they are 100% free to use with attribution.Enjoy!  :-)SharerePost-User-5133794answered a year ago0Happy March,  Fellow Creatives,This week's new free-to-use-with-attribution music tracks are:"CYBERPUNK HEROES"_LoFi"UNEASY ANTICIPATION_v001"_LoFiBoth tracks live on my Sci-Fi 11 page. Here's  a link:https://soundimage.org/sci-fi-11/Please don't forget about my Ogg music packs and tracks...they're a cool way to help support my efforts.  Donations help a lot, too.Enjoy!  :-)SharerePost-User-5133794answered a year ago0Hi Everyone,I have a bunch of brand new music tracks to share with you. As always,  they are 100% free to use with attribution:On my Drama 3 page:"WHO DONE IT?"https://soundimage.org/drama-3/On my Funny 8 page:"MORE COOKIE HEISTS"https://soundimage.org/funny-8/And on my Positive/Upbeat page:"PICNIC BY THE RIVER""CHUG ALONG, LITTLE ENGINE"https://soundimage.org/positive-upbeat/Please feel free to share my site on social media or anywhere you think it might be helpful.  :-)SharerePost-User-5133794answered a year ago0Hey Fellow Creatives,I've uploaded more free tracks to share with everyone:On my Sci-Fi 11 page:"KEEP MOVING"https://soundimage.org/sci-fi-11/On my Funny 8 page:"EXTRA CHEESE, PLEASE"https://soundimage.org/funny-8/CUSTOM MUSICIf anyone needs some custom music created, I would love to help out. Here's some information:https://soundimage.org/custom-work/Enjoy, please stay safe and keep being creative.  :-)SharerePost-User-5133794answered a year ago0Greetings Fellow Creatives,This week I'm releasing two new tracks on my Chiptunes 5 page..."QUIRKY COIN-OP GAMES""MAIN STREET PIXELVILLE"https://soundimage.org/chiptunes-5/And one on my Funny 8 page:"CRAZY CHASE"https://soundimage.org/funny-8/Please don't forget about my Ogg music collections and tracks. They sound great and are a cool way to support my hard work.Donations help a lot, too.Enjoy, stay safe and keep being creative. :-)SharerePost-User-5133794answered a year ago0Hi Everyone,I had a super-busy week, but I did manage to get a fun track done. You'll find it on my Jazz/Big Band page:SHUFFLIN’https://soundimage.org/jazz-big-band/100% free to use with attribution,  just like my 2000+ other tracks.I sincerely hope some of my tracks are helpful in your projects.  :-)SharerePost-User-5133794answered a year ago0You asked for it, you got it!After receiving numerous requests, my higher-quality Ogg music packs are now available as Zip folders so you can download all of my music tracks at once.  This will be a huge time-saver.Available genres are:Fantasy Music - Over 261 TracksSci-Fi Music - 260  TracksFunny / Quirky / Weird Music - Over 200 tracksPuzzle Music - 130 TracksChiptunes Music - Over 100 tracksAction Music - Over 80 tracksDark/Ominous Music - Over 50 tracksHorror/Surreal Music - Over 50 trackshttps://soundimage.org/ogg-music-packs-2/That said, here's a brand new track to start my Country page:"COUNTRY ROMANCE"https://soundimage.org/country/Enjoy, stay safe and keep being creative!SharerePost-User-5133794answered a year ago0Hey Everyone,Glad to see people are using my new-and-improved Ogg music packs...that's great!I added  another pack this week from my looping music page.https://soundimage.org/ogg-music-packs-2/Please note that my other genres are full of looping tracks as well...these were just the first ones that I created.That said, I have a fun new track to share on my Epic/Battle page:"HIGH SEAS ADVENTURES"https://soundimage.org/epic-battle/Enjoy, stay safe and keep being creative!  :-)SharerePost-User-5133794answered a year ago0Well, it was another crazy busy week (ugh!) but I did manage to create a new production bed to share. Free to use with attribution, you'll find it on my new Country page:"CHUGGIN' THROUGH THE BLUE GRASS STATE"https://soundimage.org/country/Enjoy!  :-)SharerePost-User-5133794answered a year ago0Happy May Everyone,Continuing my quest to build my free ambient sounds library, I've got a  couple of new ones to share:"ELECTRO DRONE""ELECTRO DRONE 2"You'll find them here:https://soundimage.org/amb-sci-fi-ambience/Enjoy,  please stay safe and keep creating!  :-)SharerePost-User-5133794answered a year ago0Hi Everyone,I have a couple of new tracks to share:On my Classical Sounding page:"STRINGS OF SADNESS "https://soundimage.org/classical-sounding/On my Country page:"COUNTRY DOO WOP"https://soundimage.org/country/As always, they're 100% free to use with attribution, just like my 2400+ other tracks.If you can, please consider making a small donation on my site to help support my efforts.  :-)Have a good week and please stay safe.SharerePost-User-5133794answered a year ago0Hi there,Thanks for the Share! Might I suggest sharing it on the Discord now since the forums will be moving around?SharerePost-User-1354821answered a year ago0Hey Finchy, I'm already beginning to do that...but thanks for the suggestion!Greetings Fellow Creatives,I've got some brand new sounds to share...100% free to use with attribution, just like my music tracks. You'll find them on my SFX - Weather page:RAIN AND THUNDER – OUTSIDERAIN AND THUNDER – THROUGH WINDOWRAIN TAPPING ON METAL CHIMNEYhttps://soundimage.org/sfx-weather/Enjoy and keep being creative!  :-)SharerePost-User-5133794answered a year ago0Hi Everyone,I had another super-busy week (I seem to be having a lot of those lately) but I did manage to create a fun new music track to share with you:"SHUFFLIN' THROUGH CENTRAL PARK"It's on my City/Urban 3 page...here's the link:https://soundimage.org/city-urban-3/As always, it's 100% free to use with attribution. Attribution information is here:https://soundimage.org/attribution-info/Enjoy and please stay safe.  :-)SharerePost-User-5133794answered a year ago"


Question: Accessing Grafana through IAM Identity Center Account in Organization

"Hi,we have an existing Grafana environment in one of our AWS accounts and were previously able to login to Grafana through the assigned user from the IAM Identity Center in the same account.We have now restructured our AWS organization by introducing a new management account which now hosts the IAM Identity Center. Assignments have been updated and the new user is assigned in Grafana as Admin. Unfortunately, we are now unable to sign in to Grafana with IAM Idendity Center. We get "Login Failed - internal server error".Is somebody able to help us with this issue?Thanks!ManfredFollowComment"

Answer: "0There are a few potential causes for this error message when trying to sign in to Grafana using IAM Identity Center. Some possible solutions include:Ensure that the IAM role that you are using to sign in to Grafana has the correct permissions.Check that the IAM Identity Provider that you are using is properly configured in Grafana.Check that the Grafana server is running and accessible.Check the Grafana server logs for more information on the error.Make sure that the IAM user you are trying to sign in with has the correct permissions in IAM.It's important to check the grafana server log to understand more about the error, because it could be a internal error with Grafana, with the IAM role or with the IAM user.CommentShareEmmanuel Oluwayemisianswered 4 months agoManfred 4 months agoHi Emmanuel,thanks for your response! Could you please let us know where we can find the Grafana server log if we are unable to access Grafana. Currently, we only have access to the AWS Grafana Workspace management tool.Thanks! ManfredShare0Hi,can somebody please let us know where to find the Grafana server log, when unable to access Grafana.Thank you!ManfredCommentShareManfredanswered 4 months ago0We had almost exactly the same problem with our Managed Grafana instance.  We changed some groups and permissions with our users in IAM Identity and only one of our users could no longer login.  We received the same 500 Internal Server Error message toast.After reviewing and comparing permissions between users, we found no differences.  The solution that worked for us was to delete the user from within Grafana (but not in IAM Identity), and then login to Grafana again with that user. The user was automatically re-created in Grafana and everything is now working as expected.Our team has searched extensively through the AWS and Grafana documents and the Github repo for Grafana, but we have not found any documentation on how AWS creates and/or syncs users when an IAM Identity (previously SSO) user logs into Managed Grafana.GL Manfred, HTH!CommentSharealways-writing-softwareanswered 4 months ago"


Question: Unknown SQS message creation

"I'm having an issue where I have a lambda function triggering off an SQS message, and something seems to have gone rogue and I can't kill it. I need to understand what's causing the SQS messages to  get created, and my attempts to debug haven't resulted in anything yet.Current known things:I've completely killed my client (localhost, since I'm in development mode), so nothing should be initiating new calls. In fact, the last record of calling the API that creates SQS jobs was triggered hours ago. That function does not have any loops in it.Monitoring in SQS seems to indicate that messages are being added to the queue ~8 times/minuteFrom the logs that my triggered lambda function is sending, it looks like those messages were initiated from client calls that happened hours ago.I've tried looking for SendMessage and SendMessageBatch in CloudTrail, and I can't seem to find those records, so something is off there, but I've tried creating a new trail with all management events, and nothing is showing upI'd really like to see if I can find more information about what's causing the SQS queue to get called so many times. Any pointers are appreciated.FollowComment"

Answer: "1Have you tried disabling your Lambda to see if messages continue to be created?Are you sure your Lambda is correctly processing and deleting messages, so it's not just messages that are reappearing after reaching the visibility timeout?CommentShareEXPERTskinsmananswered 2 months ago"


Question: can i connect newly installed LDAP server on ec2 instance with Azure AD

"Hello,recently i am facing one challenge while migrating on application to AWS env. Use case is like I have Azure AD set up already bt we cant directly access it due to it seems like it does not support LDAP , so we were thinking to have config like to creating new LDAP server on linux instance in AWS and somehow sync up the Azure AD with it and then use those LDAP server credentials in my Application.But after some try I am not able to find a proper way to achieve this, I am wondering if anyone can help me with that or at least suggest is it possible or not, if not what can be an alternate way to achieve this.FollowComment"

Answer: "0You are correct that Azure AD does not support LDAP directly. However, you can achieve your goal by using Azure AD Domain Services (AAD DS), which provides a managed domain service with LDAP support.https://learn.microsoft.com/en-us/azure/active-directory-domain-services/tutorial-configure-ldapsFirst, you need to enable AAD DS for your Azure AD directory.Configure a VPN or ExpressRoute connectionOnce you have the network connection established, set up your LDAP server on the AWS EC2 instance to use Azure AD Domain Services as a backend. Use the AAD DS domain and credentials to configure your LDAP server.CommentShareEXPERTsedat_salmananswered a month agoShriram a month agoThanks for the reply :)what i understood is,first I need to configure Azure AAD for my already created ADthen I need to connect my Azure network with vpc of AWS account where I need to set up LDAP server and configure it to use Azure AAD as a backendCan you please share any references to achieve this step 2 and step 3?i will really appreciate..Share"


Question: "Is this specific board "ESP32-S2-DevKitC-1" compaitble with IoT Core, FreeRTOS Quick Connect and setup, etc?"

"this page explains how to easily connect. Does this also work with DevKitC-1 or only DevKitC-4? Does my specific devboard support quick connect and all the benefits listed here?I don't have much experience, so any help would be greatly appreciated.FollowComment"

Answer: "2Accepted AnswerHi. As you have an ESP32-S2, I think you'd be better of with this (similar) guide: https://docs.aws.amazon.com/freertos/latest/userguide/getting_started_esp32-s2.htmlThat targets the ESP32-S2-Saola-1 board which has a different MCU than yours. Your specific board is not supported out of the box by the reference implementations in the amazon-freertos repo. Besides the AWS documentation pages, you can see the supported boards here: https://github.com/aws/amazon-freertos#freertos-qualified-boardsAnd here are the CMake recipes for the supported ESP32 boards:https://github.com/aws/amazon-freertos/blob/main/vendors/espressif/boards/esp32s2/esp32s2_saola_1.cmakehttps://github.com/aws/amazon-freertos/blob/main/vendors/espressif/boards/esp32/esp32_devkitc.cmakehttps://github.com/aws/amazon-freertos/blob/main/vendors/espressif/boards/esp32/esp32_plus_ecc608a_devkitc.cmakehttps://github.com/aws/amazon-freertos/blob/main/vendors/espressif/boards/esp32/esp32_wrover_kit.cmakeYour board has the ESP32-S2-SOLO MCU, which is a different MCU than the Saola. More on the ESP32-S2 boards here: https://docs.espressif.com/projects/esp-idf/en/latest/esp32s2/get-started/index.html#hardwareI suspect it's not a lot of work to adjust the Saola build to suit, but I've not done it before (and may be underestimating!). I think, at minimum, you would need to make an esp32s2_devkitc.make that was similar to esp32s2_saola_1.cmake. Then follow the esp32-s2 instructions, adjusting as appropriate.Does my specific devboard support quick connect and all the benefits listed here?No, that MCU is quite different. It has a secure element for example.CommentShareEXPERTGreg_Banswered a year ago0Thank you for the thorough and clear answer, it is very helpful!Do you happen to know the difference between the ESP32S2-Saola-1, ESP32-DevKitC, or ESP-WROVER-KIT? Which one of these is the most compatible with AWS?Again thank you so much for the helpCommentSharerePost-User-0536516answered a year agoGreg_B EXPERTa year agoDo you happen to know the difference between the ESP32S2-Saola-1, ESP32-DevKitC, or ESP-WROVER-KIT?It's best to consult the Espressif documentation for that.Which one of these is the most compatible with AWS?They are all compatible with AWS. Most of the AWS libraries (in FreeRTOS LTS and the Embedded C SDK) are pure ANSI C, and hence portable to almost any MCU on the market (with sufficient Flash and RAM). Additionally, you can don't even have to use FreeRTOS or the AWS libraries/SDKs to connect to AWS IoT Core; almost any MQTT client will do.Share"


Question: Corretto 11 with Tomcat 8.5 AL2 version 4.2.9 Updates for latest log4j hotpatch 1.1-12

Corretto 11 with Tomcat 8.5 AL2 version 4.2.9 was recently released including the log4j-cve-2021-44228-hotpatch.noarch 1.1-9-amzn2 patch however our deployments are failing.  Standalone AL2 Tomcat 8.5 builds outside of Elastic Beanstalks succeed since they include 1.1-12.amzn2 log4j patch.  How can I find out when Corretto 11 with Tomcat 8.5 AL2 version 4.2.9 will be updated to include 1.1-12.amzn2 patch.  We are on hold for all production deployments until the Beanstalk AMI is updated.FollowComment

Answer: "0Guess you have already solved this issue, but just in case. We have just moved to Tomcat 8.5 Correto 11 4.2.11 and our deployments work just fine.We had the same issue 2 months ago with  Tomcat 8.5 Correto 11 4.2.9 and had to stick with Tomcat 8.5 Correto 11 4.2.8 till the problem was solved.CommentShareAWS-User-9094158answered a year ago"


Question: Billing - Amazon Elastic Compute Cloud T3ACPUCredits Charges

I am seeing increasing CPUCredit charges in my bill despite all instances having sufficient CPU credits. Could someone explain the reason for this charge?FollowComment

Answer: 0Accepted AnswerIt's possible that these instances are bursting during specific times and expending the credits. I would suggest reviewing this in CloudWatch and maybe setting an alarm to notify you when it happens.https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/burstable-performance-instances-monitoring-cpu-credits.htmlCommentShareDavidanswered 24 days ago0I found the issue with one of the instances. Thanks for providing guidance on how to track the CPU credit usage on cloudwatch.CommentSharerePost-User-6419936answered 24 days ago


Question: One or more domains requested are already associated with another Amplify

Hi!I am trying to link my amplify app to my google domain but i get the following error. Does anyone have any idea?Thanks!One or more domains requested are already associated with another Amplify app: xxxxxmydomain.comFollowComment

Answer: "0Hi,You should check if you have a similar Amplify app associated to same domain in same account or another account.  If you cannot find the app that is associated with those domains, you can create a ticket with AWS Support (https://aws.amazon.com/contact-us/), so they can help you removing the association that fits your needs best.Hope it clarifies.CommentShareEXPERTalatechanswered 4 months ago"


Question: Simple Join query errors out with "table not found"

"I'm trying to join a simple "spine" table with a "feature" table. The spine table may or may not have additional columns besides the join key. If there are additional columns (in this case, random_column), the following query works fine (please note that these queries are self-sufficient. they don't depend on any external tables - all tables are inline created by the query itself):with spine_table as(select 'abc' as user_id, 'random_value' as random_column),feature_table as(select 'abc' as user_id, '123' as feature_column)select user_id, spine_table.*, feature_column    from spine_table    join feature_table    using (user_id)If, however, there's no additional column, the query throws an exception:with spine_table as(select 'abc' as user_id),feature_table as(select 'abc' as user_id, '123' as feature_column)select user_id, spine_table.*, feature_column    from spine_table    join feature_table    using (user_id)Error: SYNTAX_ERROR: line 5:17: Table 'spine_table' not foundThe second query works fine if I omit spine_table. :with spine_table as(select 'abc' as user_id),feature_table as(select 'abc' as user_id, '123' as feature_column)select user_id, feature_column    from spine_table    join feature_table    using (user_id)The problem is that my application dynamically generates the query, and it doesn't know ahead of time whether there are additional columns in the spine_table besides the join keys.FollowComment"

Answer: "0An asterisk qualified by a table name (from your example, spine_table.*) will be expanded to every column of that table that is not listed in the USING clause. But since spine_table does not have any other column you are getting that error.You will need to find a way to switch from using (user_id) to on spine_table.user_id = feature_table.user_idThe error message language is misleading and should have been saying something better. I request you to use the Feedback link on bottom left of Athena page and submit the feedback Type as Report an issue.CommentShareMilindOkeanswered 4 months ago"


Question: Can't still use db.t3.small instance by modify Aurora RDS

"Hello. I have had database instance Aurora Mysql v1 with db.t3.small type. I decided to upgrade it to v.2 using Modify features. I successfully finished it. Next step I need to upgrade this DB from v.2 to v.3 but using a snapshot like in the manual.So, unfortunately, when I try to restore a snapshot to change version of Aurora MYSQL to 3 I can't select db.t3.small type, the minimum power is db.t3.medium. Any restriction present?FollowComment"

Answer: "1Accepted AnswerRefer to the documentation here. "The smallest instance classes that you can use with version 3 are t3.medium and t4g.medium. " The db.t4g.medium is the cheapest optionCommentShareEXPERTPeter_Ganswered a year ago0More of a follow up question instead of an answer.Will there be a possibility in the future that AWS will add a db.t3.small option when selecting v3 MySQL Aurora RDS?This has been raised 10 months ago, so I am not sure if I should wait or just stick with v2.Thanks!CommentSharefelipeanswered 4 months ago"


Question: Feature Request: Import WebSocketAPI definition from AsyncAPI specification

"Our company absolutely loves that we can manage REST API definitions in API Gateway from OAS3 specifications and the API Gateway extensions, and this is exclusively how we develop, document, and rollout changes to our API definitions...with the exception of our WebSocket APIs.Our company has been using the AsyncAPI specification for our documentation purposes (https://www.asyncapi.com/docs/specifications/1.2.0/), and would love if we could create and update our Websocket API definitions from this specification as well as any necessary API Gateway extensions (or another asynchronous API specification  that AWS finds worthy).FollowComment"

Answer: "0Supporting API Specification for WebSocket API is definitely in our roadmap, and Async API is a strong candidate (and its 2.0 will come out soon).CommentShareAWS-User-3921561answered 4 years ago0Awesome, I will keep an eye out for this update.CommentSharejoshguthrieanswered 4 years ago"


Question: Cost for NVME instance storage when stopped

"We're looking at using some GPU-enabled EC2 instances which come with NVME instance storage. I can't find any information on how much NVME storage will cost when the instances are shut down, can anyone point me in the right direction?FollowComment"

Answer: "0Instance store is included in the Amazon EC2 instance price and is not a separate charge. Therefore, you are not billed for the NVME instance store when an instance is stopped. Additional details:Instance lifecycle and Amazon EC2 billing: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-instance-lifecycle.htmlAmazon EC2 instance store: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/InstanceStorage.htmlCommentShareAaron_Banswered 2 months ago"


Question: Install ant in windows codebuild project

"I need to run a build on a Windows system.  I have an existing build.xml for ant which will do what I want but can't find any documentation or examples on how to install ant on Windows.The documentation just says "You can use a build specification to install other components (for example, the AWS CLI, Apache Maven, Apache Ant, Mocha, RSpec, or similar) during the install build phase." but does not give any useful examples.FollowComment"

Answer: "0If you are using CodeBuild provided build image, then you can do "choco install ant" in your buildspec. If you are using a custom image, you can directly install ant (multiple ways do this, but you can follow the instructions from apache.org: https://ant.apache.org/manual/install.html).CommentShareSubin Manswered 3 years ago"


Question: Data download S3

How can I download  S3 bucket data shared by somoene on my S3 bucket? I have been given access key id and secret access key by the person who has shared the bucket.FollowComment

Answer: "0You can download a single object per request using the Amazon S3 console. To download multiple objects, use the AWS CLI, AWS SDKs, or REST API.aws s3api get-object --bucket DOC-EXAMPLE-BUCKET1 --key dir/my_images.tar.bz2 my_downloaded_image.tar.bz2Please find this link to get more detail on this.https://docs.aws.amazon.com/AmazonS3/latest/userguide/download-objects.htmlCommentShareGautam Kumaranswered 2 months ago"


Question: Using AWS CLI in automation without MFA token

"We have a requirements as below this we are doing manually and using MFA token but for production it is not a feasible solution.In the ROSA cluster, we will have a Kubernetes Job that will perform these tasks:download the AWS CLI v2invoke some AWS CLI operations on MSK, S3, KDA (Kinesis Data Application) and maybe OpenSearch.Can you please help how we can achieve this.FollowComment"

Answer: "0Accepted AnswerHi.  It looks like RedHat is responsible for most of the IAM setup for the ROSA cluster itself: https://access.redhat.com/documentation/en-us/red_hat_openshift_service_on_aws/4/html-single/setting_up_accounts_and_clusters/index#rosa-aws-prereqs_prerequisites.  What I'm guessing is that the permissions should be tied to an AWS IAM Role either for the ec2 instance or for Kubernetes.In this case, I would reach out to your RedHat support team.  With AWS IAM Roles, these can't have MFA configured and then you can explain to your security team that it isn't possible to have MFA for that AWS IAM Role that the cluster may use.  However, you may want to check RedHat's access with your security team to see if there is a requirement to have MFA on vendor access to your AWS Account.CommentSharejsoncanswered a year ago"


Question: What is a practical Inferentia limit to model size?

"I am trying to test a model compiled for Inferentia on an inf1.2xlarge, but when loading the model I receive the following error messages:2022-Sep-15 22:10:01.0152  3802:3802  ERROR  TDRV:dmem_alloc                              Failed to alloc DEVICE memory: 10737418242022-Sep-15 22:10:01.0152  3802:3802  ERROR  TDRV:dma_ring_alloc                          Failed to allocate TX ring2022-Sep-15 22:10:01.0172  3802:3802  ERROR  TDRV:io_create_rings                         Failed to allocate io ring for queue qPoolOut0_02022-Sep-15 22:10:01.0172  3802:3802  ERROR  TDRV:kbl_model_add                           create_io_rings() error2022-Sep-15 22:10:01.0182  3802:3802  ERROR  NMGR:dlr_kelf_stage                          Failed to load subgraph2022-Sep-15 22:10:01.0182  3802:3802  ERROR  NMGR:stage_kelf_models                       Failed to stage graph: kelf-a.json to NeuronCore2022-Sep-15 22:10:01.0184  3802:3802  ERROR  NMGR:kmgr_load_nn_post_metrics               Failed to load NN: 1.11.7.0+aec18907e-/tmp/tmptkxl8amn, err: 4These are wrapped into a Python runtime exception:RuntimeError: Could not load the model status=4 message=Allocation FailureI presume that this is because the model is on the large size. The .neff file is 373MB and takes ~4 hours to compile for a batch size of 1.This particular model is compiled for a single Neuron core. I am now trying to compile with --neuroncore-pipeline-cores 4 to spread the model across multiple cores. This however gives me the following log message:INFO: The requested number of neuroncore-pipeline-cores (4) may not be suitable for this network, and may lead to sub-optimal performance. Recommended neuroncore-pipeline-cores for this network is 1.(I can't find any technical details on how much memory an Inferentia chip has, although I'm guessing that due to Inferentia architecture "memory" is not used in the same way as it might be on CPU or GPU.)So, what is a practical size limit for an Inferentia model and what can I do about running this model on Inf1?FollowComment"

Answer: "0Hi @ntw-au.  We are working on some more general guidance (which you have requested here), but it looks like your model should load on one core once compiled.  Are you able to share more information for us to diagnose?CommentSharemrnikwawsanswered 8 months agontw-au 8 months agoThank you, I'm not able to share details publicly (happy to talk privately), but input is dimension 1×32768×3 and the model is multiple layers of convolution and batch normalisation, running on PyTorch. The trained model is 15MB.Sharentw-au 8 months agoAlso, native data type is generally FP32, with integers for indexesSharemrnikwaws 8 months agoIf you could please email us at aws-neuron-support@amazon.com we can start a more in depth conversation.  In short we won't need the exact model or weights, but something close enough to replicate the failure.  Because of operator fusing that happens during compilation this will likely need to be relatively close in structure.ShareAWS-mvaria 8 months agoHi @ntw-au, are you able to email us (aws-neuron-support@amazon.com) so that we can start a private conversation about the model?Sharentw-au 8 months agoThanks @mrnikwaws and @AWS-mvaria, I've sent an email to your support addressShare"


Question: Can I install an ipa file that are not certificated download from website on ios in device farm?

Can I install an ipa file that are not certificated download from website on ios in device farm? ThanksFollowComment

Answer: "0Accepted AnswerHi.You can't do that with an undistributed IPA made by someone else.However, even if you are not registered in the Apple Developer Program, you can install a self-signed IPA by creating a zip package using the following method.https://dev.classmethod.jp/articles/apple-develope-program-without-ipa-device-farm/CommentShareEXPERTiwasaanswered 10 months ago"


Question: How can I detect why a Fargate RunTask triggered by EventBridge rule fails

"We use EventBridge to trigger jobs in Fargate. This has been working well for a long time. Lately, it seems like starting the task in Fargate sometimes fails silently.We run thousands of these jobs and failures seem to be totally random and rare. I have done some digging in CloudTrail and I see that RunTask is executed. There is no corresponding CreateLogStream after RunTask and there are of course not any logs in CloudWatch in this case either.Since this happens rarely, I have not been able to look at a stopped task in Fargate since they tend to be cleaned up rapidly, but I'm on the lookout.I have seen this happen when we have been way below our quota in Fargate so it should not be connected to any service quotas.FollowCommentKnut 8 months agoI have been able to inspect the job in the console and found stopped reason "ResourceInitializationError: failed to configure ENI: failed to setup regular eni: netplugin failed with no error message". This doesn't solve the problem since this still silently fails.Share"

Answer: "0Accepted AnswerHello Knut,The error message ResourceInitializationError: failed to configure ENI could be due to a transient issue within the Fargate workflow. If this Fargate task was part of an ECS service, then the ECS Service Scheduler would have attempted to re-launch the task automatically.However, when EventBridge launches an ECS task, it performs the RunTask API operation to trigger the creation of a new task. Starting a task through the RunTask API involves an asynchronous workflow.If the workflow started successfully, then a success code is returned. However, this doesn't mean that the task is in RUNNING state. The RunTask caller is expected to verify if the task reaches Running state, and if that does not happen, the caller needs to retry the operation.Reattempts can be automated with an exponential backoff and retry logic by using AWS Step Functions.Here is a knowledge-center article that explains how to use Step Functions to implement the retry-backoff functionality to mitigate your problem.I hope this is helpful to you. Please add a comment if you have any concerns with this approach.Thank you!CommentShareSUPPORT ENGINEERVenkat Penmetsaanswered 8 months agoKnut 8 months agoThanks for the response, Venkat. It is helpful in that it tells me that no one should ever use EventBridge rules to trigger Fargate tasks. Since all our Fargate jobs are managed through a controller to avoid hitting service quotas; we can at least implement retry there instead of the places we would have otherwise done this. I'm currently worried about which Step Functions quotas we will be struggling with if we choose that solution.Share"


Question: RHEL EC2 Creating New Partition

"I have a EC2 instance running on RHEL 7.9 with one volume /dev/xvda. I am not a linux admin. I just know some basic stuff.How do I move /var & /home directory into separate partition? I have to do this due to some requirement. What would be the impacts by doing so?FollowCommentAWS-Everett 6 months agoDo you want a separate partition on the same /dev/xvda disk or partitions for /var and /home on separate disks (/dev/xvdb and /dev/xvdc)?SharerePost-User-9219791 6 months agoon the same /dev/xvda diskShareAWS-Everett 6 months agoKnow that the only benefit is this will prevent one partition filling up from effecting the others. So if the /var partition is at 100% full, the root partition and /home are not effected. This was an old way of managing space when disks were expensive or difficult to expand. Having separate disks will cost a little bit more but will improve performance in addition to the resilience that you are looking for.Do you have enough space on /dev/xvda to create the partitions of a size that you want? If your disk is at less than 50% full, you can proceed. Otherwise you will need to expand /dev/xvda first.SharerePost-User-9219791 6 months agoThanks for your response. It's more than 60% free space. Please let me know how to move /var directory into separate partition?Share"

Answer: "0Accepted AnswerI figured it out. Modify the EBS volume to increase the size. Create partition, format, mount /var in the new partition and reboot.You must use partprobe command if any issue occurs (in the new partition doesn't show up) with partitioning.CommentSharerePost-User-9219791answered 4 months ago"


Question: Connecting to elastiCache cluster with node.js

I am struggling to find node examples in connecting to my Elasticache cluster via node.js lambda using node-redis.const { createCluster }= require('redis');const redisClient = require('redis');function createRedisClient() {    const client = createCluster({        rootNodes: [            {                host: process.env.redis_endpoint // This is the configuration endpoint given for the cluster plus port            }        ]          });    return client;}I get an invalid protocol when I try to connect.  I have tried adding 3 of the shard endpoints to the above code with the same result.  I have tried just creating a redis client( rather than cluster) and get the same results.  How is this done?FollowComment

Answer: "2Hello,as per node-redis source code , the error is thrown when ParseURL() finds an invalid configuration:if (protocol === 'rediss:') {(parsed.socket as RedisTlsSocketOptions).tls = true;} else if (protocol !== 'redis:') {throw new TypeError('Invalid protocol');}I could not find "host" as a valid parameter for CreateCluster().rootNodes configuration.You probably want to replace host by url and make sure that process.env.redis_endpoint expands to a valid URL like:redis[s]://[[username][:password]@][host][:port][/db-number]Example:no in-transit encryptionconst client = createCluster({    rootNodes: [      {        url: 'redis://Elasticache_Cluster_Endpoint_here:6379'      }    ]  });in-transit encryption without authentication:const client = createCluster({    rootNodes: [      {        url: 'rediss://Elasticache_Cluster_Endpoint_here:6379'      }    ]  });in-transit encryption and RBAC/ACL authentication:const client = createCluster({    rootNodes: [      {        url: 'rediss://user_name:password@Elasticache_Cluster_Endpoint_here:6379'      }    ]  });CommentShareSUPPORT ENGINEERTulio_Manswered a year ago"


Question: Can we have one job for loading multiple tables with different bookmarks storing the last execution file

"Need to write multiple tables from S3 to RDS database. Can I create just one job and send the table names as parameters.As I have number of tables to be loaded it will become hectic to create one job for each table.For eg there are 2 s3 paths: s3://my_bucket/table_A , s3://my_bucket/table_B having parquet files generated every hour.Need to store the data from the S3 in table_A and table_B tables respectively and also save the last run file for both.I know that it is possible but will the job bookmark save the last executed file for both?Any other way to achieve this?FollowComment"

Answer: "0Hello,In order to achieve this use case, here is one option:It will involve leveraging Job Parameters + Job Bookmarks + a little bit of coding:Leverage Job Parameters to programmatically pass different arguments to the job (in this case, the S3 paths or prefixes that points to each dataset to be read). The arguments would be then retrieved in the script via getResolvedOptions(https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-crawler-pyspark-extensions-get-resolved-options.html).In terms of Job Bookmarks, this shouldn't be a problem as long as each datasources being read (i.e., S3 paths containing each dataset in question) includes their own dedicated transformation_ctx property, respectively. That is, the value of transformation_ctx for each datasource read has to be unique. This can be achieved with the same approach as in the above point: Use Job Parameters and retrieve them as arguments to be later used as the value of transformation_ctx (or re-use the same arguments that you'll pass for the S3 paths per se).The most important things are:(1) Each datasource has to have a unique transformation_ctx;(2) Subsequent JobRuns should use the same transformation_ctx values for each datasource, respectively. That way, the Bookmarks will be able to keep track of the already-processed data from each datasource, from each S3 path.See Tracking Processed Data Using Job Bookmarks(https://t.corp.amazon.com/V595024722/communication#:~:text=Tracking%20Processed%20Data%20Using%20Job%20Bookmarks) for more details about transformation_ctx and Job Bookmarks in general.Make also sure the script includes the lines highlighted in bold as seen in the sample script in https://docs.aws.amazon.com/glue/latest/dg/monitor-continuations.html#monitor-continuations-scriptCommentShareSUPPORT ENGINEERAjinkya B-AWSanswered a year agoAWS-User-2896664 a year agoYes, I am able to achieve this, but this will lead to serial run of table loads in target. If any of the previous table load fails the entire load will stop and not run for next tables. Any other way using which I can have one script only for all of the tables and bookmark state saved too.ShareAWS-User-2896664 a year agoThis worked, but what if any of the table load failed, and I would have to rewind the bookmark. There is no way to rewind bookmark programmatically. Is there any other way of rewinding bookmark for specific tables so that it can be read again in next run?Share0Hello,Please provide the following details:1:Method that you are using to migrate from S3 to RDS2: The RDS engine that you are migrating to.Looking forward for your response.CommentShareSUPPORT ENGINEERAjinkya B-AWSanswered a year agoAWS-User-2896664 a year agoUsing Glue service I am reading the files and migrating to Postgres. But the same script needs to be run for 100s of tables, the S3 path and table name needs to be dynamic that's it. Otherwise I will have to create that many jobs. I was thinking of creating multiple workflows and passing run parameters, but the job bookmarks will not be stored for all tables at once. Is there any other way to do thisShare0Though asked 6 months back still answering , because I did similar steps for ETLing data from MySQl-DMS-S3.Create individual jobs per table. For me , the code for all the jobs were same , [read source ( bookmarked ) select the latest version of the record , read target , identify the s3 file to be rewritten , write to target ] the only thing that differed was the source table name and the target s3 bucket , which I parameterised and stored the list of tables in a JSON file in a S3 bucket named Config.The jobs were divided into 2 parts , 1 controller python script and the other PySpark glue jobs per table which were essentially the same codeThis gives 2 benefits :If any individual job fails, you get the option to rewind and rerun the jobThe python controller script starts the Glue jobs one after the other without waiting , hence your jobs run in parallelThe controller script however waits on completion of all jobs to finish . So the total time for the python job to run = to the longest pyspark glue job run time.If you need to customise the job for any specific table , you can do thatWorkers and worker types for each job can be tuned according to the need instead of over or under powering the jobsFinally each of these jobs also write run time metrics like rows read, written time taken , bookmarks , success status to another S3 file which is then visualized in Quicksight for ETL monitoring.CommentShareKoustavCanswered 5 months agoaltearth 5 months agoHello, I'm very interested in this approach. Would you be willing to provide a boilerplate for the two scripts and a sample json of tables? I'm newer to pyspark code but am aware of being able to pass parameters and job bookmark concepts. Kindest regardsShare0Refer  https://github.com/aws-samples/aws-big-data-blog-dmscdc-walkthroughThis will give you the basic boiler plate of how to work with the controller and individual table level jobs . The blog is  very well documented and helpful . It uses DynamoDB for checkpointing , which I have replaced with Glue Bookmarks in my version.Below is a sample content of the  JSON config file :{    "etl-job-configs" : {        "master-etl-job":[            {                "etl-job-names":"table-1-etl-job,table-2-etl-job",                "source_bucket" :"source-bucket-name",                "target_bucket":"target-bucket-name",                "crawler_names": "crawler-name",                "run_crawler"  : 1            }        ],        "table-1-etl-job-config" :[            {                "source_bucket" :"source-bucket-name",                "target_bucket":"target-bucket-name",                "table_name"          :"table-1",                "primary_key"         :"id",                "input_partition_key" :"modify_time",                "target_partition_key":"create_time",                "reset_bookmark"      :0,                "skip_records"        :""            }        ],        "table-2-etl-job-config" :[{...}]}Repeat for the number of tables that you have .The controller and the table-etl jobs read this same config file.The first element is for the controller which gets the info on the list of jobs to run .The source and target buckets can be configured at the master level or can be overridden at the individual job level.You can also enhance to include options to run crawlers or reset bookmarks  or skip any specific records as requiredThis will help in altering the job parameters without touching the job codePass this config file name as a parameter to the glue jobs.Finally check out the functions and their usages for Boto3 S3 and Glue athttps://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/glue.htmlhttps://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.htmlCommentShareKoustavCanswered 5 months agoaltearth 5 months agoThanks so much. : ) Really appreciate it!Share"


Question: Cannot create a stack from template: ajax error 401

"Hi,when I try to create a stack in AWS console, I get an ajax error 401 and the page quickly reloads. I have tried multiple different template files, also basic examples from AWS guides, but it doesn't work.In my browser console I can already see an error 401 when I upload the file, although nothing is displayed in the interface.I'm using my root user.Here is a screencast:  https://mega.nz/file/Bld2FBoK#NSrCoxbVhydwJ_5lu2RQMTS57Gv_ppzfIpMvgANIgDoHow can this happen?Edited by: Sinbalta on Dec 23, 2020 6:44 AMFollowComment"

Answer: "0Wow after searching the web, I found out that my browser was the problem. Solved with this: https://github.com/webcompat/web-bugs/issues/51082.Edit: Arguably it's a configuration bug in AWS.Edited by: Sinbalta on Dec 23, 2020 6:51 AMCommentShareSinbaltaanswered 2 years ago"


Question: Issue with AWS Service Management Connector for Jira Service Management Cloud

"I've installed the AWS Service Management Connector for JSM into Jira and provisioned the users using CloudFormation from the provided script on https://docs.aws.amazon.com/smc/latest/ag/jsmcloud-base-perms.html and all the connection tests passed.However the SSM Incidents do not sync. The CloudTrail Event log shows that the sync requests fail with a ValidationException. I believe this is due to the creationTime filter.Partial Event Redacted:{    "eventVersion": "1.08",    "userIdentity": {        "type": "IAMUser",        "principalId": "AIXXXXXXXXXXXXXX",        "arn": "arn:aws:iam::XXXXXXXXXX:user/SCSyncUser",        "accountId": "XXXXXXXXXX",        "accessKeyId": "AKXXXXXXXXXXXXX",        "userName": "SCSyncUser"    },    "eventTime": "2023-03-22T14:41:55Z",    "eventSource": "ssm-incidents.amazonaws.com",    "eventName": "ListIncidentRecords",    "awsRegion": "us-west-2",    "sourceIPAddress": "xx.xx.xxx.xx",    "userAgent": "Forge/4.2.0 ari:cloud:ecosystem::app/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx",    "errorCode": "ValidationException",    "requestParameters": {        "filters": [            {                "key": "status",                "condition": {                    "equals": {                        "stringValues": [                            "OPEN",                            "RESOLVED"                        ]                    }                }            },            {                "key": "creationTime",                "condition": {}            }        ]    },    "responseElements": null,    "requestID": "xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx",    "eventID": "xxxxx-xxxx-xxx-xxxx-xxxxxxxxx",    "readOnly": true,    "eventType": "AwsApiCall",    "managementEvent": true,    "recipientAccountId": "XXXXXXXXXX",    "eventCategory": "Management"}Current CF Template: https://servicecatalogconnector.s3.amazonaws.com/SMC_ConnectorforJSMCloud-AWS_Configurations_Commercial.jsonAre there additional steps that are missing from the documentation or is this just a bug?FollowComment"

Answer: "0Please refer to our documentation. If you still have problems, please submit a support ticket and have it routed to the SMC Connector team.Please reach out to us at aws-sm-connector-interest@amazon.com if you need further assistance.CommentShareEXPERTSMC_useranswered 2 months ago"


Question: Domain transfer from aws to Ionos

Suppose I have any pending bills in my aws account and I want to transfer domain from aws to ionos. Will aws hold my domain or they have to allow me to transfer my domain.FollowComment

Answer: "0Accepted AnswerHello,Thanks for reaching out!I was able to find the following doc on transferring a domain to another registrar: https://docs.aws.amazon.com/Route53/latest/DeveloperGuide/domain-transfer-from-route-53.html.If this doesn't answer the full scope of your question, I recommend reaching out to our Support team who will have better insight on directing you.You can reach out to our teams here: http://go.aws/support-center.Best regards,Elle G.CommentShareEXPERTAWS Support - Elleanswered 6 months ago"


Question: How to connect via adb to a (Remote Session) Android Device on AWS Device Farm

"Hi everyone, I have the same question with the author from https://stackoverflow.com/questions/45365413/how-to-connect-via-adb-to-a-remote-session-android-device-on-aws-device-farm.It seems like the answer is archived so please let me put it here again."""Can I connect to Android device during a remote session via adb?I would need to connect to the Android device via adb( using tcpip mode) but I presume, I can't connect to a specific device via a public IP(?) so how can I connect from a ubuntu-server ec2 instance or a local machine to a device farm Android device during a remote session?During the remote access session, the device has private ip, offcourse (e.g. 192.168.1.10). Would using a VPC help in this regard?Any help/pointers would be greatly appreciated.Thanks.""""Hope for your help!Thank you!FollowComment"

Answer: "0Today, the ability to connect from your local machine to an Android device in AWS Device Farm over adb is not available for remote access. However, you can execute adb commands during an automation test session using the yaml file in custom mode of execution on Device Farm. Note, this still does not give you the ability to connect from your host machine directly to the device in Device Farm.CommentShareNikhil_Danswered a year ago"