Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

STS Request was denied due to user flow control #483

Open
QiXingchuan opened this issue Dec 18, 2024 · 2 comments
Open

STS Request was denied due to user flow control #483

QiXingchuan opened this issue Dec 18, 2024 · 2 comments
Assignees
Labels
bug Something isn't working

Comments

@QiXingchuan
Copy link

Describe the bug
The query may have errors like this

ErrorCode: Throttling.User. Request was denied due to user flow control. q=Throttling.User&product=Sts

Steampipe version (steampipe -v)
Steampipe v1.0.0

Plugin version (steampipe plugin list)
hub.steampipe.io/plugins/turbot/alicloud@latest | 1.1.0

To reproduce

  • Execute query like select * from alicloud_sandbox.alicloud_ecs_instance

Expected behavior
The error should not happen and should show the resource info

Additional context

  • It seems that the plugin will call GetCallerIdentity frequently. Will the cache not work in some cases?

  • I set the limit, but it seems not to work.

    plugin "alicloud" {
      limiter "exec_max_concurrency_limiter" {
        max_concurrency = 5
        bucket_size     = 5
        fill_rate       = 5
      }
    }
@QiXingchuan QiXingchuan added the bug Something isn't working label Dec 18, 2024
@ParthaI
Copy link
Contributor

ParthaI commented Dec 18, 2024

Hello, @QiXingchuan,

I’m sorry to hear that you’re encountering this issue. Let me ask a few follow-up questions to better understand and assist you:

  • Which authentication mode are you using to query the tables?
  • Could you share the content of your ~/.steampipe/config/oci.spc file? (Please ensure any sensitive information is removed before sharing.)
  • If the issue occurs with a specific profile authentication, would it be possible to try using a different profile authentication mode to see if the problem persists?
  • Have you tested the query with and without the rate-limiter configuration? Does the issue occur in both cases?

Looking forward to your response so we can troubleshoot this further. 😊

@misraved misraved self-assigned this Dec 18, 2024
@QiXingchuan
Copy link
Author

QiXingchuan commented Dec 19, 2024

Hi @ParthaI,

Which authentication mode are you using to query the tables?

  • I am using RamRoleArn mode

Could you share the content of your ~/.steampipe/config/oci.spc file? (Please ensure any sensitive information is removed before sharing.)

  • ~/.steampipe/config/alicloud.spc
plugin "alicloud" {
   limiter "exec_max_concurrency_limiter" {
      max_concurrency = 5
      bucket_size     = 5
      fill_rate       = 5
   }
}

connection "alicloud_all" {
  type        = "aggregator"
  plugin      = "alicloud"
  connections = ["ali*"]
}

connection "ali_sandbox_cloud1" {
  plugin  = "alicloud"
  regions = ["ap-southeast-1"]
  profile = "sandbox_cloud1"
}

connection "ali_sandbox_cloud2" {
  plugin  = "alicloud"
  regions = ["ap-southeast-1"]
  profile = "sandbox_cloud2"
}

...
connection "ali_sandbox_cloud100" {
  plugin  = "alicloud"
  regions = ["ap-southeast-1"]
  profile = "sandbox_cloud100"
}

If the issue occurs with a specific profile authentication, would it be possible to try using a different profile authentication mode to see if the problem persists?

  • If I only use AKSK mode, it will only query one account, and the STS issues will not happen
  • But if I use AKSK mode to query some resources needing to get attributes by get func like getEcsDiskAutoSnapshotPolicy, it will also have the user flow control issue, and the throttled API will be from ECS. Example: select * from ali_sandbox.alicloud_ecs_disk(The Rate Limiting doesn't work)

Have you tested the query with and without the rate-limiter configuration? Does the issue occur in both cases?

  • Yes, the issue happens both
  • I checked the audit log, It has far more queries than the limit value I set

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants