Issue: Weight-Only Quantization Not Working for GroupedLinear Modules

[jQizhang]

When performing weight-only quantization (e.g., NVFP4) on models with QuantTEColumnParallelGroupedLinear or other GroupedLinear modules, the quantization process fails to properly compute and store the amax values.

It may because GroupedLinear modules use multiple weight parameters (weight0, weight1, weight2, ...) instead of a single weight parameter, and share a single weight_quantizer across all weights.

The existing weight_attr_names() function cannot detect these weight parameters, causing weight_only_quantize() to skip these modules entirely.

[coderabbitai]

📝 CodeRabbit Plan Mode

Generate an implementation plan and prompts that you can use with your favorite coding agent.

• Create Plan

Examples

• Example 1
• Example 2

---

🧪 Issue enrichment is currently in open beta.

You can configure auto-planning by selecting labels in the issue_enrichment configuration.

To disable automatic issue enrichment, add the following to your .coderabbit.yaml:

issue_enrichment:
  auto_enrich:
    enabled: false

💬 Have feedback or questions? Drop into our discord or schedule a call!