[DOCS-14081] Updates to Grok Parser doc by maycmlee · Pull Request #37806 · DataDog/documentation

maycmlee · 2026-06-26T20:46:11Z

What does this PR do? What is the motivation?

Merge readiness

Updates Grok Parser doc with new features
Adds images
Ready for merge

For Datadog employees:

⚠️ Your branch name MUST follow the <name>/<description> convention and include the forward slash (/). If you've already created your PR with an incorrect branch name, please rename your branch and open a fresh PR.
🤖 New: Comment with /review to run an automated check that catches common issues before a Documentation team member reviews your PR.

AI assistance

Additional notes

github-actions · 2026-06-26T20:50:34Z

Preview links (active after the `build_preview` check completes)

Modified Files

https://docs-staging.datadoghq.com/may/grok-parser-updates-ai/observability_pipelines/processors/grok_parser

maycmlee · 2026-06-29T19:47:25Z

+
+To write parsing rules manually, in the {{< ui >}}Create Parsing Rule{{< /ui >}} modal:
+
+1. Click {{< ui >}}write rules manually{{< /ui >}}.


"write rules manually" is not capitalized in the UI so it's not capitalized here.

evazorro

This looks really good! Left a few small suggestions/questions.

One higher-level thing: after my manual review, I ran our PR review skill on this, and it flagged that you're using a few different terms on this page: "AI-generated parsing rules" (line 19), "AI-assisted" (line 52), "AI rule generator" (lines 61, 64), and "AI-created rules" (line 63). I didn't find it particularly confusing, but apparently it can be easier for agents to not have to reconcile multiple different terms.

evazorro · 2026-06-30T19:01:33Z

+    1. Review the parsed log in the {{< ui >}}Preview Changes{{< /ui >}} panel.
+    1. Click {{< ui >}}Generate New Rule{{< /ui >}} to re-run the AI rule generator or manually update the rule so the log is parsed correctly. See [Parsing][1] for information on writing parsing rules.
+    <br>**Notes**:
+        - If you re-run the AI rule generator, a new rule is created. You must manually delete previously AI-created rules if you don't want them.


I'm a little confused by this sentence: "You must manually delete previously AI-created rules if you don't want them."

Can you say more? Do the generated rules stack up in the UI?

If you re-run the AI rule generator, it'll create a new rule and won't delete the previous one so you must manually delete AI-created rules if you don't want them.

What do you think about this?

Suggested change

- If you re-run the AI rule generator, a new rule is created. You must manually delete previously AI-created rules if you don't want them.

- If you re-run the AI rule generator, a new rule is created, but the previous rule is not deleted so you must manually delete AI-generated rules if you don't want them.

I think I like the previous version better, actually. I think it will make sense when seen in context (while using the product), so probably no further clarification needed

evazorro · 2026-06-30T19:03:40Z

+        - If you re-run the AI rule generator, a new rule is created. You must manually delete previously AI-created rules if you don't want them.
+        - You can run the AI rule generator a maximum of three times per sample.
+    1. Repeat step 4 to create rules based on additional sample logs. See [Order of custom rules](#order-of-custom-rules) for information on how rule order determines which rule parses a log.
+1. If you want to add library rules, select a library rule from the {{< ui >}}reference a library rule{{< /ui >}} dropdown menu. You can add multiple library rules. See [Library rules](#library-rules) for more information.


Small thing: I don't see the reference a library rule dropdown in the screenshot below this procedure; should it be there?

Ah, so that dropdown only shows up after a rule has been created.

Does this make it clearer?

Suggested change

1. If you want to add library rules, select a library rule from the {{< ui >}}reference a library rule{{< /ui >}} dropdown menu. You can add multiple library rules. See [Library rules](#library-rules) for more information.

1. After you add a rule, you can add library rules by selecting a library rule from the {{< ui >}}reference a library rule{{< /ui >}} dropdown menu. You can add multiple library rules. See [Library rules](#library-rules) for more information.

Yes I like this!

Co-authored-by: Eva Parish <eva.parish@datadoghq.com>

maycmlee · 2026-06-30T20:37:58Z

+    1. Review the parsed log in the {{< ui >}}Preview Changes{{< /ui >}} panel.
+    1. Click {{< ui >}}Generate New Rule{{< /ui >}} to re-run the AI rule generator or manually update the rule so the log is parsed correctly. See [Parsing][1] for information on writing parsing rules.
+    <br>**Notes**:
+        - If you re-run the AI rule generator, a new rule is created. You must manually delete previously AI-created rules if you don't want them.


If you re-run the AI rule generator, it'll create a new rule and won't delete the previous one so you must manually delete AI-created rules if you don't want them.

What do you think about this?

Suggested change

- If you re-run the AI rule generator, a new rule is created. You must manually delete previously AI-created rules if you don't want them.

- If you re-run the AI rule generator, a new rule is created, but the previous rule is not deleted so you must manually delete AI-generated rules if you don't want them.

maycmlee · 2026-06-30T20:41:16Z

+        - If you re-run the AI rule generator, a new rule is created. You must manually delete previously AI-created rules if you don't want them.
+        - You can run the AI rule generator a maximum of three times per sample.
+    1. Repeat step 4 to create rules based on additional sample logs. See [Order of custom rules](#order-of-custom-rules) for information on how rule order determines which rule parses a log.
+1. If you want to add library rules, select a library rule from the {{< ui >}}reference a library rule{{< /ui >}} dropdown menu. You can add multiple library rules. See [Library rules](#library-rules) for more information.


Ah, so that dropdown only shows up after a rule has been created.

Does this make it clearer?

Suggested change

1. If you want to add library rules, select a library rule from the {{< ui >}}reference a library rule{{< /ui >}} dropdown menu. You can add multiple library rules. See [Library rules](#library-rules) for more information.

1. After you add a rule, you can add library rules by selecting a library rule from the {{< ui >}}reference a library rule{{< /ui >}} dropdown menu. You can add multiple library rules. See [Library rules](#library-rules) for more information.

maycmlee · 2026-07-01T14:11:32Z

Thanks @evazorro for the review! I applied your suggestions and responded to these two comments:

maycmlee · 2026-07-02T15:36:32Z

Thanks @evazorro! I left one as is and updated the other one (9d0edbd).

jackie8c · 2026-07-02T19:24:02Z

+1. Click {{< ui >}}Preview Library Rules{{< /ui >}} to preview preset rules for integrations. You can test out-of-the-box parsing rules with your log samples. See [Library rules](#library-rules) for more information.
+1. Toggle {{< ui >}}Disable library rules{{< /ui >}} on the Grok Parser to disable all library parsing rules.
+   <br>**Notes**:
+   - You must create a custom parsing rule before you can disable library rules.
+   - Library rules are applied by default. Disable library rules only if you are relying on custom parsing rules.


Not a blocker at all, but just wanted to note that the instructions for the "Preview Library Rules" and "Disable library rules" workflows will eventually have to be tweaked when I revamp the previewing of library rules UI (this change is still in progress). Just wanted to give a heads-up on this, but I can also help start this docs change if you are OOO during the time I reach this step.

Ah okay, thanks for the heads up! That change would also make the docs flow better.

updates to doc and add images

c418a7f

maycmlee requested a review from a team as a code owner June 26, 2026 20:46

maycmlee added the WORK IN PROGRESS No review needed, it's a wip ;) label Jun 26, 2026

github-actions Bot added the Images Images are added/removed with this PR label Jun 26, 2026

This comment has been minimized.

Sign in to view

maycmlee changed the title ~~[DOCS-14081] Updates to doc and add images~~ [DOCS-14081] Updates to Grok Parser doc Jun 29, 2026

maycmlee added 3 commits June 29, 2026 14:52

move images

42c8fc0

apply suggestions

9197f7c

small fix

9786d8f

maycmlee commented Jun 29, 2026

View reviewed changes

updates

0395e1b

evazorro removed the WORK IN PROGRESS No review needed, it's a wip ;) label Jun 30, 2026

evazorro requested changes Jun 30, 2026

View reviewed changes

Apply suggestions from code review

cf2f11d

Co-authored-by: Eva Parish <eva.parish@datadoghq.com>

maycmlee commented Jun 30, 2026

View reviewed changes

Apply suggestion from @maycmlee

b7f71e6

maycmlee requested a review from evazorro July 1, 2026 22:13

maycmlee commented Jul 2, 2026

View reviewed changes

Comment thread content/en/observability_pipelines/processors/grok_parser.md Outdated

maycmlee added 2 commits July 2, 2026 11:35

Update content/en/observability_pipelines/processors/grok_parser.md

9d0edbd

Merge branch 'master' into may/grok-parser-updates-ai

2f4318b

evazorro approved these changes Jul 2, 2026

View reviewed changes

jackie8c reviewed Jul 2, 2026

View reviewed changes


		To write parsing rules manually, in the {{< ui >}}Create Parsing Rule{{< /ui >}} modal:

		1. Click {{< ui >}}write rules manually{{< /ui >}}.

	- If you re-run the AI rule generator, a new rule is created. You must manually delete previously AI-created rules if you don't want them.
	- If you re-run the AI rule generator, a new rule is created, but the previous rule is not deleted so you must manually delete AI-generated rules if you don't want them.

	1. If you want to add library rules, select a library rule from the {{< ui >}}reference a library rule{{< /ui >}} dropdown menu. You can add multiple library rules. See [Library rules](#library-rules) for more information.
	1. After you add a rule, you can add library rules by selecting a library rule from the {{< ui >}}reference a library rule{{< /ui >}} dropdown menu. You can add multiple library rules. See [Library rules](#library-rules) for more information.

Uh oh!

Conversation

maycmlee commented Jun 26, 2026

What does this PR do? What is the motivation?

Merge readiness

For Datadog employees:

AI assistance

Additional notes

Uh oh!

github-actions Bot commented Jun 26, 2026

Preview links (active after the build_preview check completes)

Modified Files

Uh oh!

This comment has been minimized.

Choose a reason for hiding this comment

Uh oh!

evazorro left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

maycmlee commented Jul 1, 2026

Uh oh!

Uh oh!

maycmlee commented Jul 2, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Preview links (active after the `build_preview` check completes)