Skip to content

[DOCS-13743] EXP- GA BigQuery guide #35455

Merged
iadjivon merged 18 commits intomasterfrom
ida.adjivon/DOCS-13743-BigQuery-guide-expga
Mar 31, 2026
Merged

[DOCS-13743] EXP- GA BigQuery guide #35455
iadjivon merged 18 commits intomasterfrom
ida.adjivon/DOCS-13743-BigQuery-guide-expga

Conversation

@iadjivon
Copy link
Copy Markdown
Contributor

@iadjivon iadjivon commented Mar 21, 2026

What does this PR do? What is the motivation?

Fixes DOCS-13743

Adds a new guide for connecting Google BigQuery to Datadog Experiments for warehouse-native experiment analysis. The guide covers GCP service account setup, dataset permissions, and Datadog configuration.

Merge instructions

Merge readiness:

  • Ready for merge

iadjivon and others added 2 commits March 20, 2026 20:05
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@iadjivon iadjivon requested a review from a team as a code owner March 21, 2026 00:08
@iadjivon iadjivon added the WORK IN PROGRESS No review needed, it's a wip ;) label Mar 21, 2026
@iadjivon iadjivon changed the title [DOCS-13743] Add BigQuery guide for warehouse-native experiment analysis [DOCS-13743] EXP- GA BigQuery guide Mar 21, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 21, 2026

@github-actions github-actions Bot added the Images Images are added/removed with this PR label Mar 24, 2026

## Step 3: Grant IAM roles to the service account

In addition to the permissions described in the [Google Cloud Platform integration page][1], the Datadog Experiments service account requires the following permissions:
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@chasdevs does this sentence contradict with line 24: "If you're only using the Google Cloud integration for warehouse native experiment analysis, you can opt out of collecting other resources."

I guess we're recommending to still give all of the permissions, even if we're not using them to collect other resources?

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we just say "Datadog Experiments requires some additional permissions for the service account you are using..."?

@@ -0,0 +1,81 @@
---
title: Connect BigQuery for Warehouse Native Experiment Analysis
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lukasgoetzweiss The Snowflake docs (PR: #35422 (review)) use hyphenated "Warehouse-Native" but this does not. What should we do?


Once you have created a service account, continue on to the next section.

<div class="alert alert-info">If you're only using the Google Cloud integration for warehouse native experiment analysis, you can opt out of collecting other resources.</div>
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: Jeff flagged that "opt out" was confusing because there are toggles in the UI; he suggested using clearer language here like "disable" or "toggle off".


## Step 3: Grant IAM roles to the service account

In addition to the permissions described in the [Google Cloud Platform integration page][1], the Datadog Experiments service account requires the following permissions:
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we just say "Datadog Experiments requires some additional permissions for the service account you are using..."?

1. [BigQuery Job User][4] — allows the service account to run BigQuery jobs.
1. [BigQuery Data Owner][5] - grants the service account full access to the Datadog Experiments output dataset.
1. [Storage Object User][6] - allows the service account to read and write objects in the storage bucket used by Datadog Experiment.
1. [BigQuery Data Viewer][7] - allows the service account to read table used in warehouse native metrics.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where's this coming from? I think if we have BigQuery Data Owner you don't need this.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My understanding is that you need Data Owner on the output dataset, and data viewer on datasets you intend to use when creating metric SQL models. Am I thinking about that wrong?

@iadjivon iadjivon force-pushed the ida.adjivon/DOCS-13743-BigQuery-guide-expga branch from d4b5c29 to d714b7e Compare March 29, 2026 04:50
@github-actions github-actions Bot added the Guide Content impacting a guide label Mar 29, 2026
Comment thread content/en/experiments/guide/connecting_bigquery.md Outdated
Comment thread content/en/experiments/guide/connecting_bigquery.md Outdated
Comment thread content/en/experiments/guide/connecting_bigquery.md Outdated
@jeff-morgan-dd jeff-morgan-dd self-assigned this Mar 31, 2026
Copy link
Copy Markdown
Contributor

@jeff-morgan-dd jeff-morgan-dd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just see one note on the Snowflake page - thanks!

Comment thread content/en/experiments/guide/connecting_snowflake.md Outdated
Co-authored-by: jeff-morgan-dd <jeff.morgan@datadoghq.com>
@iadjivon iadjivon requested a review from jeff-morgan-dd March 31, 2026 20:57
@iadjivon iadjivon merged commit 03da6cb into master Mar 31, 2026
17 checks passed
@iadjivon iadjivon deleted the ida.adjivon/DOCS-13743-BigQuery-guide-expga branch March 31, 2026 22:07
StefonSimmons pushed a commit that referenced this pull request Apr 16, 2026
* [DOCS-13743] Add BigQuery guide placeholder with frontmatter

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* [DOCS-13743] Add BigQuery guide content (WIP)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* added bigquery to the guide index, moved the file to the guide folder, added the overview sentence to match the other guides.

* pulled in static as well

* reconfigured steps and modified overview section

* style edits

* added steps and images from gc console

* added images and moved content

* modified permissions needed

* edits from review

* new image and anchor links modified

* quick fixed

* Apply suggestion from @iadjivon

* changes the snowflake name on the index page to match the others.

* quick modifications and refreshed the image

* Update content/en/experiments/guide/connecting_snowflake.md

Co-authored-by: jeff-morgan-dd <jeff.morgan@datadoghq.com>

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: jeff-morgan-dd <jeff.morgan@datadoghq.com>
genesor pushed a commit that referenced this pull request Apr 19, 2026
* [DOCS-13743] Add BigQuery guide placeholder with frontmatter

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* [DOCS-13743] Add BigQuery guide content (WIP)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* added bigquery to the guide index, moved the file to the guide folder, added the overview sentence to match the other guides.

* pulled in static as well

* reconfigured steps and modified overview section

* style edits

* added steps and images from gc console

* added images and moved content

* modified permissions needed

* edits from review

* new image and anchor links modified

* quick fixed

* Apply suggestion from @iadjivon

* changes the snowflake name on the index page to match the others.

* quick modifications and refreshed the image

* Update content/en/experiments/guide/connecting_snowflake.md

Co-authored-by: jeff-morgan-dd <jeff.morgan@datadoghq.com>

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: jeff-morgan-dd <jeff.morgan@datadoghq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Guide Content impacting a guide Images Images are added/removed with this PR WORK IN PROGRESS No review needed, it's a wip ;)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants