You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/connections/reverse-etl/reverse-etl-source-setup-guides/bigquery-setup.md
+9-9Lines changed: 9 additions & 9 deletions
Original file line number
Diff line number
Diff line change
@@ -3,6 +3,9 @@ title: BigQuery Reverse ETL Setup
3
3
redirect_from:
4
4
- '/reverse-etl/bigquery-setup/'
5
5
---
6
+
> info "BigQuery Reverse ETL sources support Segment's dbt extension"
7
+
> If you have an existing dbt account with a Git repository, you can use [Segment's dbt extension](/docs/segment-app/extensions/dbt/) to centralize model management and versioning, reduce redundancies, and run CI checks to prevent breaking changes.
8
+
6
9
## Constructing your own role or policy
7
10
8
11
> warning ""
@@ -23,7 +26,7 @@ With this approach, use BigQuery predefined roles to create a service account fo
23
26
4. Click **Create and Continue**.
24
27
5. Click **+ Add another role** and add the [**BigQuery User**](https://cloud.google.com/bigquery/docs/access-control#bigquery.user) role.
25
28
6. Click **+ Add another role** and add the [**BigQuery Data Editor**](https://cloud.google.com/bigquery/docs/access-control#bigquery.dataEditor) role.
26
-
7. Click **Continue**, then click **Done**.
29
+
7. Click **Continue**, then click **Done**.
27
30
28
31
### Grant Limited Access
29
32
With this approach we will setup a custom role with the following permissions:
@@ -37,7 +40,7 @@ Permission | Details
37
40
38
41
1. In BigQuery, navigate to **IAM & Admin > Roles**.
39
42
2. Click **+ CREATE ROLE** to create a new role.
40
-
3. Add **title** and **Description** as you like.
43
+
3. Add **Title** and **Description** as you like.
41
44
4. Click **ADD PERMISSIONS** and add the permission listed in the above tables. You will need to repeat that until all required permissions are added.
42
45
5. Click **CREATE**.
43
46
6. Navigate to **IAM & Admin > Service Accounts**.
@@ -46,12 +49,12 @@ Permission | Details
46
49
9. Click **Create and Continue**.
47
50
10. In the **Grant this service account access to project** section, select the role you just created.
48
51
11. Click **Continue**.
49
-
12. Click **Done**. Copy and keep the Service Account email handy for the next steps
52
+
12. Click **Done**. Copy and keep the Service Account email handy for the next steps.
50
53
13. Navigate to the BigQuery SQL editor and create a dataset that will be used by Segment:
51
54
```sql
52
55
CREATESCHEMAIF NOT EXISTS `__segment_reverse_etl`;
53
56
```
54
-
14. Grant limited Access to the Segment Reverse ETL dataset
57
+
14. Grant limited access to the Segment Reverse ETL dataset
55
58
```sql
56
59
GRANT `roles/bigquery.dataEditor` ON SCHEMA `__segment_reverse_etl` TO "serviceAccount:<YOUR SERVICE ACCOUNT EMAIL>";
57
60
```
@@ -71,14 +74,11 @@ You can find the location of your BigQuery resources using the following method:
71
74
4. In the pop-up window, select **JSON** for the key type and click **Create**. The file will be downloaded.
72
75
5. Copy all the content in the JSON file you created in the previous step.
73
76
6. Open the Segment app and navigate to **Connections > Sources**.
74
-
7. On the My sources page, click **+ Add source**.
77
+
7. On the _My sources_ page, click **+ Add source**.
75
78
8. Search for "BigQuery" and select the BigQuery source from the sources catalog. On the BigQuery overview page, click **Add Source**.
76
-
9. On the Set up BigQuery page, enter a name for your source and paste all the credentials you copied from previous step into the **Enter your credentials** section.
79
+
9. On the _Set up BigQuery_ page, enter a name for your source and paste all the credentials you copied from previous step into the **Enter your credentials** section.
77
80
10. Enter the location of your BigQuery warehouse in the **Data Location** field.
78
81
11. Click **Test Connection** to test to see if the connection works. If the connection fails, make sure you have the right permissions and credentials and try again.
79
82
12. If the test connection completes successfully, click **Add source** to complete the setup process.
80
83
81
84
After you've added BigQuery as a source, you can [add a model](/docs/connections/reverse-etl/setup/#step-2-add-a-model) and follow the rest of the steps in the Reverse ETL setup guide.
82
-
83
-
> info "BigQuery Reverse ETL sources support Segment's dbt extension"
84
-
> If you have an existing dbt account with a Git repository, you can use [Segment's dbt extension](/docs/segment-app/extensions/dbt/) to centralize model management and versioning, reduce redundancies, and run CI checks to prevent breaking changes.
0 commit comments