To get started, you'll need to set up Cloud Billing data export to BigQuery. Specifically, we will need the Detailed Usage Cost and Pricing Data tables to conduct a full Savings Analysis.
Please ensure that all projects are under the same organization to facilitate this process. If some projects exist outside the primary organization or if you have Domain Restricted Sharing enabled, contact us for assistance.
Why enable Cloud Billing data exports to BigQuery? This is Google’s methodology for storing your Google Cloud Compute Engine usage and cost details.
Do I meet the prerequisites?
Check if the tables are enabled: You can see if the required tables are enabled by using the search bar to navigate to the ‘Billing export’ page of the Billing Account you want to add.
Are the tables enabled? If the tables are enabled, they will look like the tables below with a ‘Project name’ field and ‘Dataset name’ field. If this is the case, you can progress to the ‘Where Do I Find the Required Google Cloud Details?’ article.
If the BigQuery exports are not enabled, Detailed usage cost and Pricing will show as Disabled.
Are the datasets not enabled?
When enabling the detailed usage cost export, select a multi-region location. This will export Google Cloud billing data incurred from the start of the previous month from when you first enabled the export. If you select a specific region location, the export will only reflect Google Cloud billing data incurred starting from the date you enabled Cloud Billing export.
Follow Google's step-by-step instructions to configure: Set up Cloud Billing data export to BigQuery.
- When you first enable the detailed usage cost export to BigQuery, it might take up to 5 days for the exported data to fully load and several hours for the table to be created.
- When you first enable the pricing export to BigQuery, it might take up to 48 hours for the table fully load and be created.
- You can view exactly when the pricing data will be transferred by going to the Data transfer tab in the BigQuery console. Look for the "Pricing BigQuery Transfer" and find the time when the transfer will occur under "Next scheduled."