Data Export Format: Autonomous Discount Management for AWS - Savings (v2)

Once you have successfully configured Data Export, updates will be published to your S3 bucket every 24 hours. This article describes the organization and structure of the Autonomous Discount Management for AWS - Savings (v2) export.


Summary of changes from v1:
  • Now includes Savings dashboard data from all ADM for AWS services, including Compute, RDS, ElastiCache, OpenSearch, Redshift, and MemoryDB. Note this necessitated a directory structure change.
  • Now includes exports for both the RI/SP Only and All Discounts scopes

Organization

Directory Structure

ProsperOps will create the following directory structure in your export S3 bucket.

    • savings
        • v2
          • <files>

    File Structure

      The v2 directory contains two CSV files, one for each scope, either RI/SP Only or All Discounts. Each file includes AWS Compute, RDS, ElastiCache, OpenSearch, Redshift, and MemoryDB Savings dashboard metrics, with rows representing each month Autonomous Discount Management has been enabled.

      • RI/SP Only scope - includes only Reserved Instance and Savings Plan savings. Other rate optimization techniques, such as Spot instances and EDP/PPA discounts, are excluded. Use this scope to visualize and evaluate ProsperOps-managed savings outcomes independent of other rate optimization activities.
        • Name 
          • prosperops-savings-[managementAccountNumber]-monthly.csv
          • Example: prosperops-savings-123456789012-monthly.csv
        • Rows 
          • One row for each month ProsperOps has been active
          • The final row represents the current (unfinalized) month.
        • Columns (see below)
          • Actual values match your AWS bill (with prepayments amortized). This provides an accurate view of monthly cost and savings but is not useful when comparing across months since the number of days in each month can vary.

          • Normalized values (also with prepayments amortized) have been adjusted to a 30-day month to remove number of day variance and provide a useful representation that can be compared across months.
      Column Name Type Description
      month_start date The first day of the month represented by the corresponding row (yyyy-mm-dd)
      is_finalized boolean TRUE if the month is complete, FALSE if not
      service string The AWS service name. Valid values are: Compute, RDS, ElastiCache, OpenSearch, Redshift, MemoryDB
      effective_savings_rate decimal Effective Savings Rate achieved in the given month
      effective_savings_rate_prior_to_subscription decimal Baseline Effective Savings Rate achieved prior to the ProsperOps service 
      service_usage decimal What you would have paid your cloud provider without discounts (actual)
      service_spend decimal What you actually paid your cloud provider, with prepay amortized (actual)
      gross_savings decimal How much you saved on your cloud bill (actual)
      net_savings decimal Your savings net of ProsperOps' charge (actual)
      service_usage_normalized decimal What you would have paid your cloud provider without discounts (normalized)
      service_spend_normalized decimal What you actually paid your cloud provider, with prepay amortized (normalized)
      gross_savings_normalized decimal How much you saved on your cloud bill (normalized)
      net_savings_normalized decimal Your savings net of ProsperOps' charge (normalized)
      savings_share decimal ProsperOps share of savings generated (actual)
      portfolio_actions integer The number of actions our service has taken to purchase, modify, and optimize your commitments
      reserved_instance_utilization_percentage decimal Your overall reserved instance utilization for the service
      savings_plan_utilization_percentage decimal Your overall savings plan utilization for the service
      inherited_savings decimal Savings generated from commitments purchased before ProsperOps (actual)
      base_savings decimal Savings generated from ProsperOps batch-purchased savings plans (actual)
      flex_savings decimal [Compute only] Savings generated from ProsperOps optimized Convertible RIs (actual)
      flex_boost_savings decimal [Compute only] Savings generated from ProsperOps managed Standard RIs (actual)
      smart_savings decimal Savings generated from ProsperOps smart Adaptive Laddered commitments (actual)
      unbilled_savings decimal Savings generated from unbilled commitments (actual)
      inherited_savings_normalized decimal Savings generated from commitments purchased before ProsperOps (normalized)
      base_savings_normalized decimal Savings generated from ProsperOps batch-purchased savings plans (normalized)
      flex_savings_normalized decimal [Compute only] Savings generated from ProsperOps optimized Convertible RIs (normalized)
      flex_boost_savings_normalized decimal [Compute only] Savings generated from ProsperOps managed Standard RIs (normalized)
      smart_savings_normalized decimal Savings generated from ProsperOps smart Adaptive Laddered commitments (normalized)
      unbilled_savings_normalized decimal Savings generated from unbilled commitments (normalized)
      base_one_year_percentage decimal Percent of your portfolio composed of 1 year base commitments
      base_one_year_discount_percentage decimal Blended discount percentage received from 1 year base commitments
      base_three_year_percentage decimal Percent of your portfolio composed of 3 year base commitments
      base_three_year_discount_percentage decimal Blended discount percentage received from 3 year base commitments
      flex_one_year_percentage decimal [Compute only] Percent of your portfolio composed of 1 year ProsperOps optimized Convertible RIs
      flex_one_year_discount_percentage decimal [Compute only] Blended discount percentage received from 1 year ProsperOps optimized Convertible RIs
      flex_three_year_percentage decimal [Compute only] Percent of your portfolio composed of 3 year ProsperOps optimized Convertible RIs
      flex_three_year_discount_percentage decimal [Compute only] Blended discount percentage received from 3 year ProsperOps optimized Convertible RIs
      flex_boost_one_year_percentage decimal [Compute only] Percent of your portfolio composed of 1 year ProsperOps managed Standard RIs
      flex_boost_one_year_discount_percentage decimal [Compute only] Blended discount percentage received from 1 year ProsperOps managed Standard RIs
      flex_boost_three_year_percentage decimal [Compute only] Percent of your portfolio composed of 3 year ProsperOps managed Standard RIs
      flex_boost_three_year_discount_percentage decimal [Compute only] Blended discount percentage received from 3 year ProsperOps managed Standard RIs
      unbilled_one_year_percentage decimal Percent of your portfolio composed of 1 year unbilled commitments
      unbilled_one_year_discount_percentage decimal Blended discount percentage received from 1 year unbilled commitments
      unbilled_three_year_percentage decimal Percent of your portfolio composed of 3 year unbilled commitments
      unbilled_three_year_discount_percentage decimal Blended discount percentage received from 3 year unbilled commitments
      on_demand_percentage decimal Percent of your total usage running on-demand 
      blended_discount_percentage decimal Total blended discount percentage received across all non-on-demand usage
      inherited_spend_coverage decimal On-demand equivalent amount of inherited commitment coverage (normalized)
      inherited_spend_coverage_percentage decimal Percent of inherited spend coverage as a function of total usage
      base_spend_coverage decimal On-demand equivalent amount of base commitment coverage (normalized)
      base_spend_coverage_percentage decimal Percent of base spend coverage as a function of total usage
      flex_spend_coverage decimal [Compute only] On-demand equivalent amount of ProsperOps optimized Convertible RI commitment coverage (normalized)
      flex_spend_coverage_percentage decimal [Compute only] Percent of ProsperOps optimized Convertible RI spend coverage as a function of total usage
      flex_boost_spend_coverage decimal [Compute only] On-demand equivalent amount of ProsperOps managed Standard RI commitment coverage (normalized)
      flex_boost_spend_coverage_percentage decimal [Compute only] Percent of ProsperOps managed Standard RI spend coverage as a function of total usage
      smart_spend_coverage decimal On-demand equivalent amount of ProsperOps smart Adaptive Laddered commitment coverage (normalized)
      smart_spend_coverage_percentage decimal Percent of ProsperOps smart Adaptive Laddered commitment coverage as a function of total usage
      unbilled_spend_coverage decimal On-demand equivalent amount of unbilled commitment coverage (normalized)
      unbilled_spend_coverage_percentage decimal Percent of unbilled commitment coverage as a function of total usage
      uncovered_usage decimal On-demand equivalent amount of uncovered usage (normalized)
      overall_spend_coverage decimal On-demand equivalent amount of aggregate commitment coverage (normalized)
      overall_spend_coverage_percentage decimal Percent of aggregate commitment coverage as a function of total usage
      • All Discounts scope - includes all rate optimization techniques—Reserved Instances, Savings Plans, Spot Instances, and EDP/PPA discounts—providing a comprehensive view of your overall rate optimization outcomes. It's often more applicable for broad FinOps reporting. In this scope, keep in mind that factors outside of ProsperOps' control may affect your savings outcomes, including your Effective Savings Rate.
        • Name
          • prosperops-savings-[managementAccountNumber]-all_discounts-monthly.csv
          • Example: prosperops-savings-123456789012-all_discounts-monthly.csv
        • Rows 
          • One row for each month ProsperOps has been active
          • The final row represents the current (unfinalized) month.
        • Columns (see below)
          • Actual values match your AWS bill (with prepayments amortized). This provides an accurate view of monthly cost and savings but is not useful when comparing across months since the number of days in each month can vary.

          • Normalized values (also with prepayments amortized) have been adjusted to a 30-day month to remove number of day variance and provide a useful representation that can be compared across months.
      Column Name Type Description
      month_start date The first day of the month represented by the corresponding row (yyyy-mm-dd)
      is_finalized boolean TRUE if the month is complete, FALSE if not
      service string The AWS service name. Valid values are: Compute, RDS, ElastiCache, OpenSearch, Redshift, MemoryDB
      effective_savings_rate decimal Effective Savings Rate achieved in the given month
      effective_savings_rate_prior_to_subscription decimal Baseline Effective Savings Rate achieved prior to the ProsperOps service 
      service_usage decimal What you would have paid your cloud provider without discounts (actual)
      service_spend decimal What you actually paid your cloud provider, with prepay amortized (actual)
      gross_savings decimal How much you saved on your cloud bill (actual)
      net_savings decimal Your savings net of ProsperOps' charge (actual)
      service_usage_normalized decimal What you would have paid your cloud provider without discounts (normalized)
      service_spend_normalized decimal What you actually paid your cloud provider, with prepay amortized (normalized)
      gross_savings_normalized decimal How much you saved on your cloud bill (normalized)
      net_savings_normalized decimal Your savings net of ProsperOps' charge (normalized)
      savings_share decimal ProsperOps share of savings generated (actual)
      portfolio_actions integer The number of actions our service has taken to purchase, modify, and optimize your commitments
      reserved_instance_utilization_percentage decimal Your overall reserved instance utilization for the service
      savings_plan_utilization_percentage decimal Your overall savings plan utilization for the service
      inherited_savings decimal Savings generated from commitments purchased before ProsperOps (actual)
      base_savings decimal Savings generated from ProsperOps batch-purchased savings plans (actual)
      flex_savings decimal [Compute only] Savings generated from ProsperOps optimized Convertible RIs (actual)
      flex_boost_savings decimal [Compute only] Savings generated from ProsperOps managed Standard RIs (actual)
      smart_savings decimal Savings generated from ProsperOps smart Adaptive Laddered commitments (actual)
      unbilled_savings decimal Savings generated from unbilled commitments (actual)
      spot_savings decimal Savings generated from the use of spot instances (actual)
      other_private_rate_savings decimal Savings generated from other rate optimization activities, e.g. private rates savings off of on-demand EC2, Lambda, Fargate (actual)
      inherited_savings_normalized decimal Savings generated from commitments purchased before ProsperOps (normalized)
      base_savings_normalized decimal Savings generated from ProsperOps batch-purchased savings plans (normalized)
      flex_savings_normalized decimal [Compute only] Savings generated from ProsperOps optimized Convertible RIs (normalized)
      flex_boost_savings_normalized decimal [Compute only] Savings generated from ProsperOps managed Standard RIs (normalized)
      smart_savings_normalized decimal Savings generated from ProsperOps smart Adaptive Laddered commitments (normalized)
      unbilled_savings_normalized decimal Savings generated from unbilled commitments (normalized)
      spot_savings_normalized decimal Savings generated from the use of spot instances (normalized)
      other_private_rate_savings_normalized decimal Savings generated from other rate optimization activities, e.g. private rates savings off of on-demand EC2, Lambda, Fargate (normalized)
      base_one_year_percentage decimal Percent of your portfolio composed of 1 year base commitments
      base_one_year_discount_percentage decimal Blended discount percentage received from 1 year base commitments
      base_three_year_percentage decimal Percent of your portfolio composed of 3 year base commitments
      base_three_year_discount_percentage decimal Blended discount percentage received from 3 year base commitments
      flex_one_year_percentage decimal [Compute only] Percent of your portfolio composed of 1 year ProsperOps optimized Convertible RIs
      flex_one_year_discount_percentage decimal [Compute only] Blended discount percentage received from 1 year ProsperOps optimized Convertible RIs
      flex_three_year_percentage decimal [Compute only] Percent of your portfolio composed of 3 year ProsperOps optimized Convertible RIs
      flex_three_year_discount_percentage decimal [Compute only] Blended discount percentage received from 3 year ProsperOps optimized Convertible RIs
      flex_boost_one_year_percentage decimal [Compute only] Percent of your portfolio composed of 1 year ProsperOps managed Standard RIs
      flex_boost_one_year_discount_percentage decimal [Compute only] Blended discount percentage received from 1 year ProsperOps managed Standard RIs
      flex_boost_three_year_percentage decimal [Compute only] Percent of your portfolio composed of 3 year ProsperOps managed Standard RIs
      flex_boost_three_year_discount_percentage decimal [Compute only] Blended discount percentage received from 3 year ProsperOps managed Standard RIs
      unbilled_one_year_percentage decimal Percent of your portfolio composed of 1 year unbilled commitments
      unbilled_one_year_discount_percentage decimal Blended discount percentage received from 1 year unbilled commitments
      unbilled_three_year_percentage decimal Percent of your portfolio composed of 3 year unbilled commitments
      unbilled_three_year_discount_percentage decimal Blended discount percentage received from 3 year unbilled commitments
      spot_percentage decimal Percent of your portfolio composed of spot usage
      spot_discount_percentage decimal Blended discount percentage received off of spot usage
      capacity_block_reservation_percentage decimal Percent of your portfolio composed of capacity block reservation usage
      capacity_block_reservation_discount_percentage decimal Blended discount percentage received off of capacity block reservation usage
      on_demand_percentage decimal Percent of your usage running on-demand
      on_demand_discount_percentage decimal Blended discount percentage received off of on-demand usage
      blended_discount_percentage decimal Total blended discount percentage received across all usage
      inherited_spend_coverage decimal On-demand equivalent amount of inherited commitment coverage (normalized)
      inherited_spend_coverage_percentage decimal Percent of inherited spend coverage as a function of total usage
      base_spend_coverage decimal On-demand equivalent amount of base commitment coverage (normalized)
      base_spend_coverage_percentage decimal Percent of base spend coverage as a function of total usage
      flex_spend_coverage decimal [Compute only] On-demand equivalent amount of ProsperOps optimized Convertible RI commitment coverage (normalized)
      flex_spend_coverage_percentage decimal [Compute only] Percent of ProsperOps optimized Convertible RI spend coverage as a function of total usage
      flex_boost_spend_coverage decimal [Compute only] On-demand equivalent amount of ProsperOps managed Standard RI commitment coverage (normalized)
      flex_boost_spend_coverage_percentage decimal [Compute only] Percent of ProsperOps managed Standard RI spend coverage as a function of total usage
      smart_spend_coverage decimal On-demand equivalent amount of ProsperOps smart Adaptive Laddered commitment coverage (normalized)
      smart_spend_coverage_percentage decimal Percent of ProsperOps smart Adaptive Laddered commitment coverage as a function of total usage
      spot_spend_coverage decimal On-demand equivalent amount of spot usage (normalized)
      spot_spend_coverage_percentage decimal Percent of spot usage a function of total usage
      unbilled_spend_coverage decimal On-demand equivalent amount of unbilled commitment coverage (normalized)
      unbilled_spend_coverage_percentage decimal Percent of unbilled commitment coverage as a function of total usage
      capacity_block_reservation_usage decimal On-demand equivalent amount of capacity block reservation usage (normalized)
      uncovered_usage decimal On-demand equivalent amount of uncovered usage (normalized)
      overall_spend_coverage decimal On-demand equivalent amount of aggregate commitment plus spot coverage (normalized)
      overall_spend_coverage_percentage decimal Percent of aggregate commitment plus spot coverage as a function of total usage