PulseAugur
EN
LIVE 02:20:28

Gradient Boosting Prediction Costs Driven by Tree Count, Not Features

This article details the cost of running gradient boosting predictions at scale, emphasizing that the number of trees in the model is the primary driver of computational cost, not the number of features. The author provides a cost model showing that scoring 50 million rows with 800 trees costs approximately $0.13 per night, or $49 annually, assuming specific compute prices and throughput. Adjusting hyperparameters like the learning rate can significantly increase the tree count and thus the cost, even if accuracy gains are minimal. AI

IMPACT Provides a cost model for optimizing inference of gradient boosted models, highlighting key cost drivers for AI operators.

RANK_REASON Article provides analysis and cost modeling for a specific machine learning technique, rather than announcing a new release or event.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Gradient Boosting Prediction Costs Driven by Tree Count, Not Features

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Multigrid ·

    What Running Gradient Boosting Predictions at Batch Scale Costs

    <p>Scoring a boosted tree ensemble is cheap per row and expensive in aggregate, and almost nobody knows which of their parameters is driving the bill. It is the tree count. Here is the arithmetic that shows why, with every input stated so you can substitute your own.</p> <p>Every…