Skip to main content

Advanced Settings

The Advanced step of a new AutoML job is optional. Each section has defaults that suit most jobs; expand one to change it. Which sections appear depends on the problem type:

SectionTabularMultimodalTime Series
Model SelectionYes
Ensemble & StackingYes
Data Handling & FeaturesYes
Training BehaviorYesVerbosity onlyVerbosity only
Hyperparameter Optimization (HPO)Yes
Model HyperparametersYes
Time Series ConfigurationYes
Multimodal ConfigurationYes
Custom JSON ConfigurationYes

Model Selection​

The model families to train. The header counts the enabled ones. Fewer families train faster.

GroupFamilyOn by default
Gradient BoostingLightGBM (GBM): fast gradient boostingYes
CatBoost (CAT): strong on categorical featuresYes
XGBoost (XGB): robust gradient boostingYes
Tree-BasedRandom Forest (RF): stable, interpretableYes
Extra Trees (XT): a faster random forest variantYes
Neural NetworksPyTorch Neural Network (NN_TORCH)Yes
FastAI Neural Network (FASTAI)Yes
Transformer (FT_TRANSFORMER): GPU recommendedNo
Other ModelsK-Nearest Neighbors (KNN)Yes
Linear/Logistic Regression (LR)Yes
TabPFN: a foundation model for up to 10,000 rowsNo

Ensemble & Stacking​

Bagging​

SettingDefaultMeaning
Bag Folds (K-fold)0 (off)Train each model on K folds and average them. 5 to 10 is typical; 0 to 20.
Bag Sets (Repeats)1Repeat the bagging with new folds. More sets are better but slower; 1 to 20.
Save bag fold modelsOnKeep each fold's model

Stacking​

SettingDefaultMeaning
Stack LevelsNo stacking1, 2 or 3 levels (3 is slow) of models trained on the previous level's predictions
Dynamic stackingOffDetects stacking overfitting and decides the levels itself
Fit weighted ensemble in each layerOnA weighted ensemble of each layer's models
Include original features in stackerOnStacked models also see the original columns

Post-Training​

SettingDefaultMeaning
Refit best model on full dataOffRefit the best model on the training and validation rows together
Set refitted as best modelOffServe the refitted model
Keep only best modelOffDelete the other models to save space
Delete auxiliary filesOffDelete files not needed for prediction

Data Handling & Features​

SettingDefaultMeaning
Feature GeneratorAuto (recommended)AutoGluon's automatic feature engineering (dates, categories, text). Disabled uses the columns as they are.
Sample Weight ColumnNoneA column whose values weight each row
Generate text n-gram featuresOnWord n-gram counts from text columns
Extract text special featuresOnLengths, symbol and word counts from text columns
Include raw text as featuresOffPass text through as text
Enable feature pruningOffDrop features that do not help the score

Training Behavior​

SettingDefaultMeaning
Inference Time Limit (seconds/row)0 (no limit)The slowest prediction per row allowed; slower models are left out
Fit StrategySequential (stable)Parallel fits models at the same time with Ray (experimental)
Verbosity LevelNormalSilent, Minimal, Normal, Detailed or Debug: how much the training log says
Calibrate probabilities (classification)AutoTemperature-scale a classifier's probabilities on the validation rows
Calibrate decision threshold (binary)AutoChoose the threshold that maximizes the metric
Track learning curvesOffRecord each model's metric over its iterations
Raise on model failureOffFail the job when one model fails, instead of skipping it (debugging)

Hyperparameter Optimization (HPO)​

Off by default: every family trains once per bag with its defaults. Enable hyperparameter tuning searches each family's hyperparameters over AutoGluon's search space for it.

SettingDefaultChoices
Search StrategyAutoAuto (Bayesian for neural networks, random for the others), Random Search, Bayesian Optimization
Number of Trials101 to 100, per family
Time Limit per Trial (seconds)30060 to 3,600
SchedulerLocalLocal or FIFO

LightGBM, CatBoost, XGBoost, the linear model and the neural networks are tuned. Random Forest, Extra Trees and K-Nearest Neighbors have no search space and train once with their defaults. The job's time limit still applies: tuning stops when it runs out.

Model Hyperparameters​

Off by default: every family trains with AutoGluon's defaults for the preset, and tuning searches them. Turn on Customize model hyperparameters to fix values for every model of a family; tuning then searches only the hyperparameters you did not set.

TabHyperparameters (starting values)
LightGBMBoosting Rounds 1000, Num Leaves 128, Learning Rate 0.05, Feature Fraction 0.9, Min Data in Leaf 20, Extra Trees mode off
CatBoostIterations 1000, Tree Depth 6, Learning Rate 0.05, L2 Regularization 3, Random Strength 1
XGBoostEstimators 1000, Max Depth 6, Learning Rate 0.05, Subsample 0.9, Colsample by Tree 0.9, Min Child Weight 1
Random ForestEstimators 300, Max Features sqrt (or log2), Min Samples Leaf 1
Neural NetEpochs 100, Learning Rate 0.001, Dropout 0.1, Batch Size 256 (32 to 1,024), Hidden Layers 3, Hidden Size 256 (64 to 1,024)

Time Series Configuration​

SettingDefaultMeaning
Prediction Length (Horizon)1How many steps ahead to forecast (1 to 365)
FrequencyDaily (D)Minute (T), Hourly (H), Daily (D), Weekly (W), Monthly (M), Quarterly (Q) or Yearly (Y)
ID Column (Series Identifier)The column naming each series, such as item_id or store_id
Timestamp ColumnThe column holding each row's time
Known CovariatesComma-separated columns whose future values are known when forecasting, such as holidays or promotions

A forecaster produces a point forecast and the 0.1, 0.5 and 0.9 quantiles.

Multimodal Configuration​

SettingDefaultMeaning
Text ColumnsComma-separated columns read as free text
Image ColumnsComma-separated columns naming image files in the dataset's volume; the job fetches them before training
Text BackboneBERT BaseBERT Base, RoBERTa Base, ELECTRA Base or DistilBERT
Max Text Length (tokens)512128, 256 or 512
Image Size (pixels)224x224224x224, 384x384 or 512x512
Enable image augmentationOnRandomly augments training images (AutoGluon's trivial augment)
Enable multimodal ensemblingOffTrain several multimodal models, one per backbone, and ensemble them

Custom JSON Configuration​

Tabular jobs only, for advanced users. Each setting must be a JSON object; Next refuses one that is not, naming it and why, and so does the REST API.

  • Custom Hyperparameters (JSON): AutoGluon's hyperparameters argument, keyed by family, for example {"GBM": {"num_boost_round": 500}, "CAT": {"iterations": 500}}. A family named here replaces that family's settings from Model Hyperparameters.
  • ag_args_fit (JSON): arguments for every model's fit, for example {"num_cpus": 4, "num_gpus": 1}.

The REST API and SDK also take ag_args_json and ag_args_ensemble_json (see the AutoML REST API). Switching a job to Multimodal or Time Series clears its custom JSON.