Draft

CATEs

CATE Coverage

The simulations are based on the the make_heterogeneous_data-DGP with \(2000\) observations. The groups are defined based on the first covariate, analogously to the CATE PLR Example, but rely on LightGBM to estimate nuisance elements (due to time constraints).

The non-uniform results (coverage, ci length and bias) refer to averaged values over all groups (point-wise confidende intervals).

DoubleML Version                        0.9.0
Script                   plr_cate_coverage.py
Date                      2024-09-09 09:52:53
Total Runtime (seconds)           8957.487109
Python Version                         3.12.5
Table 1: Coverage for 95.0%-Confidence Interval over 1000 Repetitions
Learner l Learner m Bias CI Length Coverage Uniform CI Length Uniform Coverage
LGBM LGBM 0.117 0.294 0.652 0.626 0.831
LGBM Lasso 0.091 0.404 0.921 0.861 0.995
Lasso LGBM 0.496 0.360 0.053 0.766 0.000
Lasso Lasso 0.050 0.244 0.944 0.523 0.998
Table 2: Coverage for 90.0%-Confidence Interval over 1000 Repetitions
Learner l Learner m Bias CI Length Coverage Uniform CI Length Uniform Coverage
LGBM LGBM 0.117 0.246 0.549 0.626 0.838
LGBM Lasso 0.091 0.339 0.864 0.862 0.996
Lasso LGBM 0.496 0.302 0.042 0.766 0.000
Lasso Lasso 0.050 0.205 0.892 0.520 0.999