Draft

Flexible covariate adjustments in RDD

Sharp Design

DoubleML Version                      0.9.dev0
Script                   rdd_sharp_coverage.py
Date                       2024-12-02 14:40:41
Total Runtime (seconds)            4122.115155
Python Version                          3.12.7
Table 1: Coverage for 95.0%-Confidence Interval over 500 Repetitions
Method Learner g fs specification Bias CI Length Coverage
rdflex Global linear cutoff 0.553 2.623 0.922
rdflex LGBM cutoff 0.139 0.682 0.960
rdflex Linear cutoff 0.558 2.638 0.918
rdflex Stacked cutoff 0.130 0.666 0.964
rdflex Global linear cutoff and score 0.555 2.622 0.922
rdflex LGBM cutoff and score 0.145 0.713 0.950
rdflex Linear cutoff and score 0.558 2.637 0.922
rdflex Stacked cutoff and score 0.142 0.694 0.956
rdflex Global linear interacted cutoff and score 0.555 2.624 0.926
rdflex LGBM interacted cutoff and score 0.151 0.715 0.948
rdflex Linear interacted cutoff and score 0.554 2.652 0.916
rdflex Stacked interacted cutoff and score 0.142 0.690 0.962
rdrobust linear cutoff 0.555 2.597 0.916
Table 2: Coverage for 90.0%-Confidence Interval over 500 Repetitions
Method Learner g fs specification Bias CI Length Coverage
rdflex Global linear cutoff 0.553 2.201 0.874
rdflex LGBM cutoff 0.139 0.572 0.914
rdflex Linear cutoff 0.558 2.214 0.874
rdflex Stacked cutoff 0.130 0.559 0.900
rdflex Global linear cutoff and score 0.555 2.201 0.876
rdflex LGBM cutoff and score 0.145 0.598 0.902
rdflex Linear cutoff and score 0.558 2.213 0.870
rdflex Stacked cutoff and score 0.142 0.582 0.880
rdflex Global linear interacted cutoff and score 0.555 2.202 0.878
rdflex LGBM interacted cutoff and score 0.151 0.600 0.886
rdflex Linear interacted cutoff and score 0.554 2.225 0.880
rdflex Stacked interacted cutoff and score 0.142 0.579 0.904
rdrobust linear cutoff 0.555 2.180 0.874

Fuzzy Design

DoubleML Version                      0.9.dev0
Script                   rdd_fuzzy_coverage.py
Date                       2024-12-02 19:02:59
Total Runtime (seconds)            19854.44735
Python Version                          3.12.7
Table 3: Coverage for 95.0%-Confidence Interval over 328 Repetitions
Method Learner g Learner m fs specification Bias CI Length Coverage
rdflex Global linear Global linear cutoff 2.640 13.125 0.966
rdflex Global linear LGBM cutoff 2.663 13.174 0.973
rdflex Global linear Linear cutoff 2.657 13.194 0.966
rdflex Global linear Stacked cutoff 2.647 12.827 0.963
rdflex LGBM Global linear cutoff 0.482 2.551 0.966
rdflex LGBM LGBM cutoff 0.500 2.533 0.982
rdflex LGBM Linear cutoff 0.480 2.594 0.991
rdflex LGBM Stacked cutoff 0.480 2.491 0.973
rdflex Linear Global linear cutoff 2.614 13.086 0.970
rdflex Linear LGBM cutoff 2.656 13.058 0.970
rdflex Linear Linear cutoff 2.661 13.281 0.970
rdflex Linear Stacked cutoff 2.547 12.771 0.973
rdflex Stacked Global linear cutoff 0.512 2.609 0.973
rdflex Stacked LGBM cutoff 0.484 2.489 0.979
rdflex Stacked Linear cutoff 0.508 2.689 0.979
rdflex Stacked Stacked cutoff 0.456 2.472 0.973
rdflex Global linear Global linear cutoff and score 2.633 13.102 0.966
rdflex Global linear LGBM cutoff and score 2.636 12.980 0.973
rdflex Global linear Linear cutoff and score 2.656 13.237 0.966
rdflex Global linear Stacked cutoff and score 2.650 13.156 0.976
rdflex LGBM Global linear cutoff and score 0.527 2.694 0.985
rdflex LGBM LGBM cutoff and score 0.548 2.668 0.973
rdflex LGBM Linear cutoff and score 0.505 2.761 0.976
rdflex LGBM Stacked cutoff and score 0.510 2.623 0.985
rdflex Linear Global linear cutoff and score 2.649 13.181 0.973
rdflex Linear LGBM cutoff and score 2.689 13.209 0.979
rdflex Linear Linear cutoff and score 2.657 13.301 0.970
rdflex Linear Stacked cutoff and score 2.675 13.171 0.966
rdflex Stacked Global linear cutoff and score 0.504 2.685 0.979
rdflex Stacked LGBM cutoff and score 0.518 2.616 0.973
rdflex Stacked Linear cutoff and score 0.505 2.729 0.991
rdflex Stacked Stacked cutoff and score 0.511 2.743 0.985
rdflex Global linear Global linear interacted cutoff and score 2.603 13.085 0.966
rdflex Global linear LGBM interacted cutoff and score 2.633 13.096 0.970
rdflex Global linear Linear interacted cutoff and score 2.636 13.236 0.966
rdflex Global linear Stacked interacted cutoff and score 2.630 13.005 0.970
rdflex LGBM Global linear interacted cutoff and score 0.542 2.716 0.982
rdflex LGBM LGBM interacted cutoff and score 0.528 2.691 0.979
rdflex LGBM Linear interacted cutoff and score 0.525 2.710 0.988
rdflex LGBM Stacked interacted cutoff and score 0.545 2.634 0.985
rdflex Linear Global linear interacted cutoff and score 2.658 13.163 0.970
rdflex Linear LGBM interacted cutoff and score 2.760 13.609 0.976
rdflex Linear Linear interacted cutoff and score 2.668 13.324 0.970
rdflex Linear Stacked interacted cutoff and score 2.737 13.321 0.973
rdflex Stacked Global linear interacted cutoff and score 0.565 2.778 0.973
rdflex Stacked LGBM interacted cutoff and score 0.516 2.688 0.976
rdflex Stacked Linear interacted cutoff and score 0.528 2.795 0.970
rdflex Stacked Stacked interacted cutoff and score 0.527 2.777 0.982
rdrobust linear linear cutoff 2.646 13.005 0.970
Table 4: Coverage for 90.0%-Confidence Interval over 328 Repetitions
Method Learner g Learner m fs specification Bias CI Length Coverage
rdflex Global linear Global linear cutoff 2.640 11.015 0.930
rdflex Global linear LGBM cutoff 2.663 11.056 0.927
rdflex Global linear Linear cutoff 2.657 11.073 0.927
rdflex Global linear Stacked cutoff 2.647 10.765 0.927
rdflex LGBM Global linear cutoff 0.482 2.141 0.936
rdflex LGBM LGBM cutoff 0.500 2.126 0.942
rdflex LGBM Linear cutoff 0.480 2.177 0.954
rdflex LGBM Stacked cutoff 0.480 2.091 0.921
rdflex Linear Global linear cutoff 2.614 10.982 0.930
rdflex Linear LGBM cutoff 2.656 10.959 0.924
rdflex Linear Linear cutoff 2.661 11.146 0.924
rdflex Linear Stacked cutoff 2.547 10.718 0.933
rdflex Stacked Global linear cutoff 0.512 2.190 0.933
rdflex Stacked LGBM cutoff 0.484 2.089 0.945
rdflex Stacked Linear cutoff 0.508 2.256 0.945
rdflex Stacked Stacked cutoff 0.456 2.075 0.939
rdflex Global linear Global linear cutoff and score 2.633 10.996 0.930
rdflex Global linear LGBM cutoff and score 2.636 10.893 0.924
rdflex Global linear Linear cutoff and score 2.656 11.109 0.930
rdflex Global linear Stacked cutoff and score 2.650 11.041 0.933
rdflex LGBM Global linear cutoff and score 0.527 2.261 0.954
rdflex LGBM LGBM cutoff and score 0.548 2.239 0.942
rdflex LGBM Linear cutoff and score 0.505 2.317 0.948
rdflex LGBM Stacked cutoff and score 0.510 2.202 0.960
rdflex Linear Global linear cutoff and score 2.649 11.062 0.924
rdflex Linear LGBM cutoff and score 2.689 11.086 0.933
rdflex Linear Linear cutoff and score 2.657 11.163 0.918
rdflex Linear Stacked cutoff and score 2.675 11.054 0.924
rdflex Stacked Global linear cutoff and score 0.504 2.253 0.939
rdflex Stacked LGBM cutoff and score 0.518 2.195 0.942
rdflex Stacked Linear cutoff and score 0.505 2.290 0.951
rdflex Stacked Stacked cutoff and score 0.511 2.302 0.960
rdflex Global linear Global linear interacted cutoff and score 2.603 10.982 0.933
rdflex Global linear LGBM interacted cutoff and score 2.633 10.990 0.930
rdflex Global linear Linear interacted cutoff and score 2.636 11.108 0.936
rdflex Global linear Stacked interacted cutoff and score 2.630 10.914 0.933
rdflex LGBM Global linear interacted cutoff and score 0.542 2.279 0.939
rdflex LGBM LGBM interacted cutoff and score 0.528 2.259 0.936
rdflex LGBM Linear interacted cutoff and score 0.525 2.274 0.945
rdflex LGBM Stacked interacted cutoff and score 0.545 2.210 0.933
rdflex Linear Global linear interacted cutoff and score 2.658 11.047 0.921
rdflex Linear LGBM interacted cutoff and score 2.760 11.421 0.936
rdflex Linear Linear interacted cutoff and score 2.668 11.182 0.933
rdflex Linear Stacked interacted cutoff and score 2.737 11.179 0.921
rdflex Stacked Global linear interacted cutoff and score 0.565 2.332 0.930
rdflex Stacked LGBM interacted cutoff and score 0.516 2.256 0.936
rdflex Stacked Linear interacted cutoff and score 0.528 2.346 0.939
rdflex Stacked Stacked interacted cutoff and score 0.527 2.330 0.942
rdrobust linear linear cutoff 2.646 10.914 0.927