Objective: The aim of this paper is to present bootstrap algorithms for measuring the accuracy of estimation and prediction in design-based and model-based approaches in survey sampling and small area estimation. Three proposals of prediction-mean squared error estimators are also examined. Research Design & Methods: Various bootstrap procedures are shown and used to estimate the design- and prediction-mean squared errors based on real data. Computations are supported by two R packages. Findings: Three prediction-mean squared error estimators are proposed. Implications / Recommendations: The bootstrap algorithms used in the design-based approach give similar results for the considered data for the variance estimates of the considered estimator, implying that the speed of the algorithms may be important for practitioners in cases of similar properties. The proposed estimators of the prediction mean squared error produce higher estimates than other estimators in the model-based approach, indicating a positive bias that can be interpreted as a pessimistic accuracy estimate. Contribution: All the presented bootstrap algorithms are easily applicable using two R packages available at R CRAN and GitHub. Three double bootstrap prediction-MSE estimators are proposed and analysed in the real-data application.
Read full abstract