Alternative Statistical Inference for the First Normalized Incomplete Moment
AuthorsJiannan Lu, Peng Ding†, Anqi Zhao‡
Alternative Statistical Inference for the First Normalized Incomplete Moment
AuthorsJiannan Lu, Peng Ding†, Anqi Zhao‡
This paper re-examines the first normalized incomplete moment, a well-established measure of inequality with wide applications in economic and social sciences. Despite the popularity of the measure itself, existing statistical inference appears to lag behind the needs of modern-age analytics. To fill this gap, we propose an alternative solution that is intuitive, computationally efficient, mathematically equivalent to the existing solutions for “standard” cases, and easily adaptable to “non-standard” ones. The theoretical and practical advantages of the proposed methodology are demonstrated via both simulated and real-life examples. In particular, we discover that a common practice in industry can lead to highly non-trivial challenges for trustworthy statistical inference, or misleading decision making altogether.
All About Sample-Size Calculations for A/B Testing: Novel Extensions and Practical Guide
September 11, 2023research area Data Science and Annotation, research area Methods and Algorithmsconference CIKM
While there exists a large amount of literature on the general challenges and best practices for trustworthy online A/B testing, there are limited studies on sample size estimation, which plays a crucial role in trustworthy and efficient A/B testing that ensures the resulting inference has a sufficient power and type I error control. For example, when the sample size is under-estimated the statistical inference, even with the correct analysis…
Dynamic Memory for Interpretable Sequential Optimization
August 3, 2022research area Data Science and Annotation, research area Methods and AlgorithmsWorkshop at KDD
Real-world applications of reinforcement learning for recommendation and experimentation faces a practical challenge: the relative reward of different bandit arms can evolve over the lifetime of the learning agent. To deal with these non-stationary cases, the agent must forget some historical knowledge, as it may no longer be relevant to minimise regret. We present a solution to handling non-stationarity that is suitable for deployment at scale,…