[SCIE-IEEE Access] Empirical Measurement of Client Contribution for Federated Learning With Data Size Diversification - S. K. Shyn, D. Kim and K. Kim
- 인공지능 융합 연구실
- 조회수441
- 2022-11-18
Abstract. Client contribution evaluation is crucial in federated learning(FL) to effectively select inuential clients. Contrary to data valuation in centralized settings, client contribution evaluation in FL faces a lack of data accessibility and consequently challenges stable quantication of the impact of data heterogeneity. To address this instability of client contribution evaluation, we introduce an empirical method, Federated Client Contribution Evaluation through Accuracy Approximation(FedCCEA), which exploits data size as a tool for client contribution evaluation. After several FL simulations, FedCCEA approximates the test accuracy using the sampled data size and extracts the client contribution from the trained accuracy approximator. In addition, FedCCEA grants data size diversication, which reduces the massive variation in accuracy resulting from game-theoretic strategies. Several experiments have shown that FedCCEA strengthens the robustness to diverse heterogeneous data environments and the practicality of partial participation.
Index Terms. Client contribution, client selection, data valuation, data heterogeneity, federated learning, incentive mechanism, shapley value.