Robust learning and optimization in distributionally robust stochastic variational inequalities under uncertainty
DOI:
https://doi.org/10.35335/emod.v17i1.70Keywords:
Distributionally robust, Optimization, Robust learning, Stochastic variational inequalities, UncertaintyAbstract
Robust learning and optimization in distributionally robust stochastic variational inequalities under uncertainty is a crucial research area that addresses the challenge of making optimal decisions in the presence of distributional ambiguity. This research explores the development of methodologies and algorithms to handle uncertainty in variational inequalities, incorporating a distributionally robust framework that considers a range of possible distributions or uncertainty sets. By minimizing the worst-case expected performance across these distributions, the proposed approaches ensure robustness and optimality in decision-making under uncertainty. The research encompasses theoretical analysis, algorithm development, and empirical evaluations to demonstrate the effectiveness of the proposed methodologies in various domains, such as portfolio optimization and supply chain management. The outcomes of this research contribute to the advancement of robust optimization techniques, enabling decision-makers to make reliable and robust decisions in complex real-world systems
References
Batista, A., Pozo, D., & Vera, J. (2021). Managing the unknown: A distributionally robust model for the admission planning problem under uncertain length of stay. Computers & Industrial Engineering, 154, 107041.
Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., & Tickoo, O. (2021). Uncertainty as a form of transparency: Measuring, communicating, and using uncertainty. Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, 401–413.
Blanchet, J., Kang, Y., Olea, J. L. M., Nguyen, V. A., & Zhang, X. (2020). Machine Learning’s Dropout Training is Distributionally Robust Optimal. ArXiv Preprint ArXiv:2009.06111.
Can, B., Gurbuzbalaban, M., & Aybat, N. S. (2022). A Variance-Reduced Stochastic Accelerated Primal Dual Algorithm. ArXiv Preprint ArXiv:2202.09688.
Chen, L., Liu, Y., Yang, X., & Zhang, J. (2022). Stochastic Approximation Methods for the Two-Stage Stochastic Linear Complementarity Problem. SIAM Journal on Optimization, 32(3), 2129–2155.
Chen, X., Pong, T. K., & Wets, R. J. B. (2017). Two-stage stochastic variational inequalities: an ERM-solution procedure. Mathematical Programming, 165, 71–111.
Dambrine, M., Khan, A. A., & Sama, M. (2022). A stochastic regularized second-order iterative scheme for optimal control and inverse problems in stochastic partial differential equations. Philosophical Transactions of the Royal Society A, 380(2236), 20210352.
de Jonge, B., Klingenberg, W., Teunter, R., & Tinga, T. (2015). Optimum maintenance strategy under uncertainty in the lifetime distribution. Reliability Engineering & System Safety, 133, 59–67.
de la Barra, J., Gil, E., Angulo, A., & Navarro-Espinosa, A. (2020). Effect of failure rates uncertainty on distribution systems reliability. 2020 IEEE Power & Energy Society General Meeting (PESGM), 1–5.
Duan, C., Fang, W., Jiang, L., Yao, L., & Liu, J. (2018). Distributionally robust chance-constrained approximate AC-OPF with Wasserstein metric. IEEE Transactions on Power Systems, 33(5), 4924–4936.
Dürr, O., Sick, B., & Murina, E. (2020). Probabilistic deep learning: With python, keras and tensorflow probability. Manning Publications.
Esfahani, P. M., & Kuhn, D. (2015). Data-driven distributionally robust optimization using the Wasserstein metric: Performance guarantees and tractable reformulations. ArXiv Preprint ArXiv:1505.05116.
Fani, A., Naseri, H., Golroo, A., Mirhassani, S. A., & Gandomi, A. H. (2022). A progressive hedging approach for large-scale pavement maintenance scheduling under uncertainty. International Journal of Pavement Engineering, 23(7), 2460–2472.
Gao, B.-B., Xing, C., Xie, C.-W., Wu, J., & Geng, X. (2017). Deep label distribution learning with label ambiguity. IEEE Transactions on Image Processing, 26(6), 2825–2838.
Gao, J., Xu, Y., Barreiro-Gomez, J., Ndong, M., Smyrnakis, M., & Tembine, H. (2018). Distributionally robust optimization. Algorithms-Examples, 1.
Gersonius, B., Ashley, R., Jeuken, A., Pathinara, A., & Zevenbergen, C. (2015). Accounting for uncertainty and flexibility in flood risk management: comparing R eal‐I n‐O ptions optimisation and A daptation T ipping P oints. Journal of Flood Risk Management, 8(2), 135–144.
Gu, N., Wang, H., Zhang, J., & Wu, C. (2021). Bridging chance-constrained and robust optimization in an emission-aware economic dispatch with energy storage. IEEE Transactions on Power Systems, 37(2), 1078–1090.
Husain, H., Nguyen, V., & Hengel, A. van den. (2022). Distributionally Robust Bayesian Optimization with $phi $-divergences. ArXiv Preprint ArXiv:2203.02128.
Iusem, A. N., Jofré, A., Oliveira, R. I., & Thompson, P. (2019). Variance-based extragradient methods with line search for stochastic variational inequalities. SIAM Journal on Optimization, 29(1), 175–206.
Iusem, A. N., Jofré, A., & Thompson, P. (2019). Incremental constraint projection methods for monotone stochastic variational inequalities. Mathematics of Operations Research, 44(1), 236–263.
Juan, A. A., Faulin, J., Grasman, S. E., Rabe, M., & Figueira, G. (2015). A review of simheuristics: Extending metaheuristics to deal with stochastic combinatorial optimization problems. Operations Research Perspectives, 2, 62–72.
Kamarposhti, M. A., Colak, I., Shokouhandeh, H., Iwendi, C., Padmanaban, S., & Band, S. S. (2022). Optimum operation management of microgrids with cost and environment pollution reduction approach considering uncertainty using multi‐objective NSGAII algorithm. IET Renewable Power Generation.
Kannan, A., & Shanbhag, U. V. (2019). Optimal stochastic extragradient schemes for pseudomonotone stochastic variational inequality problems and their variants. Computational Optimization and Applications, 74(3), 779–820.
Kannan, R., & Luedtke, J. R. (2021). A stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs. Mathematical Programming Computation, 13(4), 705–751.
Kara, G., Özmen, A., & Weber, G.-W. (2019). Stability advances in robust portfolio optimization under parallelepiped uncertainty. Central European Journal of Operations Research, 27, 241–261.
Keith, A. J., & Ahner, D. K. (2021). A survey of decision making and optimization under uncertainty. Annals of Operations Research, 300(2), 319–353.
Kuhn, D., Esfahani, P. M., Nguyen, V. A., & Shafieezadeh-Abadeh, S. (2019). Wasserstein distributionally robust optimization: Theory and applications in machine learning. In Operations research & management science in the age of analytics (pp. 130–166). Informs.
Kuznetsova, E., Ruiz, C., Li, Y.-F., & Zio, E. (2015). Analysis of robust optimization for decentralized microgrid energy management under uncertainty. International Journal of Electrical Power & Energy Systems, 64, 815–832.
Levy, D., Carmon, Y., Duchi, J. C., & Sidford, A. (2020). Large-scale methods for distributionally robust optimization. Advances in Neural Information Processing Systems, 33, 8847–8860.
Li, B., & Zhang, R. (2021). A new mean-variance-entropy model for uncertain portfolio optimization with liquidity and diversification. Chaos, Solitons & Fractals, 146, 110842.
Li, J., Chen, C., & So, A. M.-C. (2020). Fast epigraphical projection-based incremental algorithms for wasserstein distributionally robust support vector machine. Advances in Neural Information Processing Systems, 33, 4029–4039.
Li, M., Zhang, C., Ding, M., & Lv, R. (2022). A two-stage stochastic variational inequality model for storage and dynamic distribution of medical supplies in epidemic management. Applied Mathematical Modelling, 102, 35–61.
Liu, H., Han, K., Gayah, V. V, Friesz, T. L., & Yao, T. (2015). Data-driven linear decision rule approach for distributionally robust optimization of on-line signal control. Transportation Research Part C: Emerging Technologies, 59, 260–277.
Lu, S., Lee, J. H., & You, F. (2020). Soft‐constrained model predictive control based on data‐driven distributionally robust optimization. AIChE Journal, 66(10), e16546.
Lu, Y., Yang, L., Yang, K., Gao, Z., Zhou, H., Meng, F., & Qi, J. (2022). A distributionally robust optimization method for passenger flow control strategy and train scheduling on an urban rail transit line. Engineering, 12, 202–220.
Majewski, S., Miasojedow, B., & Moulines, E. (2018). Analysis of nonsmooth stochastic approximation: the differential inclusion approach. ArXiv Preprint ArXiv:1805.01916.
Mavromatidis, G., Orehounig, K., & Carmeliet, J. (2018). Comparison of alternative decision-making criteria in a two-stage stochastic program for the design of distributed energy systems under uncertainty. Energy, 156, 709–724.
Miao, F., He, S., Pepin, L., Han, S., Hendawi, A., Khalefa, M. E., Stankovic, J. A., & Pappas, G. (2021). Data-driven distributionally robust optimization for vehicle balancing of mobility-on-demand systems. ACM Transactions on Cyber-Physical Systems, 5(2), 1–27.
Mohajerin Esfahani, P., & Kuhn, D. (2018). Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations. Mathematical Programming, 171(1–2), 115–166.
Nakao, H., Shen, S., & Chen, Z. (2017). Network design in scarce data environment using moment-based distributionally robust optimization. Computers & Operations Research, 88, 44–57.
Nguyen, V. A., Shafieezadeh Abadeh, S., Yue, M.-C., Kuhn, D., & Wiesemann, W. (2019). Optimistic distributionally robust optimization for nonparametric likelihood approximation. Advances in Neural Information Processing Systems, 32.
Ning, C., & You, F. (2017). Data‐driven adaptive nested robust optimization: general modeling framework and efficient computational algorithm for decision making under uncertainty. AIChE Journal, 63(9), 3790–3817.
Ning, C., & You, F. (2018). Data-driven decision making under uncertainty integrating robust optimization with principal component analysis and kernel smoothing methods. Computers and Chemical Engineering, 112, 190–210. https://doi.org/10.1016/j.compchemeng.2018.02.007
Ning, C., & You, F. (2019). Data-driven Wasserstein distributionally robust optimization for biomass with agricultural waste-to-energy network design under uncertainty. Applied Energy, 255, 113857.
Noyan, N., Rudolf, G., & Lejeune, M. (2018). Distributionally robust optimization with decision-dependent ambiguity set. Optimization Online.
Noyan, N., Rudolf, G., & Lejeune, M. (2022). Distributionally robust optimization under a decision-dependent ambiguity set with applications to machine scheduling and humanitarian logistics. INFORMS Journal on Computing, 34(2), 729–751.
Osaba, E., Villar-Rodriguez, E., Del Ser, J., Nebro, A. J., Molina, D., LaTorre, A., Suganthan, P. N., Coello, C. A. C., & Herrera, F. (2021). A tutorial on the design, experimentation and application of metaheuristic algorithms to real-world optimization problems. Swarm and Evolutionary Computation, 64, 100888.
Qin, Z. (2015). Mean-variance model for portfolio optimization problem in the simultaneous presence of random and uncertain returns. European Journal of Operational Research, 245(2), 480–488.
Qin, Z., Kar, S., & Zheng, H. (2016). Uncertain portfolio adjusting model using semiabsolute deviation. Soft Computing, 20, 717–725.
Rahimian, H., & Mehrotra, S. (2019). Distributionally robust optimization: A review. ArXiv Preprint ArXiv:1908.05659.
Rockafellar, R. T., & Sun, J. (2019). Solving monotone stochastic variational inequalities and complementarity problems by progressive hedging. Mathematical Programming, 174(1–2), 453–471.
Rockafellar, R. T., & Wets, R. J. B. (2017). Stochastic variational inequalities: single-stage to multistage. Mathematical Programming, 165(1), 331–360.
Rupprecht, C., Laina, I., DiPietro, R., Baust, M., Tombari, F., Navab, N., & Hager, G. D. (2017). Learning in an uncertain world: Representing ambiguity through multiple hypotheses. Proceedings of the IEEE International Conference on Computer Vision, 3591–3600.
Sapkota, H., Ying, Y., Chen, F., & Yu, Q. (2021). Distributionally robust optimization for deep kernel multiple instance learning. International Conference on Artificial Intelligence and Statistics, 2188–2196.
Shaham, U., Yamada, Y., & Negahban, S. (2018). Understanding adversarial training: Increasing local stability of supervised models through robust optimization. Neurocomputing, 307, 195–204.
Shang, C., Huang, X., & You, F. (2017). Data-driven robust optimization based on kernel learning. Computers & Chemical Engineering, 106, 464–479.
Shang, C., & You, F. (2018). Distributionally robust optimization for planning and scheduling under uncertainty. Computers & Chemical Engineering, 110, 53–68.
Shang, C., & You, F. (2019). A data-driven robust optimization approach to scenario-based stochastic model predictive control. Journal of Process Control, 75, 24–39.
Shang, T.-T., & Tang, G.-J. (2022). Expected Residual Minimization Method for Stochastic Tensor Variational Inequalities. Journal of the Operations Research Society of China, 1–24.
Singla, M., Ghosh, D., & Shukla, K. K. (2020). A survey of robust optimization based machine learning with special reference to support vector machines. International Journal of Machine Learning and Cybernetics, 11(7), 1359–1385.
Sinha, A., Namkoong, H., Volpi, R., & Duchi, J. (2017). Certifying some distributional robustness with principled adversarial training. ArXiv Preprint ArXiv:1710.10571.
Siqin, Z., Niu, D., Wang, X., Zhen, H., Li, M., & Wang, J. (2022). A two-stage distributionally robust optimization model for P2G-CCHP microgrid considering uncertainty and carbon emission. Energy, 260, 124796.
Sözüer, S., & Thiele, A. C. (2016). The state of robust optimization. Robustness Analysis in Decision Aiding, Optimization, and Analytics, 89–112.
Stanton, M. C. B., & Roelich, K. (2021). Decision making under deep uncertainties: A review of the applicability of methods in practice. Technological Forecasting and Social Change, 171, 120939.
Sun, H.-L., & Chen, X.-J. (2021). Two-stage stochastic variational inequalities: theory, algorithms and applications. Journal of the Operations Research Society of China, 9(1), 1–32.
Ta, V.-D., Liu, C.-M., & Tadesse, D. A. (2020). Portfolio optimization-based stock prediction using long-short term memory network in quantitative trading. Applied Sciences, 10(2), 437.
Timonina‐Farkas, A., Glogg, R. Y., & Seifert, R. W. (2022). Limiting the impact of supply chain disruptions in the face of distributional uncertainty in demand. Production and Operations Management, 31(10), 3788–3805.
Van Parys, B. P. G., Esfahani, P. M., & Kuhn, D. (2021). From data to decisions: Distributionally robust optimization is optimal. Management Science, 67(6), 3387–3402.
Wang, X. (2022). Globally and superlinearly convergent algorithms for two-stage stochastic variational inequalities and their applications.
Yan, W., & Liu, Y. (2022). Stochastic Approximation Based Confidence Regions for Stochastic Variational Inequalities. ArXiv Preprint ArXiv:2203.09933.
Yang, M., Kumar, S., Wang, X., & Fry, M. J. (2021). Scenario-robust pre-disaster planning for multiple relief items. Annals of Operations Research, 1–26.
Yang, Y., & Wu, W. (2018). A distributionally robust optimization model for real-time power dispatch in distribution networks. IEEE Transactions on Smart Grid, 10(4), 3743–3752.
Yin, F., Liu, Y., & Chen, Y. (2022). Distributionally robust optimisation model for multi-objective hub location problem via considering ambiguousness. Transportmetrica A: Transport Science, 1–31.
Yousefian, F., Nedić, A., & Shanbhag, U. V. (2017). On smoothing, regularization, and averaging in stochastic approximation methods for stochastic variational inequality problems. Mathematical Programming, 165, 391–431.
Yu, Y., Lin, T., Mazumdar, E. V, & Jordan, M. (2022). Fast distributionally robust learning with variance-reduced min-max optimization. International Conference on Artificial Intelligence and Statistics, 1219–1250.
Yuan, J., Xie, J., Huang, M., Fan, H., Feng, E., & Xiu, Z. (2020). Robust optimal control problem with multiple characteristic time points in the objective for a batch nonlinear time-varying process using parallel global optimization. Optimization and Engineering, 21, 905–937.
Zhang, J., Li, Y., & Yu, G. (2022). Emergency relief network design under ambiguous demands: A distributionally robust optimization approach. Expert Systems with Applications, 208, 118139.
Zhang, Z., Lin, S., Dedeoglu, M., Ding, K., & Zhang, J. (2020). Data-driven distributionally robust optimization for edge intelligence. IEEE INFOCOM 2020-IEEE Conference on Computer Communications, 2619–2628.
Zhen, J., Kuhn, D., & Wiesemann, W. (2021). Mathematical foundations of robust and distributionally robust optimization. ArXiv Preprint ArXiv:2105.00760.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Hengki Tamando Sihotang, Patrisius Michaud Felix Marsoit, Patrisia Teresa Marsoit
This work is licensed under a Creative Commons Attribution 4.0 International License.
