Integrating machine learning and real-time optimization for heterogeneous instant delivery orders scheduling and routing
DOI:
https://doi.org/10.35335/emod.v16i1.56Keywords:
Heterogeneous delivery, Machine learning, Real-time optimization, Routing, SchedulingAbstract
This research aims to integrate machine learning and real-time optimization for heterogeneous instant delivery order scheduling and routing. The objective is to minimize the total delivery time while considering factors such as demand, time windows, predicted demand, and vehicle capacity constraints. By leveraging machine learning algorithms and real-time data, the proposed approach provides adaptive decision-making capabilities, allowing for dynamic adjustments in response to changing conditions. A mathematical formulation is developed to model the problem, and an algorithm is proposed to solve it. A numerical example is presented to demonstrate the effectiveness of the approach. The results highlight the optimal assignment of orders to vehicles at different time periods, leading to efficient delivery routes and minimized delivery time. The integration of machine learning and real-time optimization offers promising opportunities for enhancing the efficiency and responsiveness of delivery operations. This research contributes to advancing the field of instant delivery order scheduling and routing and paves the way for further developments in real-time logistics optimization
References
Adams, D., & Krulicky, T. (2021). Artificial intelligence-driven big data analytics, real-time sensor networks, and product decision-making information systems in sustainable manufacturing internet of things. Economics, Management and Financial Markets, 16(3), 81–93.
Al-Abbasi, A. O., Ghosh, A., & Aggarwal, V. (2019). Deeppool: Distributed model-free algorithm for ride-sharing using deep reinforcement learning. IEEE Transactions on Intelligent Transportation Systems, 20(12), 4714–4727.
Allen, J., Bektaş, T., Cherrett, T., Friday, A., McLeod, F., Piecyk, M., Piotrowska, M., & Austwick, M. Z. (2017). Enabling a freight traffic controller for collaborative multidrop urban logistics: Practical and theoretical challenges. Transportation Research Record, 2609(1), 77–84.
Andronie, M., Lăzăroiu, G., Iatagan, M., Uță, C., Ștefănescu, R., & Cocoșatu, M. (2021). Artificial intelligence-based decision-making algorithms, internet of things sensing networks, and deep learning-assisted smart process management in cyber-physical production systems. Electronics, 10(20), 2497.
Azvine, B., Cui, Z., Nauck, D. D., & Majeed, B. (2006). Real time business intelligence for the adaptive enterprise. The 8th IEEE International Conference on E-Commerce Technology and The 3rd IEEE International Conference on Enterprise Computing, E-Commerce, and E-Services (CEC/EEE’06), 29.
Bhandary, V., Malik, A., & Kumar, S. (2016). Routing in wireless multimedia sensor networks: a survey of existing protocols and open research issues. Journal of Engineering, 2016.
Cao, W., Mukai, M., Kawabe, T., Nishira, H., & Fujiki, N. (2015). Cooperative vehicle path generation during merging using model predictive control with real-time optimization. Control Engineering Practice, 34, 98–105.
Chen, T., Zhang, B., Pourbabak, H., Kavousi-Fard, A., & Su, W. (2016). Optimal routing and charging of an electric vehicle fleet for high-efficiency dynamic transit systems. IEEE Transactions on Smart Grid, 9(4), 3563–3572.
Choi, J., Xuelei, J., & Jeong, W. (2018). Optimizing the construction job site vehicle scheduling problem. Sustainability, 10(5), 1381.
Çöltekin, A., Heil, B., Garlandini, S., & Fabrikant, S. I. (2009). Evaluating the effectiveness of interactive map interface designs: a case study integrating usability metrics with eye-movement analysis. Cartography and Geographic Information Science, 36(1), 5–17.
Dablanc, L., Morganti, E., Arvidsson, N., Woxenius, J., Browne, M., & Saidi, N. (2017). The rise of on-demand ‘Instant Deliveries’ in European cities. Supply Chain Forum: An International Journal, 18(4), 203–217.
Dai, B., Cao, Y., Wu, Z., Dai, Z., Yao, R., & Xu, Y. (2021). Routing optimization meets Machine Intelligence: A perspective for the future network. Neurocomputing, 459, 44–58.
Dai, X., & Burns, A. (2020). Period adaptation of real-time control tasks with fixed-priority scheduling in cyber-physical systems. Journal of Systems Architecture, 103, 101691.
Decasper, D., Dittia, Z., Parulkar, G., & Plattner, B. (2000). Router plugins: a software architecture for next-generation routers. IEEE/ACM Transactions on Networking, 8(1), 2–15.
Fouda, E., & Fouda, E. (2020). Advanced Data Preprocessing and Feature Engineering. Learn Data Science Using SAS Studio: A Quick-Start Guide, 133–146.
Gellings, C. W. (2020). The smart grid: enabling energy efficiency and demand response. CRC press.
Guo, K., Yang, Z., Yu, C.-H., & Buehler, M. J. (2021). Artificial intelligence and machine learning in design of mechanical materials. Materials Horizons, 8(4), 1153–1172.
Hua, Y., Zhao, Z., Li, R., Chen, X., Liu, Z., & Zhang, H. (2019). Deep learning with long short-term memory for time series prediction. IEEE Communications Magazine, 57(6), 114–119.
Ibarz, J., Tan, J., Finn, C., Kalakrishnan, M., Pastor, P., & Levine, S. (2021). How to train your robot with deep reinforcement learning: lessons we have learned. The International Journal of Robotics Research, 40(4–5), 698–721.
Ivanov, D., Dolgui, A., Das, A., & Sokolov, B. (2019). Digital supply chain twins: Managing the ripple effect, resilience, and disruption risks by data-driven optimization, simulation, and visibility. Handbook of Ripple Effects in the Supply Chain, 309–332.
Jiang, M., Liu, J., Zhang, L., & Liu, C. (2020). An improved Stacking framework for stock index prediction by leveraging tree-based ensemble models and deep learning algorithms. Physica A: Statistical Mechanics and Its Applications, 541, 122272.
Konstantakopoulos, G. D., Gayialis, S. P., & Kechagias, E. P. (2020). Vehicle routing problem and related algorithms for logistics distribution: a literature review and classification. Operational Research, 1–30.
Kostikov, E. (2021). Optimization of e-commerce distribution center location. Marketing i Menedžment Innovacij.
Krata, J., & Saha, T. K. (2018). Real-time coordinated voltage support with battery energy storage in a distribution grid equipped with medium-scale PV generation. IEEE Transactions on Smart Grid, 10(3), 3486–3497.
Kuziemski, M., & Misuraca, G. (2020). AI governance in the public sector: Three tales from the frontiers of automated decision-making in democratic settings. Telecommunications Policy, 44(6), 101976.
Le, T. V, Stathopoulos, A., Van Woensel, T., & Ukkusuri, S. V. (2019). Supply, demand, operations, and management of crowd-shipping services: A review and empirical evidence. Transportation Research Part C: Emerging Technologies, 103, 83–103.
Leng, J., Ruan, G., Song, Y., Liu, Q., Fu, Y., Ding, K., & Chen, X. (2021). A loosely-coupled deep reinforcement learning approach for order acceptance decision of mass-individualized printed circuit board manufacturing in industry 4.0. Journal of Cleaner Production, 280, 124405.
Liu, C., Li, H., Tang, Y., Lin, D., & Liu, J. (2019). Next generation integrated smart manufacturing based on big data analytics, reinforced learning, and optimal routes planning methods. International Journal of Computer Integrated Manufacturing, 32(9), 820–831.
Lwakatare, L. E., Raj, A., Crnkovic, I., Bosch, J., & Olsson, H. H. (2020). Large-scale machine learning systems in real-world industrial settings: A review of challenges and solutions. Information and Software Technology, 127, 106368.
Ma, T., Motta, G., & Liu, K. (2017). Delivering real-time information services on public transit: A framework. IEEE Transactions on Intelligent Transportation Systems, 18(10), 2642–2656.
Marković, N., Nair, R., Schonfeld, P., Miller-Hooks, E., & Mohebbi, M. (2015). Optimizing dial-a-ride services in Maryland: benefits of computerized routing and scheduling. Transportation Research Part C: Emerging Technologies, 55, 156–165.
Martins, L. do C., de la Torre, R., Corlu, C. G., Juan, A. A., & Masmoudi, M. A. (2021). Optimizing ride-sharing operations in smart sustainable cities: Challenges and the need for agile algorithms. Computers & Industrial Engineering, 153, 107080.
Melakessou, F., Kugener, P., Alnaffakh, N., Faye, S., & Khadraoui, D. (2020). Heterogeneous sensing data analysis for commercial waste collection. Sensors, 20(4), 978.
Morariu, O., Morariu, C., Borangiu, T., & Răileanu, S. (2018). Manufacturing systems at scale with big data streaming and online machine learning. Service Orientation in Holonic and Multi-Agent Manufacturing: Proceedings of SOHOMA 2017, 253–264.
Mourad, A., Puchinger, J., & Chu, C. (2019). A survey of models and algorithms for optimizing shared mobility. Transportation Research Part B: Methodological, 123, 323–346.
Nama, M., Nath, A., Bechra, N., Bhatia, J., Tanwar, S., Chaturvedi, M., & Sadoun, B. (2021). Machine learning‐based traffic scheduling techniques for intelligent transportation system: Opportunities and challenges. International Journal of Communication Systems, 34(9), e4814.
Nguyen, N., Strnad, O., Klein, T., Luo, D., Alharbi, R., Wonka, P., Maritan, M., Mindek, P., Autin, L., & Goodsell, D. S. (2020). Modeling in the time of COVID-19: Statistical and rule-based mesoscale models. IEEE Transactions on Visualization and Computer Graphics, 27(2), 722–732.
Paul, A., Acar, P., Liao, W., Choudhary, A., Sundararaghavan, V., & Agrawal, A. (2019). Microstructure optimization with constrained design objectives using machine learning-based feedback-aware data-generation. Computational Materials Science, 160, 334–351.
Peyman, M., Copado, P. J., Tordecilla, R. D., Martins, L. do C., Xhafa, F., & Juan, A. A. (2021). Edge computing and iot analytics for agile optimization in intelligent transportation systems. Energies, 14(19), 6309.
Poikonen, S., & Campbell, J. F. (2021). Future directions in drone routing research. Networks, 77(1), 116–126.
Psaraftis, H. N., Wen, M., & Kontovas, C. A. (2016). Dynamic vehicle routing problems: Three decades and counting. Networks, 67(1), 3–31.
Punmiya, R., & Choe, S. (2019). Energy theft detection using gradient boosting theft detector with feature engineering-based preprocessing. IEEE Transactions on Smart Grid, 10(2), 2326–2329.
Qiu, J., Wu, Q., Ding, G., Xu, Y., & Feng, S. (2016). A survey of machine learning for big data processing. EURASIP Journal on Advances in Signal Processing, 2016, 1–16.
Raca, D., Zahran, A. H., Sreenan, C. J., Sinha, R. K., Halepovic, E., Jana, R., & Gopalakrishnan, V. (2020). On leveraging machine and deep learning for throughput prediction in cellular networks: Design, performance, and challenges. IEEE Communications Magazine, 58(3), 11–17.
Ren, D., Gallego-García, D., Pérez-García, S., Gallego-García, S., & García-García, M. (2021). Modeling Human Decision-Making Delays and Their Impacts on Supply Chain System Performance: A Case Study. International Conference on Intelligent Human Computer Interaction, 673–688.
Ren, S., Choi, T.-M., Lee, K.-M., & Lin, L. (2020). Intelligent service capacity allocation for cross-border-E-commerce related third-party-forwarding logistics operations: A deep learning approach. Transportation Research Part E: Logistics and Transportation Review, 134, 101834.
Rezaeianjouybari, B., & Shang, Y. (2020). Deep learning for prognostics and health management: State of the art, challenges, and opportunities. Measurement, 163, 107929.
Sabar, N. R., Bhaskar, A., Chung, E., Turky, A., & Song, A. (2019). A self-adaptive evolutionary algorithm for dynamic vehicle routing problems with traffic congestion. Swarm and Evolutionary Computation, 44, 1018–1027.
Schubert, D., Kuhn, H., & Holzapfel, A. (2021). Same‐day deliveries in omnichannel retail: Integrated order picking and vehicle routing with vehicle‐site dependencies. Naval Research Logistics (NRL), 68(6), 721–744.
Sethi, S., Kathuria, M., & Kaushik, T. (2021). Face mask detection using deep learning: An approach to reduce risk of Coronavirus spread. Journal of Biomedical Informatics, 120, 103848.
Shi, R., Zhang, J., Chu, W., Bao, Q., Jin, X., Gong, C., Zhu, Q., Yu, C., & Rosenberg, S. (2015). MDP and machine learning-based cost-optimization of dynamic resource allocation for network function virtualization. 2015 IEEE International Conference on Services Computing, 65–73.
Singh*, K., Yalamarty, S. S., Kamyab, M., & Cheatham, C. (2019). Cloud-based ROP prediction and optimization in real-time using supervised machine learning. Unconventional Resources Technology Conference, Denver, Colorado, 22-24 July 2019, 3067–3078.
Soga, S., Ogura, E. T., Watanabe, T., Sato, A., Yatabe, Y., & Kobayashi, M. (2018). Development of cutting-edge technologies for next-generation logistics services. Hitachi Rev, 67(2), 252–258.
Song, D. (2021). A literature review, container shipping supply chain: Planning problems and research opportunities. Logistics, 5(2), 41.
Syam, N., & Sharma, A. (2018). Waiting for a sales renaissance in the fourth industrial revolution: Machine learning and artificial intelligence in sales research and practice. Industrial Marketing Management, 69, 135–146.
Tsay, D., & Patterson, C. (2018). From machine learning to artificial intelligence applications in cardiac care: Real-world examples in improving imaging and patient access. Circulation, 138(22), 2569–2575.
Ulmer, M. W., & Thomas, B. W. (2018). Same‐day delivery with heterogeneous fleets of drones and vehicles. Networks, 72(4), 475–505.
Wang, X., Liu, Y., Zhao, J., Liu, C., Liu, J., & Yan, J. (2021). Surrogate model enabled deep reinforcement learning for hybrid energy community operation. Applied Energy, 289, 116722.
Wang, Y., Assogba, K., Liu, Y., Ma, X., Xu, M., & Wang, Y. (2018). Two-echelon location-routing optimization with time windows based on customer clustering. Expert Systems with Applications, 104, 244–260.
Xie, J., Yu, F. R., Huang, T., Xie, R., Liu, J., Wang, C., & Liu, Y. (2018). A survey of machine learning techniques applied to software defined networking (SDN): Research issues and challenges. IEEE Communications Surveys & Tutorials, 21(1), 393–430.
Xue, G., Wang, Z., & Wang, G. (2021). Optimization of rider scheduling for a food delivery service in O2O business. Journal of Advanced Transportation, 2021, 1–15.
Yang, C., Du, S., Li, L., You, S., Yang, Y., & Zhao, Y. (2017). Adaptive real-time optimal energy management strategy based on equivalent factors optimization for plug-in hybrid electric vehicle. Applied Energy, 203, 883–896.
Zavin, A., Sharif, A., Ibnat, A., Abdullah, W. M., & Islam, M. N. (2017). Towards developing an intelligent system to suggest optimal path based on historic and real-time traffic data. 2017 20th International Conference of Computer and Information Technology (ICCIT), 1–6.
Zhang, K., Qu, T., Zhou, D., Jiang, H., Lin, Y., Li, P., Guo, H., Liu, Y., Li, C., & Huang, G. Q. (2020). Digital twin-based opti-state control method for a synchronized production operation system. Robotics and Computer-Integrated Manufacturing, 63, 101892.
Zhang, Z., Zhang, D., & Qiu, R. C. (2019). Deep reinforcement learning for power system applications: An overview. CSEE Journal of Power and Energy Systems, 6(1), 213–225.
Zhou, J., Sun, J., Cong, P., Liu, Z., Zhou, X., Wei, T., & Hu, S. (2019). Security-critical energy-aware task scheduling for heterogeneous real-time MPSoCs in IoT. IEEE Transactions on Services Computing, 13(4), 745–758.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Patrisia Teresa Marsoit, Patrisius Michaud Felix Marsoit, Ralp Varene

This work is licensed under a Creative Commons Attribution 4.0 International License.