Every research paper has two versions

Every published paper begins with a question. This research explores how AI, Federated Deep Reinforcement Learning, and Digital Twins can transform 6G-enabled smart cities from reactive systems into intelligent, predictive, and sustainable ecosystems that optimize resources autonomously.

Published in Computational Sciences

Every research paper has two versions
Like

Share this post

Choose a social network to share with, or copy the URL to share elsewhere

This is a representation of how your post may appear on social media. The actual post will vary between social networks

Explore the Research

Springer International Publishing
Springer International Publishing Springer International Publishing

A machine learning enabled IoT framework for intelligent resource management in 6 G enabled smart cities - Discover Internet of Things

The Sixth-Generation (6 G) networks and Internet of Things (IoT) are anticipated to introduce smart city applications that will reshape the urban lifestyle with reliable, low latency and high connectivity communications. Ensuring the smooth operation of the smart city applications along with efficient 6 G-IoT resource management in heterogeneous and dynamic environments is a major challenge. The static and centralized resource management schemes are not suitable for 6 G-IoT due to the large scale, complexity and dynamic nature of the network. This paper proposes a scheme that leverages the benefits of the Federated Deep Reinforcement Learning (FDRL) and proactive Digital Twin (DT) for efficient resource management of 6 G-IoT in a manner that is intelligent, autonomous and secure. A five-layer resource management architecture consisting of IoT sensing layer, 6 G communication layer, edge intelligence layer, digital twin layer and management layer is proposed in this paper. The proposed 6 G-IoT resource management scheme utilizes FDRL for edge nodes to learn the globally optimal joint communication and computation resource allocation policies through collaborative learning without sharing the underlying data, thereby resolving the privacy and scalability issues. The proactive DT is utilized as a “sandbox” to do simulations of possible resource allocation actions to predict the outcomes of the actions and to preconfigure the required resources before they are really needed in the network to prevent any potential Quality of Service (QoS) violations. In this work, we demonstrate the validity of proposed framework and performance gain in smart city communication through our detailed co-simulation validation over three representative scenarios: Urban Mobility (UD), Public Event (PE) and Emergency Response (ER). The proposed framework is validated against three state-of-the-art solutions namely Static Slicing (SS), Centralized Deep Reinforcement Learning (CDRL) and Isolated Edge Deep Reinforcement Learning (IEDRL). The simulation results confirm the feasibility of proposed framework and significantly outperform existing solutions in terms of various performance metrics. Specifically, for the Urban Mobility (UD) scenario, proposed framework ensures URLLC for 98.7% of the time during the peak hour which is 65% better than the existing solutions; Digital Twin of the network has 73% service convergence time improvement and 45% SLA violations reduction. Moreover, the reliability of the emergency services provided by proposed framework is over 99% within 2.1 min after occurrence of the infrastructure failure. Furthermore, proposed framework achieves 49% energy efficiency improvement of network resources by the intelligent resource orchestration which supports the sustainable urban operations. All the research objectives of this project have been fulfilled: - The system architecture is verified. - The performance of the proposed FDRL algorithm is verified to achieve cross-domain optimization. - The Digital Twin can be used for measurable proactive maintenance. - The performance of the proposed system is verified by experiments and the proposed system shows great improvement. - The sustainability and privacy advantages of the proposed system are quantified. This work advances both the theoretical and practical sides of distributed AI for network functions. It also provides a useful practice reference for building efficient, reliable and sustainable smart cities in the 6 G era.

Every research paper has two lives. One is the published version that readers see structured into sections, enriched with figures, supported by equations, and concluded with carefully interpreted results. The other is invisible. It exists in the countless hours of thinking, questioning, rewriting, and doubting. It is built on curiosity rather than citations, and persistence rather than publications. This paper belongs to that invisible story. While it introduces a machine learning enabled IoT framework for intelligent resource management in 6G-enabled smart cities, for me it represents something far more personal—a journey of asking questions that refused to leave my mind.

I have always believed that the most meaningful research begins not in a laboratory, but in observation. Every day I watched technology evolve at an extraordinary pace. Cities were becoming increasingly connected, artificial intelligence was becoming more capable, and communication networks were moving steadily toward the era of 6G. Yet despite these remarkable advances, many urban systems still waited for problems before taking action. Traffic management reacted after congestion appeared. Emergency communication improved only after failures occurred. Resource allocation responded to demand instead of predicting it. The contradiction fascinated me.

"An intelligent city should not merely react to the future it should be prepared for it."

That single thought became the seed from which this entire research grew.

As I immersed myself in the literature, I realized that brilliant ideas already existed everywhere. Researchers had developed powerful reinforcement learning algorithms, privacy-preserving federated learning models, sophisticated Digital Twins, and advanced edge computing architectures. Each technology was impressive on its own. However, they often worked like individual instruments playing different melodies. I wanted to know what would happen if they performed together as an orchestra. Could they create a truly autonomous system capable of learning, predicting, adapting, and optimizing simultaneously?

Finding that answer proved much harder than I expected. The first architectural designs looked elegant until I began testing their practical implications. Improving one component often weakened another. Increasing intelligence sometimes reduced scalability. Strengthening optimization occasionally affected privacy. There were days when entire sections of the framework had to be discarded and redesigned from the beginning. Those moments were frustrating, yet they became the most valuable part of the journey because they reminded me that research is not about protecting ideas it is about improving them.

"The first solution is rarely the best solution. Research is the courage to rewrite your own thinking."

Slowly, the framework started taking shape. Federated Deep Reinforcement Learning emerged as the learning engine capable of making distributed decisions while preserving data privacy. The Digital Twin evolved into far more than a simulation environment; it became a predictive companion capable of testing future decisions before they reached the real world. Suddenly, the framework was no longer reacting to network events it was anticipating them. Watching this transition from reactive intelligence to proactive decision-making remains one of the most satisfying moments of my academic career.

Throughout this work, I repeatedly returned to one personal belief that has guided my research for years. Artificial intelligence should never exist merely to improve benchmark scores or produce better graphs. Its true purpose is to solve meaningful problems that improve people's lives. Every optimization algorithm should ultimately make systems more reliable. Every predictive model should contribute to safer infrastructure. Every intelligent network should make cities more sustainable, resilient, and prepared for the unexpected.

"Technology earns its value not by becoming smarter, but by making society stronger."

Of course, every research journey has moments when confidence quietly disappears. There were simulations that produced disappointing outcomes, hypotheses that failed despite weeks of effort, and revisions that seemed endless. More than once I wondered whether the framework had become too ambitious. Yet every obstacle reinforced a lesson I have learned repeatedly throughout my academic career: persistence is often a more valuable research skill than brilliance.

"Research rarely rewards speed; it rewards those who refuse to stop asking questions."

One aspect of this journey that I deeply value is collaboration. Scientific progress is never built in isolation. Constructive discussions, thoughtful criticism, and shared academic commitment transformed many early ideas into stronger contributions. My co-author's insights added depth to the work, and together we continually challenged each other's assumptions until the framework reflected not only technical innovation but also practical relevance. Research, at its finest, is a conversation between curious minds rather than a competition between individuals.

Looking back today, I realize I remember very few of the long nights spent writing equations or refining simulation parameters. Instead, I remember the excitement of discovering a connection that had previously gone unnoticed, the satisfaction of seeing an experiment finally validate a hypothesis, and the quiet confidence that comes when an idea gradually matures into knowledge. Those moments remind me why I chose research as a lifelong pursuit.

This publication is not the destination. It is another milestone on a journey that continues to evolve with every new question. Technologies such as artificial intelligence, Digital Twins, federated learning, and 6G will undoubtedly transform the future, but they will also create new challenges waiting to be explored. I hope this work contributes, even in a small way, to that future by encouraging researchers to think beyond individual algorithms and toward intelligent ecosystems that serve society.

As I close this story, one thought remains closest to my heart.

"Every published paper is simply curiosity that survived every obstacle placed before it."

If readers remember anything beyond the algorithms, architectures, or performance metrics presented in this work, I hope they remember that research is ultimately a deeply human journey. Behind every figure lies a failed experiment, behind every equation lies a difficult question, and behind every publication lies a story of persistence. This paper is my story a story of curiosity transformed into research, research transformed into knowledge, and knowledge shared with the hope of building a smarter, more sustainable world.

Dr. Sanjay Agal

Please sign in or register for FREE

If you are a registered user on Research Communities by Springer Nature, please sign in

Follow the Topic

Data Science
Mathematics and Computing > Computer Science > Artificial Intelligence > Data Science
Internet of Things
Mathematics and Computing > Computer Science > Computer Engineering and Networks > Internet of Things
Smart Infrastructure
Mathematics and Computing > Computer Science > Computer and Information Systems Applications > Computer Application in Administrative Data Processing > Smart Infrastructure
Intelligence Infrastructure
Mathematics and Computing > Computer Science > Artificial Intelligence > Intelligence Infrastructure

Related Collections

With Collections, you can get published faster and increase your visibility.

Machine Learning and Information Security for Internet of Things

The Internet of Things (IoT) has emerged as a transformative paradigm that interconnects billions of smart devices, sensors, and systems to enable seamless data exchange and intelligent automation. With widespread adoption across critical sectors including smart cities, industrial automation, healthcare, transportation, and smart homes, IoT delivers substantial economic and social value by enhancing operational efficiency, service personalization, and resource optimization. However, the exponential growth of IoT ecosystems—characterized by device heterogeneity, distributed architectures, and massive data transmission—poses unprecedented challenges in ensuring information security (e.g., data privacy, access control, and threat mitigation) and developing robust machine learning models for real-time analytics, anomaly detection, and adaptive decision-making. To address these issues, researchers are exploring innovative methodologies such as federated learning, lightweight cryptography, and AI-driven threat intelligence. The interdisciplinary nature of IoT research necessitates collaboration among experts in computer science, cybersecurity, data science, and electrical engineering, whose collective insights drive technological breakthroughs and risk mitigation strategies. In summary, IoT is a rapidly evolving field where machine learning and information security are foundational pillars, holding immense potential to unlock safe, reliable, and innovative applications that reshape industries and daily life.

This collection aims to bring together researchers and practitioners from academia and industry to present their latest findings, discuss recent advances, and exchange ideas on machine learning and information security for IoT. The collection will focus on the development of novel models, control strategies, learning techniques, and security methods for IoT, with an emphasis on their application to real-world problems. Analytical, numerical, and experimental works which contribute to the development of machine learning and information security for IoT, are welcome.

This Collection supports and amplifies research related to SDG11.

Keywords: Machine Learning; Information Security; Internet of Things; Control Systems; Signal Processing; Mathematical Optimization; Complex Networks; Big Data and Data Mining; Modelling and Simulation; Neural Networks

Publishing Model: Open Access

Deadline: Dec 10, 2026

Emerging Frontiers in Technological Integration for Health, Agriculture, and Urban Sustainability

The goal of this Topical Collection is to investigate the novel ways that the Internet of Things (IoT), artificial intelligence (AI), machine learning (ML), cyber-physical systems, CPS, smart cities, 5G, and Internet of Vehicles (IoV) can be used to address problems and promote sustainable development in the fields of urban sustainability, health, and agriculture. The aim of this showcase is to provide innovative research, techniques, and case studies that illustrate how technology integration can significantly improve human well-being, food security, and environmental sustainability.

This Topical Collection is significant because it has the potential to further research, spur innovation, and motivate action in support of sustainable development objectives. This Topical Collection can accelerate the integration of diverse developing technologies and their applications for smart cities by uniting interdisciplinary viewpoints and presenting best practices. Sub-themes or topics mapping to the scope of the Topical Collection proposal include but are not limited to the following:

• 5G and IoT Integration and Interoperability and Standards in IoT

• Agri-Tech Solutions for Sustainable Agriculture & Precision Agriculture

• AI and Machine Learning in Cyber-Physical Systems

• AI Enabled Smart Health Solutions

• Blockchain for IoT Security and Trust

• Edge Computing in IoT Systems

• Health and Wellness in Urban Environments

• Intelligent Transportation Systems using Internet of Vehicles (IoVs) and Vehicular Networks

• IoT and AI based Smart Home Innovations for Health and Comfort

• IoT and AI Enabled Smart City Infrastructure and Urban Development

• Medical Technology Advancements Using IoT and AI

• Pervasive and Ubiquitous Computing

• Security and Privacy in IoT Networks

• Sensors and Devices for IoT and CPS

• Smart Environmental Monitoring and Conservation using IoT sensors, satellite imagery, and data analytics

• Sports Science and Performance Enhancement using Data Analytics and AI

• Virtual Reality, Augmented Reality and Mixed Reality in Industry

Keywords:

Internet of Things (IoT); Artificial Intelligence (AI); Emerging Technologies; Smart Cities; Cyber Physical Systems

Publishing Model: Open Access

Deadline: Sep 30, 2026