Machine learning (ML) sits at the heart of smart city technologies, from traffic management systems to energy optimization. But not all machine learning works the same way. Depending on the type of data available and the problem at hand, different approaches are used. The three main types-supervised learning, unsupervised learning, and reinforcement learning-each have distinct characteristics, strengths, and applications. Understanding these differences is essential for anyone working with smart technologies.

Table of Contents

Supervised learning with labelled datasets

Supervised learning is the most common approach in machine learning. It works by training a model on a dataset where each data point has a known outcome or label. The algorithm learns the relationship between inputs and outputs, then applies that knowledge to make predictions on new, unseen data.

Think of it as learning with a teacher who provides correct answers during training. The model sees thousands of examples with their corresponding labels, adjusts its internal parameters to minimize errors, and gradually improves its accuracy.

How labelled data works

Supervised learning uses labeled training data to learn patterns and make predictions. Each input is paired with its correct output. For image classification, this means every image comes with a label identifying what it contains. For price prediction, historical data includes both the features (size, location, age of a property) and the actual sale prices.

The quality and quantity of labelled data directly affect model performance. More diverse, accurately labelled examples typically produce better results.

The MNIST dataset example

One of the most famous examples of supervised learning is the MNIST database (Modified National Institute of Standards and Technology database). It contains 60,000 training images and 10,000 testing images of handwritten digits, each being a 28ร—28 pixel grayscale image.

Every image in MNIST is paired with its correct label-the digit it represents (0 through 9). A machine learning model trains on these labelled examples, learning to recognize patterns in pixel arrangements that correspond to specific numbers. After training, the model can classify new handwritten digits it has never seen before.

The task is to classify a given image of a handwritten digit into one of 10 classes representing integer values from 0 to 9. MNIST has become a benchmark in computer vision research-often called the “hello world” of machine learning-because it provides a standardized way to test new algorithms and architectures.

Common supervised learning applications

Supervised learning handles two main types of problems: classification and regression. Classification tasks include spam detection and image recognition, while regression tasks involve predicting continuous values like house prices or stock forecasts.

Smart city applications include traffic prediction systems that learn from historical patterns to forecast congestion, energy demand forecasting based on past consumption data, and predictive maintenance systems that identify equipment likely to fail based on sensor readings and previous failure records.

Unsupervised learning for pattern discovery

Unlike supervised learning, unsupervised learning works with data that has no predefined labels. Instead of learning from correct answers, the algorithm explores data to find hidden patterns, structures, or groupings on its own.

This approach is particularly valuable when we don’t know what patterns exist in our data or when labelling large datasets would be impractical or expensive.

Clustering and pattern recognition

Unsupervised learning finds hidden patterns in unlabeled data without predetermined outcomes. The most common technique is clustering, where similar data points are grouped together based on shared characteristics.

Common algorithms include K-Means clustering, which partitions data into a specified number of groups, and hierarchical clustering, which creates a tree-like structure of nested groups. These methods excel at customer segmentation, document categorization, and discovering natural groupings within complex datasets.

Fraud detection applications

Fraud detection represents one of the most impactful applications of unsupervised learning. Unsupervised machine learning algorithms can look at complex networks of transactions and detect unusual patterns that might indicate fraudulent activity.

The key advantage here is that fraudsters constantly change their tactics. Traditional supervised systems trained on past fraud patterns may miss new types of attacks. Unsupervised machine learning can detect new and unknown fraud types, enabling organizations to take early action before damage occurs.

Clustering-based anomaly detection assumes that similar data points belong to similar groups. When a transaction doesn’t fit into any normal cluster, it gets flagged for review. This approach has proven effective for credit card fraud, insurance claims analysis, and network intrusion detection.

In smart city contexts, unsupervised learning helps identify unusual patterns in utility usage (potential theft or leaks), abnormal traffic behaviour (accidents or road hazards), and anomalies in public infrastructure performance.

Reinforcement learning through rewards

Reinforcement learning (RL) operates on an entirely different principle than supervised or unsupervised approaches. An agent interacts with an environment, learning through rewards and penalties to maximize long-term success.

Rather than learning from a fixed dataset, the RL agent takes actions, observes results, and adjusts its behaviour based on feedback. This trial-and-error approach mirrors how humans and animals naturally learn many skills.

The reward-punishment system

In reinforcement learning, every action has consequences. Good actions that move toward a goal receive positive rewards; poor actions receive penalties. Over thousands or millions of iterations, the agent learns which sequences of actions produce the best outcomes.

The agent interacts with its environment, learns what actions produce the highest rewards, and avoids penalties through trial and error. This learning process continues indefinitely, allowing the agent to adapt to changing conditions and discover optimal strategies that might not be obvious to human programmers.

Self-driving cars and autonomous systems

Autonomous vehicles represent a major application area for reinforcement learning. Reinforcement learning has been used to teach a car to drive from scratch on a real road, demonstrating the technique’s potential for complex real-world tasks.

In the self-driving context, the components map directly to RL concepts. The agent is the driver; the environment is the car and its surroundings; the state represents where the car is on the road; actions include braking, turning, and accelerating. The reward might be distance travelled without requiring human intervention.

Deep reinforcement learning has become a powerful learning framework capable of learning complex policies in high dimensional environments. Modern autonomous vehicles use these techniques for lane following, obstacle avoidance, and navigation through complex traffic scenarios.

Industrial automation and robotics

Beyond vehicles, reinforcement learning powers industrial robots that learn assembly tasks, warehouse systems that optimize picking routes, and smart grid controllers that balance energy supply and demand. This type of learning is frequently used in robotics and gaming, where agents must make sequential decisions in complex environments.

In smart cities, RL optimizes traffic signal timing based on real-time conditions, manages building energy systems to reduce consumption while maintaining comfort, and coordinates drone fleets for delivery or surveillance operations.

Comparing machine learning categories

Each type of machine learning addresses different kinds of problems, and choosing the right approach depends on your data and goals.

Data requirements

Supervised learning requires a large amount of labeled data, while unsupervised learning can work with unlabeled data. Reinforcement learning needs neither labels nor historical data in the traditional sense-instead, it requires an environment where the agent can experiment and receive feedback.

For organizations with extensive labelled historical data, supervised learning often produces the most accurate predictions. When labels are scarce or expensive to obtain, unsupervised techniques offer valuable alternatives for discovering patterns and anomalies.

Problem types and use cases

Supervised learning deals with classification and regression; unsupervised learning handles clustering and association problems; reinforcement learning addresses exploration, policy learning, and sequential decision-making.

Choose supervised learning when you have labeled data and a clear goal, unsupervised learning when you want to explore patterns in unlabeled data, and reinforcement learning when you need to teach an agent to make decisions based on feedback.

Computational considerations

Supervised learning algorithms are generally faster and easier to implement, while reinforcement learning can be more complex and computationally expensive. Unsupervised learning falls somewhere between, depending on the specific algorithm and dataset size.

Modern smart city implementations often combine multiple approaches. A traffic management system might use supervised learning to predict congestion, unsupervised learning to identify unusual patterns, and reinforcement learning to optimize signal timing in real time.

Real-world integration

Modern ML systems often use multiple learning approaches to solve complex problems. Netflix, for example, combines supervised learning for rating predictions, unsupervised learning to discover viewer segments, and reinforcement learning to optimize when and how recommendations are presented.

Understanding these three paradigms provides a foundation for evaluating smart city technologies and appreciating how intelligent systems learn from data, discover patterns, and make decisions in complex urban environments.

What do you think? As machine learning becomes more embedded in urban infrastructure, how should cities balance automation benefits against the need for human oversight and transparency in these decision-making systems?

How useful was this post?

Click on a star to rate it!

Average rating 0 / 5. Vote count: 0

No votes so far! Be the first to rate this post.

We are sorry that this post was not useful for you!

Let us improve this post!

Tell us how we can improve this post?

References
  1. https://www.geeksforgeeks.org/machine-learning/supervised-vs-reinforcement-vs-unsupervised/
  2. https://www.digitalocean.com/resources/articles/types-of-machine-learning
  3. https://en.wikipedia.org/wiki/MNIST_database
  4. https://www.geeksforgeeks.org/machine-learning/mnist-dataset/
  5. https://machinelearningmastery.com/how-to-develop-a-convolutional-neural-network-from-scratch-for-mnist-handwritten-digit-classification/
  6. https://www.aitude.com/supervised-vs-unsupervised-vs-reinforcement/
  7. https://www.educative.io/answers/supervised-vs-unsupervised-vs-reinforcement-learning
  8. https://www.datavisor.com/wiki/unsupervised-machine-learning
  9. https://medium.com/southworks/fraud-detection-applying-unsupervised-learning-techniques-4ae6f71b266f
  10. https://towardsdatascience.com/reinforcement-learning-self-driving-cars-to-self-driving-labs-018f465d6bbc/
  11. https://www.technologyreview.com/2022/05/27/1052826/ai-reinforcement-learning-self-driving-cars-autonomous-vehicles-wayve-waabi-cruise/
  12. https://ieeexplore.ieee.org/document/9351818
  13. https://www.pecan.ai/blog/3-types-of-machine-learning/

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

Smart Technologies (Hardware and Software)

1 Internet of Things (IOT) and Its Applications

  1. Introduction to IoT
  2. Definition of IoT
  3. Characteristics of IoT
  4. Physical Design IoT
  5. Logical design of IoT
  6. IoT Enabling Technologies
  7. IoT in Healthcare
  8. IoT in Home/Home Automation
  9. IoT in Environment

2 Industrial Internet of Things (IIOT) and Internet of Everything (IOE)

  1. Definition of IIoT
  2. Why Industrial IoT? โ€“ Speciality of IIoT
  3. Common Ground of IoT and IIoT
  4. The IoT Landscape
  5. The IoT Technology Stack
  6. Difference Between IoT and IIoT
  7. IIot Technologies and Concepts
  8. Physical Design of IIoT
  9. Industry 4.0: Automation of Industries
  10. IIoT Architecture
  11. Pillars of The Internet of Everything (IoE)
  12. The Difference Between IoE and IoT
  13. Applications of IoE
  14. The Future?

3 Smart Grid Technologies for Smart Cities

  1. Smart Grid: a Paradigm Shift
  2. Sensing, Measurement, Control and Automation Technologies
  3. Energy Storage Technology
  4. Renewable Generation
  5. Information & Communication Technology
  6. Cyber Security

4 Basics of Blockchain Technology

  1. Blockchain Technology and Its Components
  2. Evolution of Blockchain
  3. Blockchain Applications
  4. Limitations and Challenges of Blockchain
  5. Impact of Blockchain Technology
  6. Blockchain Platforms/Protocols

5 Applications of Blockchain Technology

  1. Financial Services
  2. Education
  3. Healthcare
  4. Insurance
  5. Real Estate
  6. Energy

6 Blockchain Technology for Smart Cities

  1. Smart Healthcare
  2. Smart Grid
  3. Smart Transportation
  4. Supply Chain Management
  5. Others
  6. Challenges of Applying Blockchain to Smart City Applications

7 Basics of AI

  1. Introduction
  2. What is AI?
  3. Components of Artificial Intelligence
  4. Fields of Application of AI
  5. Implementation of AI
  6. The Future of AI
  7. AI Ethics

8 Introduction to Machine Language

  1. What is Machine Learning?
  2. Types of Machine Learning
  3. Machine Learning Algorithms
  4. Neural Networks and Deep Learning
  5. Mathematics for Machine Learning
  6. Software for Machine Learning

9 AI and Machine Learning for Smartcities

  1. Introduction
  2. Healthcare
  3. Education
  4. Mobility and Transportation
  5. Energy Sector
  6. Environment and Economy
  7. AI and ML Challenges

10 Digital India Concepts in Smart Cities

  1. Introduction to Digital India
  2. Digitization and Data Processes
  3. Sensors
  4. Types of Sensors
  5. Sensors Applications in Smart Cities Projects
  6. Actuators
  7. Types of Actuators
  8. Actuators Applications in Smart Cities
  9. Digital India: Enabler of Smart Cities

11 Data Science, Big Data Analytics

  1. Data Science
  2. Big Data
  3. Big Data Analytics
  4. Characteristics of Big Data
  5. Role of Data Analytics in Smart City Development and Management
  6. Challenges and Issues in Smart Cities
  7. Case Study

12 Concept of SCADA, GIS and MIS

  1. Architecture
  2. Communications
  3. Functional Overview of Scada
  4. Data Acquisition
  5. Data Flow
  6. Data Processing
  7. Tagging in Scada
  8. Trending
  9. Geographical Information System (GIS)
  10. Management Information System