Siirry suoraan sisältöön

Future IoT TechnologiesLaajuus (5 cr)

Code: TTC8850

Credits

5 op

Teaching language

  • English

Responsible person

  • Jari Hautamäki

Objective

Course objectives
In the course, you will learn how to use advanced new technologies, such as artificial intelligence, in the implementation of IoT systems. You get to know different neural networks and understand their basic parameters.

Competences:
EUR-ACE Knowledge and Understanding
EUR-ACE Engineering Practice


You know the architectures of neural networks and understand their application areas. You know how to make a Q-table of basic neural network design and implementation in practice. You know what the RL agent does and you know how to train the agent to make it work optimally. You understand the difference between On-Policy and Off-Policy algorithms and know how to use information to select an algorithm.

Content

Comparison of neural networks (RL, Supervised, Unsupervised )
Keras, Pytorch and other algorithm-based neural networks
RL agent and environment
Exploitation and exploration
Reward and hyperparameters
Basic neuromath and activation functions
Policy gradient method and value based learning
Bellman equation and its demo (Q-learning)
Pytorch, PPO algorithm and demo

Qualifications

Johdanto IoT-järjestelmiin

Assessment criteria, satisfactory (1)

Avoidance 1: You understand the principles of neural networks and can apply the knowledge to select them

Satisfactory 2: You understand the basics of Q-learning methods and can make a small application with it

Assessment criteria, good (3)

Good 3: Can adjust the parameter of the Bellman algorithm (Exploration, Exploitation, gamma +....) so that the operation of the controlled object is optimized

Excellent 4: You know how to tune a multilayer neural network using the PPO algorithm so that the given actuator behaves as desired.

Assessment criteria, excellent (5)

Excellent 5: In addition to the previous ones, you understand the limitations of artificial intelligence in various practical applications and understand that OpenAI-Gym models require a strong substance control. You also know how to document your work well, using TensorFlow outputs to evaluate hyperparameters.

Enrollment

18.11.2024 - 09.01.2025

Timing

13.01.2025 - 30.04.2025

Number of ECTS credits allocated

5 op

Mode of delivery

Face-to-face

Unit

School of Technology

Campus

Lutakko Campus

Teaching languages
  • English
Seats

0 - 35

Degree programmes
  • Bachelor's Degree Programme in Information and Communications Technology
  • Bachelor's Degree Programme in Information and Communications Technology
Teachers
  • Jouko Kotkansalo
Groups
  • TTV22S5
    Tieto- ja viestintätekniikka (AMK)
  • TTV22S2
    Tieto- ja viestintätekniikka (AMK)
  • TTV22S3
    Tieto- ja viestintätekniikka (AMK)
  • TIC22S1
    Bachelor's Degree Programme in Information and Communications Technology
  • TTV22S1
    Tieto- ja viestintätekniikka (AMK)
  • TTV22S4
    Tieto- ja viestintätekniikka (AMK)

Objective

Course objectives
In the course, you will learn how to use advanced new technologies, such as artificial intelligence, in the implementation of IoT systems. You get to know different neural networks and understand their basic parameters.

Competences:
EUR-ACE Knowledge and Understanding
EUR-ACE Engineering Practice


You know the architectures of neural networks and understand their application areas. You know how to make a Q-table of basic neural network design and implementation in practice. You know what the RL agent does and you know how to train the agent to make it work optimally. You understand the difference between On-Policy and Off-Policy algorithms and know how to use information to select an algorithm.

Content

Comparison of neural networks (RL, Supervised, Unsupervised )
Keras, Pytorch and other algorithm-based neural networks
RL agent and environment
Exploitation and exploration
Reward and hyperparameters
Basic neuromath and activation functions
Policy gradient method and value based learning
Bellman equation and its demo (Q-learning)
Pytorch, PPO algorithm and demo

Evaluation scale

0-5

Arviointikriteerit, tyydyttävä (1-2)

Avoidance 1: You understand the principles of neural networks and can apply the knowledge to select them

Satisfactory 2: You understand the basics of Q-learning methods and can make a small application with it

Arviointikriteerit, hyvä (3-4)

Good 3: Can adjust the parameter of the Bellman algorithm (Exploration, Exploitation, gamma +....) so that the operation of the controlled object is optimized

Excellent 4: You know how to tune a multilayer neural network using the PPO algorithm so that the given actuator behaves as desired.

Assessment criteria, excellent (5)

Excellent 5: In addition to the previous ones, you understand the limitations of artificial intelligence in various practical applications and understand that OpenAI-Gym models require a strong substance control. You also know how to document your work well, using TensorFlow outputs to evaluate hyperparameters.

Qualifications

Johdanto IoT-järjestelmiin

Enrollment

01.08.2024 - 22.08.2024

Timing

26.08.2024 - 18.12.2024

Number of ECTS credits allocated

5 op

Virtual portion

5 op

Mode of delivery

Online learning

Unit

School of Technology

Teaching languages
  • English
Seats

0 - 35

Degree programmes
  • Bachelor's Degree Programme in Information and Communications Technology
  • Bachelor's Degree Programme in Information and Communications Technology
Teachers
  • Jouko Kotkansalo
Groups
  • TTV22S5
    Tieto- ja viestintätekniikka (AMK)
  • TTV22S2
    Tieto- ja viestintätekniikka (AMK)
  • TTV22S3
    Tieto- ja viestintätekniikka (AMK)
  • TIC22S1
    Bachelor's Degree Programme in Information and Communications Technology
  • TTV22S1
    Tieto- ja viestintätekniikka (AMK)
  • TTV22SM
    Tieto- ja viestintätekniikka (AMK)
  • TTV22S4
    Tieto- ja viestintätekniikka (AMK)
  • TTV22SM2
    Tieto- ja viestintätekniikka (AMK)

Objective

Course objectives
In the course, you will learn how to use advanced new technologies, such as artificial intelligence, in the implementation of IoT systems. You get to know different neural networks and understand their basic parameters.

Competences:
EUR-ACE Knowledge and Understanding
EUR-ACE Engineering Practice


You know the architectures of neural networks and understand their application areas. You know how to make a Q-table of basic neural network design and implementation in practice. You know what the RL agent does and you know how to train the agent to make it work optimally. You understand the difference between On-Policy and Off-Policy algorithms and know how to use information to select an algorithm.

Content

Comparison of neural networks (RL, Supervised, Unsupervised )
Keras, Pytorch and other algorithm-based neural networks
RL agent and environment
Exploitation and exploration
Reward and hyperparameters
Basic neuromath and activation functions
Policy gradient method and value based learning
Bellman equation and its demo (Q-learning)
Pytorch, PPO algorithm and demo

Evaluation scale

0-5

Arviointikriteerit, tyydyttävä (1-2)

Avoidance 1: You understand the principles of neural networks and can apply the knowledge to select them

Satisfactory 2: You understand the basics of Q-learning methods and can make a small application with it

Arviointikriteerit, hyvä (3-4)

Good 3: Can adjust the parameter of the Bellman algorithm (Exploration, Exploitation, gamma +....) so that the operation of the controlled object is optimized

Excellent 4: You know how to tune a multilayer neural network using the PPO algorithm so that the given actuator behaves as desired.

Assessment criteria, excellent (5)

Excellent 5: In addition to the previous ones, you understand the limitations of artificial intelligence in various practical applications and understand that OpenAI-Gym models require a strong substance control. You also know how to document your work well, using TensorFlow outputs to evaluate hyperparameters.

Qualifications

Johdanto IoT-järjestelmiin

Enrollment

20.11.2023 - 04.01.2024

Timing

08.01.2024 - 30.04.2024

Number of ECTS credits allocated

5 op

Mode of delivery

Face-to-face

Unit

School of Technology

Campus

Lutakko Campus

Teaching languages
  • English
Seats

0 - 35

Degree programmes
  • Bachelor's Degree Programme in Information and Communications Technology
  • Bachelor's Degree Programme in Information and Communications Technology
Teachers
  • Jouko Kotkansalo
Groups
  • TTV21S3
    Tieto- ja viestintätekniikka (AMK)
  • TTV21S5
    Tieto- ja viestintätekniikka (AMK)
  • TIC21S1
    Bachelor's Degree Programme in Information and Communications Technology
  • TTV21S2
    Tieto- ja viestintätekniikka (AMK)
  • TTV21S1
    Tieto- ja viestintätekniikka (AMK)

Objective

Course objectives
In the course, you will learn how to use advanced new technologies, such as artificial intelligence, in the implementation of IoT systems. You get to know different neural networks and understand their basic parameters.

Competences:
EUR-ACE Knowledge and Understanding
EUR-ACE Engineering Practice


You know the architectures of neural networks and understand their application areas. You know how to make a Q-table of basic neural network design and implementation in practice. You know what the RL agent does and you know how to train the agent to make it work optimally. You understand the difference between On-Policy and Off-Policy algorithms and know how to use information to select an algorithm.

Content

Comparison of neural networks (RL, Supervised, Unsupervised )
Keras, Pytorch and other algorithm-based neural networks
RL agent and environment
Exploitation and exploration
Reward and hyperparameters
Basic neuromath and activation functions
Policy gradient method and value based learning
Bellman equation and its demo (Q-learning)
Pytorch, PPO algorithm and demo

Evaluation scale

0-5

Arviointikriteerit, tyydyttävä (1-2)

Avoidance 1: You understand the principles of neural networks and can apply the knowledge to select them

Satisfactory 2: You understand the basics of Q-learning methods and can make a small application with it

Arviointikriteerit, hyvä (3-4)

Good 3: Can adjust the parameter of the Bellman algorithm (Exploration, Exploitation, gamma +....) so that the operation of the controlled object is optimized

Excellent 4: You know how to tune a multilayer neural network using the PPO algorithm so that the given actuator behaves as desired.

Assessment criteria, excellent (5)

Excellent 5: In addition to the previous ones, you understand the limitations of artificial intelligence in various practical applications and understand that OpenAI-Gym models require a strong substance control. You also know how to document your work well, using TensorFlow outputs to evaluate hyperparameters.

Qualifications

Johdanto IoT-järjestelmiin

Enrollment

01.08.2023 - 24.08.2023

Timing

28.08.2023 - 19.12.2023

Number of ECTS credits allocated

5 op

Virtual portion

5 op

Mode of delivery

Online learning

Unit

School of Technology

Teaching languages
  • English
Seats

0 - 35

Degree programmes
  • Bachelor's Degree Programme in Information and Communications Technology
Teachers
  • Jouko Kotkansalo
Groups
  • TTV21S3
    Tieto- ja viestintätekniikka (AMK)
  • TTV21S5
    Tieto- ja viestintätekniikka (AMK)
  • TTV21SM
    Tieto- ja viestintätekniikka (AMK)
  • TTV21S2
    Tieto- ja viestintätekniikka (AMK)
  • TTV21S1
    Tieto- ja viestintätekniikka (AMK)

Objective

Course objectives
In the course, you will learn how to use advanced new technologies, such as artificial intelligence, in the implementation of IoT systems. You get to know different neural networks and understand their basic parameters.

Competences:
EUR-ACE Knowledge and Understanding
EUR-ACE Engineering Practice


You know the architectures of neural networks and understand their application areas. You know how to make a Q-table of basic neural network design and implementation in practice. You know what the RL agent does and you know how to train the agent to make it work optimally. You understand the difference between On-Policy and Off-Policy algorithms and know how to use information to select an algorithm.

Content

Comparison of neural networks (RL, Supervised, Unsupervised )
Keras, Pytorch and other algorithm-based neural networks
RL agent and environment
Exploitation and exploration
Reward and hyperparameters
Basic neuromath and activation functions
Policy gradient method and value based learning
Bellman equation and its demo (Q-learning)
Pytorch, PPO algorithm and demo

Evaluation scale

0-5

Arviointikriteerit, tyydyttävä (1-2)

Avoidance 1: You understand the principles of neural networks and can apply the knowledge to select them

Satisfactory 2: You understand the basics of Q-learning methods and can make a small application with it

Arviointikriteerit, hyvä (3-4)

Good 3: Can adjust the parameter of the Bellman algorithm (Exploration, Exploitation, gamma +....) so that the operation of the controlled object is optimized

Excellent 4: You know how to tune a multilayer neural network using the PPO algorithm so that the given actuator behaves as desired.

Assessment criteria, excellent (5)

Excellent 5: In addition to the previous ones, you understand the limitations of artificial intelligence in various practical applications and understand that OpenAI-Gym models require a strong substance control. You also know how to document your work well, using TensorFlow outputs to evaluate hyperparameters.

Qualifications

Johdanto IoT-järjestelmiin

Enrollment

01.11.2022 - 05.01.2023

Timing

09.01.2023 - 28.04.2023

Number of ECTS credits allocated

5 op

Mode of delivery

Face-to-face

Unit

School of Technology

Campus

Lutakko Campus

Teaching languages
  • English
Seats

0 - 30

Degree programmes
  • Bachelor's Degree Programme in Information and Communications Technology
Teachers
  • Jouko Kotkansalo

Objective

Course objectives
In the course, you will learn how to use advanced new technologies, such as artificial intelligence, in the implementation of IoT systems. You get to know different neural networks and understand their basic parameters.

Competences:
EUR-ACE Knowledge and Understanding
EUR-ACE Engineering Practice


You know the architectures of neural networks and understand their application areas. You know how to make a Q-table of basic neural network design and implementation in practice. You know what the RL agent does and you know how to train the agent to make it work optimally. You understand the difference between On-Policy and Off-Policy algorithms and know how to use information to select an algorithm.

Content

Comparison of neural networks (RL, Supervised, Unsupervised )
Keras, Pytorch and other algorithm-based neural networks
RL agent and environment
Exploitation and exploration
Reward and hyperparameters
Basic neuromath and activation functions
Policy gradient method and value based learning
Bellman equation and its demo (Q-learning)
Pytorch, PPO algorithm and demo

Location and time

According to the schedule in state 431

Oppimateriaali ja suositeltava kirjallisuus

Materials in the e-learning environment.

Teaching methods

- lectures
- independent study
- distance learning
- webinars
- small group learning
- exercises
- learning tasks
- seminars

Employer connections

- ekskursiot
- vierailijaluennot
- projektit

Vaihtoehtoiset suoritustavat

The admission procedures are described in the degree rule and the study guide. The teacher of the course will give you more information on possible specific course practices

Student workload

One credit (1 Cr) corresponds to an average of 27 hours of work.

- lectures 52 h
- exercises 15 h
- assignment 35 h
- independent study 30 h
- company visits 3 h
Total 135 h

Further information

In the reference project, the robot car is trained to drive the track more evenly (small wobble). Reinforcement neural network optimizes car driving according to a reward, agent, policy. The AI ​​is located first on the server and finally on the edge of the network. Investigate whether driving improves as a result of edge calculation

Evaluation scale

0-5

Arviointikriteerit, tyydyttävä (1-2)

Avoidance 1: You understand the principles of neural networks and can apply the knowledge to select them

Satisfactory 2: You understand the basics of Q-learning methods and can make a small application with it

Arviointikriteerit, hyvä (3-4)

Good 3: Can adjust the parameter of the Bellman algorithm (Exploration, Exploitation, gamma +....) so that the operation of the controlled object is optimized

Excellent 4: You know how to tune a multilayer neural network using the PPO algorithm so that the given actuator behaves as desired.

Assessment criteria, excellent (5)

Excellent 5: In addition to the previous ones, you understand the limitations of artificial intelligence in various practical applications and understand that OpenAI-Gym models require a strong substance control. You also know how to document your work well, using TensorFlow outputs to evaluate hyperparameters.

Qualifications

Johdanto IoT-järjestelmiin

Enrollment

01.08.2022 - 25.08.2022

Timing

29.08.2022 - 16.12.2022

Number of ECTS credits allocated

5 op

Virtual portion

5 op

Mode of delivery

Online learning

Unit

School of Technology

Campus

Lutakko Campus

Teaching languages
  • English
Seats

0 - 70

Degree programmes
  • Bachelor's Degree Programme in Information and Communications Technology
Teachers
  • Jouko Kotkansalo

Objective

Course objectives
In the course, you will learn how to use advanced new technologies, such as artificial intelligence, in the implementation of IoT systems. You get to know different neural networks and understand their basic parameters.

Competences:
EUR-ACE Knowledge and Understanding
EUR-ACE Engineering Practice


You know the architectures of neural networks and understand their application areas. You know how to make a Q-table of basic neural network design and implementation in practice. You know what the RL agent does and you know how to train the agent to make it work optimally. You understand the difference between On-Policy and Off-Policy algorithms and know how to use information to select an algorithm.

Content

Comparison of neural networks (RL, Supervised, Unsupervised )
Keras, Pytorch and other algorithm-based neural networks
RL agent and environment
Exploitation and exploration
Reward and hyperparameters
Basic neuromath and activation functions
Policy gradient method and value based learning
Bellman equation and its demo (Q-learning)
Pytorch, PPO algorithm and demo

Location and time

According to the schedule in state 431

Oppimateriaali ja suositeltava kirjallisuus

Materials in the e-learning environment.

Teaching methods

- lectures
- independent study
- distance learning
- webinars
- small group learning
- exercises
- learning tasks
- seminars

Employer connections

- excursions
- visiting lecturers
- projects

Exam schedules

The possible date and method of the exam will be announced in the course opening.

Vaihtoehtoiset suoritustavat

The admission procedures are described in the degree rule and the study guide. The teacher of the course will give you more information on possible specific course practices.

Student workload

One credit (1 Cr) corresponds to an average of 27 hours of work.

- lectures 52 h
- exercises 15 h
- assignment 35 h
- independent study 30 h
- company visits 3 h
Total 135 h

Further information

Evaluation according to the project

In the reference project, the robot car is trained to drive the track more evenly (small wobble). Reinforcement neural network optimizes car driving according to a reward, agent, policy. The AI ​​is located first on the server and finally on the edge of the network. Investigate whether driving improves as a result of edge calculation

Evaluation scale

0-5

Arviointikriteerit, tyydyttävä (1-2)

Avoidance 1: You understand the principles of neural networks and can apply the knowledge to select them

Satisfactory 2: You understand the basics of Q-learning methods and can make a small application with it

Arviointikriteerit, hyvä (3-4)

Good 3: Can adjust the parameter of the Bellman algorithm (Exploration, Exploitation, gamma +....) so that the operation of the controlled object is optimized

Excellent 4: You know how to tune a multilayer neural network using the PPO algorithm so that the given actuator behaves as desired.

Assessment criteria, excellent (5)

Excellent 5: In addition to the previous ones, you understand the limitations of artificial intelligence in various practical applications and understand that OpenAI-Gym models require a strong substance control. You also know how to document your work well, using TensorFlow outputs to evaluate hyperparameters.

Qualifications

Johdanto IoT-järjestelmiin