International Audio Laboratories Erlangen

Lecture: Audio Processing for the Internet of Things (AIoT) (Summer Term 2021)

  • Instructor: Prof. Dr. Nils Peters

  • Credits: 2.5 ECTS

  • Format: Lecture, in English

  • Term: Summer 2021

  • Time: Wednesday 16:15–17:45 (1st Lecture: 21.04.2021)

  • Location: Via ZOOM. Link and access information for ZOOM meetings can be found at StudOn (see below).

  • Dates: Wed 21.4.2021, Wed 28.4.2021 , Wed 5.5.2021, Wed 12.5.2021, Wed 19.5.2021, Wed 26.5.2021, Wed 2.6.2021, Wed 9.6.2021, Wed 16.6.2021, Wed 23.6.2021, Wed 30.6.2021, Wed 7.7.2021

  • Office Hours: Monday 16:00–17:00 (virtual, use lecture ZOOM link)

  • Exam (graded): Oral examination at the end of term.

  • Examination Dates and Location: To be announced, subject to COVID-19 safety regulations.

Important Notes:
  • Due to the COVID-19 pandemic, the lecture Audio Processing for the Internet of Things will be offered as a fully virtual course via ZOOM.
  • Participation in the ZOOM sessions is only possible for FAU students. To access the Zoom sessions, you must register via StudOn prior to the first lecture. In StudOn, you will then find Zoom access information.
  • As a technical requirement, all participants must have access to a computer capable of running the ZOOM video conferencing software, including a stable internet connection for audio and video transmission.

Content

The course focuses on audio and speech processing algorithms within the context of the Internet of Things (IoT). Reading material recommendations are provided during the lectures.

  • Foundation: history, components, current challenges
  • Overview of relevant wireless protocols: bandwidth, range, latency, spectrum
  • Audio device synchronization: NTP, PTP, device orchestration, wireless acoustic sensor networks, asynchronous and event-driven audio sampling
  • Acoustic Sensing for Voice User Interfaces: keyword spotting, speech recognition, speaker verification, anti-spoofing
  • Acoustic Scene Detection: event detection, scene classification, anomaly detection, sound tagging, blind reverb estimation
  • Sound Creation: text-to-speech, sound generative networks
  • Data-over-sound: sound-beacon, watermarking, acoustic fingerprint
  • Privacy in IoT: edge vs. cloud processing, secure signal processing, federated learning, differential privacy, audio encryption

Course Requirements

Before starting this lecture, it is recommended to complete the following courses (or have equivalent knowledge):

  • Signals and Systeme I & II
  • Digital Signal Processing

Links