Categories
Coding Processing Sound TLU

2020/05 Graphics and Sound Programming @ Tallinn University

Sound Programming part of the course (19-21 May 2020)

Brief Description of course content:

  • Basic concepts in acoustics and music theory.
  • Digital signal processing.
  • Digital filtering.
  • Fast Fourier transform.
  • Sound synthesis.
  • Audio engines.
  • Procedural sound generation in p5.js.
  • Integration of procedural audio in games.

Calendar:

  • May 19, 16:15-19:45
    Audio engines. Procedural sound generation in p5.js.
    Presentations 1 and 2; Exercises 1 and 2 (see below)
  • May 20, 16:15-19:45
    Digital signal processing. Digital filtering. Fast Fourier transform.
    Presentation 3; Exercises 3, 4 and 5 (see below)
  • May 21, 16:15-19:45
    Integration of procedural audio in games.
    Presentation 4; Exercises 6, 7 and 8 (see below)
  • May 29, 23:59
    Assignment submission deadline

Resources:

Presentations:

Exercises:

  • Ex1-Oscillator: Code / Video
  • Ex2-SoundFile: Code / Video
  • Ex3-AmplitudeFFT: Code / Video
  • Ex4-SineFilter: Code / Video
  • Ex5-RandomLoop: Code / Video
  • Ex6-DelayMap: Code / Video
  • Ex7-ParticlesReverb: Code / Video
  • Ex8-SpaceInvaders (revisions): original code / version with oscillator & noise
    Instructions:

    • Copy the original code.
    • Add foreground sounds (sound files) for a) shooting and for b) destroying an enemy.
    • Combine each sound with a sound processing method: with rate, filter, delay or reverb.
    • Manipulate one of the 2 sounds mapping it to a x or y value in the game (e.g. map the x position of player to filter frequency).
    • Manipulate the other sound based on a random parameter (e.g. make the explosion playback rate a random value).

Assignment:

Create the sound design for a game, using programming techniques in p5.js. Use the game Asteroids as a starting point. Code: https://editor.p5js.org/codingtrain/sketches/VtYr6E4_M (*) The code is spread out in different files, press the “>“ next to Index.html to see all files.

  • UPLOAD LINK: [submissions closed]
  • DEADLINE: 29/May/2020

Instructions:

  1. Copy the Asteroids code. You can simply go to File > Duplicate to edit it and save, when logged in.
  2. Add foreground and background sounds (at least 2 of each).
  3. Combine each sound with a sound processing method – for example: rate, filter, delay or reverb.
  4. Manipulate at least one of the sounds by mapping it to a parameter in the game.
  5. Manipulate at least another sound based on a random parameter.
  6. Manipulate at least one graphical element based on sound analysis methods, such as FFT or Amplitude (if needed, add graphical elements).
  7. Explore further techniques in p5.Sound library similar to the ones studied in class.
  8. Comment the code to explain the additions made.
  9. In the first line of the code, add a comment with your name and the URL of the project (for example: https://editor.p5js.org/nunocorreia/sketches/1x2y3z
  10. Download the project files (File > Download). Rename folder with your name. Zip (compress) the folder (.zip extension) and upload to: [submissions closed] (deadline: 29/May/2020)

Evaluation criteria:

  1. Quality and appropriateness of foreground and background sounds
  2. Quality, diversity and appropriateness of sound manipulation techniques
  3. Use of mappings of sound manipulation to game parameters
  4. Use of randomization techniques
  5. Use of mappings of sound to graphical elements
  6. Exploration of additional techniques
  7. Quality of the comments to the code
  8. Overall quality of the sound design

(*) From Coding Train website. More information:

One reply on “2020/05 Graphics and Sound Programming @ Tallinn University”