CSE/ISE 334 LECTURE NOTES

Creativity Resources


What is Multimedia?


Visual Design Elements and Principles

YouTube video: "Elements and Principles of Design"

"Why We Love Beautiful Things", By Lance Hosey, NY Times, 2/15/2013
http://www.nytimes.com/2013/02/17/opinion/sunday/why-we-love-beautiful-things.html

Brief History of Graphic Communications

The Metropolitan Museum of Art's Timeline of Art History

The Collections at the Metropolitan Museum of Art

Google Arts & Culture Portal

Google Museum Virtual Tours


Synthetic Reality

• Heironymus Bosch
https://www.wikiart.org/en/hieronymus-bosch

Animation: Bosch-inspired station ID animation for MTV
https://www.youtube.com/watch?v=M285A0dK6PQ

• Salvador Dali
https://www.wikiart.org/en/salvador-dali

Video: "Dreams of Dali: A Virtual Reality Experience"
https://www.youtube.com/watch?v=F1eLeIocAcU

• M.C. Escher
https://mcescher.com/gallery/most-popular/#

Video: "Escher for Real", Escher illusions realized at Technion University
https://www.youtube.com/watch?v=cmr4HqjSSw4

"Drawing Hands with AI (After MC Escher)", Joohhe Yoon's New Yorker cover
https://www.newyorker.com/culture/cover-story/cover-story-2023-04-24

Video: Regular Division of the Plane - Escher Tessellation, Museum of Science, Boston
https://www.youtube.com/watch?v=G-oVgNX-fcg

Video: Escher Droste Effect
https://www.youtube.com/watch?v=8DVLY41MClA

Video: Escher's "Relativity" as a 3d animation
https://www.youtube.com/watch?v=JdgPvripL9A

• Max Fleischer's Stereoptical Camera
https://commons.wikimedia.org/wiki/File:Fleischer_stereoptical_camera_fig1_edit.png

Video:
Popeye animation using the setback camera
https://www.youtube.com/watch?v=Fnvnyb1e-p8

• The multiplane camera
https://www.theinsidetips.com/tip-512-animate-with-a-multi-plane-camera/

Video: Walt Disney explains the multiplane camera
https://www.youtube.com/watch?v=3YIR39KeJMk

Rotoscoping
https://en.wikipedia.org/wiki/Rotoscoping#/media/File:US_patent_1242674_figure_3.png

Animation: Dali & Disney - "Destino"
https://www.youtube.com/watch?v=hc_f9VDVsNk

Exhibit: "Faking It: Manipulated Photography Before Photoshop", Metropolitan Museum of Art, 10/11/2012 - 1/27/12013
http://www.metmuseum.org/exhibitions/listings/2012/faking-it

Exhibit: "Agitated Images: John Heartfield & German Photomontage, 1920 - 1938", The J. Paul Getty Museum
http://www.getty.edu/art/exhibitions/heartfield/


Multimedia Development Process

NY Times video: "A Rare Inside Look Inside Pixar Studios"

Knight Digital Media Center, "Multimedia Storytelling"

Exhibit: "The Science Behind Pixar"
https://sciencebehindpixar.org/explore


Character Design

Video: "Cody -- Character Design and Development"
https://www.youtube.com/watch?v=ughOkHzMUhw

Video: "Digital Artists Behind The Life of PI", By Jeremy Beiler and Shayla Harris, NY Times 2/14/2013
http://www.nytimes.com/video/movies/100000002064437/digital-artists-behind-life-of-pi.html


Storyboards

Video: "Surf's Up - Storyboard to Surfboard"
https://www.youtube.com/watch?v=ZkH1zNedOc0

"Storytelling Your Way to a Better Job or a Stronger Start-Up", By Alina Tugend, NY Times, 12/12/2014
http://www.nytimes.com/2014/12/13/your-money/storytelling-to-find-a-job-or-build-a-business.html

Video: "The Hero's Journey according to Joseph Campbell", By Matthew Winkler and Kirill Yeretsky
https://www.youtube.com/watch?v=d1Zxt28ff-E

Video: "Freytag's Pyramid"
https://www.youtube.com/watch?v=nqQtkuQz_GY

Wally Wood's "22 Panels That Always Work"

22 Panels, applied to video


Audio

The Nature of Sound

Guitar Oscillation
https://www.youtube.com/watch?v=INqfM1kdfUc

Sonic Reflection
https://www.pictorem.com/93178/Inside%20Guitar.html

"Birds on the Wires"
https://www.youtube.com/watch?v=LoM4ZZJ2UrM

Speech to Birdsong Conversion, By Ooona Raisanen
http://www.windytan.com/2021/03/speech-to-birdsong-conversion.html

https://www.npr.org/2021/04/16/988200892/heres-what-all-things-considered-sounds-like-in-blackbird-song

"Voice of the Trees", By Bartholomaus Traubeck
https://www.youtube.com/watch?v=ZYLaPVi_I2U

Deep Space Sounds from NASA
https://www.nasa.gov/mission_pages/cassini/multimedia/pia07966.html

The Psychology of Sound

"The Shadow Knows"
https://www.youtube.com/watch?v=uMlRpN8ANrU

"Trump Stalks Hillary", By Danny Elfman
https://www.youtube.com/watch?v=BbeCC9XOCmE

"Why this creepy melody is in so many movies" (Dies Irae)
https://www.youtube.com/watch?v=-3-bVRYRnSM

The Technology of Music

Analog to Digital Converter
https://m-audio.com/m-track-duo

Player Piano
https://www.youtube.com/watch?v=aseMAEctM1s

Wolfram Tones
http://tones.wolfram.com/

Animusic
https://www.kurzweilai.net/instrument-of-the-future

Videogame Music Composers
https://www.npr.org/podcasts/493916268/music-respawn

Student Work

Rene Diresta
https://www3.cs.stonybrook.edu/~tony/intromm/showcase/audio/diresta.mp3

Brian Paras
Audio
Storyboard


3D modeling, shading, lighting, animation, and rendering

https://www3.cs.stonybrook.edu/~tony/intromm/Blender_tutorials/ui.mp4

https://www3.cs.stonybrook.edu/~tony/intromm/Blender_tutorials/workspaceedit.mp4

https://www3.cs.stonybrook.edu/~tony/intromm/Blender_tutorials/simple.mp4

https://www3.cs.stonybrook.edu/~tony/intromm/Blender_tutorials/advanced.mp4

https://www3.cs.stonybrook.edu/~tony/intromm/Blender_tutorials/uvmap.mp4

https://www3.cs.stonybrook.edu/~tony/intromm/Blender_tutorials/rigging.mp4

https://www3.cs.stonybrook.edu/~tony/intromm/Blender_tutorials/lighting.mp4

https://www3.cs.stonybrook.edu/~tony/intromm/Blender_tutorials/rendering.mp4


Animation

12 principles of animation (from “The Illusion of Life”, by Disney animators Ollie Johnston and Frank Thomas, 1981)
https://www.creativebloq.com/advice/understand-the-12-principles-of-animation

https://vimeo.com/93206523

Pixar Light & Heavy
https://www.youtube.com/watch?v=-S7tsm5PU64

Physics of Animation (National Science Foundation)
https://www.youtube.com/watch?v=h6iu7e7jS1o

Magic Lantern
https://www.youtube.com/watch?v=J1fUSqH5op8

Eadweard Muybridge studies of human locomotion
https://archive.org/details/Eadweard_Muybridge_-_The_Human_Figure_in_Motion

Isadora Duncan
https://archive.org/details/Eadweard_Muybridge_-_The_Human_Figure_in_Motion/page/n131/mode/2up

Animated Muybridge motion studies
https://commons.wikimedia.org/wiki/Category:Eadweard_Muybridge_animations

Muybridge biography
https://www.youtube.com/watch?v=wNU7sXkZmSw&t=3s

Cartoon Laws of Physics
https://www.dgp.toronto.edu/~karan/courses/csc2529/cartoonlaw.htm

Laws of Motion in a Cartoon Landscape
https://www.youtube.com/watch?v=1XxVq34jY78

Neil deGrasse Tyson discusses the Cartoon Laws of Physics (National Geographic TV)
https://www.youtube.com/watch?v=8tD4CFgc3S8


ARCHIVE

Principles of Creativity


Pictures


Text and Graphics


The Nature of Information


Audio


Sensory Perception


The Design of Information


Animation


3D Animation

3D Modeling Primer


Video