CSE/ISE 334 Course Information


Course number:

CSE or ISE 334


Course title:
"Introduction to Multimedia Systems"


Course description:
This is a survey course of both electronic and digital media technologies. Students learn a wide variety of multimedia standards, formats, and data types; and develop proficiency with industry-standard tools for capturing, editing, and processing media. Relevance to software development, such as interface design or digital entertainment, is demonstrated through case studies. The nature of light and sound, and the biology of human perception are explored along with implications for digital representation of information. Intellectual property rights and other ethical issues related to media are discussed. Students work independently on lab exercises and build a final multimedia project that integrates the exercises.


Prerequisite(s):
U3 or higher status.


Number of credits:
3


Course topics:

What is Multimedia?
Conduits of information: print, broadcast, internet
Vehicles of expression: text, graphics, animation, audio, video, 3D
Multimedia systems approach (Shannon)

The Nature of Information
Analog Events, Digital Recordings
Waveforms
Electromagnetic Spectrum
Color models
Frequency and Amplitude, Pitch and Volume, Color and Brightness
Transducers
Sampling rate, quantization
Aliasing

The Biology and Psychology of Human Perception
Visible spectrum
Auditory range
Sensory bandwidth
Psychology of color
Pattern recognition

The Design of Information
Aspect ratio and figure-ground relationships
Design of statistical and schematic data (Tufte)

Images
Image capture
Rasterizing
Graphics formats
Digital color and palettes
Graphics compression

Text and Graphics
Vector graphics
Icons
Text formats, character sets, and fonts
Typography

Audio
Audio capture
Digital audio vs. MIDI
Audio formats
Audio compression

Animation
Animation principles
Frame rate
Rotoscopy
Interpolation
Kinematics
Animation formats

3D
3D modeling
Motion capture
Texture mapping
3D formats
3D animation

Video
Video capture
Analog video vs. digital video
Video formats and standards
Video compression


Course objectives:
Upon completion of the course students should demonstrate an understanding of multimedia standards and their perceptual limitations. Students should also be able to digitize and process audio and images, and compress and encode the files appropriately for a variety of delivery methods. They should be able to capture motion and render it realistically, and should also be able to model objects in 3D, render, and animate them. Finally students should be able to synchronize these diverse media elements in a linear presentation.


Computer usage:
Software tools include GIMP, Inkscape, Audacity, and Blender.


Course webpage:
http://xsrv.mm.cs.stonybrook.edu/intromm

Course email:
intromm@cs.stonybrook.edu


Americans with Disabilities Act: If you have a physical, psychological, medical or learning disability that may impact your course work, please contact Disability Support Services, ECC (Educational Communications Center) Building, Room 128, (631) 632-6748. They will determine with you what accommodations, if any, are necessary and appropriate. All information and documentation is confidential.

Academic Integrity: Each student must pursue his or her academic goals honestly and be personally accountable for all submitted work. Representing another person's work as your own is always wrong. Faculty are required to report any suspected instances of academic dishonesty to the Academic Judiciary. Faculty in the Health Sciences Center (School of Health Technology & Management, Nursing, Social Welfare, Dental Medicine) and School of Medicine are required to follow their school-specific procedures. For more comprehensive information on academic integrity, including categories of academic dishonesty, please refer to the academic judiciary website at http://www.stonybrook.edu/uaa/academicjudiciary/

Critical Incident Management: Stony Brook University expects students to respect the rights, privileges, and property of other people. Faculty are required to report to the Office of Judicial Affairs any disruptive behavior that interrupts their ability to teach, compromises the safety of the learning environment, or inhibits students' ability to learn.

Minimal Student Responsibilities: http://sb.cc.stonybrook.edu/bulletin/current/policiesandregulations/policies_expectations/min_instructional_student_resp.php


Course coordinator and instructor:
Tony Scarlatos
anthony.scarlatos@stonybrook.edu