I’m very happy to announce my new book, Learning AV Foundation, is available for pre-order from InformIT. Enter
MCCUNE1808 to receive a 35% discount. This is the book I wish I had a few years ago, and I hope it will provide you with the understanding and inspiration to build amazing media applications for iOS and OS X!
This book is not intended to be a definitive reference guide covering every aspect of the framework, but instead focuses on the most relevant parts of the framework to lay the foundation that will empower you to be fully comfortable with the concepts, features, and conventions used throughout. Here are the details of the topics covered in the book:
- Chapter 1, ”Getting Started with AV Foundation”—This chapter will help you take your first steps with AV Foundation. It deconstructs the framework to help you gain a better understanding of its features and capabilities. This chapter also provides a high-level overview of the media domain itself and covers topics such as digital sampling and media compression. An understanding of these topics will be helpful throughout the book.
- Chapter 2, “Playing and Recording Audio”—AV Foundation’s classes for playing and recording audio are some of its most widely used features. In this chapter we discuss how to use the framework’s audio classes, and you’ll put them into action building an audio looper and voice memo applications. We also cover how to use audio sessions to help you provide a polished audio user experience to your apps.
- Chapter 3, “Working with Assets and Metadata”—Much of the framework is built around the notion of assets. An asset represents a media resource, such as a QuickTime movie or an MP3 audio file. You learn to use assets and how to use the framework’s metadata features by building a metadata editing application.
- Chapter 4, “Playing Video”—Playing video is one of the most essential tasks AV Foundation performs. It’s a primary or supporting use case in many media apps. You gain a detailed understanding of how to use the framework’s playback features to build a custom video player with full transport controls, subtitle display, and Airplay support.
- Chapter 5, “Using the AV Kit Framework”—AV Kit is a new framework introduced in Mac OS X 10.9 and now in iOS 8. It enables you to quickly build AV Foundation video players with user interfaces matching QuickTime Player on OS X and the Videos app on iOS. This can be a great option if you want to build players maintaining fidelity with the native operating system while retaining the full power of working directly with AV Foundation’s video APIs covered in Chapter 4.
- Chapter 6, “Capturing Media”—This chapter provides an introduction to the framework’s audio and video capture features. You learn to use these features to control the built-in camera hardware available on iOS devices and modern Macs. This is one of the most widely used areas of the framework, and it can help you build powerful, modern camera capture applications.
- Chapter 7, “Using Advanced Capture Features”—This chapter covers a variety of advanced capture topics. You learn to use metadata capture to perform barcode scanning and face detection. You learn to use the advanced zooming capabilities provided by the framework. You also learn to enable high frame rate capture, which is great for adding slow motion effects to your videos. We also discuss how to integrate with OpenGL ES to process the video samples captured by the camera, which opens up a world of possibilities.
- Chapter 8, “Reading and Writing Media”—AV Foundation provides a lot of high-level functionality, but the framework never hides the lower-level details from you when you need it. In this chapter we discuss the framework’s low-level reading and writing facilities that can enable you to process the media in any way you want. We discuss how to read audio samples from an asset and render them as an audio waveform. We also look at applying real-time video effects using the camera capture APIs.
- Chapter 9, “Composing and Editing Media”—In this chapter we begin our exploration of the framework’s media editing features. This is one of the most powerful features of the framework, and it enables you to create new media by composing and editing media from a variety of sources. In this chapter you begin building the book’s most advanced application, 15 Seconds, which is a video editor similar to an application like iMovie for iOS.
- Chapter 10, “Mixing Audio”—An important part of building media compositions is learning how to mix multiple audio tracks. You learn how to use mixing techniques such as audio fades and ducking that will help you add polish to your audio presentation.
- Chapter 11, “Performing Video Transitions”—Video transitions are commonly used to indicate a change in location or storyline, and AV Foundation provides robust support for applying video transitions to your compositions. In this chapter you learn to use the framework’s video composition to control the compositing of multiple video tracks in your composition. You’ll put these features into action to add dissolve, push, and wipe transitions to the 15 Seconds app.
- Chapter 12, “Layering Animated Content”—This chapter discusses how to add titles, lower thirds, and other animated overlay effects using the Core Animation framework. You’ll see how to use Core Animation to build animation sequences that seamlessly synchronize with your video playback. We also discuss how to incorporate these same effects in your final exported videos.