多媒体通信系统PDF|Epub|txt|kindle电子书版本网盘下载

多媒体通信系统PDF格式电子书版下载

注意：本站所有压缩包均有解压码： 点击下载压缩包解压工具

Chapter 1 Multimedia Communications1

1.1 Introduction1

1.2 Multimedia Communication Model4

1.3 Elements of Multimedia Systems4

1.4 User Requirements5

1.5 Network Requirements7

1.6 Packet Transfer Concept8

1.7 Multimedia Requirements and ATM Networks9

1.8 Multimedia Terminals10

1.9 Concluding Remarks12

Chapter 2 Audio-Visual Integration13

2.1 Introduction13

2.2 Media Interaction14

2.3 Bimodality of Human Speech16

2.4 Lip Reading18

2.5 Speech-Driven Talking Heads21

2.6 Lip Synchronization23

2.7 Lip Tracking24

2.8 Audio-to-Visual Mapping27

2.8.1 Classification-Based Conversion27

2.8.2 HMM for Audio-to-Visual Conversion28

2.8.3 Audio and Visual Integration for Lip-Reading Applications28

2.8.4 Audio-Visual Information Preprocessing29

2.8.5 Pattern-Recognition Strategies29

2.8.6 Integration Strategy29

2.9 Bimodal Person Verification30

2.10 Joint Audio-Video Coding31

2.11 Concluding Remarks32

Chapter 3 Multimedia Processing in Communications35

3.1 Introduction37

3.2 Digital Media37

3.3 Signal-Processing Elements40

3.4 Challenges of Multimedia Information Processing42

3.4.1 Pre and Postprocessing44

3.4.2 Speech,Audio and Acoustic Processing for Multimedia44

3.4.3 Video Signal Processing46

3.4.4 Content-Based Image Retrieval48

Texture-Based Methods48

Shape-Based Methods49

Color-Based Methods49

3.5 Perceptual Coding of Digital Audio Signals51

3.5.1 General Perceptual Audio-Coding Architecture51

3.5.2 Review of Psychoacoustic Fundamentals53

Absolute Threshold of Hearing53

Critical Band Frequency Analysis54

Simultaneous Masking and the Spread of Masking55

Temporal Masking56

PE57

3.6 Transform Audio Coders58

3.6.1 Optimum Coding in the Frequency Domain59

3.6.2 Perceptual Transform Coder60

3.6.3 Hybrid Coder61

3.6.4 Transform Coding Using DFT Interblock Redundancy62

3.6.5 ASPEC62

3.6.6 Differential Perceptual Audio Coder63

3.6.7 DFT Noise Substitution64

3.6.8 DCT with Vector Quantization65

3.6.9 MDCT65

3.6.10 MDCT with VQ66

3.7 Audio Subband Coders66

3.7.1 Wavelet Decompositions67

3.7.2 DWT-based Subband Coders69

3.8 Speech Coder Attributes69

3.9 CD Audio Coding for Multimedia Applications71

3.10 Image Coding71

3.11 Video Coding74

3.11.1 TC and Subband Coding(SBC)74

3.11.2 Predictive Coding75

3.11.3 Motion-Compensated Video Coding76

3.12 Watermarking78

3.12.1 Watermarking Techniques80

3.12.2 Main Features of Watermarking81

3.12.3 Application Domains83

3.13 Organization,Storage and Retrieval Issues85

3.13.1 Streaming Issues for Speech and Audio85

3.13.2 Streaming Issues for Video87

3.14 Signal Processing for Networked Multimedia88

3.15 NNs for Multimedia Processing89

3.15.1 NNs for Optimal Visualization90

3.15.2 Neural Techniques for Motion Estimation91

3.15.3 NN Application to Face Detection and Recognition91

3.15.4 Personal Authentication by Fusing Image and Speech92

3.15.5 Subject-Based Retrieval for Image and Video Databases93

3.15.6 Face-Based Video Indexing and Browsing94

3.16 Multimedia Processors94

3.16.1 Image-Processing Hardware and Software95

3.16.2 Multimedia Processors Classification96

3.16.3 General Purpose Microprocessors98

3.16.4 Microprocessors for Embedded Applications101

3.17 Concluding Remarks102

Chapter4 Distributed Multimedia Systems105

4.1 Introduction105

4.2 Main Features of a DMS107

4.3 Resource Management of DMS107

4.4 Networking108

4.4.1 Ip Networking109

IP Multicast110

Resource Reservation Protocol(RSVP)111

RTP112

4.4.2 Integrated Management Architecture for IP-Based Networks112

Performance Management114

Fault Management114

Configuration Management115

Security Management115

Accounting and Billing Management116

4.4.3 ATM116

4.4.4 Integration of IP and ATM119

4.4.5 Real-Time Multimedia over ATM(RMOA)120

4.5 Multimedia Operating Systems122

CPU Management123

Memory Management123

I/O Management124

File System Management124

4.6 Distributed Multimedia Servers124

4.6.1 Multimedia Packing125

4.7 Distributed Multimedia Applications126

4.7.1 ITV127

VoD128

4.7.2 Telecooperation131

Telecooperation Infrastructure132

Telecooperative Applications133

Telemedicine135

4.7.3 Hypermedia Applications135

Basic Features of a Hypermedia System135

The Web136

4.8 Concluding Remarks137

Chapter 5 Multimedia Communication Standards139

5.1 Intro duction140

5.2 MPEG Approach to Multimedia Standardization142

5.3 MPEG-1(Coding of Moving Pictures and Associated Audio)146

5.3.1 The Basic MPEG-1 Interframe Coding Scheme149

5.3.2 Conditional Replenishment152

5.3.3 Specific Storage Media Functionalities152

5.3.4 Rate Control153

5.4 MPEG-2(Generic Coding of Moving Pictures and Associated Audio)154

5.4.1 MPEG-2 Video157

MPEG-2 Video-The Basics158

MPEG-2 Video Syntax163

MPEG-2 Video Scalability163

MPEG-2 Video:Profiles and Levels166

5.4.2 MPEG-2 Audio167

5.4.3 MPEG-2 Systems171

5.4.4 MPEG-2 DSM-CC175

5.5 MPEG-4——Coding of Audiovisual Objects176

5.5.1 Overview of MPEG-4:Motivations,Achievement,Process and Requirements178

Media Objects180

MPEG-4 Version 1182

MPEG-4 Version 2183

Extensions to MPEG-4 Beyond Version 2188

Profiles in MPEG-4189

Verification Testing:Checking MPEG s Performance192

MPEG-4 Standardization Process193

Requirements for MPEG-4194

5.5.2 MPEG-4 Systems195

MPEG-4 Systems Architecture196

Elementary Stream Management(ESM)199

Auxiliary Descriptors und Streams201

Structuring Content by Grouping of Streams203

Managing Content Complexity203

Distributed Content-Handling Considerations204

System Decoder Model(SDM)for ES Synchronization204

MPEG-4 Systems BIFS205

5.5.3 DMIF210

DMIF Computational Model213

5.5.4 MPEG-4 Video214

Shape-Coding Tools for MPEG-4 Natural Video216

Motion Estimation and Campensation217

Texture-Coding Tools218

Multifunctional Coding220

Sprite Coding221

Scalability221

Error Resilience223

Relationship Between Natural and Synthetic Video Coding223

Synthetic Images225

Integration of Face Animation with Natural Video226

FAPs227

Face Model232

Coding of FAPs233

FIT235

Integration of Face Animation and Text-to-Speech(TTS) Synthesis235

BIFS for Facial Animation236

2D Mesh Coding237

VO Tracking238

2D-Mesh Object Encoder/Decoder239

5.5.5 MPEG-4 Audio243

MPEG-4 Natural Audio Coding244

General Audio Coding(Advanced Audio Coding Based)244

Twin VQ248

Speech Coding in MPEG-4 Audio248

Scalability in MPEG-4 Natural Audio252

Synthetic Audio in MPEG-4252

Audio BIFS255

5.5.6 Profiles and Levels in MPEG-4256

Visual Object Types256

Visual Profiles259

Audio Object Types260

Audio Profiles261

Graphics261

Systems Profiles261

5.6 MPEG-4 Visual Texture Coding(VTC) and JPEG 2000 Image Compression Standards262

5.6.1 JPEG 2000 Development Process263

5.6.2 Overview of Still-Image Coding Standards267

MPEG-4 VTC267

JPEG267

PNG268

5.6.3 Significant Features of JPEG 2000268

Region of Interest(ROI)Coding268

Scalability268

Error Resilience269

IPRs269

5.6.4 Architecture of JPEG 2000269

5.6.5 JPEG 2000 Bit Stream275

5.6.6 Compression Efficiency Comparisons277

Error Resilience281

5.7 MPEG-7 Standardization Process of Multimedia Content Description282

5.7.1 Objective of the MPEG-7 Standard282

5.7.2 Status of the MPEG-7 Standard285

5.7.3 Major Functionalities in MPEG-7286

MPEG-7 Systems286

MPEG-7 DDL289

MPEG-7 Audio289

MPEG-7 Visual290

MPEG-7 MMDSs297

MPEG-7 Reference Software(XM)299

MPEG-7 Conformance299

5.7.4 Applications Enabled by MPEG-7300

5.8 MPEG-21 Multimedia Framework301

5.8.1 Audiovisual Content Representation Issues303

5.8.2 Description of a Multimedia Framework Architecture304

MPEG-21 Digital Item Declaration304

Content Representation305

Digital Item Identification and Description305

Content Management and Usage305

Intellectual Property Management and Protection305

Terminals and Networks306

Event Reporting306

5.8.3 Requirements for Digital Item Declaration306

5.9 ITU-T Standardization of Audiovisual Communication Systems308

5.9.1 ITU-T Standardization Process308

5.9.2 Audiovisual Systems(H.310,H.320,H.321,H.322,H.323,and H.324)310

H.320 Standard312

Standards for Audiovisual Services Across ATM H.310 and H.321312

Standard H.322——Guaranteed Qos LAN Systems315

ITU-T H.323 Standard317

H.324 Standard319

5.9.3 Video-Coding Standards(H.261,H.263 and H.26L)319

H.261 Standard319

H.263 Standard323

H.263+(H.263 Version 2)Standard327

H.263++ Standard Development332

H.26L Standard333

5.9.4 ITU-T Speech-Coding Standards336

Bit Rate338

Delay338

Complexity339

Quality339

5.9.5 Multimedia Multiplex and Synchronization Standards340

ITU-T Recommendation H.221341

ITU-T Recommendation H.223341

ITU-T Recommendation H.225341

Common Control Protocol H.245343

5.10 IETF and Internet Standards344

5.10.1 IETF Standardization Process344

5.10.2 Internet Network Architecture347

5.10.3 Internet Protocols348

Classical IP Stack350

IP Version 6351

Priority Field352

Folw Label353

IPv6 Addresses353

Hop-by-Hop Options Header355

Fragment Header356

Routing Header356

IPv6 Security357

5.10.4 Real-Time Multimedia Transmission Across the Internet359

Signaling360

Session Control360

Transport361

Network Infrastructure363

Multimedia Data for Network Use364

5.10.5 MPEG-4 Video Transport Across the Internet365

Use of RTP365

System Architecture366

MPEG-4 Server368

MPEG-4 Client369

5.11 Concluding Remarks370

Chapter 6 Multimedia Communications Across Networks373

6.1 Packet Audio/Video in the Network Environment373

6.1.1 Packet Voice374

6.1.2 Integrated Packet Networks377

6.1.3 Packet Video380

6.2 Video Transport Across Generic Networks382

6.2.1 Layered Video Coding386

Layered Compression386

Layered Transmission388

6.2.2 Error-Resilient Video Coding Techniques388

Error-Resilient Encoding390

Decoder Error Concealment392

Error-Resilient Entropy Code393

6.2.3 Scalable Rate Control394

Rate Control Techniques396

Theoretical Foundation of the SRC397

6.2.4 Streaming Video Across the Internet400

Video Compression401

Requirements Imposed by Streaming Applications403

Application Layer Qos Control404

Continuous Media Distribution Services407

Streaming Servers409

Media Synchronization409

Protocols for Streaming Video410

6.3 Multimedia Transport Across ATM Networks411

6.3.1 MUltiplexing in ATM Networks412

6.3.2 Video Delay in ATM Networks413

6.3.3 Errors and Losses in ATM417

6.3.4 MPEG Video Error Concealment420

6.3.5 Loss Concealment420

6.3.6 Video Across WATM Networks421

6.3.7 Heterogeneous Networking422

6.4 Multimedia Across IP Networks424

6.4.1 Video Transmission Across IP Networks424

6.4.2 Traffic Specification for MPEG Video Transmission on the Internet426

6.4.3 Bandwidth Allocation Mechanism427

6.4.4 Fine-Grained Scalable Video Coding for Multimedia Across IP428

6.5 Multimedia Across DSLs432

6.5.1 VoDSL Architecture433

6.5.2 Delivering Voice Services Across DSL438

6.5.3 MUltimedia Across ADSL439

Serial Transmission:TDM439

Parallel Transmission Frequency Division Multiplexing441

6.6 Internet Access Networks441

6.6.1 DSL Networks443

6.6.2 Cable Access Networks445

6.6.3 Fixed Wireless Routed for Internet Access447

6.7 Multimedia Across Wireless449

6.7.1 Wireless Broadband Communication System(WBCS)for Multimedia451

6.7.2 Audiovisual Solutions for Wireless Communications453

6.7.3 Mobile Networks458

Speech Transmission in GSM459

Video Across GSM460

Mobile ATM462

Mobile IP462

Wireless Multimedia Delivery467

SIP in Mobile Environment469

Multicast Routing in Cellular Networks470

Broadband Wireless Mobile471

6.7.4 Broadcasting Networks473

Digital Video Broadcasting(DVB)477

Data Transmission Using MPEG-2 and DVB478

MPEG Program Stream480

MPEG Transport Stream481

Broadband Multimedia Satellite Systems484

Multimedia Home Platform486

Multimedia Car Platform487

6.8 Digital Television Infrastructure for Interactive Multimedia Services488

Interactive Broadcast Data(IDB) Services490

Data Carousel Concept492

6.9 Concluding Remarks493

References497

Index537

About the Authors545