Synopsis on Audio watermarking

PARMINDER SINGH MTECH CSE Roll no. 96266581736 Contact no. 9464040069

Bhai Maha Singh college of Engg., Sri Muktsar Sahib

Audio watermarking
The growth of high speed computer networks and that of Internet, in particular, has explored means of new business, scientific, entertainment, and social opportunities. Ironically, the cause for the growth is also of the apprehension - use of digital formatted data. Digital media offer several distinct advantages over analog media, such as high quality, easy editing, high fidelity copying. The ease by which digital information can be duplicated and distributed has led to the need for effective copyright protection tools. Various software products have been recently introduced in attempt to address these growing concerns. It is done by hiding data (information) within digital audio, images and video files. One way of such data hiding is digital signature, copyright label or digital watermark that completely characterizes the person who applies it and, therefore, marks it as being his intellectual property. Digital Watermarking is the process that embeds data called a watermark into a multimedia object such that watermark can be detected or extracted later to make an assertion about the object. Watermarking is either blind or non blind for audio files. The classification of ways of hiding the information is shown in fig.1. Digital Watermarking is the process that embeds data called a watermark, tag or label into multimedia object such that watermark can be detected or extracted later to make an assertion about the object. The object may be an image or audio or video. It may also be text only. General Framework for Watermarking: Watermarking is the process that embeds data called a watermark or digital signature or tag or label into a multimedia object such that watermark can be detected or extracted later to make an assertion about the object. The object may be an image or audio or video. A simple example of a digital watermark would be a visible seal placed over an image to identify the copyright. However the watermark might contain additional information including the identity of the purchaser of a particular copy of the material.

Fig.1: Information hiding techniques In general, any watermarking scheme (algorithm) consists of three parts.

The watermark. The encoder (insertion algorithm). The decoder and comparator (verification or extraction or detection algorithm).

Each owner has a unique watermark or an owner can also put different watermarks in different objects. The marking algorithm incorporates the watermark into the object. The verification algorithm authenticates the object determining both the owner and the integrity of the object. Types of digital watermarking: Digital watermarking can be classified according to its working domain (spatial or frequency), type of document (text, image, audio or video), 3

human perception (invisible or visible) and application (source or destination based). Detailed classification is shown in fig.2.

Fig.2: Classification of digital watermarking Audio watermarking: Our interest is with the audio watermarking. It is of two types i.e. blind and non blind audio watermarking. If the detection of the digital watermark can be done without the original data, such techniques are called blind. Here, the source document is scanned and the watermark information is extracted. On the other hand, non blind techniques use the original source to extract the watermark by simple comparison and correlation procedures. However, it turns out that blind techniques are more insecure than non blind methods.

Literature Review
Sang-Kwang Lee and Yo-Sung Ho [2000]: [1] proposed a digital audio watermarking technique in the cepstrum domain. They inserted a digital watermark into the cepstral components of the audio signal using a technique analogous to spread spectrum communications, hiding a narrow hand signal in a wideband channel. In this method, pseudo-random sequences are used to watermark the audio signal. Paraskevi Bassia, Ioannis Pitas and Nikos Nikolaidis [2001]: [2] presented the watermarking method that does not require the use of the original signal for watermark detection. The watermark signal is generated using a key, i.e., a single number known only to the copyright owner. Jana Dittmann and Martin Steinebach [2001]: [3] proposed to extract the audio and video content, called feature, and embed the content features with a robust watermarking scheme into the audio and video data. These features of audio and video data have to be identified. Watermarking payload and feature data requirements have to be compared. Nedeljko, Anja Keskinarkaus and Tapio Seppanen [2001]: [4] presents a novel algorithm for embedding a spread spectrum based watermark into uncompressed, raw audio sequences. The scheme takes advantage of temporal masking phenomenon in HAS in order to embed watermark data below the masking threshold of audio signal. The detection of the watermark is done by blind detection, without using the original audio. Darko Kirovski and Henrique S. Malvar [2003]: [5] presented several novel mechanisms for effective encoding and detection of direct-sequence spread-spectrum watermarks in audio signals. The developed techniques aim at improving detection convergence and robustness, improving watermark imperceptiveness, preventing de-synchronization attacks, alleviating estimation/removal attacks and finally establishing covert communication over a public audio channel.

Nedeljko Cvejic and Tapio Seppanen [2003]: [6] presented a novel robust audio watermarking method in wavelet domain. Embedding of watermarks is performed in a perceptually significant set of sub-bands of the host audio. In order to enhance security, watermark is embedded in a randomly selected sub-band of the host audio according to a secret key. Watermark embedding to a mapped sub-band is done in a predefined time period, similarly to frequency hopping approach in digital communications. Shahrzad Esmaili, Sridhar Krishnan and Kaamran Raahemifar [2003]: [7] presents a novel audio watermarking scheme based on spread spectrum techniques that embeds a digital watermark within an audio signal using the instantaneous mean frequency ( IMF ) of the signal. In addition, this technique uses the short-time Fourier transform of the original audio signal to estimate a weighted IMF of the signal. Based on the masking properties of the psychoacoustic model, they derived the required sound pressure level of the watermark. Wen-Chih WU, Oscal T.-C. Chen [2004]: [8] used two considerations to adjust the appropriate decay rates of each audio signal segment. One is the characteristic of audio signals after watermarking and the other being the accurate watermarks that are decoded and recovered after MP3 attacks on the watermarked audio signals. Wang Rang-Ding, Xu Da-Wen and Li Qian [2005]: [9] presents an audio watermarking scheme based on wavelet packet and psychoacoustic model. Wavelet packet is a very good tool to analysis the audio signal which is non-stationary. The algorithm has better imperceptibility by using masking effect in human auditory system. The masking threshold is computed in wavelet domain. Thus the computational complexity is reduced greatly, because it doesnt like MPEG algorithm which should perform FFT. Sonia Djaziri Larbi and Mriem Jadane-Sadane [2005]: [10] viewed watermarking as a preprocessing step for further audio processing systems. The watermark signal conveys no information, rather it is used to modify the statistical characteristics of an audio signal,

in particular that its non stationary. The embedded watermark is then added in order to stationnarize the host signal. Zhi Li, Qibin Sun and Yong Lian [2005]: [11] presented a scalable (i.e. lossy-to-lossless) watermark scheme based on a recently standardized scalable audio coder. The proposed framework enables the recovery of the original lossless audio after watermark embedding, and in the meanwhile, is able to make the watermark adaptive such that the watermark distortion to the lossy host audio is minimized. An encryption mechanism is further employed for restricting unauthorized access to lossless audio and watermark removal. Zhang Li, Chen Li-min and Qian Gong-bin [2006]: [12] proposed a self-synchronization blind audio watermarking based on wavelet transform. A way to estimate attacking parameters of watermarked audio may encounter is proposed by using statistics of original audio and these statistics characteristics can be used as private key for watermark detector. So the watermark detection scheme can make the re-synchronization between the watermark embedding and the detection process without any additional synchronization code to cause additional noise. Zhi Li, Qibin Sun and Yong Lian [2006]: [13] presents a scalable approach to lossless watermarking for audio signals. The proposed watermarking framework is built on a recently standardized two-layer scalable audio coder advanced audio zip. By embedding watermarks in both the core layer and enhancement layer bit streams in a special way, the watermark distortion in either layer is compensated by the watermark in the opposite layer. Wei Li, Xiangyang Xue, and Peizhong Lu [2006]: [14] proposed a novel contentdependent localized robust audio watermarking scheme. The basic idea is to first select steady high-energy local regions that represent music edges like note attacks, transitions or drum sounds by using different methods, then embed the watermark in these regions. Such regions are of great importance to the understanding of music and will not be changed much for maintaining high auditory quality. 7

Ji-Xin Liu and Zhe-Ming Lu [2006]: [15] proposed a novel robust audio watermarking algorithm. It takes full advantage of the multi-resolution and the energy compression properties of the Discrete Wavelet Transform (DWT) and Discrete Cosine Transform (DCT) respectively, and embeds a pseudorandom permuted binary image in the original audio signal by Vector Quantization (VQ). The original audio is first transformed using the properly selected wavelet bases into the DWT domain, then the approximate coefficients are segmented into frames and transformed to the DCT domain and for each frame, several middle-frequency DCT coefficients are composed as a vector to be substituted. Xiangyang Wang, Wei Qi, and Panpan Niu [2007]: [16] proposed a new adaptive blind digital audio watermarking algorithm on the basis of support vector regression (SVR). This algorithm embeds the template information and watermark signal into the original audio by adaptive quantization according to the local audio correlation and human auditory masking. Shijun Xiang and Jiwu Huang [2007]: [17] presented a multi bit robust audio watermarking by using the insensitivity of the audio histogram shape and the modified mean to TSM and cropping operations which solves the problem of the robustness of audio watermarking area against de-synchronization attacks, such as TSM (Time-Scale Modification) and random cropping operations. B. Charmchamras, S. Kaengin, S. Airphaiboon and M. Sangworasil [2007]: [18] presented the technology of embedding image data into the audio signal and additive audio watermarking algorithm based on SNR to determine a scaling parameter. The audio is based on DWT. The intensity of embedded watermarks on the original audio signal is modified by adaptively modulation of the scaling parameter. Lin Kezheng, Fan Bo and Yang Wei [2008]: [19] proposed a robust audio watermarking scheme with self-synchronization which is based on discrete wavelet transforming stable 8

feature, in order to improve the watermark invisibility and robustness simultaneously. When audio is under attacks, the absolute average value of low frequency sub-bands of discrete wavelet is a steady feature. Thus taking this absolute average value as flags of watermark boundary and domain of embedding watermark is effective and practical. Wang Rang-ding and Xiong Yi-qun [2008]: [20] proposed an audio aggregate watermark algorithm based on Cloud model. It is a breakthrough from the traditional watermarking which only works to a single audio, implement copyright protection for an audio aggregation. In this paper, all the audio works in the audio aggregation are performed wavelet transform respectively to get wavelet coefficients, the combination of a part of these coefficients are mapped into a considerable number of Cloud drops, these Cloud drops are served as Zero-watermark. Vivekananda Bhat K, Indranil Sengupta, and Abhijit Das [2008]: [21] proposed a novel audio watermarking algorithm for audio copyright protection. The method is based on cepstrum domain transform. This algorithm embeds the watermark data into original audio signal using mean quantization of cepstrum coefficients. Sun Shui-fa, Jiang Ming, Liu Xin-qiong, Wan Jun-li and Zheng Sheng [2008]: [22] proposed a blind audio watermarking algorithm in the time domain. The audio signal is divided into frames and the watermark is inserted on a frame by frame basis. The proposed algorithm detects the watermark using a signal processor based on the stochastic resonance mechanism. The watermark detection does not need the original audio. Shoujie You, Sen Bai and Weiwei Cao [2008]: [23] presented a novel audio watermarking algorithm based on the audio amplitude inversion. The host audio is divided into several frames, then inversed the audio amplitude to embed watermark. They extracted the watermark by judging the polarity of the similarity, and the resynchronization was designed to increase the correct rate.

Bingwei Chen, Jiying Zhao and Dali Wang [2008]: [24] proposes a novel adaptive watermarking algorithm for MP3 compressed audio signals, based on human auditory system. In the proposed algorithm, watermark is embedded adaptively and transparently after Modified Discrete Cosine Transformation (MDCT) and before quantization. Gaussian distribution statistic analysis is introduced to make this watermarking algorithm adaptive.
Sr.N o. Author Name Xiangyang Wang, Wei Qi, and Panpan Niu Paper Title Terms Learnt Human auditory system (HAS) Effect of amplitude of the echo msignals Evaluation of watermarkin g methods Watermarkin g in the Time Domain selfsynchronizati on blind audio watermarkin g Watermarkin g on both audio and video data parallely m-Sequences Date and Year of Publication

A New Adaptive Digital Audio Watermarking Based on Support Vector Regression

An Analysis-bySynthesis Echo Watermarking Method Performance Evaluation of Digital Audio Watermarking Algorithms Robust Audio Watermarking in the Time Domain Selfsynchronization Adaptive Blind Audio Watermarking Joint Watermarking Of Audio-Visual data Audio Watermarking Using m-Sequences and Temporal Masking

November, 2007

Wen-Chih Wu and Oscal T.C. Chen

J. D. Gordy and L. T. Bruton Paraskevi Bassia, Ioannis Pitas and Nikos Nikolaidis Zhang Li, Chen Limin and Qian Gong-bin

2004 IEEE International Conference on Multimedia and Expo (ICME) August, 2000

June, 2001

2006

Jana Dittmann and Martin Steinebach Nedeljko Cvejic, Anja Keskinarkaus and Tapio Seppanen

2001

21-24 October 2001

10

Wang Rang-ding and Xiong Yi-qun

An Audio Aggregate Watermark Based on Cloud Model

Cloud Model

2008

Problem Formulation
MP3 has been generating a significant popularity for distributing digital audio signals over the Internet. However; copyright issue has been raised because of illegal copy and redistribution. Digital watermarking is a technology that allows users to embed watermark into digital contents to identify the copyright holder, to prevent illegal copy and to verify modification to the original content. Bingwei Chen, Jiying Zhaoand and Dali Wang [2008] proposed a novel adaptive watermarking algorithm for MP3 compressed audio signals, based on human auditory system. In the proposed algorithm, watermark is embedded adaptively and transparently after Discrete Cosine Transformation (DCT) and before quantization. They tested the adaptive watermarking algorithm on various types of audio signals. The experimental results show that the new algorithm can survive most common signal manipulation including MP3 compression but from their conclusion it is clear that the results are preliminary and can be improved tremendously. Thus I proposed a new scheme which uses random carrier instead of fixed or low frequency carriers to embed the watermark into the audio bit stream.

11

RESEARCH OBJECTIVES
Develop an algorithm to produce the watermarked audio that is having high value of peak signal to noise ratio (PSNR), high signal noise ratio (SNR) and less bit error rate (BER). To make an algorithm robust enough that it can withstand different transmission parameters e.g. MP3 compression and low pass filtering. The watermarked audio produced by this algorithm must not be fragile enough, so that it cannot be easily decoded or extracted from the audio file. The algorithm implemented using MATLAB

12

Methodology
The watermarking method I am performing is shown in fig.3. The audio file is portioned into frames which are 90 milliseconds in duration. This frame size is chosen so that the embedded watermark does not introduce any audible distortion into the file. With a 90 ms frame size, our bit rate for watermarked data is equal to 1 / 0.09 = 11.1 bits per second. Then discrete cosine transform (DCT) will be performed. After DCT random carrier is chosen so that it will be difficult to detect the watermark. Finally the watermark is embedded in the wav file with random carrier.

13

Fig.3: Watermarking flow diagram

The algorithm can be evaluated using three basic criterias i.e. Peak signal to noise ratio (PSNR), Signal to noise ratio (SNR) and Bit error rate (BER) as follows:

Where MSE stands for mean square error and can be shown as

14

x(n)= Host signal of length N samples N is divided into B blocks of M samples. x is the watermark signal. w(n) is the watermarked signal w is the recovered watermarked signal.

Facilities required for proposed work

Software & Hardware Requirement Software Requirements:

15

Operating System Win Front End

Windows XP or Vista to be installed on the machine. C#

Hardware Requirements:
Processor RAM Hard Disk Drives Pentium-IV or higher 512 MB RAM or higher 40 GB or higher DVD writer and USB

References
[1] Nedeljko, Anja Keskinarkaus and Tapio Seppanen, Audio Watermarking using msequence and temporal masking, 2001 IEEE workshop on applications on signal processing to audio and acoustics.

16

[2] Sun Shui-fa, Jiang Ming, Liu Xin-qiong, Wan Jun-li and Zheng Sheng, A Blind Audio Watermarking Based on Stochastic Resonance Signal Processor, ICSP2008 Proceedings. [3] Shijun Xiang and Jiwu Huang, Histogram-Based Audio Watermarking Against Time-Scale Modification and Cropping Attacks, IEEE Transactions on multimedia, vol. 9, no. 7, november 2007. [4] Jana Dittmann and Martin Steinebach, Joint Watermarking Of Audio-Visual Data, pp 601, 2001 IEEE. [5] Xiangyang Wang, Wei Qi, and Panpan Niu, A New Adaptive Digital Audio Watermarking Based on Support Vector Regression, IEEE Transactions on audio, speech, and language processing, vol. 15, no. 8, november 2007 [6] Nedeljko Cvejic and Tapio Seppanen, Robust Audio Watermarking in Wavelet Domain Using Frequency Hopping and Patchwork Method, Proceedings of the 3rd International Symposium on Image and Signdl Processing and Analysis (2003). [7] Vivekananda Bhat K, Indranil Sengupta and Abhijit Das, Audio Watermarking Based on Mean Quantization in Cepstrum Domain, ADCOM 2008. [8] Sonia Djaziri Larbi and Mriem Jadane-Sadane, Audio Watermarking: A Way to Stationnarize Audio Signals, IEEE Transactions on signal processing, vol. 53, no. 2, february 2005. [9] Wen-Chih Wu.Oscal T.-C. Chen, An Analysis-by-Synthesis Echo Watermarking Method, 2004 IEEE International Conference on Multimedia and Expo (ICME).

17

[10] Shoujie You, Sen Bai and Weiwei Cao, A Robust Audio Watermarking Algorithm Against DA/AD Conversions and De-synchronization Attacks, Proceedings of the 7th World Congress on Intelligent Control and Automation, 2008, Chongqing, China [11] Shahrzad Esmaili, Sridhar Krishnan and Kaamran Raahemifar, A Novel Spread Spectrum Audio Watermarking Scheme Based On Time-Frequency Characteristics, CCECE 2003 - CCGEI 2003, Montreal, May/mai 2003. [12] B. Charmchamras, S. Kaengin, S. Airphaiboon and M. Sangworasil, Audio Watermarking Technique using Binary Image in Wavelet Domain, ICICS 2007. [13] Zhi Li, Qibin Sun and Yong Lian, Design and Analysis of a Scalable Watermarking Scheme for the Scalable Audio Coder, IEEE Transactions on signal processing, vol. 54, no. 8, august 2006. [14] Wang Rang-Ding Xu Da-Wen Li Qian, Audio Watermarking Algorithm Based on Wavelet Packet and Psychoacoustic Model, Proceedings of the Sixth International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT05). [15] Paraskevi Bassia, Ioannis Pitas and Nikos Nikolaidis, Robust Audio Watermarking in the Time Domain, IEEE Transactions on multimedia, vol. 3, no. 2, june 2001. [16] Wei Li, Xiangyang Xue, and Peizhong Lu, Localized Audio Watermarking Technique Robust Against Time-Scale Modification, IEEE Transactions on multimedia, vol. 8, no. 1, February 2006. [17] Ji-Xin Liu and Zhe-Ming Lu, DWT and DCT Combined Robust Watermarking Algorithm Based on Vector Quantization with Labeled Codewords, 2006, IEEE.

18

[18] Wang Rang-ding and Xiong Yi-qun, An Audio Aggregate Watermark Based on Cloud Model, ICSP2008 Proceedings. [19] Lin Kezheng, Fan Bo and Yang Wei, Robust Audio Watermarking Scheme Based on Wavelet Transforming Stable Feature, 2008 International Conference on Computational Intelligence and Security. [20] Zhang Li, Chen Li-min and Qian Gong-bin, Self-synchronization Adaptive Blind Audio Watermarking, pp 381, 2006 IEEE. [21] Zhi Li, Qibin Sun and Yong Lian, an adaptive scalable watermark scheme for highquality audio archiving and streaming applications, 2005, IEEE. [22] Sang-Kwang Lee and Yo-Sung Ho, Digital Audio Watermarking In The Cepstrum Domain, IEEE Transactions on Consumer Electronics, Vol. 46, No. 3, AUGUST 2000. [23] Darko Kirovski and Henrique S. Malvar, Spread-Spectrum Watermarking of Audio Signals, IEEE Transactions on signal processing, vol. 51, no. 4, april 2003. [24] Bingwei Chen, Jiying Zhao and Dali Wang, An Adaptive Watermarking Algorithm for MP3 Compressed Audio Signals, I2MTC 2008 - IEEE International Instrumentation and Measurement Technology Conference Victoria, Vancouver Island, British Columbia, Canada, 2008.

19