A memoryless source has the alphabet A = {-5, -3, -1,0, 1, 3, 5). with corresponding probabilities (0.05,0.1, 0.1,0.15, 0.05, 0.25, 0.3). 1. Find the entropy of the source. 2. Assuming that the source is quantized according to the quantization rule (9(-5)3Dq(-3)%3D -4 q(-1) = q(0) = q(1) =0 9(3) = q(5) = 4 find the entropy of the quantized source.

A memoryless source has the alphabet A = {-5, -3, -1,0, 1, 3, 5). with corresponding probabilities (0.05,0.1, 0.1,0.15, 0.05, 0.25, 0.3). 1. Find the entropy of the source. 2. Assuming that the source is quantized according to the quantization rule (9(-5)3Dq(-3)%3D -4 q(-1) = q(0) = q(1) =0 9(3) = q(5) = 4 find the entropy of the quantized source.

Database System Concepts

7th Edition

ISBN:9780078022159

Author:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Publisher:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Chapter1: Introduction

Section: Chapter Questions

Problem 1PE

See similar textbooks

Similar questions

Find an nfa with four states for L={an :n≥1}∪{bm ak :m≥0, k≥0}
7. Consider the following NFA (M): 0,1 0,1 start 1 0, : 97 Scanned by CamScanner d. Complete the following epsilon closure Table state Epsilon Closure q1 E((ql})= q2 E({q2})= q3 E({q3})= 94 E({q4})=
The Potential difference Vpo resulting from the work required to move a 10 nc charge from the origin to point P). 1, 0) against the static field E =5a, (V/m) is: Select one: O a. 5 V O b.-5 nj O C. None of these O d.-5 V
The following is an illustration of the one-step transition probabilities for a renewal Markov chain with no recurrence.
20-The joint probability of channel is defined as: P(x₁, y₁) = 1, P(x₁, y2) = 0, P(x2, ₁) = 0.5, P(x2, y2) = 0.5, P(x3, y₁) = 0.3, P(x3, y2) = 0.7. Find: Marginal entropies. Joint entropy 2- 3- 4- Conditional entropies. d- The mutual information between x₁ The trans information. Draw the channel model. e- f- and Y2.
3. Give an example of a random variable X that takes on values from the set of all binary strings of length 4 where the min-entropy of X and the entropy of X are very different. Explain what is causing this phenomenon.
Compute the optimum threshold value k* for the given normalized histogram below using Otsu method. Note that image has four intensity levels only (i=0,1,2,3). Also, find the separability measure ƞ(k*).
2- Discuss the differ between Maximum Entropy of binary source and other Entropy of sources
Simplify the following using K-Map and compare it to Boolean simplification. SHOW ALL PERTINENT SOLUTIONS AND PUT YOUR ANSWER INSIDE A BOX. 5. F(A, B,C, D, E) = E(0,2, 3,4,5,6, 7, 11, 15, 16, 18, 19, 23, 27,31) %3D 6. F = ABCE + ĀBCD + BDE + BCD+ CDĒ + BDE
Quick Question for this problem
4. Given a random variable w with den sity F(w) and a random variable p as the umiform im the interval (-71, +71) where wlP (two w and p are independent) R.V.S Suppose the stochastic process, xt) =a Cos (wt+P). meam a) show that xlt) is wss with zero and auto correlation equal R(E) = E (Coswr) j(wt+P) b) show that zt)=aé is also a Wss.
The probability of event A occurring is 10/10. The probability of event B occurring is 0/10. What is the entropy of this system?