What is the entropy of a source which outputs, every second, one of 5 possible messages, α, β, γ, δ and κ with a probability of pα = 1/2, pβ = 1/4, pγ = 1/8, pδ = 1/16 and pκ = 1/16? Suggest a coding method for this system. What is the source information rate? I get .875

What is the entropy of a source which outputs, every second, one of 5 possible messages, α, β, γ, δ and κ with a probability of pα = 1/2, pβ = 1/4, pγ = 1/8, pδ = 1/16 and pκ = 1/16? Suggest a coding method for this system. What is the source information rate? I get .875

Database System Concepts

7th Edition

ISBN:9780078022159

Author:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Publisher:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Chapter1: Introduction

Section: Chapter Questions

Problem 1PE

See similar textbooks

Related questions

Q: Consider the given table and determine a. The source code using Fano Coding technique. b. Determine…

Q: Construct binary and ternary Huffman codes for a source with probabilities ?? = 0.25,…

Q: 2. How many, among messages of length m, have k or more 1 symbols and why? 3. Consider a message…

A: To do: 2nd and 3rd part of the given question

Q: Question 1: Consider the following discrete-time signal (2, x[n] = 2≤n≤7 otherwise and h[n] = {…

A: As per our guidelines, we are supposed to answer only one question. Kindly repost the remaining…

Q: ollowing table lists the jobs with their time estimators in days the variance * of critical path i-j…

A: Expected time is calculated as E =(t0 + 4(tm) + tp)/6 i-j t0 tm tp E A-B 2 6 16 7 B-C 5 12…

Q: Consider the probability matrix, the source code words and their corresponding probabilities of a…

A: the answer is C a3

Q: Please explain in details the following portion: In summary, we present a more general form of…

A: According to given summary we have to define GHZ states channel and how it explicit constructure of…

Q: binary and ternary Huffman codes for a source with probabilities

A: binary and ternary Huffman codes for a source with probabilities

Q: Write Algorithm to Constructing dead reckoning messages. Dead-Reckoning-Message(s,t,P,Q) in: state…

A: given data: in: state value s; time stamp t; prediction information P; previously sent state Qout:…

Q: Consider a DMS emitting six symbols with probabilities as SS S6 52 0.05 S3 0.08 S4 S1 0.65 0.15 0.04…

A: Note - as according to guidelines we can answer only first question at a time if you want answer of…

Q: Given the following confusion matrix from a binary classifier: True label Positive Negative 0.63…

A: Given a confusion matrix, Y axis is true label and X-axis is Predicted label. Which can be…

Q: lanation is expected with every answer, and may count for half o swer does not have an explanation,…

A: It is defined as a sequential bi-state single-bit memory device named after its inventor by Jack…

Q: The Hi-Fi modem company has designed a new frequency modulation that can transmit 38400 bits/sec.…

Q: aaba What are the lower and higher bounds of the final interval in arithmetic coding? You can…

A: According to the question , we have to explain lower and higher bounds of the final interval in…

Q: A message source emits an alphabet of seven symbols whose probabilities are P(XO) = 1/4, P(X1) 1/8,…

A: Shannon Fano code is a technique for lossless data compression. This is named after Claude Shannon…

Q: For the joint probability given as below, find the noise entropy, draw the channel model, then check…

A: Answer: I have given answer in the handwritten format

Q: Plot the following discrete-time signals over the range -10 sns 10: i. 6[n-31

A: Matlab code: n = (-10:1:10); delta = (n==3); stem (n,delta,'filled');

Q: For the source coding: (a) What is/are the benefit(s) of calculating entropy? (b) What is/are the…

A: Note: As per Q and A guidelines, will be solving only 1st question with a) and b) part.

Q: Maximum entropy of 2n symbols of Information can be occurred when the probabilities of symbols are:

A: Please check the step 2 for solution

Q: Let's let Ig(x) mean the log base 2 of x. We said that the number of checkbits c for d data bits is…

A: For the first few values of c,the number of data bits d = b - c is approximately Ig(d).Since, the…

Q: Get SNR-dependent graphs of BER and interruption probabilities for each state by doing receiver…

A: The Answer for the given question in step-2 in written format.

Q: :the values of A, w, t0 are -2 4 إختر أحد الخيارات .a A=2, w=2, t0=1 .b None of the given options…

A: G2(t)=A G1(t/w-t0) The value of A will be 2 because G2(t) is two time G1(t) as shown in above…

Q: Q1: For the cascaded channels shown: Find P(Z\X) and mutual information between x2 and 22 if p(x2) =…

A: Note: Answering the first question as per the guidelines. Task : Given the channel diagram The…

Q: CD IS A POWER OF 2 OR 3. C, D, are 0001 =1 = 2° OR 1001 = 9 = 3² COM

A: Truth Table A B C D F 0 0 0 0 0 x 1 0 0 0 1 1 2 0 0 1 0 1 3 0 0 1 1 1 4 0 1 0 0 1 5…

Q: Consider two events, a and b, and a set of these binary events is S = {a, b, a, a, b, a, b, b, b, a,…

A: Answer: Binary events S = { a, b,a,a,b,a,b,b,b,a,a,a} If we split at middle then left have 4 a and 2…

Q: Let be the discrete source on the alphabets {I, B, D, R, .} which defines a series of 5 possible…

A: Answer has been explained below:-

Q: Q1:\ For the following system:- Y(k)=ay(k-1) + bu(k) + e(k) Where e is a zero mean white noise and u…

Q: Consider the sliding window algorithm with SWS=RWS =3, (a) Show that if DATA[6] is in the receive…

A: In data communication, the Sliding Window protocol is used to guarantee the trustworthy transfer of…

Q: A band limited white noise has a single sided PSD of 100 over the frequency range of 1 to 26 hz.…

A: Answer: I hove given answer in the handwritten format.

Q: Question: Apply any learning algorithms on Speech Decoder?

Q: Give two discrete time signals x [n] and y [n], x[n] = {8, 8, 8} for n = {0, 1, 2} and y[n] = µ[n] —…

Q: Given a BEC with p = 0.5 and P = 0.8, find the probabilities associated with the l outputs. (I.e.,…

Q: Q1 If the key is 110100001 where, If ki=0, then Si (x)=((1 1 0 | 0 1 1 | 100 ))x+((1 1 1)) and If…

Q: If E is a bit error rate BER, and the probability of a bit being error free is (1-E), then the…

A: The question is to choose the correct option for the given question.

Q: 20-The joint probability of channel is defined as: P(x₁, y₁)= 1, P(x₁, y2) = 0, P(x2, y₁) = 0.5,…

A: To find the marginal entropies, we need to sum the probabilities of each possible value of the…

Q: The closed-loop state-space system [1.6 -0.8 0.0363 Ik+1= 0. 0. Tk 1 Yk = [6.91 16.5 -17.9] ak %3D…

A: I'm providing the answer to the above question. i hope this will help you.

Q: QUESTION 3 (a) Consider the code C={010,101} as the input to an extended binary symmetric channel…

A: Answer: I have given answered in the handwritten format in brief explained.

Q: Consider a telegraph source having two symbols, dot and dash. The dot duration is 0.2 second. The…

Question

100%

What is the entropy of a source which outputs, every second, one of 5 possible messages, α, β, γ, δ and κ with a probability of p_α = 1/2, p_β = 1/4, p_γ = 1/8, p_δ = 1/16 and p_κ = 1/16? Suggest a coding method for this system. What is the source information rate?

I get .875

Expert Solution

This question has been solved!

Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.

This is a popular solution!

SEE SOLUTION Check out a sample Q&A here

Step 1

VIEW

Step 2

VIEW

Step 3

VIEW

Trending now

This is a popular solution!

Step by step

Solved in 3 steps with 2 images

SEE SOLUTION Check out a sample Q&A here

Similar questions

dont answer if you dont know answer only if you are sure 100% dont post copied or existing one
Alice is going to send the following message to Bob. ”Hello! I will be there at 5:37.” (a) Derive the alphabet A of this message. (b) Assign a binary string of length 5 to each symbol in A. (c) Alice is going to do channel encoding by using a binary linear code of length 8 which is defined as follows: C = {c1c2c3c4c5c6c7c8 | c6 = c1 + c3 + c4, c7 = c2 + c3 + c4 + c5, c8 = c1 + c1 + c4 + c5}. Find a generator matrix for C and determine its dimension.
Exercise 5.10 The binary repetition code Rn, of odd length n = 2t + 1, is used to encode messages transmitted through a BSC I' in which each digit has probabilities P and Q (=P) of correct or incorrect transmission, and P > 1/2. Show that in this case the maximum likelihood rule, majority decoding and nearest neighbor decoding all give the same decision rule A.
i need the answer quickly
I am looking for some help to better understanding. I need step by step process. Thanks
J1
Information theory
Q1: Answer two of the following branches a) A DMS has a maximum entropy Hmax(X) = 3.17 bits/symbol. Determine the source entropy if it transmits a message in which the probability of the first symbol S, is 0.5 and all other symbols have the same probability (they are equally likely). b) A DMS delivers the message "SAWSSAN" to a source encoder one symbol every 0.25 μuseces. 1) Calculate the data transmission rate if the message is transmitted from the encoder in binary form using fixed length coding. 2) Calculate the data transmission rate if the message is transmitted from the encoder in binary form using Arithmetic coding method.
LZW coding: we have a word of length 1000, containing these letters with its probabilities: p(a)=0.5, p(b)=0.2, p(c)=0.15, p(d)=0.15 we need 2 bits to represent each letter, so the word requires 2000 bits. using lzw algorithm we decompressed to about 1850 bits, and our compression ratio is 2000/1809 = 1.105 Does this solution seem correct/good?
Referring to (1–6), consider a communication system with the following values for the different probabilities:(a) Find the probabilities P(Y = 0) and P(Y = 1) at the channel output.(b) Find the probability that a 1 was sent given that a 1 was received.(c) What is the probability that a 0 was sent given that a 1 was received?
solve