A certain communication system is composed of 16 different symbols or messages. The probability of each messages are as follows:   M1– 1/128     M2– 5/128     M3– 7/128      M4- 8/128   M5- 15/128   M6- 23/128   M7- 11/128    M8- 17/128   M9- 14/128   M10- 2/128   M11- 5/128   M12- 3/128   M13- 5/128   M14- 4/128   M15- 2/128    M16- 6/128   (a) Determine the entropy. (b) For 1,000,000 messages, approximate the total information from message M1?

Introductory Circuit Analysis (13th Edition)
13th Edition
ISBN:9780133923605
Author:Robert L. Boylestad
Publisher:Robert L. Boylestad
Chapter1: Introduction
Section: Chapter Questions
Problem 1P: Visit your local library (at school or home) and describe the extent to which it provides literature...
icon
Related questions
icon
Concept explainers
Question

A certain communication system is composed of 16 different symbols or messages. The probability of each messages are as follows:

 

M1– 1/128     M2– 5/128     M3– 7/128      M4- 8/128

 

M5- 15/128   M6- 23/128   M7- 11/128    M8- 17/128

 

M9- 14/128   M10- 2/128   M11- 5/128   M12- 3/128

 

M13- 5/128   M14- 4/128   M15- 2/128    M16- 6/128

 

(a) Determine the entropy. (b) For 1,000,000 messages, approximate the total information from message M1?

Expert Solution
steps

Step by step

Solved in 3 steps

Blurred answer
Knowledge Booster
Fault analysis
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, electrical-engineering and related others by exploring similar questions and additional content below.
Similar questions
  • SEE MORE QUESTIONS
Recommended textbooks for you
Introductory Circuit Analysis (13th Edition)
Introductory Circuit Analysis (13th Edition)
Electrical Engineering
ISBN:
9780133923605
Author:
Robert L. Boylestad
Publisher:
PEARSON
Delmar's Standard Textbook Of Electricity
Delmar's Standard Textbook Of Electricity
Electrical Engineering
ISBN:
9781337900348
Author:
Stephen L. Herman
Publisher:
Cengage Learning
Programmable Logic Controllers
Programmable Logic Controllers
Electrical Engineering
ISBN:
9780073373843
Author:
Frank D. Petruzella
Publisher:
McGraw-Hill Education
Fundamentals of Electric Circuits
Fundamentals of Electric Circuits
Electrical Engineering
ISBN:
9780078028229
Author:
Charles K Alexander, Matthew Sadiku
Publisher:
McGraw-Hill Education
Electric Circuits. (11th Edition)
Electric Circuits. (11th Edition)
Electrical Engineering
ISBN:
9780134746968
Author:
James W. Nilsson, Susan Riedel
Publisher:
PEARSON
Engineering Electromagnetics
Engineering Electromagnetics
Electrical Engineering
ISBN:
9780078028151
Author:
Hayt, William H. (william Hart), Jr, BUCK, John A.
Publisher:
Mcgraw-hill Education,