Program Overview

Electrical Engineering Program at Indian Institute of Technology Bombay

The Indian Institute of Technology Bombay (IITB) offers a comprehensive Electrical Engineering program. Established in 1957, the department of Electrical Engineering has been one of the major departments at IITB since its inception.

About the Department

• Head's Message
• Our History
• News
• Events
• Find Us
• Life @ IIT Bombay
• Awards
• FAQs
• Gallery

Academics

• Courses
• PhD
• MTech
• Dual Degree
• BTech
• Faculty Advisors
• Teaching Labs
• Wadhwani Lab
• TI DSP Lab
• ePGD
• Calendar
• Timetable
• Placements
• Co-curricular

Admissions

• PhD
• Postgraduation
• Undergraduation

Research Areas

• Communication and Signal Processing
• Control and Computing
• Power Electronics and Power Systems
• Electronic Systems
• Integrated Circuit and Systems
• Solid State Devices

People

• Faculty
• Post Doc
• Students
• Staff
• Committees

EE 763 - Science of Information Statistics and Learning

Course Description

Information Theory basics:

• Bayes' theorem
• Random Variables
• Independence and Conditioning
• Shannon entropy
• Relative Entropy
• Mutual Information
• Markov chains
• Sanov's theorem

Statistics:

• Linear regression
• statistical model
• Exponential families
• sampling
• Monte Carlo
• inference
• Maximum Likelihood Estimation
• Maximum a posteriori
• Bayesian Inference

Inference:

• MaxENT algorithm
• the relation between Bayesian and MaxENT methods
• Statistical Mechanics
• Ising models
• graphical models
• Hammersley-Clifford theorem
• EM algorithm
• belief propagation

Learning:

• Introduction to neural networks
• the single neuron as a classifier
• the capacity of a single neuron
• learning as inference
• Hopfield networks
• Boltzmann machines
• Supervised learning in multilayered networks
• Gaussian processes
• Deconvolution

Application to Chemical Reaction Networks:

• Introduction to chemical reaction networks
• Mass-action kinetics
• Chemical Master Equation
• Birch's theorem
• Connection to exponential families
• the MLE algorithm using reaction networks
• current topics in molecular intelligence

Course Details

• Latest Semester: Spring
• Programs: PG
• Latest Instructor: Manoj Gopalkrishnan
• Substitutions: Not Applicable