Syllabus
EE 503: Probability for Electrical and Computer Engineers
Fall 2025 (4 units)
This course focuses on reasoning with probabilistic uncertainty. This involves developing careful skills in logical reasoning and applying those skills to a wide range of problems in probabilistic and statistical inference from signal processing to machine learning. The course depends primarily on lecture material and handouts. Attendance is mandatory. There are weekly exams and no make-ups. Unexcused absences or early departures result in an automatic exam score of zero.
Lecture: Tuesday, Thursday (section: 30774), 12:00 – 13:50
Discussion: Friday (section: 31113), 11:00 – 15:50
Enrollment is in-person ONLY. Attendance is mandatory to all lectures. Taping or recording lectures or discussions is strictly forbidden without the instructor’s explicit written permission.
Course materials
Probability and Random Processes for Electrical and Computer Engineers, Gubner, J.A., Cambridge University Press, 2006.
Probability, Statistics, and Random Processes for Electrical Engineering, Leon-Garcia, A., Pearson, 2008.
Computer Age Statistical Inference: Algorithms, Evidence, and Data Science, Efron, B., and Hastie, T., Cambridge University Press, 2016.
NOTE: Texts are secondary to in-class lecture material and homework sets.
“No AI” policy
The use of AI tools is strictly prohibited and considered a serious violation of academic integrity. This includes all artificial intelligence technologies, including but not limited to large language models, text generators, and AI-assisted writing software, for any aspect of coursework—be it research, outlining, drafting, editing, or proofreading. Any suspected use of AI will be thoroughly investigated. Violations may result in severe consequences, including course failure and referral to the Office of Student Judicial Affairs and Community Standards for further disciplinary action.
Course Outline
| Week | Topics |
|---|---|
| Week 1 26 Aug |
Logic and sets. Proof technique. Sigma-algebras. Probability axioms. |
| Week 2 02 Sep |
Uncountability. Borel sigma-algebra. Independence. Total probability. |
| Week 3 09 Sep |
Combinatorics. Limits of sequences and sets. Borel-Cantelli Lemma. |
| Week 4 16 Sep |
Discrete probability. Poisson Law. Approximations. |
| Week 5 23 Sep |
Random variables. Continuous densities. Bayes conjugate inference. |
| Week 6 30 Sep |
Expectations and higher moments of random variables. |
| Week 7 07 Oct |
Covariance. Correlation. Uncertainty principles. |
| 09 Oct | No class: Fall Recess. — Class rescheduled to Oct 7th at 18:00. |
| Week 8 14 Oct |
Stochastic convergence of random sequences. Laws of large numbers. |
| Week 9 21 Oct |
Conditional expectations. S.I.T. technique. Maximum likelihood estimation. |
| Week 10 28 Oct |
Transformed densities. Monte Carlo. Entropy and information. Mixtures. |
| Week 11 04 Nov |
Central limit theorem. Confidence intervals. Numeric approximations. |
| Week 12 11 Nov |
Financial engineering: probabilistic highlights. Martingales. Queues. |
| Week 13 18 Nov |
Markov processes and queues. Optimal estimation. Multiple regression. |
| 25 Nov | No class, Thanksgiving Holiday. |
| Week 14 02 Dec |
Markov chains. Bayesian regression. Advanced applications. Review. |
| Monday 16 Dec |
Final Exam, 11:00 - 13:00 |
Grading Procedure
Class grade depends on weekly exams and the final exam. Homework problems are optional. Homework problems from the text do not count. Homework handouts count as extra credit.
Weekly Exams (60%)
60 Points. 13 weekly exams. Closed book. 10 minutes at the start of each Tuesday lecture. No make-up exams. Each weekly exam is worth 6 points. Missed exams earn 0 points. The total weekly exam score sums your 10 best weekly exam scores. Algorithm: label your weekly exam scores from lowest to highest: \(w_1 \le \cdots \le w_{13}\). Then \(W = w_{4} + \cdots + w_{13}\) is your total weekly-exam score. Class attendance is mandatory. Unexcused absences get an automatic exam score of zero for that week’s exam grade.
Final Exam (40%)
40 Points. Cumulative. The final exam is closed book with no note sheets. You are expected to bring a non-graphing scientific calculator.
Homework
Textbook problems are checked but not graded. Handout problems are graded but count only as extra points. They count at most as 10 points if all homework sets turned in and accurately worked. Your grade remains as is if only some homework turned in. How much homework affects which cases is at the discretion of the instructor. You may discuss homework problems with classmates but each student must submit their own original work. Turning in identical homework sets counts as cheating. Cheating warrants an F in the course.
Course Grade
A if 90.00 - 100 points,
B if 80.00 - 89.99 points,
C if 70.00 - 79.99 points,
D if 60.00 - 69.99 points,
F if 0 - 59.99 points.
(“+” and “–” at ≈ 1.5% of grade boundary).
Cheating
Cheating is not tolerated on homework or exams. Penalty ranges from F on exam to F in course to recommended expulsion.