[Solved] Assignment 2: CS 215

Questions:1. Given random variables X and Y having probability density functions fX(x) and fY (y) respectively andjoint probability density function fXY (x, y), derive an expression for the probability density function of therandom variable Z = XY (i.e. the product of X and Y ) in terms of fX(x), fY (y) and fXY (x, y). Also derivean expression for P(X ≤ Y ). Refine the expressions if X and Y are independent. [5+5=10 points]2. Let X1, X2, …, Xn be n > 0 independent identically distributed random variables with cdf FX(x) andpdf fX(x) = F0(X)(x). Derive an expression for the cdf and pdf of Y1 = max(X1, X2, …, Xn) and Y2 =min(X1, X2, …, Xn) in terms of FX(x). [10 points]3. Consider a sequence of Bernoulli trials with success parameter p ∈ (0, 1) where you bet a certain amount.If a trial results in success, you gain that amount, else you pay the same amount. Now consider a strategywhere you bet amount x in the first trial. If the trial is a failure, you bet double the amount in the nexttrial, and stop as soon as a trial is a success. Compute the total amount you will win if n trials are played(i.e. you won on the nth trial). [10 points]4. Prove that any two independent random variables are uncorrelated (i.e., their covariance is zero). Constructa counter-example to show that the converse is not always true. [2 + 5 = 7 points]5. Given a random variable X whose values lie in the interval [a, b] where a < b, prove that Var(X) ≤(b − a)24.[8 points]16. A function g(x) of variable x is said to be convex if it always lies lies above its tangent. In other words ifthe line l(x) = a + bx is a tangent at x, then g(x) ≥ a + bx. For example, g(x) = x2is a convex function.Prove that g(E(X)) ≥ E(g(X)). [10 points]7. (a) Read in the image parrots.png from the homework folder using the MATLAB function imread and castit as a double array. Consider random variables X1, X2 where X1 is a random variable that denotes thepixel intensities from the image and X2 denotes the intensities of a neighbor of each pixel located z pixelsaway. For the case z = 1, your task is to write MATLAB code to compute (1) the correlation coefficient,(2) a measure of dependence called quadratic mutual information (QMI) defined as Px1Px2(pX1X2(x1, x2)−pX1(x1)pX2(x2))2, and (3) another measure of independence defined as Px1Px2|pX1X2(x1, x2)−pX1(x1)pX2(x2)|.Here pX1X2(x1, x2) represents the normalized joint histogram (i.e., joint pmf) of X1 and X2 (‘normalized’means that the entries sum up to one). For X2, ignore the first z columns of the image. For X1, ignorethe last z columns of the image. For computing the joint histogram, use a bin-width of 10 in both X1 andX2. For computing the marginal histogram, you need to integrate the joint histogram along one of the twodirections respectively. You should write your own joint histogram routine in MATLAB – do not use anyinbuilt functions for it.(b) Compute only the correlation coefficient for different values of z ranging from 0to100. Plot a graph ofthe correlation coefficient versus z. Comment on the graph.Your report should include a table containing all the three values for each case. Comment on the differencesin the values for the original and scrambled image in your report. What is the minimum and maximumvalue that measure (3) can ever acquire? Explain in your report. [15 points]