linear optimization Assume that f : D → R is twice continuously differentiable for all x...
A function f : Rn λε [0,1] R is strictly convex if for all x, y є Rn and all fax + (1-λ)y) < λ/(x) + (1-1)f(y) A symmetric matrix P-AT +A is called positive-definite if all its eigenvalues are positive. Show that a quadratic function f(x) -xPx is a convex function if and only P is positive-definite.
A function f : Rn λε [0,1] R is strictly convex if for all x, y є Rn and all fax +...
Assume f : R" → R is twice continuously differentiable. Prove that the following are equivalent: (a) f(ex + (1-8)ì) < ef(x) + (1-8)/(x) for all x, x E Rn and 0 < θ < 1 (b) f(x)+ /f(x) . (x-x) -f(r) for all x,x E R" (c) f(x) > 0 for all x E R" Hint: Look at : RRdefine by gt) f(x + ty) where x, y E R. First show g is convex (as a function of...
Convex Optimization
Let f: R R be a differentiable function on R. Show that f is convex iff f' is nondecreasing (i.e. x y f'(x) <f'(y)).
Let a continuously differentiable function f: Rn → R and a point x E Rn be given. For d E Rn we define Prove the following statements: (i) If f is convex and gd has a local minimum at t-0 for every d E R", then x is a minimiser of f. (ii) In general, the statement in (i) does not hold without assuming f to be convex. Hint: For) consider the function f: R2-»R given by
Let a continuously...
Exercise 5.2. This problem concerns the formulation of a model-based method for min imizing a twice-continuously differentiable function f : Rn R. Let B be a symmetric positive-definite matrix. At a point xk, consider the quadratic model (a) Write the quadratic model in terms of the variables p -x - k and find pk such that PERn (b) Show that the vector pk of part (a) is a descent direction for f at xk (c) Show that if B is...
Let U be an open subset of R. Let f: U C Rn → Rm. (a) Prove that f is continuously differentiable if and only if for each a є U, for each E > 0, there exists δ > 0 such that for each x E U, if IIx-all < δ, then llDf(x)-Df(a) ll < ε. (b) Let m n. Prove that if f is continuously differentiable, a E U, and Df (a) is invertible, then there exists δ...
1 Let f: R R be a continuously differentiable map satisfying ilf(x)-FG) ll 리1x-vil, f Rn. Then fis onto 2. f(RT) is a closed subset of R'" 3, f(R") is an open subset of RT 4. f(0)0 or all x, y E 5) S= (xe(-1,4] Sin(x) > 0). Let of the following is true? I. inf (S).< 0 2. sup (S) does not exist Which . sup (S) π ,' inf (S) = π/2
1 Let f: R R be...
2.1 Compute the gradient V f(x) and Hessian V2 f (x) of the Rosenbrock function f(x) 100(x2-x?)2 +(1-x1)2. (2.22) CHAPTER 2. FUNDAMENTALS OF UNCONSTRAINED OPTIMIZATION 28 (1, 1) matrix at that point is positive definite. Show that x* is the only local minimizer of this function, and that the Hessian
Monotone mappings. A function u : Rn Rn is called monotone if for all x, y є dom v, Note that monotone' as defined here is not the same as the definition given in 83.6.1. Both definitions are widely used.) Suppose f R"- R is a differentiable convex function. Show that its gradient ▽f is monotone. Is the converse true. i.e., 1s every monotone mapping the gradient of a convex function?
Monotone mappings. A function u : Rn Rn is...
(2) Let f : Rn → R be a C2 function. Suppose a sequence (zk) converges to x*, where the Hessian Hf(z.) is positive definite. Let ▽ := ▽f(xk)メ0, Hfk := H f(zk), dkー-Bİigfe, and :=-[Hfel-ı▽fk for each k, where each matrix Bk is ll(Be-Hfe)del = 0 if and only if ei adtive lim lidt dall =0. (11 points)
(2) Let f : Rn → R be a C2 function. Suppose a sequence (zk) converges to x*, where the Hessian...