Many of the papers and reports since 1992 by Stephen Wright and co-authors are listed here. (Note that the linked versions are often not the final published version.)

Selected Talks

Publication List at AMS Site

Stephen J. Wright

Computer Sciences Department
University of Wisconsin,
1210 West Dayton Street,
Madison, WI 53706

Phone (608) 262-4838
Fax (608) 262-9777



Late versions (not necessarily the final version) of these reports can be downloaded by clicking on the appropriate tag. S. J. Wright, "An interior point algorithm for linearly constrained optimization", SIAM J. Optimization 2 (1992), pp. 450-473. Stephen J. Wright, "Stable parallel algorithms for two-point boundary value problems," SIAM J. Sci. Statist. Comput. 13 (1992), pp. 742-764. Stephen J. Wright, "Interior-point methods for optimal control of discrete-time systems," J. Optim. Theory Appls 77 (1993), pp. 161-187. Stephen J. Wright, "Stable parallel elimination for boundary value ODEs" Numerische Mathematik 67 (1994), pp. 521--536. Stephen J. Wright, "Identifiable surfaces in constrained optimization," SIAM J. Control Optim. 31 (1993), pp. 1063-1079. Stephen J. Wright, "A Collection of problems for which Gaussian elimination with partial pivoting is unstable," SIAM J. Sci. Statist. Comput. 14 (1993), pp. 231-238. Robert M. M. Mattheij and Stephen J. Wright, "Parallel stabilized compactification for ODEs with parameters and multipoint conditions," Appl. Num. Math. 13 (1993), pp. 305-333. S. J. Wright, "An Infeasible-interior-point method for linear complementarity problems," Mathematical Programming 67 (1994), pp. 29--52. S. J. Wright, "A Path-following infeasible-interior-point method for linear complementarity problems," Optim. Methods Softw. 2 (1993), pp. 79-106. S. J. Wright and D. Ralph "A Superlinear infeasible-interior-point algorithm for monotone complementarity problems," Mathematics of Operations Research 21 (1996), pp. 815-838. R. D. C. Monteiro and S. J. Wright, "Interior-point algorithms for degenerate linear complementarity problems," Comput. Optim. Appls 3 (1994) pp. 131-155. R. D. C. Monteiro and S. J. Wright, "Superlinear primal-dual affine scaling algorithms for LCP," Mathematical Programming 69 (1995) pp. 311-333. R. D. C. Monteiro and S. J. Wright, "A superlinear infeasible-interior-point affine scaling algorithm for LCP," SIAM Journal on Optimization 6 (1996), pp. 1--20. S. J. Wright, "Stability of linear equations solvers in interior-point methods," SIAM J. Matrix Analysis and Applications 16 (1995) pp. 1287--1307. S. J. Wright, "A Path-following interior-point method for linear and quadratic problems," Annals of Operations Research 62 (1996), pp. 103-130. S. J. Wright and Yin Zhang "A Superquadratic infeasible-interior-point method for linear complementarity problems," Mathematical Programming 73 (1996), pp. 269-289.

P446.dvi, S. J. Wright, "Stability of augmented system factorizations in interior-point methods," (revision of "Stability of linear algebra computations in interior-point methods for linear programming") SIAM J. Matrix Analysis and Applications 18 (1997), pp. 191-222. P485.pdf S. J. Wright and F. Jarre, "On the role of the objective function in barrier methods," Preprint MCS-P485-1294, December, 1994. (Revised May, 1998; Appear in Mathematical Programming, Series A 84 (1998), pp. 357-373. See also this Correction which fixes some typos and completes the proof of Theorem 2 in the published paper. P556.pdf D. Ralph and S. J. Wright, "Superlinear convergence of an interior-point method for monotone variational inequalities," in Complementarity and Variational Problems: State of the Art, SIAM Publications, 1997, pages 345-385. P561.pdf S. J. Wright, "Applying new optimization algorithms to model predictive control," Chemical Process Control-V, CACHE, AIChE Symposium Series No. 316, Volume 93, 1997, pp. 147-155. P600.pdf S. J. Wright, "Modified Cholesky factorizations in interior-point algorithms for linear programming," Preprint ANL/MCS-P600-0596, May, 1996. (Revised: May 1998 and December 1998.) SIAM Journal on Optimization 9 (1999), pp. 1159--1191. P622.pdf D. Ralph and S. J. Wright, "Superlinear convergence of an interior-point method despite dependent constraints," Preprint ANL/MCS-P622-1196, November, 1996. (Revised August, 1998.) Mathematics of Operations Research 25 (2000), pp. 179-194. P643.pdf S. J. Wright, "Superlinear convergence of a stabilized SQP method to a degenerate solution," Preprint ANL/MCS-P643-0297, February, 1997. Computational Optimization and Applications 11 (1998), pp. 253--275.

pdf, C. V. Rao, S. J. Wright, and J. B. Rawlings, "Application of interior-point methods to model predictive control," Journal of Optimization Theory and Applications 99 (1998), pp. 723--757. See also these corrections, courtesy of Matt Tenny.

OTC Technical Report 97/04 (WEB VERSION) Joseph Czyzyk, Jonathan H. Owen, and Stephen J. Wright, "NEOS: Optimization on the Internet," June, 1997., P681_3.pdf, S. J. Wright, "On the convergence of the Newton/log-barrier method," Preprint ANL/MCS-P681-0897, August, 1997. (Revised January, 1999 and April, 2000.) Mathematical Programming 90 (2001), pp. 71-100., P699_3.pdf, S. J. Wright, "Modifying SQP for degenerate problems," Preprint ANL/MCS-P699-1097, October, 1997. (Last modified March, 2002.) SIAM Journal on Optimization 13 (2002), pp. 585-613., J. Czyzyk, T. Wisniewski, and S. J. Wright, "Optimization case studies in the NEOS Guide," Preprint ANL/MCS-P704-0198, January, 1998. (Revised July, 1998.) SIAM Review 41 (1999), pp. 148--163., P705_2.pdf, S. J. Wright, "Effects of finite-precision arithmetic on interior-point methods for nonlinear programming," Preprint ANL/MCS-P705-0198, January, 1998. (Revised May, 2000.) SIAM Journal on Optimization 12 (2001), pp. 36-78., P740.pdf, Z. Ren, R. Sheng, and S. J. Wright, "Advanced computational techniques for Laue diffraction analysis," Preprint ANL/MCS-P740-0199, January, 1999.

focapd.doc, S. J. Wright, "Algorithms and software for linear and nonlinear programming," in Foundations of Computer-Aided Process Design, CACHE Publications, 1999. S. J. Wright and D. Orban, "Properties of the log-barrier function on degenerate nonlinear programs," Preprint ANL/MCS-P772-0799, July, 1999. (Revised May, 2001.) Mathematics of Operations Research 27 (2002), pp. 585-613., osp.pdf, S. J. Wright, "Optimization Software Packages," Preprint, August, 1999. In Handbook of Applied Optimization, M. Resende and P. Pardalos, eds., Oxford University Press, 2002, pp.1008-1015., P783.pdf, S. J. Wright, "Recent developments in interior-point methods," Preprint ANL/MCS-P783-0999, September, 1999. Systems Modeling and Optimization: Methods, Theory, and Applications, M.~J.~D. Powell and S. Scholtes, eds., Kluwer, 2000, pp. 311-333.

pdf, B. A. Turlach, W. N. Venables, and S. J. Wright, "Simultaneous Variable Selection," Technometrics 27 (2005), pp. 349-363., potra-wright.pdf, F. A. Potra and S. J. Wright, "Interior-point methods," November, 1999. Journal of Computational and Applied Mathematics 124 (2000), pp. 281-302., vicente-wright.pdf, L. Vicente and S. J. Wright, "Local convergence of a primal-dual method for degenerate nonlinear programming," February, 2000. (Revised May, 2001.) Computational Optimization and Applications 22 (2002), pp. 311-328.

pdf, E. A. Yildirim and S. J. Wright, "Warm-start strategies in interior-point methods for linear programming" Preprint ANL/MCS-P799-0300, March, 2000. (Revised May, 2001.) SIAM Journal on Optimization 12 (2002), pp. 782-810., P808.pdf S. J. Wright, "On reduced convex QP formulations of monotone LCPs," Preprint ANL/MCS-P808-0400, April, 2000. (Revised February, 2001.) Mathematical Programming 90 (2001), pp. 459--473., optima_metaneos.pdf S. J. Wright, "Solving optimization problems on computational grids," November, 2000. Optima 65, May, 2001., P865_2.pdf, S. J. Wright, "Constraint identification and algorithm stabilization for degenerate nonlinear programs," Mathematical Programming, Series B 95 (2003), pp. 137-160.

pdf J. Linderoth and S. J. Wright, "Decomposition algorithms for stochastic programming on a computational grid," Computational Optimization and Applications 24 (2003), pp. 207-250. (Special issue on Stochastic Programming.) (Winner of Best Paper in COAP for 2003.)

twmcc-2001-04.pdf G. Pannocchia, S. J. Wright, and J. B. Rawlings, "Model Predictive Control with Active Steady-State Input Constraints: Existence and Computation," Technical Report 2001-04, Texas-Wisconsin Modeling and Control Consortium, May 2001; Revised March, 2002. IEEE Transactions on Automatic Control 48 (2003), pp. 1002-1007.

ps, pdf J. Linderoth and S. J. Wright, "Computational Grids for Stochastic Programming," Optimization Technical Report 01-01, Computer Sciences Department, University of Wisconsin-Madison, October, 2001. Chapter 5 of Applications of Stochastic Programming, MPS-SIAM Series in Optimization, SIAM Publications, 2005.

pdf E. Michael Gertz and S. J. Wright, "Object-Oriented Software for Quadratic Programming," ACM Transactions on Mathematical Software 29 (2003), pp. 58-81.

pdf J. T. Linderoth, A. Shapiro, and S. J. Wright, "The Empirical Behavior of Sampling Methods for Stochastic Programming," Optimization Technical Report 02-01, Computer Sciences Department, University of Wisconsin-Madison, January, 2002. Revised October, 2002. To appear in Annals of Operations Research (2006).
See also the companion web site.

pdf S. J. Wright and M. J. Tenny, "A Feasible Trust-Region Sequential Quadratic Programming Algorithm," SIAM Journal on Optimization 14 (2004), pp. 1074-1105.

ps, M. J. Tenny, S. J. Wright and J. B. Rawlings "Nonlinear Model Predictive Control via Feasibility-Perturbed Sequential Quadratic Programming," Computational Optimization and Applications 28 (2004), pp. 87-121.
The code described in this paper is freely available on request. It is written in GNU Octave.

pdf, M. J. Tenny, J. B. Rawlings, and S. J. Wright, "Closed-loop behavior of nonlinear modelpredictive control," AIChE Journal 50 (2004), pp. 2142-2154.

pdf, S. J. Wright, "An Algorithm for degenerate nonlinear programming with rapid local convergence", SIAM Journal on Optimization 15 (2005), pp. 673-696.

pdf, Olafsson, A. and Wright, S. J., "Linear programming formulations and algorithms for radiotherapy treatment planning," Optimization Methods and Software 21 (2006), pp. 201-231.

pdf, Almeida, J., Eager, D., Vernon, M., and Wright, S. J., "Minimizing delivery cost in scalable streaming content distribution systems," IEEE Transactions on Multimedia 6 (2004), pp. 356-365.

pdf, D. Ralph and S. J. Wright, "Some Properties of Regularization and Penalization Schemes for MPECs," Optimization Methods and Software 19 (2004), pp. 527-556.

pdf, C. Oberlin and S. J. Wright, "Active Constraint Identification in Nonlinear Programming," SIAM Journal on Optimization 17 (2006), p. 577-605.

pdf, M. Anitescu, P. Tseng, and S. J. Wright, "Elastic-Mode Algorithms for Mathematical Programs with Equilibrium Constraints: Global Convergence and Stationarity Properties," Mathematical Programming, Series A 110 (2007), pp. 337-371.

pdf, F. Lu, S. Keles, S. J. Wright, and G. Wahba, "A framework for kernel regularization with application to protein clustering," Technical Report No. 1007, Department of Statistics, University of Wisconsin-Madison, May, 2005. Proceedings of the National Academy of Sciences 102 (2005), pp. 12332-12337.

pdf, A. Olafsson, R. Jeraj, and S. J. Wright, "Optimization of intensity-modulate radiation therapy with biological objectives," Phys. Med. Biol. 50 (2005), pp. 5357-5379.

pdf, A. Olafsson and S. J. Wright, "Efficient schemes for robust IMRT treatment planning," Phys. Med. Biol. 51 (2006), pp. 5621-5642.

Lim, J.-H., Ferris, M. C., Wright, S. J., Shepard, D., and Earl, M., "An optimization framework for conformal radiation treatment planning," INFORMS Journal on Computing 19 (2007), pp. 366-380.

pdf, C. Oberlin and S. J. Wright, "An accelerated Newton method for equations with semismooth Jacobians and nonlinear
complementarity problems," Mathematical Programming, Series B 117 (2009), pp. 355-386.

pdf, Pannocchia, G., Rawlings, J. B., and Wright, S. J., “Fast, large-scale model predictive control by partial enumeration,”
Automatica 43 (2007), pp. 852-860.

pdf, Venkat, A. N., Hiskens, I. Rawlings, J. B., and Wright, S. J., "Distributed MPC strategies with application to power system automatic generation control," IEEE Transactions on Control Systems Technology 16 (2008), pp. 1192-1206.

pdf, Marcia, R., Mitchell, J., and Wright, S. J., “Convex quadratic approximation via semidefinite programming,” to
appear in Optimization Methods and Software, 2007.

pdf, Fisher, M., Nocedal, J., Tremolet, Y., and Wright, S. J., Data Assimilation inWeather Forecasting: A Case Study
in PDE-Constrained Optimization” Optimization and Engineering 10 (2009), pp. 409-426.

pdf, Goldberg, A., Zhu. X., and Wright, S. J., “Dissimilarity in graph-based semi-supervised classification,” 11th International Conference on Artificial Intelligence and Statistics, March, 2007.

pdf, Corrada Bravo, H. Wright, S. J., Eng, K. H., Keles, S., and Wahba, G., "Estimating tree-structured covariance matrices via mixed-integer programming," 12th AISTATS, 2009.

pdf, M. Figueiredo, R. Nowak, and S. J. Wright, "Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems," IEEE Journal of Selected Topics in Signal Processing 1 (2007), pp. 586-597.

pdf, W. Bajwa, J. Haupt, G. Raz, S. J. Wright, and R. D. Nowak, "Toeplitz-structured compressed sensing matrices," Proceedings of the IEEE Statistical Signal Processing Workshop, Madison, WI (2007), pp. 294-298.

pdf, Suresh, V., Bannen, R. M., Phillips, G. N., Wright, S. J., and Mitchell, J. C., "Optimal design of thermally stable proteins," Bioinformatics 24 (2008), pp. 2339-2343.

pdf, Wright, S. J. and Nowak, R., and Figueiredo, M., "Sparse Reconstruction by Separable Approximation," IEEE Transactions on Signal Processing 57 (2009), pp. 2479-2493.

pdf, W. Shi, G. Wahba, S. Wright, K. Lee, R. Klein, and B. Klein, "LASSO-Patternsearch Algorithm with applciation to opthalmology and genomic data," Statistics and its Interface 1 (2008), pp. 137-153.

pdf, Zhu, M., Wright, S. J., and Chan, T., "Duality-based algorithms for total-variation-regularized image restoration," CAM Report 08-33, UCLA, May, 2008. To appear in Computational Optimization and Applications.

pdf, Lee, S. and Wright, S. J., "Implementing Algorithms for Signal and Image Reconstruction on Graphical Processing Units," Technical Report, September 2008.

pdf, Lee, S. and Wright, S. J., "Decomposition algorithm for training large-scale semiparametric support vector machines," European Conference on Machine Learning (ECML PKDD), September, 2009.

pdf, Tropp, J. and Wright, S. J., "Computational methods for sparse solution of linear inverse problems," Proceedings of the IEEE 98 (2010), pp. 948-958.

pdf, Miller, W., Wright, S. J., Zhang,Y., Schuster, S. C., and Hayes, V. M., "Optimization methods for selecing founder populations for captive breeding of endangered species," Pacific Symposium on Biocomputing 10 (2010), pp. 43-53.

pdf, Stewart, B. T., Venkat, A. N., Rawlings, J. B., Wright, S. J., and Pannocchia, G., "Cooperative distributed model predictive control," Systems and Control Letters 59 (2010), pp. 460-469.

pdf, Stewart, B. T., Rawlings, J. B., Wright, and S. J., "Hierarchical cooperative distributed model predictive control," American Control Conference, 2010.

pdf, Lewis, A. S. and Wright, S. J., "A proximal method for composite minimization," Technical Report, December 2008.

pdf, Lewis, A. S. and Wright, S. J., "Identifying activity," SIAM Journal on Optimization 21 (2011), pp. 597-614.

pdf, Pannocchia, G., Rawlings, J. B., and Wright, S. J., "Partial enumeration MPC: Robust stability results and application to an unstable CSTR," DYCOPS 2010.

pdf, Pannocchia, G., Rawlings, J. B., and Wright, S. J., "Conditions under which suboptimal nonlinear MPC is inherently robust," Systems and Control Letters 60 (2011), pp. 747-755..

pdf, Pannocchia, G., Wright, S. J., and Rawlings, J. B., "Partial Enumeration MPC: Robust stability results and applications to an unstable CSTR," to appear in Journal of Process Control, 2011.

pdf, Stewart, B. T., Wright, S. J., and Rawlings, J. B., "Cooperative distributed model predictive control for nonlinear systems," to appear in Journal of Process Control, 2011.

pdf, Wright, S. J., "Accelerated block-coordinate relaxation for regularized optimization," August 2010. Revised September 2011.

pdf, Lee, S. and Wright, S. J., "ASSET: Approximate stochastic subgradient estimation training for support vector machines," September, 2010.

pdf, Rao, N., Nowak, R. D., Wright, S. J., and Kingsbury, N. G., "Convex approaches to model wavelet sparsity patterns," to appear in ICIP 2011, September, 2011.

pdf, Lee, S. and Wright, S. J., "Manifold identification in dual averaging for regularized online stochastic learning," July 2011. Shorter version from Intl Conference on Machine Learning, July 2011.

pdf, Niu, F., Recht, B., Re, C., and Wright, S. J., "HOGWILD!: A Lock-free approach to parallelizing stochastic gradient descent," June 2011.



Selected Talks, S. J. Wright, "Recent advances in interior-point methods," Talk at IFIP '99 TC7 Conference, Cambridge, July 15, 1999.

aw2000.ppt, S. J. Wright, "Recent developments in optimization and their impact on control," Talk at AspenWorld 2000, February 9, 2000.

dundee-talkfour.pdf S. J. Wright, "Solving stochastic optimization problems on computational grids," Talk at Dundee Conference on Numerical Analylsis, June, 2001.

siopt_talk_may02.pdf, S. J. Wright, "The Ongoing Impact of Interior-Point Methods," Talk at SIAM Optimization Conference OPT02, Toronto, May 20, 2002.

focm-talk.pdf, S. J. Wright, "Optimization Problems in Model Predictive Control," Talk at Foundations of Computational Mathematics, FOCM '02, Minneapolis, August 6, 2002.

siam-annual-jul04.pdf, S. J. Wright, "Continuous Optimization: Recent Developments and Applications" Talk at SIAM Annual Meeting, July 16, 2004.

sjw-huatulco.pdf, S. J. Wright, "Applications with l-1 norm objective terms," talk in Huatulco, Oaxaca, January 2007.

sjw-waterloo.pdf, S. J. Wright, "Solving l-1 regularized regression problems," talk at Waterloo, June 2007.

pdf, S. J. Wright, "Sparse Optimization: Algorithms and Applications," Caltech, April 21, 2008.

pdf, S. J. Wright, "Optimization in Machine Learning," NIPS Workshops, December, 2008. See the VIDEO.

pdf, S. J. Wright, "Optimization Algorithms for Compressed Sensing," SIAM Gator Student Conference, March, 2009.

pdf, S. J. Wright, "Optimization Algorithms in Support Vector Machines," Computational Learning Workshop and Summer School, University of Chicago, June, 2009.

pdf, S. J. Wright, "Sparse Optimization Methods," Conference on Advanced Methods and Perspectives in Nonlinear Optimization and Control, Toulouse, February, 2010.

pdf, S. J. Wright, "Sparse and Structured Optimization," 8th Chinese Symposium on Mathematical Programming, Shanghai, May, 2010.

pdf, S. J. Wright, "Optimization Algorithms in Machine Learning," NIPS Tutorial, December, 2010. Here's the VIDEO.

pdf, S. J. Wright, "Sparse Optimization," SIAM Conference on Optimization, Darmstadt, May, 2011.

pdf, S. J. Wright, "Gradient Algorithms for Regularized Optimization," SPARS11, Edinburgh, June, 2011.

pdf, S. J. Wright, "Gradient Methods for Regularized Optimization," ICIAM 2011, Vancouver, July, 2011.




Optimization Software Guide by J. J. More' and S. J. Wright, SIAM, 1993.

Primal-Dual Interior-Point Methods by S. J. Wright, (xx+289 pages) SIAM, 1997.

Numerical Optimization (Second Edition) by J. Nocedal and S. J. Wright, Numerical Optimization, Springer, 2006.

Linear Programming with MATLAB by M. C. Ferris, O. L. Mangasarian, and S. J. Wright, SIAM, 2007.


The University of Wisconsin Madison