Abstract
The notion that biological systems come to embody optimal solutions seems consistent with the competitive drive of evolution. It has been used to interpret many examples of sensorimotor behavior. It is attractive from the viewpoint of control engineers because it solves the redundancy problem by identifying the one optimal motor strategy out of many similarly acceptable possibilities. This perspective examines whether there is sufficient basis to apply the formal engineering tools of optimal control to a reductionist understanding of biological systems. For an experimental biologist, this translates into whether the theory of optimal control generates nontrivial and testable hypotheses that accurately predict novel phenomena, ideally at deeper levels of structure than the observable behavior. The methodology of optimal control is applicable when there is (i) a single, known cost function to be optimized, (ii) an invertible model of the plant, and (iii) simple noise interfering with optimal performance. None of these is likely to be true for biological organisms. Furthermore, their motivation is usually good-enough rather than globally optimal behavior. Even then, the performance of a biological organism is often much farther from optimal than the physical limits of its hardware because the brain is continuously testing the acceptable limits of performance as well as just performing the task. This perspective considers an alternative strategy called “good-enough” control, in which the organism uses trial-and-error learning to acquire a repertoire of sensorimotor behaviors that are known to be useful, but not necessarily optimal. This leads to a diversity of solutions that tends to confer robustness on the individual organism and its evolution. It is also more consistent with the capabilities of higher sensorimotor structures, such as cerebral cortex, which seems to be designed to classify and recall complex sets of information, thereby allowing the organism to learn from experience, rather than to compute new strategies online. Optimal control has been a useful metaphor for understanding some superficial aspects of motor psychophysics. Reductionists who want to understand the underlying neural mechanisms need to move on.
Similar content being viewed by others
References
Anderson FC, Pandy MG (1999) A dynamic optimization solution for vertical jumping in three dimensions. Comput Methods Biomech Biomed Eng 2: 201–231
Bernstein NA (1967) The co-ordination and regulation of movement. In: Whiting HTA (ed) (Translation) Human motor actions: Bernstein reassessed. Elsevier, Amsterdam
Bjursten LM, Norrsell K, Norrsell U (1976) Behavioural repertory of cats without cerebral cortex from infancy. Exp Brain Res 25: 115–130
Boyd SP, Vandenberghe L (2004) Convex optimization. Cambridge University Press, New York
Buchanan TS, Shreeve DA (1996) An evaluation of optimization techniques for the prediction of muscle activation patterns during isometric tasks. J Biomech Eng 118: 565–574
Churchland MM, Afshar A, Shenoy KV (2006) A central source of movement variability. Neuron 52: 1085–1096
Crowninshield RD, Brand RA (1981) A physiologically based criterion of muscle force prediction in locomotion. J Biomech 14: 793–801
Culler E, Mettler FA (1934) Conditioned behavior in a decorticate dog. J Comp Psychol 18: 291–303
de Rugy A, Loeb GE, Carroll TJ (2012) Muscle coordination is habitual rather than optimal. J Neurosci 32: 7384–7391
Diamond IT (1979) The subdivisions of neocortex: a proposal to revise the traditional view of sensory, motor, and association areas. Prog Psychobiol Physiol Psychol 8: 1–43
Flanders M (2011) What is the biological basis of sensorimotor integration?. Biol Cybern 104: 1–8
Flash T, Hogan N (1985) The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci 5: 1688–1703
Friston K (2010) The free-energy principle: a unified brain theory. Nat Rev Neurosci 11: 127–138
Gallistel CR, Fairhurst S, Balsam P (2004) The learning curve: implications of a quantitative analysis. Proc Natl Acad Sci USA 101: 13124–13131
Gill PE, Murray W, Wright MH (1982) Practical optimization. Emerald Group Publishing Limited, West Yorkshire
Goaillard J-M, Taylor AL, Schulz DJ, Marder E (2009) Functional consequences of animal-to-animal variation in circuit parameters. Nat Neurosci 12: 1424–1430
Grashow R, Brookings T, Marder E (2010) Compensation for variable intrinsic neuronal excitability by circuit-synaptic interactions. J Neurosci 30: 9145–9156
Hamilton AFd, Jones KE (2004) The scaling of motor noise with muscle strength and motor unit number in humans. Exp Brain Res 157: 417–430
Harper D (2010) optimal. In: Online Etymology Dictionary. http://www.etymonline.com/index.php?allowed_in_frame=0&search=optimal&searchmode=none
He J, Levine WS, Loeb GE (1991) Feedback gains for correcting small perturbations to standing posture. IEEE Trans Autom Control 36: 322–332
Jones KE, Hamilton AFd, Wolpert DM (2002) Sources of signal-dependent noise during isometric force production. J Neurophysiol 88: 1533–1544
Kawato M (1999) Internal models for motor control and trajectory planning. Curr Opin Neurobiol 9: 718–727
Kawato M, Gomi H (1992) A computational model of four regions of the cerebellum based on feedback-error learning. BiolCybern 68: 95–103
Lagarias JC, Reeds JA, Wright MH, Wright PE (1998) Convergence properties of the Nelder-Mead simplex method in low dimensions. SIAM J OPTIM 9: 112–147
Li Y, Levine WS, Loeb GE (2012) A two-joint human posture control model with realistic neural delays. IEEE Trans Neural Syst Rehabil Eng. doi:10.1109/TNSRE.2012.2199333
Loeb GE (1983) Finding common ground between robotics and physiology. Trends Neurosci 6: 203–204
Loeb GE (1993) The distal hindlimb musculature of the cat: interanimal variability of locomotor activity and cutaneous reflexes. Exp Brain Res 96: 125–140
Loeb GE (1999) Asymmetry of hindlimb muscle activity and cutaneous reflexes after tendon transfers in kittens. J Neurophysiol 82: 3392–3405
Loeb GE, Levine WS, He J (1990) Understanding sensorimotor feedback through optimal control. Cold Spring Harbor Symp Quant Biol 55: 791–803
Marr D (1982) Vision. W.H. Freeman & Co, New York
McCrea DA, Rybak IA (2008) Organization of mammalian locomotor rhythm and pattern generation. Brain Res Rev 57: 134–146
Osu R, Gomi H (1999) Multijoint muscle regulation mechanisms examined by measured human arm stiffness and EMG signals. J Neurophysiol 81: 1458–1468
Pandy MG, Anderson FC, Hull DG (1992) A parameter optimization approach for the optimal control of large-scale musculoskeletal systems. J Biomech Eng 114: 450–460
Pandy MG, Zajac FE, Sim E, Levine WS (1990) An optimal control model for maximum-height human jumping. J Biomech 23: 1185–1198
Partridge LD (1982) The good enough calculi of evolving control systems: evolution is not engineering. Am J Physiol 242: R173–R177
Pedotti A, Krishnan VV, Stark L (1978) Optimization of muscle-force sequencing in human locomotion. Math Biosci 38: 57–76
Pellionisz AJ, Peterson BW (1988) A tensorial model of neck motor activation. In: Peterson BW, Richmond FJR (eds) Control of head movement. Oxford University Press, New York, pp 178–186
Perfiliev S, Isa T, Johnels B, Steg G, Wessberg J (2010) Reflexive limb selection and control of reach direction to moving targets in cats, monkeys, and humans. J Neurophysiol 104: 2423–2432
Pierrot-Deseilligny E, Burke DC (2005) The circuitry of the human spinal cord: its role in motor control and movement disorders. Cambridge University Press, Cambridge
Raikova RT, Gabriel DA, Aladjov H (2005) Experimental and modelling investigation of learning a fast elbow flexion in the horizontal plane. J Biomech 38: 2070–2077
Raphael G, Tsianos GA, Loeb GE (2010) Spinal-like regulator facilitates control of a two-degree-of-freedom wrist. J Neurosci 30: 9431–9444
Rathelot JA, Strick PL (2009) Subdivisions of primary motor cortex based on cortico-motoneuronal cells. PNAS 106: 918–923
Sabes PN, Jordan MI (1997) Obstacle avoidance and a perturbation sensitivity model for motor planning. J Neurosci (New York) 17: 7119–7128
Slifkin AB, Newell KM (1998) Is variability in human performance a reflection of system noise. Curr Dir Psychol Sci 7: 170–177
Tang LS, Goeritz ML, Caplan JS, Taylor AL, Fisek M, Marder E (2010) Precise temperature compensation of phase in a rhythmic motor pattern. PLoS Biol 8: e1000469
Terekhov A, Zatsiorsky V (2011) Analytical and numerical analysis of inverse optimization problems: conditions of uniqueness and computational methods. Biol Cybern 104: 75–93
Todorov E, Jordan MI (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226–1235
Tsianos GA, Raphael G, Loeb GE (2011) Modeling the potentiality of spinal-like circuitry for stabilization of a planar arm system. Prog Brain Res 194: 203–213
Tsianos GA, Rustin C, Loeb GE (2012) Mammalian muscle model for predicting force and energetics during physiological behaviors. IEEE Trans Neural Syst Rehabil Eng 20: 117–133
Valero-Cuevas FJ, Hoffmann H, Kurse MU, Kutch JJ, Theodorou EA (2009) Computational models for neuromuscular function. IEEE Rev Biomed Eng 2: 110–135
Venkataraman P (2009) Applied optimization with MATLAB programming, Chapt 6. Wiley, Somerset
Yuan G, Chang K, Hsieh C, Lin C (2010) A comparison of optimization methods for large-scale L1-regularized linear classification. Linear Classif J Mach Learn Res 2: 3183–3234
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Loeb, G.E. Optimal isn’t good enough. Biol Cybern 106, 757–765 (2012). https://doi.org/10.1007/s00422-012-0514-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00422-012-0514-6