- ▪E.D. Sontag, "Scale-invariance in biological sensing", In Encyclopedia of Systems and Control, pp. 1-4, 2020. doipdf
Abstract
The phenomenon of fold-change detection, or scale-invariance, is exhibited by a variety of sensory systems, in both bacterial and eukaryotic signaling pathways. This encyclopedia-style article gives a brief introduction to the subject.
- ▪D. K. Agrawal, R. Marshall, M.A. Al-Radhawi, V. Noireaux, E. D. Sontag, "Some remarks on robust gene regulation in a biomolecular integral controller", In Proc. 2019 IEEE Conf. Decision and Control, pp. 2820-2825, 2019. pdfadaptation · biological adaptation · perfect adaptation · tracking · synthetic biology · integral feedback · TX/TL · systems biology · dynamical systems · adaptation · internal model principle · systems biology
Abstract
Integral feedback can help achieve robust tracking independently of external disturbances. Motivated by this knowledge, biological engineers have proposed various designs of biomolecular integral feedback controllers to regulate biological processes. In this paper, we theoretically analyze the operation of a particular synthetic biomolecular integral controller, which we have recently proposed and implemented experimentally. Using a combination of methods, ranging from linearized analysis to sum-of-squares (SOS) Lyapunov functions, we demonstrate that, when the controller is operated in closed-loop, it is capable of providing integral corrections to the concentration of an output species in such a manner that the output tracks a reference signal linearly over a large dynamic range. We investigate the output dependency on the reaction parameters through sensitivity analysis, and quantify performance using control theory metrics to characterize response properties, thus providing clear selection guidelines for practical applications. We then demonstrate the stable operation of the closed-loop control system by constructing quartic Lyapunov functions using SOS optimization techniques, and establish global stability for a unique equilibrium. Our analysis suggests that by incorporating effective molecular sequestration, a biomolecular closed-loop integral controller that is capable of robustly regulating gene expression is feasible.
- ▪D. K. Agrawal, R. Marshall, M.A. Al-Radhawi, V. Noireaux, E. D. Sontag, "Some remarks on robust gene regulation in a biomolecular integral controller", In Proc. 2019 IEEE Conf. Decision and Control, pp. 2820-2825, 2019. pdfadaptation · biological adaptation · perfect adaptation · tracking · synthetic biology · integral feedback · TX/TL · systems biology · dynamical systems · adaptation · internal model principle · systems biology
Abstract
Integral feedback can help achieve robust tracking independently of external disturbances. Motivated by this knowledge, biological engineers have proposed various designs of biomolecular integral feedback controllers to regulate biological processes. In this paper, we theoretically analyze the operation of a particular synthetic biomolecular integral controller, which we have recently proposed and implemented experimentally. Using a combination of methods, ranging from linearized analysis to sum-of-squares (SOS) Lyapunov functions, we demonstrate that, when the controller is operated in closed-loop, it is capable of providing integral corrections to the concentration of an output species in such a manner that the output tracks a reference signal linearly over a large dynamic range. We investigate the output dependency on the reaction parameters through sensitivity analysis, and quantify performance using control theory metrics to characterize response properties, thus providing clear selection guidelines for practical applications. We then demonstrate the stable operation of the closed-loop control system by constructing quartic Lyapunov functions using SOS optimization techniques, and establish global stability for a unique equilibrium. Our analysis suggests that by incorporating effective molecular sequestration, a biomolecular closed-loop integral controller that is capable of robustly regulating gene expression is feasible.
- ▪D.K. Agrawal, R. Marshall, V. Noireaux, E.D. Sontag, "In vitro implementation of robust gene regulation in a synthetic biomolecular integral controller", Nature Communications, vol. 10, pp. 1-12, 2019. pdfantithetic controller · tracking · synthetic biology · integral feedback · TX/TL · systems biology · dynamical systems · adaptation · internal model principle · identifiability
Abstract
Cells respond to biochemical and physical internal as well as external signals. These signals can be broadly classified into two categories: (a) ``actionable'' or ``reference'' inputs that should elicit appropriate biological or physical responses such as gene expression or motility, and (b) ``disturbances'' or ``perturbations'' that should be ignored or actively filtered-out. These disturbances might be exogenous, such as binding of nonspecific ligands, or endogenous, such as variations in enzyme concentrations or gene copy numbers. In this context, the term robustness describes the capability to produce appropriate responses to reference inputs while at the same time being insensitive to disturbances. These two objectives often conflict with each other and require delicate design trade-offs. Indeed, natural biological systems use complicated and still poorly understood control strategies in order to finely balance the goals of responsiveness and robustness. A better understanding of such natural strategies remains an important scientific goal in itself and will play a role in the construction of synthetic circuits for therapeutic and biosensing applications. A prototype problem in robustly responding to inputs is that of ``robust tracking'', defined by the requirement that some designated internal quantity (for example, the level of expression of a reporter protein) should faithfully follow an input signal while being insensitive to an appropriate class of perturbations. Control theory predicts that a certain type of motif, called integral feedback, will help achieve this goal, and this motif is, in fact, a necessary feature of any system that exhibits robust tracking. Indeed, integral feedback has always been a key component of electrical and mechanical control systems, at least since the 18th century when James Watt employed the centrifugal governor to regulate steam engines. Motivated by this knowledge, biological engineers have proposed various designs for biomolecular integral feedback control mechanisms. However, practical and quantitatively predictable implementations have proved challenging, in part due to the difficulty in obtaining accurate models of transcription, translation, and resource competition in living cells, and the stochasticity inherent in cellular reactions. These challenges prevent first-principles rational design and parameter optimization. In this work, we exploit the versatility of an Escherichia coli cell-free transcription-translation (TXTL) to accurately design, model and then build, a synthetic biomolecular integral controller that precisely controls the expression of a target gene. To our knowledge, this is the first design of a functioning gene network that achieves the goal of making gene expression track an externally imposed reference level, achieves this goal even in the presence of disturbances, and whose performance quantitatively agrees with mathematical predictions.
- ▪F. Menolascina, R. Rusconi, V.I. Fernandez, S.P. Smriga, Z. Aminzare, E. D. Sontag, R. Stocker, "Logarithmic sensing in Bacillus subtilis aerotaxis", npj Systems Biology and Applications, vol. 3, pp. 16036-, 2017. pdfadaptation · biological adaptation · perfect adaptation · Aerotaxis · chemotaxis · scale invariance · FCD · fold-change detection · B. subtilis · systems biology
Abstract
Aerotaxis, the directed migration along oxygen gradients, allows many microorganisms to locate favorable oxygen concentrations. Despite oxygen's fundamental role for life, even key aspects of aerotaxis remain poorly understood. In Bacillus subtilis, for example, there is conflicting evidence of whether migration occurs to the maximal oxygen concentration available or to an optimal intermediate one, and how aerotaxis can be maintained over a broad range of conditions. Using precisely controlled oxygen gradients in a microfluidic device, spanning the full spectrum of conditions from quasi-anoxic to oxic (60nM-1mM), we resolved B. subtilis' ``oxygen preference conundrum'' by demonstrating consistent migration towards maximum oxygen concentrations. Surprisingly, the strength of aerotaxis was largely unchanged over three decades in oxygen concentration (131nM-196mM). We discovered that in this range B. subtilis responds to the logarithm of the oxygen concentration gradient, a log-sensing strategy that affords organisms high sensitivity over a wide range of conditions.
- ▪M. Skataric, E.V. Nikolaev, E.D. Sontag, "A fundamental limitation to fold-change detection by biological systems with multiple time scales", IET Systems Biology, vol. 9, pp. 1-15, 2015. pdfadaptation · biological adaptation · perfect adaptation · singular perturbations · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · incoherent feedforward loop · feedforward · IFFL
Abstract
The phenomenon of fold-change detection, or scale invariance, is exhibited by a variety of sensory systems, in both bacterial and eukaryotic signaling pathways. It has been often remarked in the systems biology literature that certain systems whose output variables respond at a faster time scale than internal components give rise to an approximate scale-invariant behavior, allowing approximate fold-change detection in stimuli. This paper establishes a fundamental limitation of such a mechanism, showing that there is a minimal fold-change detection error that cannot be overcome, no matter how large the separation of time scales is. To illustrate this theoretically predicted limitation, we discuss two common biomolecular network motifs, an incoherent feedforward loop and a feedback system, as well as a published model of the chemotaxis signaling pathway of Dictyostelium discoideum.
- ▪M. Skataric, E.V. Nikolaev, E.D. Sontag, "Scale-invariance in singularly perturbed systems", In Proc. IEEE Conf. Decision and Control, Los Angeles, Dec. 2014, pp. 3035-3040, 2014. pdfadaptation · biological adaptation · perfect adaptation · singular perturbations · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · incoherent feedforward loop · feedforward · IFFL
Abstract
This conference paper (a) summarizes material from "A fundamental limitation to fold-change detection by biological systems with multiple time scales" (IET Systems Biology 2014) and presents additional remarks regarding (b) expansion techniques to compute FCD error and (c) stochastic adaptation and FCD
- ▪A.O. Hamadeh, B.P. Ingalls, E.D. Sontag, "Transient dynamic phenotypes as criteria for model discrimination: fold-change detection in Rhodobacter sphaeroides chemotaxis", Proc. Royal Society Interface, vol. 10, pp. 20120935, 2013. pdfadaptation · biological adaptation · perfect adaptation · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · chemotaxis
Abstract
The chemotaxis pathway of the bacterium Rhodobacter sphaeroides has many similarities to that of Escherichia coli. It exhibits robust adaptation and has several homologues of the latter's chemotaxis proteins. Recent theoretical results have correctly predicted that, in response to a scaling of its ligand input signal, Escherichia coli exhibits the same output behavior, a property known as fold-change detection (FCD). In light of recent experimental results suggesting that R. sphaeroides may also show FCD, we present theoretical assumptions on the R. sphaeroides chemosensory dynamics that can be shown to yield FCD behavior. Furthermore, it is shown that these assumptions make FCD a property of this system that is robust to structural and parametric variations in the chemotaxis pathway, in agreement with experimental results. We construct and examine models of the full chemotaxis pathway that satisfy these assumptions and reproduce experimental time-series data from earlier studies. We then propose experiments in which models satisfying our theoretical assumptions predict robust FCD behavior where earlier models do not. In this way, we illustrate how transient dynamic phenotypes such as FCD can be used for the purposes of discriminating between models that reproduce the same experimental time-series data.
- ▪A. O. Hamadeh, E.D. Sontag, B.P. Ingalls, "Response time re-scaling and Weber's law in adapting biological systems", In Proc. American Control Conference, pp. 4564-4569, 2013. pdfadaptation · biological adaptation · perfect adaptation · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · chemotaxis
Abstract
Recent experimental work has shown that transient E. coli chemotactic response is unchanged by a scaling of its ligand input signal (fold change detection, or FCD), and this is in agreement with earlier mathematical predictions. However, this prediction was based on certain particular assumptions on the structure of the chemotaxis pathway. In this work, we begin by showing that behavior similar to FCD can be obtained under weaker conditions on the system structure. Namely, we show that under relaxed conditions, a scaling of the chemotaxis system's inputs leads to a time scaling of the output response. We propose that this may be a contributing factor to the robustness of the experimentally observed FCD. We further show that FCD is a special case of this time scaling behavior for which the time scaling factor is unity. We then proceed to extend the conditions for output time scaling to more general adapting systems, and demonstrate this time scaling behavior on a published model of the chemotaxis pathway of the bacterium Rhodobacter sphaeroides. This work therefore provides examples of how robust biological behavior can arise from simple yet realistic conditions on the underlying system structure.
- ▪A.O. Hamadeh, B.P. Ingalls, E.D. Sontag, "Fold-Change Detection As a Chemotaxis Model Discrimination Tool", In Proc. IEEE Conf. Decision and Control, Maui, Dec. 2012, 2012. Paper WeC09.2.
- ▪M. Skataric, E.D. Sontag, "A characterization of scale invariant responses in enzymatic networks", PLoS Computational Biology, vol. 8, pp. e1002748, 2012. pdfadaptation · biological adaptation · perfect adaptation · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection
Abstract
This paper studies a recently discovered remarkable feature that was shown in many adapting systems: scale invariance, which means that the initial, transient behavior stays approximately the same when the background signal level is scaled. Not every adapting system is scale-invariant: we investigate under which conditions a broadly used model of biochemical enzymatic networks will show scale invariant behavior. For all 3-node enzymatic networks, we performed a wide computational study to find candidates for scale invariance, among 16,038 possible topologies. This effort led us to discover a new necessary and sufficient mechanism that explains the behavior of all 3-node enzyme networks that have this property, which we call``uniform linearizations with fast output''. We also apply our theoretical results to a concrete biological example of order six, a model of the response of the chemotaxis signaling pathway of Dictyostelium discoideum to changes in chemoeffector cyclic adenosine monophosphate (cAMP).
- ▪M. Skataric, E.D. Sontag, "Exploring the scale invariance property in enzymatic networks", In Proc. IEEE Conf. Decision and Control, Maui, Dec. 2012, 2012. Paper WeC09.2.adaptation · biological adaptation · perfect adaptation · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · enzymatic networks
Abstract
This is a conference version of ``A characterization of scale invariant responses in enzymatic networks.
- ▪L. Bleris, Z. Xie, D. Glass, A. Adadey, E.D. Sontag, Y. Benenson, "Synthetic incoherent feed-forward circuits show adaptation to the amount of their genetic template", Molecular Systems Biology, vol. 7, pp. 519-, 2011. pdfadaptation · feedforward loops · systems biology · synthetic biology · incoherent feedforward loop · feedforward · IFFL
Abstract
Natural and synthetic biological networks must function reliably in the face of fluctuating stoichiometry of their molecular components. These fluctuations are caused in part by changes in relative expression efficiency and the DNA template amount of the network-coding genes. Gene product levels could potentially be decoupled from these changes via built-in adaptation mechanisms, thereby boosting network reliability. Here we show that a mechanism based on an incoherent feed-forward motif enables adaptive gene expression in mammalian cells. We modeled, synthesized, and tested transcriptional and post-transcriptional incoherent loops and found that in all cases the gene product adapts to changes in DNA template abundance. We also observed that the post-transcriptional form results in superior adaptation behavior, higher absolute expression levels, and lower intrinsic fluctuations. Our results support a previously-hypothesized endogenous role in gene dosage compensation for such motifs and suggest that their incorporation in synthetic networks will improve their robustness and reliability.
- ▪O. Shoval, U. Alon, E.D. Sontag, "Symmetry invariance for adapting biological systems", SIAM Journal on Applied Dynamical Systems, vol. 10, pp. 857-886, 2011. pdf(See here for a small typo: http://www.sontaglab.org/FTPDIR/shoval.alon.sontag.erratum.pdf)identifiability · adaptation · biological adaptation · perfect adaptation · adaptation · feedforward loops · integral feedback · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · incoherent feedforward loop · feedforward · IFFL
Abstract
Often, the ultimate goal of regulation is to maintain a narrow range of concentration levels of vital quantities (homeostasis, adaptation) while at the same time appropriately reacting to changes in the environment (signal detection or sensitivity). Much theoretical, modeling, and analysis effort has been devoted to the understanding of these questions, traditionally in the context of steady-state responses to constant or step-changing stimuli. In this paper, we present a new theorem that provides a necessary and sufficient characterization of invariance of transient responses to symmetries in inputs. A particular example of this property, scale invariance (a.k.a. "fold change detection"), appears to be exhibited by biological sensory systems ranging from bacterial chemotaxis pathways to signal transduction mechanisms in eukaryotes. The new characterization amounts to the solvability of an associated partial differential equation. It is framed in terms of a notion which considerably extends equivariant actions of compact Lie groups. For several simple system motifs that are recurrent in biology, the solvability criterion may be checked explicitly.
- ▪O. Shoval, U. Alon, E.D. Sontag, "Symmetry invariance for adapting biological systems", SIAM Journal on Applied Dynamical Systems, vol. 10, pp. 857-886, 2011. pdf(See here for a small typo: http://www.sontaglab.org/FTPDIR/shoval.alon.sontag.erratum.pdf)identifiability · adaptation · biological adaptation · perfect adaptation · adaptation · feedforward loops · integral feedback · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · incoherent feedforward loop · feedforward · IFFL
Abstract
Often, the ultimate goal of regulation is to maintain a narrow range of concentration levels of vital quantities (homeostasis, adaptation) while at the same time appropriately reacting to changes in the environment (signal detection or sensitivity). Much theoretical, modeling, and analysis effort has been devoted to the understanding of these questions, traditionally in the context of steady-state responses to constant or step-changing stimuli. In this paper, we present a new theorem that provides a necessary and sufficient characterization of invariance of transient responses to symmetries in inputs. A particular example of this property, scale invariance (a.k.a. "fold change detection"), appears to be exhibited by biological sensory systems ranging from bacterial chemotaxis pathways to signal transduction mechanisms in eukaryotes. The new characterization amounts to the solvability of an associated partial differential equation. It is framed in terms of a notion which considerably extends equivariant actions of compact Lie groups. For several simple system motifs that are recurrent in biology, the solvability criterion may be checked explicitly.
- ▪O. Shoval, U. Alon, E.D. Sontag, "Input symmetry invariance, and applications to biological systems", In Proc. IEEE Conf. Decision and Control, Orlando, Dec. 2011, pp. TuA02.5, 2011. adaptation · biological adaptation · perfect adaptation · adaptation · feedforward loops · integral feedback · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · jump Markov processes
Abstract
This paper studies invariance with respect to symmetries in sensory fields, a particular case of which, scale invariance, has recently been found in certain eukaryotic as well as bacterial cell signaling systems. We describe a necessary and sufficient characterization of symmetry invariance in terms of equivariant transformations, show how this characterization helps find all possible symmetries in standard models of biological adaptation, and discuss symmetry-invariant searches.
- ▪O. Shoval, U. Alon, E.D. Sontag, "Input symmetry invariance, and applications to biological systems", In Proc. IEEE Conf. Decision and Control, Orlando, Dec. 2011, pp. TuA02.5, 2011. adaptation · biological adaptation · perfect adaptation · adaptation · feedforward loops · integral feedback · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · jump Markov processes
Abstract
This paper studies invariance with respect to symmetries in sensory fields, a particular case of which, scale invariance, has recently been found in certain eukaryotic as well as bacterial cell signaling systems. We describe a necessary and sufficient characterization of symmetry invariance in terms of equivariant transformations, show how this characterization helps find all possible symmetries in standard models of biological adaptation, and discuss symmetry-invariant searches.
- ▪E.D. Sontag, "Remarks on invariance of population distributions for systems with equivariant internal dynamics", 2011. wwwpdf
- ▪O. Shoval, L. Goentoro, Y. Hart, A. Mayo, E.D. Sontag, U. Alon, "Fold change detection and scalar symmetry of sensory input fields", Proc Natl Acad Sci USA, vol. 107, pp. 15995-16000, 2010. pdfidentifiability · adaptation · biological adaptation · perfect adaptation · adaptation · feedforward loops · integral feedback · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · incoherent feedforward loop · feedforward · IFFL
Abstract
Certain cellular sensory systems display fold-change detection (FCD): a response whose entire shape, including amplitude and duration, depends only on fold-changes in input, and not on absolute changes. Thus, a step change in input from, say, level 1 to 2, gives precisely the same dynamical output as a step from level 2 to 4, since the steps have the same fold-change. We ask what is the benefit of FCD, and show that FCD is necessary and sufficient for sensory search to be independent of multiplying the input-field by a scalar. Thus the FCD search pattern depends only on the spatial profile of the input, and not on its amplitude. Such scalar symmetry occurs in a wide range of sensory inputs, such as source strength multiplying diffusing/convecting chemical fields sensed in chemotaxis, ambient light multiplying the contrast field in vision, and protein concentrations multiplying the output in cellular signaling-systems.Furthermore, we demonstrate that FCD entails two features found across sensory systems, exact adaptation and Weber's law, but that these two features are not sufficient for FCD. Finally, we present a wide class of mechanisms that have FCD, including certain non-linear feedback and feedforward loops.. We find that bacterial chemotaxis displays feedback within the present class, and hence is expected to show FCD. This can explain experiments in which chemotaxis searches are insensitive to attractant source levels. This study thus suggests a connection between properties of biological sensory systems and scalar symmetry stemming from physical properties of their input-fields.
- ▪O. Shoval, L. Goentoro, Y. Hart, A. Mayo, E.D. Sontag, U. Alon, "Fold change detection and scalar symmetry of sensory input fields", Proc Natl Acad Sci USA, vol. 107, pp. 15995-16000, 2010. pdfidentifiability · adaptation · biological adaptation · perfect adaptation · adaptation · feedforward loops · integral feedback · scale invariance · systems biology · transient behavior · symmetries · fcd · fold-change detection · incoherent feedforward loop · feedforward · IFFL
Abstract
Certain cellular sensory systems display fold-change detection (FCD): a response whose entire shape, including amplitude and duration, depends only on fold-changes in input, and not on absolute changes. Thus, a step change in input from, say, level 1 to 2, gives precisely the same dynamical output as a step from level 2 to 4, since the steps have the same fold-change. We ask what is the benefit of FCD, and show that FCD is necessary and sufficient for sensory search to be independent of multiplying the input-field by a scalar. Thus the FCD search pattern depends only on the spatial profile of the input, and not on its amplitude. Such scalar symmetry occurs in a wide range of sensory inputs, such as source strength multiplying diffusing/convecting chemical fields sensed in chemotaxis, ambient light multiplying the contrast field in vision, and protein concentrations multiplying the output in cellular signaling-systems.Furthermore, we demonstrate that FCD entails two features found across sensory systems, exact adaptation and Weber's law, but that these two features are not sufficient for FCD. Finally, we present a wide class of mechanisms that have FCD, including certain non-linear feedback and feedforward loops.. We find that bacterial chemotaxis displays feedback within the present class, and hence is expected to show FCD. This can explain experiments in which chemotaxis searches are insensitive to attractant source levels. This study thus suggests a connection between properties of biological sensory systems and scalar symmetry stemming from physical properties of their input-fields.
- ▪E.D. Sontag, "Remarks on Feedforward Circuits, Adaptation, and Pulse Memory", IET Systems Biology, vol. 4, pp. 39-51, 2010. pdfadaptation · feedforward loops · integral feedback · systems biology · transient behavior · incoherent feedforward loop · feedforward · IFFL
Abstract
This note studies feedforward circuits as models for perfect adaptation to step signals in biological systems. A global convergence theorem is proved in a general framework, which includes examples from the literature as particular cases. A notable aspect of these circuits is that they do not adapt to pulse signals, because they display a memory phenomenon. Estimates are given of the magnitude of this effect.