Laboratory for Control, Learning, and Systems Biology

observability

2025
  1. D. Biswas, E.D Sontag, N.J. Cowan, "An exact active sensing strategy for a class of bio-inspired systems", European Journal of Control, 2025. wwwpdf
    Also in Proc. 23rd European Control Conference, and longer version in https://arxiv.org/abs/2411.06612.
    Abstract

    We consider a general class of translation-invariant systems with a specific category of output nonlinearities motivated by biological sensing. We show that no dynamic output feedback can stabilize this class of systems to an isolated equilibrium point. To overcome this fundamental limitation, we propose a simple control scheme that includes a low-amplitude periodic forcing function akin to so-called "active sensing" in biology, together with nonlinear output feedback. Our analysis shows that this approach leads to the emergence of an exponentially stable limit cycle. These findings offer a provably stable active sensing strategy and may thus help to rationalize the active sensing movements made by animals as they perform certain motor behaviors.

2022
  1. E.D. Sontag, D. Biswas, N.J. Cowan, "An observability result related to active sensing", arXiv, 2022. pdf
    arXiv 2210.03848
    Abstract

    For a general class of translationally invariant systems with a specific category of nonlinearity in the output, this paper presents necessary and sufficient conditions for global observability. Critically, this class of systems cannot be stabilized to an isolated equilibrium point by dynamic output feedback. These analyses may help explain the active sensing movements made by animals when they perform certain motor behaviors, despite the fact that these active sensing movements appear to run counter to the primary motor goals. The findings presented here establish that active sensing underlies the maintenance of observability for such biological systems, which are inherently nonlinear due to the presence of the high-pass sensor dynamics.

2017
  1. E.D. Sontag, "Dynamic compensation, parameter identifiability, and equivariances", PLoS Computational Biology, vol. 13, pp. e1005447, 2017. wwwpdf
    (Preprint was in bioRxiv https://doi.org/0.1101/095828, 2016)
    Abstract

    A recent paper by Karin et al. introduced a mathematical notion called dynamical compensation (DC) of biological circuits. DC was shown to play an important role in glucose homeostasis as well as other key physiological regulatory mechanisms. Karin et al.\ went on to provide a sufficient condition to test whether a given system has the DC property. Here, we show how DC is a reformulation of a well-known concept in systems biology, statistics, and control theory – that of parameter structural non-identifiability. Viewing DC as a parameter identification problem enables one to take advantage of powerful theoretical and computational tools to test a system for DC. We obtain as a special case the sufficient criterion discussed by Karin et al. We also draw connections to system equivalence and to the fold-change detection property.

2009
  1. E.D. Sontag, Y. Wang, A. Megretski, "Input classes for identification of bilinear systems", IEEE Transactions Autom. Control, vol. 54, pp. 195-207, 2009. pdf
    Also arXiv math.OC/0610633, 20 Oct 2006, and short version in ACC'07.
    Abstract

    This paper asks what classes of input signals are sufficient in order to completely identify the input/output behavior of generic bilinear systems. The main results are that step inputs are not sufficient, nor are single pulses, but the family of all pulses (of a fixed amplitude but varying widths) do suffice for identification.

2007
  1. E.D. Sontag, Y. Wang, "Uniformly Universal Inputs", In Analysis and Design of Nonlinear Control Systems, pp. 9-24, 2007. pdf
    Abstract

    A result is presented showing the existence of inputs universal for observability, uniformly with respect to the class of all continuous-time analytic systems. This represents an ultimate generalization of a 1977 theorem, for bilinear systems, due to Alberto Isidori and Osvaldo Grasselli.

  2. E.D. Sontag, Y. Wang, A. Megretski, "Remarks on Input Classes for Identification of Bilinear Systems", In Proceedings American Control Conf., New York, July 2007, pp. 4345-4350, 2007.
2005
  1. J.P. Hespanha, D. Liberzon, D. Angeli, E.D. Sontag, "Nonlinear norm-observability notions and stability of switched systems", IEEE Trans. Automat. Control, vol. 50, no. 2, pp. 154–168, 2005. pdf
    Abstract

    This paper proposes several definitions of observability for nonlinear systems and explores relationships among them. These observability properties involve the existence of a bound on the norm of the state in terms of the norms of the output and the input on some time interval. A Lyapunov-like sufficient condition for observability is also obtained. As an application, we prove several variants of LaSalle's stability theorem for switched nonlinear systems. These results are demonstrated to be useful for control design in the presence of switching as well as for developing stability results of Popov type for switched feedback systems.

2002
  1. J.P. Hespanha, D. Liberzon, E.D. Sontag, "Nonlinear observability and an invariance principle for switched systems", In Proc.\ IEEE Conf.\ Decision and Control, Las Vegas, Dec.\ 2002, IEEE Publications, pp. 4300–4305, 2002. pdf
  2. E.D. Sontag, "For differential equations with r parameters, 2r+1 experiments are enough for identification", J. Nonlinear Sci., vol. 12, no. 6, pp. 553–583, 2002. pdf
    Abstract

    Given a set of differential equations whose description involves unknown parameters, such as reaction constants in chemical kinetics, and supposing that one may at any time measure the values of some of the variables and possibly apply external inputs to help excite the system, how many experiments are sufficient in order to obtain all the information that is potentially available about the parameters? This paper shows that the best possible answer (assuming exact measurements and real analiticity) is 2r+1 experiments, where r is the number of parameters.

2001
  1. A. C. Antoulas, E. D. Sontag, Y. Yamamoto, "Controllability and Observability", In Wiley Encyclopedia of Electrical and Electronics Engineering, pp. 264-281, 2001. wwwdoipdf
  2. M. Chaves, E.D. Sontag, "Observers for certain chemical reaction networks", In Proc.\ 2001 European Control Conf., Sep.\ 2001, pp. 3715–3720, 2001.
1999
  1. D. Angeli, E.D. Sontag, "Forward completeness, unboundedness observability, and their Lyapunov characterizations", Systems Control Lett., vol. 38, no. 4-5, pp. 209–217, 1999. pdf
    Abstract

    A finite-dimensional continuous-time system is forward complete if solutions exist globally, for positive time. This paper shows that forward completeness can be characterized in a necessary and sufficient manner by means of smooth scalar growth inequalities. Moreover, a version of this fact is also proved for systems with inputs, and a generalization is also provided for systems with outputs and a notion (unboundedness observability) of relative completeness. We apply these results to obtain a bound on reachable states in terms of energy-like estimates of inputs.

1995
  1. E.D. Sontag, "Spaces of observables in nonlinear control", In Proceedings of the International Congress of Mathematicians, Vol.\ 1, 2 (Zürich, 1994), pp. 1532–1545, 1995. pdf
    Abstract

    Invited talk at the 1994 ICM. Paper deals with the notion of observables for nonlinear systems, and their role in realization theory, minimality, and several control and path planning questions.

  2. E.D. Sontag, "From linear to nonlinear: some complexity comparisons", In Proc.\ IEEE Conf.\ Decision and Control, New Orleans, Dec.\ 1995, IEEE Publications, 1995, pp. 2916–2920, 1995. pdf
    Abstract

    This paper deals with the computational complexity, and in some cases undecidability, of several problems in nonlinear control. The objective is to compare the theoretical difficulty of solving such problems to the corresponding problems for linear systems. In particular, the problem of null-controllability for systems with saturations (of a "neural network" type) is mentioned, as well as problems regarding piecewise linear (hybrid) systems. A comparison of accessibility, which can be checked fairly simply by Lie-algebraic methods, and controllability, which is at least NP-hard for bilinear systems, is carried out. Finally, some remarks are given on analog computation in this context.

  3. Y. Wang, E.D. Sontag, "Orders of input/output differential equations and state-space dimensions", SIAM J. Control Optim., vol. 33, no. 4, pp. 1102–1126, 1995. doipdf
    Abstract

    This paper deals with the orders of input/output equations satisfied by nonlinear systems. Such equations represent differential (or difference, in the discrete-time case) relations between high-order derivatives (or shifts, respectively) of input and output signals. It is shown that, under analyticity assumptions, there cannot exist equations of order less than the minimal dimension of any observable realization; this generalizes the known situation in the classical linear case. The results depend on new facts, themselves of considerable interest in control theory, regarding universal inputs for observability in the discrete case, and observation spaces in both the discrete and continuous cases. Included in the paper is also a new and simple self-contained proof of Sussmann's universal input theorem for continuous-time analytic systems.

1994
  1. F. Albertini, E.D. Sontag, "State observability in recurrent neural networks", Systems Control Lett., vol. 22, no. 4, pp. 235–244, 1994. doipdf
    Abstract

    This paper concerns recurrent networks x'=s(Ax+Bu), y=Cx, where s is a sigmoid, in both discrete time and continuous time. Our main result is that observability can be characterized, if one assumes certain conditions on the nonlinearity and on the system, in a manner very analogous to that of the linear case. Recall that for the latter, observability is equivalent to the requirement that there not be any nontrivial A-invariant subspace included in the kernel of C. We show that the result generalizes in a natural manner, except that one now needs to restrict attention to certain special "coordinate" subspaces.

  2. E.D. Sontag, Y. Wang, "Orders of I/O equations and uniformly universal inputs", In Proc.\ IEEE Conf.\ Decision and Control, Orlando, Dec.\ 1994, IEEE Publications, 1994, pp. 1270–1275, 1994.
1993
  1. F. Albertini, E.D. Sontag, "For neural networks, function determines form", Neural Networks, vol. 6, no. 7, pp. 975–990, 1993. pdf
    Abstract

    This paper shows that the weights of continuous-time feedback neural networks x'=s(Ax+Bu), y=Cx (where s is a sigmoid) are uniquely identifiable from input/output measurements. Under very weak genericity assumptions, the following is true: Assume given two nets, whose neurons all have the same nonlinear activation function s; if the two nets have equal behaviors as "black boxes" then necessarily they must have the same number of neurons and -except at most for sign reversals at each node- the same weights. Moreover, even if the activations are not a priori known to coincide, they are shown to be also essentially determined from the external measurements.

  2. F. Albertini, E.D. Sontag, "State observability in recurrent neural networks", In Proc.\ IEEE Conf.\ Decision and Control, San Antonio, Dec.\ 1993, IEEE Publications, 1993, pp. 3706–3707, 1993.
  3. R. Koplon, E.D. Sontag, "Linear systems with sign-observations", SIAM J. Control Optim., vol. 31, no. 5, pp. 1245–1266, 1993. doipdf
    Abstract

    This paper deals with systems that are obtained from linear time-invariant continuous- or discrete-time devices followed by a function that just provides the sign of each output. Such systems appear naturally in the study of quantized observations as well as in signal processing and neural network theory. Results are given on observability, minimal realizations, and other system-theoretic concepts. Certain major differences exist with the linear case, and other results generalize in a surprisingly straightforward manner.

1992
  1. E.D. Sontag, Y. Wang, "I/O equations in discrete and continuous time", In Proc.\ IEEE Conf.\ Decision and Control, Tucson, Dec.\ 1992, IEEE Publications, 1992, pp. 3661–3662, 1992.
  2. Y. Wang, E.D. Sontag, "Generating series and nonlinear systems: analytic aspects, local realizability, and i/o representations", Forum Math., vol. 4, no. 3, pp. 299–322, 1992. pdf
    Abstract

    This paper studies fundamental analytic properties of generating series for nonlinear control systems, and of the operators they define. It then applies the results obtained to the extension of facts, which relate realizability and algebraic input/output equations, to local realizability and analytic equations.

  3. Y. Wang, E.D. Sontag, "Algebraic differential equations and rational control systems", SIAM J. Control Optim., vol. 30, no. 5, pp. 1126–1149, 1992. pdf
    Abstract

    It is shown that realizability of an input/output operators by a finite-dimensional continuous-time rational control system is equivalent to the existence of a high-order algebraic differential equation satisfied by the corresponding input/output pairs ("behavior"). This generalizes, to nonlinear systems, the classical equivalence between autoregressive representations and finite dimensional linear realizability.

1991
  1. R. Schwarzschild, E.D. Sontag, "Quantized systems, saturated measurements, and sign-linear systems", In Proc.\ Conf.\ Inform.\ Sci.\ and Systems, John Hopkins University, March 1991, pp. 134–139, 1991.
  2. E.D. Sontag, Y. Wang, "I/O equations for nonlinear systems and observation spaces", In Proc.\ IEEE Conf.\ Decision and Control, Brighton, UK, Dec.\ 1991, IEEE Publications, 1991, pp. 720–725, 1991. pdf
    Abstract

    This paper studies various types of input/output representations for nonlinear continuous time systems. The algebraic and analytic i/o equations studied in previous papers by the authors are generalized to integral and integro-differential equations, and an abstract notion is also considered. New results are given on generic observability, and these results are then applied to give conditions under which that the minimal order of an equation equals the minimal possible dimension of a realization, just as with linear systems but in contrast to the discrete time nonlinear theory.

1990
  1. E.D. Sontag, Y. Wang, "Input/output equations and realizability", In Realization and modelling in system theory (Amsterdam, 1989), pp. 125–132, 1990. pdf
  2. Y. Wang, E.D. Sontag, "Realization of families of generating series: differential algebraic and state space equations", In Proc.\ 11th IFAC World Congress\/, Tallinn, former USSR, 1990, pp. 62–66, 1990.
1989
  1. Y. Wang, E.D. Sontag, "On two definitions of observation spaces", Systems Control Lett., vol. 13, no. 4, pp. 279–289, 1989. doipdf
    Abstract

    This paper establishes the equality of the observation spaces defined by means of piecewise constant controls with those defined in terms of differentiable controls.

  2. Y. Wang, E.D. Sontag, "A new result on the relation between differential-algebraic realizability and state space realizations", In Proc.\ Conf.\ Info.\ Sciences and Systems, Johns Hopkins University Press, 1989, pp. 143–147, 1989.
  3. Y. Wang, E.D. Sontag, "Realization and input/output relations: the analytic case", In Proceedings of the 28th IEEE Conference on Decision and Control, Vol.\ 1–3 (Tampa, FL, 1989), pp. 1975–1980, 1989.
1988
  1. E.D. Sontag, "Bilinear realizability is equivalent to existence of a singular affine differential I/O equation", Systems Control Lett., vol. 11, no. 3, pp. 181–187, 1988. doipdf
    Abstract

    For continuous time analytic input/output maps, the existence of a singular differential equation relating derivatives of controls and outputs is shown to be equivalent to bilinear realizability. A similar result holds for the problem of immersion into bilinear systems. The proof is very analogous to that of the corresponding, and previously known, result for discrete time.

1987
  1. E.D. Sontag, "Reachability, observability, and realization of a class of discrete-time nonlinear systems", In Encycl.\ of Systems and Control, pp. 3288–3293, 1987.
1984
  1. E.D. Sontag, "A concept of local observability", Systems Control Lett., vol. 5, no. 1, pp. 41–47, 1984. pdf
    Abstract

    A notion of local observability, which is natural in the context of nonlinear input/output regulation. is introduced. A simple characterization is provided, a comparison is made with other local nonlinear observability definitions. and its behavior under constant-rate sampling is analyzed.

1980
  1. M. L. J. Hautus, E.D. Sontag, "An approach to detectability and observers", In Algebraic and geometric methods in linear systems theory (AMS-NASA-NATO Summer Sem., Harvard Univ., Cambridge, Mass., 1979), pp. 99–135, 1980. pdf
    Abstract

    This paper proposes an approach to the problem of establishing the existence of observers for deterministic dynamical systems. This approach differs from the standard one based on Luenberger observers in that the observation error is not required to be Markovian given the past input and output data. A general abstract result is given, which special- izes to new results for parametrized families of linear systems, delay systems and other classes of systems. Related problems of feedback control and regulation are also studied.

1979
  1. E.D. Sontag, "On the observability of polynomial systems. I. Finite-time problems", SIAM J. Control Optim., vol. 17, no. 1, pp. 139–151, 1979. pdf
    Abstract

    Different notions of observability are compared for systems defined by polynomial difference equations. The main result states that, for systems having the standard property of (multiple-experiment initial-state) observability, the response to a generic input sequence is sufficient for final-state determination. Some remarks are made on results for nonpolynomial and/or continuous-time systems. An identifiability result is derived from the above.

1976
  1. E.D. Sontag, Y. Rouchaleau, "On discrete-time polynomial systems", Nonlinear Anal., vol. 1, no. 1, pp. 55–64, 1976. pdf
    Abstract

    Considered here are a type of discrete-time systems which have algebraic constraints on their state set and for which the state transitions are given by (arbitrary) polynomial functions of the inputs and state variables. The paper studies reachability in bounded time, the problem of deciding whether two systems have the same external behavior by applying finitely many inputs, the fact that finitely many inputs (which can be chosen quite arbitrarily) are sufficient to separate those states of a system which are distinguishable, and introduces the subject of realization theory for this class of systems.

  2. E.D. Sontag, "On finitely accessible and finitely observable rings", J. Pure Appl. Algebra, vol. 8, no. 1, pp. 97–104, 1976. pdf
    Abstract

    Two classes of rings which occur in linear system theory are introduced and compared. Characterizations of one of them are given in terms, of integral extensions (every finite extension of R is integral) and Cayley–Hamilton type matrix condition. A comparison is made in the case of no zero-divisors with Ore domains.