- ▪F. Albertini, E.D. Sontag, "Continuous control-Lyapunov functions for asymptotically controllable time-varying systems", Internat. J. Control, vol. 72, no. 18, pp. 1630–1641, 1999. pdf
Abstract
This paper shows that, for time varying systems, global asymptotic controllability to a given closed subset of the state space is equivalent to the existence of a continuous control-Lyapunov function with respect to the set.
- ▪F. Albertini, E.D. Sontag, "Control-Lyapunov functions for time-varying set stabilization", In Proc.\ European Control Conf.\/, Brussels, July 1997, 1997. (Paper WE-E A5, CD-ROM file ECC515.pdf, 6 pages)
- ▪F. Albertini, E.D. Sontag, "State observability in recurrent neural networks", Systems Control Lett., vol. 22, no. 4, pp. 235–244, 1994. doipdfmachine learning · artificial intelligence · neural networks · recurrent neural networks · observability · identifiability
Abstract
This paper concerns recurrent networks x'=s(Ax+Bu), y=Cx, where s is a sigmoid, in both discrete time and continuous time. Our main result is that observability can be characterized, if one assumes certain conditions on the nonlinearity and on the system, in a manner very analogous to that of the linear case. Recall that for the latter, observability is equivalent to the requirement that there not be any nontrivial A-invariant subspace included in the kernel of C. We show that the result generalizes in a natural manner, except that one now needs to restrict attention to certain special "coordinate" subspaces.
- ▪F. Albertini, E.D. Sontag, "Further results on controllability properties of discrete-time nonlinear systems", Dynam. Control, vol. 4, no. 3, pp. 235–253, 1994. doipdf
Abstract
Controllability questions for discrete-time nonlinear systems are addressed in this paper. In particular, we continue the search for conditions under which the group-like notion of transitivity implies the stronger and semigroup-like property of forward accessibility. We show that this implication holds, pointwise, for states which have a weak Poisson stability property, and globally, if there exists a global "attractor" for the system.
- ▪F. Albertini, E.D. Sontag, "Uniqueness of weights for recurrent nets", In Systems and Networks: Mathematical Theory and Applications\/, Proc.\ MTNS '93, Vol. 2, Akad.\ Verlag, Regensburg, pp. 599–602, 1993. pdfFull version, never submitted for publication, is here: http://sontaglab.org/FTPDIR/93mtns-nn-extended.pdfmachine learning · artificial intelligence · neural networks · identifiability · recurrent neural networks
Abstract
This paper concerns recurrent networks x'=s(Ax+Bu), y=Cx, where s is a sigmoid, in both discrete time and continuous time. The paper establishes parameter identifiability under stronger assumptions on the activation than in "For neural networks, function determines form", but on the other hand deals with arbitrary (nonzero) initial states.
- ▪F. Albertini, E.D. Sontag, "Controllability of discrete-time nonlinear systems", In Systems and Networks: Mathematical Theory and Applications\/, Proc.\ MTNS '93, Vol. 2, Akad.\ Verlag, Regensburg, pp. 35–38, 1993.
- ▪F. Albertini, E.D. Sontag, "Identifiability of discrete-time neural networks", In Proc.\ European Control Conf.\/, Groningen, June 1993, pp. 460–465, 1993.
- ▪F. Albertini, E.D. Sontag, "Discrete-time transitivity and accessibility: analytic systems", SIAM J. Control Optim., vol. 31, no. 6, pp. 1599–1622, 1993. doipdf
Abstract
A basic open question for discrete-time nonlinear systems is that of determining when, in analogy with the classical continuous-time "positive form of Chow's Lemma", accessibility follows from transitivity of a natural group action. This paper studies the problem, and establishes the desired implication for analytic systems in several cases: (i) compact state space, (ii) under a Poisson stability condition, and (iii) in a generic sense. In addition, the paper studies accessibility properties of the "control sets" recently introduced in the context of dynamical systems studies. Finally, various examples and counterexamples are provided relating the various Lie algebras introduced in past work.
- ▪F. Albertini, E.D. Sontag, "For neural networks, function determines form", Neural Networks, vol. 6, no. 7, pp. 975–990, 1993. pdfmachine learning · artificial intelligence · neural networks · identifiability · recurrent neural networks · realization theory · observability · neural networks
Abstract
This paper shows that the weights of continuous-time feedback neural networks x'=s(Ax+Bu), y=Cx (where s is a sigmoid) are uniquely identifiable from input/output measurements. Under very weak genericity assumptions, the following is true: Assume given two nets, whose neurons all have the same nonlinear activation function s; if the two nets have equal behaviors as "black boxes" then necessarily they must have the same number of neurons and -except at most for sign reversals at each node- the same weights. Moreover, even if the activations are not a priori known to coincide, they are shown to be also essentially determined from the external measurements.
- ▪F. Albertini, E.D. Sontag, "State observability in recurrent neural networks", In Proc.\ IEEE Conf.\ Decision and Control, San Antonio, Dec.\ 1993, IEEE Publications, 1993, pp. 3706–3707, 1993.
- ▪F. Albertini, E.D. Sontag, V. Maillot, "Uniqueness of weights for neural networks", In Artificial Neural Networks for Speech and Vision, pp. 115–125, 1993. pdf
Abstract
In this short expository survey, we sketch various known facts about uniqueness of weights in neural networks, including results about recurrent nets, and we provide a new and elementary complex-variable proof of a uniqueness result that applies in the single hidden layer case.
- ▪F. Albertini, E.D. Sontag, "For neural networks, function determines form", In Proc.\ IEEE Conf.\ Decision and Control, Tucson, Dec.\ 1992, IEEE Publications, 1992, pp. 26–31, 1992.
- ▪F. Albertini, E.D. Sontag, "Some connections between chaotic dynamical systems and control systems", In Proc.\ European Control Conf.\ \/, Vol 1, Grenoble, July 1991, pp. 58–163, 1991. pdf
Abstract
This paper shows how to extend recent results of Colonius and Kliemann, regarding connections between chaos and controllability, from continuous to discrete time. The extension is nontrivial because the results all rely on basic properties of the accessibility Lie algebra which fail to hold in discrete time. Thus, this paper first develops further results in nonlinear accessibility, and then shows how a theorem can be proved, which while analogous to the one given in the work by Colonius and Klieman, also exhibits some important differences. A counterexample is used to show that the theorem given in continuous time cannot be generalized in a straightforward manner.
- ▪F. Albertini, E.D. Sontag, "Accessibility of discrete-time nonlinear systems, and some relations to chaotic dynamics", In Proc.\ Conf.\ Inform.\ Sci.\ and Systems, John Hopkins University, March 1991, pp. 731–736, 1991.
- ▪F. Albertini, E.D. Sontag, "Transitivity and forward accessibility of discrete-time nonlinear systems", In Analysis of controlled dynamical systems (Lyon, 1990), pp. 21–34, 1991.
- ▪F. Albertini, E.D. Sontag, "Some connections between chaotic dynamical systems and control systems", Rutgers Center for Systems and Control, SYCON-90-13, 1990.