- ▪R. Albert, B. DasGupta, R. Hegde, G.S. Sivanathan, A. Gitter, G. Gürsoy, P. Paul, E.D. Sontag, "A new computationally efficient measure of topological redundancy of biological and social networks", Physical Review E, vol. 84, pp. 036117, 2011. pdf
Abstract
In this paper, we introduce a topological redundancy measure for labeled directed networks that is formal, computationally efficient and applicable to a variety of directed networks such as cellular signaling, metabolic and social interaction networks. We demonstrate the computational efficiency of our measure by computing its value and statistical significance on a number of biological and social networks with up to several thousands of nodes and edges. Our results suggest a number of interesting observations: (1) social networks are more redundant that their biological counterparts, (2) transcriptional networks are less redundant than signaling networks, (3) the topological redundancy of the C. elegans metabolic network is largely due to its inclusion of currency metabolites, and (4) the redundancy of signaling networks is highly (negatively) correlated with monotonicity of their dynamics.
- ▪R. Albert, B. Dasgupta, E.D. Sontag, "Inference of signal transduction networks from double causal evidence", In Computational Biology, Methods in Molecular Biology vol. 673, pp. 239-251, 2010. pdf
Abstract
We present a novel computational method, and related software, to synthesize signal transduction networks from single and double causal evidence.
- ▪B. Dasgupta, P. Vera-Licona, E.D. Sontag, "Reverse engineering of molecular networks from a common combinatorial approach", In Algorithms in computational molecular biology: Techniques, Approaches and Applications, pp. 941-954, 2010. pdf
- ▪R. Albert, B. Dasgupta, R. Dondi, E.D. Sontag, "Inferring (biological) signal transduction networks via transitive reductions of directed graphs", Algorithmica, vol. 51, pp. 129-159, 2008. doipdf
Abstract
The transitive reduction problem is that of inferring a sparsest possible biological signal transduction network consistent with a set of experimental observations, with a goal to minimize false positive inferences even if risking false negatives. This paper provides computational complexity results as well as approximation algorithms with guaranteed performance.
- ▪S. Kachalo, R. Zhang, E.D. Sontag, R. Albert, B. Dasgupta, "NET-SYNTHESIS: A software for synthesis, inference and simplification of signal transduction networks", Bioinformatics, vol. 24, pp. 293 - 295, 2008. pdf
Abstract
This paper presents a software tool for inference and simplification of signal transduction networks. The method relies on the representation of observed indirect causal relationships as network paths, using techniques from combinatorial optimization to find the sparsest graph consistent with all experimental observations. We illustrate the biological usability of our software by applying it to a previously published signal transduction network and by using it to synthesize and simplify a novel network corresponding to activation-induced cell death in large granular lymphocyte leukemia.
- ▪R. Albert, B. DasGupta, R. Dondi, S. Kachalo, E.D. Sontag, A. Zelikovsky, K. Westbrooks, "A novel method for signal transduction network inference from indirect experimental evidence", Journal of Computational Biology, vol. 14, pp. 927-949, 2007. pdf
Abstract
This paper introduces a new method of combined synthesis and inference of biological signal transduction networks. The main idea lies in representing observed causal relationships as network paths, and using techniques from combinatorial optimization to find the sparsest graph consistent with all experimental observations. The paper formalizes the approach, studies its computational complexity, proves new results for exact and approximate solutions of the computationally hard transitive reduction substep of the approach, validates the biological applicability by applying it to a previously published signal transduction network by Li et al., and shows that the algorithm for the transitive reduction substep performs well on graphs with a structure similar to those observed in transcriptional regulatory and signal transduction networks.
- ▪R. Albert, B. DasGupta, R. Dondi, S. Kachalo, E.D. Sontag, A. Zelikovsky, K. Westbrooks, "A novel method for signal transduction network inference from indirect experimental evidence", In 7th Workshop on Algorithms in Bioinformatics (WABI), pp. 407-419, 2007. Conference version of journal paper with same title
- ▪P. Berman, B. Dasgupta, E.D. Sontag, "Algorithmic issues in reverse engineering of protein and gene networks via the modular response analysis method", Annals of the NY Academy of Sciences, vol. 1115, pp. 132-141, 2007. pdfsystems biology · reaction networks · gene and protein networks · reverse engineering · systems identification · graph algorithms
Abstract
This paper studies a computational problem motivated by the modular response analysis method for reverse engineering of protein and gene networks. This set-cover problem is hard to solve exactly for large networks, but efficient approximation algorithms are given and their complexity is analyzed.
- ▪P. Berman, B. Dasgupta, E.D. Sontag, "Randomized approximation algorithms for set multicover problems with applications to reverse engineering of protein and gene networks", Discrete Applied Mathematics Special Series on Computational Molecular Biology, vol. 155, pp. 733-749, 2007. pdfsystems biology · reaction networks · gene and protein networks · systems identification · reverse engineering
Abstract
This paper investigates computational complexity aspects of a combinatorial problem that arises in the reverse engineering of protein and gene networks, showing relations to an appropriate set multicover problem with large "coverage" factor, and providing a non-trivial analysis of a simple randomized polynomial-time approximation algorithm for the problem.
- ▪B. DasGupta, G.A. Enciso, E.D. Sontag, Y. Zhang, "Algorithmic and complexity aspects of decompositions of biological networks into monotone subsystems", BioSystems, vol. 90, pp. 161-178, 2007. pdf
Abstract
A useful approach to the mathematical analysis of large-scale biological networks is based upon their decompositions into monotone dynamical systems. This paper deals with two computational problems associated to finding decompositions which are optimal in an appropriate sense. In graph-theoretic language, the problems can be recast in terms of maximal sign-consistent subgraphs. The theoretical results include polynomial-time approximation algorithms as well as constant-ratio inapproximability results. One of the algorithms, which has a worst-case guarantee of 87.9% from optimality, is based on the semidefinite programming relaxation approach of Goemans-Williamson. The algorithm was implemented and tested on a Drosophila segmentation network and an Epidermal Growth Factor Receptor pathway model.
- ▪B. Dasgupta, G.A. Enciso, E.D. Sontag, Y. Zhang, "Algorithmic and complexity results for decompositions of biological networks into monotone subsystems", In Lecture Notes in Computer Science: Experimental Algorithms: 5th International Workshop, WEA 2006, pp. 253–264, 2006. (Cala Galdana, Menorca, Spain, May 24-27, 2006)
- ▪B. DasGupta, J.P. Hespanha, J. Riehl, E.D. Sontag, "Honey-pot constrained searching with local sensory information", Nonlinear Analysis, vol. 65, pp. 1773-1793, 2006. pdf
Abstract
This paper investigates the problem of searching for a hidden target in a bounded region of the plane by an autonomous robot which is only able to use limited local sensory information. It proposes an aggregation-based approach to solve this problem, in which the continuous search space is partitioned into a finite collection of regions on which we define a discrete search problem and a solution to the original problem is obtained through a refinement procedure that lifts the discrete path into a continuous one. The resulting solution is in general not optimal but one can construct bounds to gauge the cost penalty incurred. The discrete version is formalized and an optimization problem is stated as a `reward-collecting' bounded-length path problem. NP-completeness and efficient approximation algorithms for various cases of this problem are discussed.
- ▪B. Dasgupta, P. Berman, E.D. Sontag, "Computational complexities of combinatorial problems with applications to reverse engineering of biological networks", In Advances in Computational Intelligence: Theory & Applications, pp. 303–316, 2006.
- ▪B. DasGupta, J.P. Hespanha, E.D. Sontag, "Aggregation-based approaches to honey-pot searching with local sensory information", In Proceedings American Control Conf., Boston, June 2004, 2004.
- ▪B. DasGupta, J.P. Hespanha, E.D. Sontag, "Computational complexities of honey-pot searching with local sensory information", In Proceedings American Control Conf., Boston, June 2004, CD-ROM, ThA06.1, IEEE Publications, Piscataway, 2004. pdf
Abstract
In this paper we investigate the problem of searching for a hidden target in a bounded region of the plane, by an autonomous robot which is only able to use limited local sensory information. We formalize a discrete version of the problem as a "reward-collecting" path problem and provide efficient approximation algorithms for various cases.
- ▪B. DasGupta, E.D. Sontag, "A polynomial-time algorithm for checking equivalence under certain semiring congruences motivated by the state-space isomorphism problem for hybrid systems", Theor. Comput. Sci., vol. 262, no. 1-2, pp. 161–189, 2001. doipdf
Abstract
The area of hybrid systems concerns issues of modeling, computation, and control for systems which combine discrete and continuous components. The subclass of piecewise linear (PL) systems provides one systematic approach to discrete-time hybrid systems, naturally blending switching mechanisms with classical linear components. PL systems model arbitrary interconnections of finite automata and linear systems. Tools from automata theory, logic, and related areas of computer science and finite mathematics are used in the study of PL systems, in conjunction with linear algebra techniques, all in the context of a "PL algebra" formalism. PL systems are of interest as controllers as well as identification models. Basic questions for any class of systems are those of equivalence, and, in particular, if state spaces are equivalent under a change of variables. This paper studies this state-space equivalence problem for PL systems. The problem was known to be decidable, but its computational complexity was potentially exponential; here it is shown to be solvable in polynomial-time.
- ▪B. Dasgupta, E.D. Sontag, "A polynomial-time algorithm for an equivalence problem which arises in hybrid systems theory", In Proc.\ IEEE Conf.\ Decision and Control, Tampa, Dec.\ 1998, IEEE Publications, 1998, pp. 1629–1634, 1998.
- ▪B. Dasgupta, E.D. Sontag, "Sample complexity for learning recurrent perceptron mappings", In Advances in Neural Information Processing Systems 8, pp. 204–210, 1996. Proc. NIPS(NeurIPS)-8, Denver, 1995, https://papers.nips.cc/paper_files/paper/1995
- ▪B. DasGupta, E.D. Sontag, "Sample complexity for learning recurrent perceptron mappings", IEEE Trans. Inform. Theory, vol. 42, no. 5, pp. 1479–1487, 1996. pdfmachine learning · artificial intelligence · neural networks · VC dimension · recurrent neural networks
Abstract
Recurrent perceptron classifiers generalize the usual perceptron model. They correspond to linear transformations of input vectors obtained by means of "autoregressive moving-average schemes", or infinite impulse response filters, and allow taking into account those correlations and dependences among input coordinates which arise from linear digital filtering. This paper provides tight bounds on sample complexity associated to the fitting of such models to experimental data. The results are expressed in the context of the theory of probably approximately correct (PAC) learning.
- ▪B. DasGupta, H.T. Siegelmann, E.D. Sontag, "On the complexity of training neural networks with continuous activation functions", IEEE Trans.\ Neural Networks, vol. 6, pp. 1490–1504, 1995. pdfanalog computing · theory of computing · neural networks · computational complexity · machine learning
Abstract
Blum and Rivest showed that any possible neural net learning algorithm based on fixed architectures faces severe computational barriers. This paper extends their NP-completeness result, which applied only to nets based on hard threshold activations, to nets that employ a particular continuous activation. In view of neural network practice, this is a more relevant result to understanding the limitations of backpropagation and related techniques.
- ▪B. DasGupta, H. T. Siegelmann, E.D. Sontag, "On a learnability question associated to neural networks with continuous activations (extended abstract)", In COLT '94: Proceedings of the seventh annual conference on Computational learning theory, pp. 47–56, 1994. doi
- ▪B. DasGupta, H.T. Siegelmann, E.D. Sontag, "On the Intractability of Loading Neural Networks", In Theoretical Advances in Neural Computation and Learning\/, pp. 357–389, 1994. pdf