Kyriakos G. Vamvoudakis

Assistant Professor

  • Ph.D., Electrical Engineering, Automation and Robotics Research Institute, University of Texas at Arlington, USA (2008-2011)
  • M.Sc., Electrical Engineering, Automation and Robotics Research Institute, University of Texas at Arlington, USA (2006-2008)
  • Diploma (5 year degree, M.Sc. equivalent), Electronic and Computer Engineering, Technical University of Crete, Greece (2001-2006)

Control theory, game theory, network security, multi-agent optimization, reinforcement learning.

Assistant Professor Department of Aerospace and Ocean Engineering, Virginia Tech, 2016-present.

  • Research and teaching.

Faculty Lecturer Department of Mechanical Engineering, University of California, Santa Barbara, Winter 2016.

Faculty Project Research Scientist Center for Control, Dynamical-systems, and Computation (CCDC), Department of Electrical and Computer Engineering, University of California, Santa Barbara, (2012-2016).

  • Working in the general area of network security, game theory, smart grid and multi-agent optimization with Professor João P. Hespanha. Under grants:

  • “Bio-inspired Control Systems,” Army Research Office (ARO) grant, W911NF-09-D-0001, 2013-present.

  • “A Cyber Awareness Framework for Attack Analysis, Prediction, and Visualization,” MURI Army Research Office (ARO) grant, W911NF-09-1-0553, 2012-present.

Adjunct Professor Department of Electrical Engineering, The University of Texas at Arlington, (2011-2012)

  • Instructor for the graduate class Linear Systems Engineering. This is the main graduate introductory course on linear system theory. Student evaluation (out of 5): 4.7.

Faculty Research Associate/Research Scientist Automation & Robotics Research Institute, The University of Texas at Arlington, (2011-2012).

  • Working on feedback control theory, approximate dynamic programming and game theory (Nash, Stackelberg, graphical games). Under grants:

  • “Adaptive Dynamic Programming for Real-Time Cooperative Multi-Player Games and Graphical Games,” National Science Foundation (NSF) grant, ECS-1128050, 2011-2012.

  • “Design of Structured Controllers for High Performance DoD Maneuvering Systems Using Neural Networks,” ARO grant, W91NF-05-1-0314, 2008-2012.

  • “Trust Based Collaborative Control for Teams on Communication Networks,” Air Force Office of Scientific Research (AFOSR) grant, FA9550-09-1-0278, 2009-2012.

Research Assistant Automation & Robotics Research Institute, The University of Texas at Arlington, (2006-2011)

  • Working on feedback control theory and approximate dynamic programming. Under grants:

  • “Design of Structured Controllers for High Performance DoD Maneuvering Systems Using Neural Networks,” ARO grant, W91NF-05-1-0314, 2008-2012.

  • “Trust Based Collaborative Control for Teams on Communication Networks,” AFOSR grant, FA9550-09-1-0278, 2009-2012.

  • “Adaptive Critics for Nonlinear Continuous-Time Systems,” NSF grant, ECS-0501451, 2007-2008.

  • “Adaptive Dynamic Programming for Continuous Time Systems and Networked Agents on Graphs,” NSF grant, ECS-0801330, 2008-2011.

Research Assistant Automation Laboratory, Department of Electronic & Computer Engineering, Technical University of Crete, Greece, (2005-2006)

  • Working on systems biology and neural networks for feedback control.

  • International Neural Network Society (INNS) Young Investigator Award, 2016.

  • Senior Member of IEEE, 2015.

  • Inclusion of the 2010 Automatica paper in the IFAC Virtual Special Issue of Annual Reviews in Control (This virtual special issue highlights papers published between 2010 and 2013 that have appeared in the six journals of the IFAC), as one of the papers with the highest citation rates in the control field, 2014.

  • Certificates for Four Research Articles Featured in ScienceDirect Top-25 List of Most Popular (Hottest) Articles in Automatica, Elsevier, 2010-2013.

  • Honor by the Office of the Provost and the University Library for Creative Works and Awards, University of Texas at Arlington, 2011.

  • Best Researcher Award, Automation and Robotics Research Institute, 2011.

  • Best Paper Award for Autonomous/Unmanned Vehicles, 27th Army Science Conference, Orlando, December 2010.

  • Best Presentation Award at the World Congress of Computational Intelligence, Barcelona, July 2010.

  • Invited member of Tau Beta Pi (TBP) and Eta Kappa Nu (HKN) honor engineering societies.

  • Invited member of Golden Key International honor society.

  • Registered Electrical/Computer Engineer (PE), Technical Chamber of Greece (2007).

  • Biography appears in Marquis Who’s Who in the World since 2009, Marquis Who’s Who in Science and Engineering since 2010 and Marquis Who’s Who in Americasince 2012.

  • STEM Doctoral Fellowship (2008, 2009, 2010, 2011).

  • Fellowship of the Greek State Scholarships Foundation (IKY) for the performance at undergraduate studies.

  • Honors for every of the six years high school education from the Greek Ministry of Education (GPA 3.92/4).

K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Optimal Online Adaptive Controller,” U.S. Patent No. 9,134,707, July 2015.

[1] K. G. Vamvoudakis, S. Jagannathan (Eds.), Control of Complex Systems: Theory and Applications, Elsevier, 2016.

[2] D. Vrabie, K. G. Vamvoudakis,  F. L. Lewis, Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles, Control Engineering Series, IET Press, 2012.

[3] K. G. Vamvoudakis, H. Modares, B. Kiumarsi, F. L. Lewis, “Game Theory-Based Control System Algorithms with Real-Time Reinforcement Learning,” to appear in IEEE Control Systems Magazine, 2016.

[4] K. G. Vamvoudakis, A. Mojoodi, H. Ferraz, “Event-Triggered Optimal Tracking Control of Nonlinear Systems,” to appear in International Journal of Robust and Nonlinear Control, 2016.

[5] K. G. Vamvoudakis, M. F. Miranda, J. P. Hespanha, “Asymptotically-Stable Optimal Adaptive Control Algorithm with Saturating Actuators and Relaxed Persistence of Excitation,” to appear in IEEE Transactions on Neural Networks and Learning Systems, 2016.

[6] L. R. Garcia Carrillo, K. G. Vamvoudakis, J. P. Hespanha, “Approximate Optimal Adaptive Control for Weakly Coupled Nonlinear Systems: A Neuro-Inspired Approach,” to appear in International Journal of Adaptive Control and Signal Processing (Special Issue on From Adaptive Control to Variable Structure Systems: Seeking for Harmony), 2016.

[7] F. Tatari, M. B. Naghibi-Sistani, K. G. Vamvoudakis, “Distributed Learning Algorithm for Nonlinear Differential Graphical Games,” to appear in Transactions of the Institute of Measurement and Control, 2016.

[8] Q. Jiao, H. Modares, S. Xu, F. L. Lewis, K. G. Vamvoudakis, “Multi-Agent Zero-Sum Differential Graphical Games for Disturbance Rejection in Cooperative Control,” Automatica, vol. 62, pp. 24-34, 2016. (This paper is included in the most downloaded articles from Automatica in the last 90 days)

[9] K. G. Vamvoudakis, “Non-Zero Sum Nash Q-learning for Unknown Deterministic Continuous-Time Linear Systems,” Automatica, vol. 61, pp. 274-281, 2015.

[10] K. G. Vamvoudakis, “Event-Triggered Optimal Adaptive Control Algorithm for Continuous-Time Nonlinear Systems,” IEEE/CAA Journal of Automatica Sinica (Special Issue on Extensions of Reinforcement Learning and Adaptive Control), vol. 1, no. 3, pp. 282-293, 2014. (This paper is No. 8 in the Top 50 most popular documents in IEEE/CAA Journal of Automatica Sinica, February, 2015)

[11] M. I. Abouheaf, F. L. Lewis, K. G. Vamvoudakis, S. Haesaert, R. Babuska, “Multi-Agent Discrete-Time Graphical Games and Reinforcement Learning Solutions,” Automatica, vol. 50, no. 12, pp. 3038-3053, 2014.

[12] K. G. Vamvoudakis, J. P. Hespanha, B. Sinopoli, Y. Mo, “Detection in Adversarial Environments,” IEEE Transactions on Automatic Control (Special Issue on Control of Cyber-Physical Systems), vol. 59, no. 12, pp. 3209-3223, 2014. (This paper was No. 12 in the Top 50 most popular documents in IEEE Transactions on Automatic Control, December, 2014)

[13] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Online Learning Algorithm for Optimal Control with Integral Reinforcement Learning,” International Journal of Robust and Nonlinear Control, vol. 24, no. 17, pp. 2686-2710, 2014.

[14] S. Bhasin, R. Kamalapurkar, M. Johnson, K. G. Vamvoudakis, F. L. Lewis, W. E. Dixon, “A Novel Actor-Critic-Identifier Architecture for Approximate Optimal Control of Uncertain Nonlinear Systems,” Automatica, vol. 49, no. 1, pp. 82-92, 2013. (This paper was No. 18 in the Top 25 Hottest Articles in Automatica, Elsevier, October-December, 2012)

[15] F. L. Lewis, D. Vrabie, K. G. Vamvoudakis, “Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers,” IEEE Control Systems Magazine, vol. 32, no. 6, pp. 76-105, 2012. (This paper is listed in the Top 25 Most Accessed Articles, IEEE Control Systems, 2013-2015)

[16] K. G. Vamvoudakis, F. L. Lewis, G. R. Hudas, “Multi-Agent Differential Graphical Games: Online Adaptive Learning Solution for Synchronization with Optimality,” Automatica, vol. 48, no. 8, pp. 1598-1611, 2012. (This paper was No. 5 in the Top 25 Hottest Articles in Automatica, Elsevier, July-September, 2012)

[17] K. G. Vamvoudakis, F. L. Lewis, “Online Neural Network Solution of Nonlinear Two-Player Zero-Sum Games Using Synchronous Policy Iteration,” International Journal of Robust and Nonlinear Control, vol. 22, no. 13, pp. 1460-1483, 2012.

[18] G. Hudas, K. G. Vamvoudakis, D. Mikulski, F. L. Lewis, “Online Adaptive Learning for Team Strategies in Multi-Agent Systems,” The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology (Special Issue on Intelligent Behaviors in Tactical Unmanned Systems), vol. 9, no. 1, pp. 59-69, 2012. (This paper is the Most-Read Article since last year, SAGE Journals, 2012-present)

[19] K. G. Vamvoudakis, F. L. Lewis, “Multi-Player Non Zero-Sum Games: Online Adaptive Learning Solution of Coupled Hamilton-Jacobi Equations,” Automatica, vol. 47, no. 8, pp. 1556-1569, 2011. (This paper was No. 17 in the Top 25 Hottest Articles in Automatica, Elsevier, July-September, 2011)

[20] F. L. Lewis, K. G. Vamvoudakis, “Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 41, no. 1, pp. 14-25, 2011. (This paper is the Top Article in Computational Intelligence, BioMedLib, February 2011-present)

[21] K. G. Vamvoudakis, F. L. Lewis, “Online Actor-Critic Algorithm to Solve the Continuous-Time Infinite Horizon Optimal Control Problem,” Automatica, vol. 46, no. 5, pp. 878-888, 2010. (This paper is selected to be included in the Virtual Special Issue of Annual Reviews in Control, as one of the papers with the highest citation rates in the control field. This paper is in the list of the most cited Automatica articles published after 2009 according to Scopus. This paper was No. 23 in the Top 25 Articles in Automatica, Elsevier, April-September 2010)

Chair/Advisory Board

Editorship

Journal Editorial Board Member

Technical Committee Member

  • Adaptive Dynamic Programming and Reinforcement Learning (ADPRLTC), IEEE Computational Intelligence Society, (2013-present)

  • Intelligent Control (TCIC), IEEE Control Systems Society, (2012-present)

Chair and/or Organizer

  • Invited Session on Event-Triggered and Self-Triggered Control for Linear Systems, IEEE Conference on Decision and Control, Las Vegas, NV, 2016

  • Session on Optimal Control and Learning, American Control Conference, Boston, MA, 2016

  • Session on Anti-Windup and PID Control, American Control Conference, Boston, MA, 2016

  • Invited Session on Approximate/Adaptive Dynamic Programming for Control of Cyber-physical Systems, International Joint Conference on Neural Networks (IJCNN), Vancouver, Canada, 2016

  • Workshop on Recent Advances and Future Directions on Adaptation and Control, Chicago, IL, 2015

  • Invited Tutorial Session on Autonomy and Machine Intelligence in Complex Systems, American Control Conference, Chicago, IL, 2015

  • Session on Cooperative Control II, American Control Conference, Chicago, IL, 2015

  • Session on Adaptive Control I, American Control Conference, Portland, OR, 2014

  • Session on Optimal Control IV, American Control Conference, Washington, DC, 2013

  • Session on Intelligent Behaviors, SPIE Defense, Security, and Sensing, Baltimore, Maryland, 2013

  • Session on Cyber-Security III, Workshop on Control of Cyber-Physical Systems, Johns Hopkins University, 2013

  • Invited Session on Reinforcement Learning, Approximation Based Control, and Games, IEEE Multi-Conference on Systems and Control (MSC), CO, 2011

  • Invited Session on Approximate Dynamic Programming with feedback Control Applications, International Joint Conference on Neural Networks (IJCNN), Barcelona, 2010

International Program Committee Member

  • Robotics: Science and Systems Conference (RSS), 2016

  • IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), 2016

  • International Conference on Adaptive and Self-Adaptive Systems and Applications (ADAPTIVE), 2016

  • IEEE International Conference on Control, Measurement and Instrumentation (CMI), 2016

  • International Conference on Innovations in Computational Intelligence and Its Applications (ICICI), 2016

  • IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), 2015

  • IEEE Multi-Conference on Systems and Control (MSC), 2015

  • International Conference on Intelligent Information Processing, Security and Advanced Communication (IPAC 2015), 2015

  • International Conference on Artificial Intelligence and Robots (AIAR), 2015

  • IEEE Multi-Conference on Systems and Control (MSC), 2014

  • IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), 2014

  • International Joint Conference on Neural Networks (IJCNN), 2014

  • IEEE Multi-Conference on Systems and Control (MSC), 2013

  • IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), 2013

  • IEEE Multi-Conference on Systems and Control (MSC), 2012

  • IEEE Multi-Conference on Systems and Control (MSC), 2011

Reviewer and Referee for Various Scholarly Publications and Funding Agencies

  • Proposal reviews for NSF, Austrian Science Fund, Icelandic Research Fund.

  • Book reviews for Springer, Prentice Hall, CRC Press (Taylor & Francis Group).

  • Various IEEE Transactions (Automatic Control; Systems, Man and Cybernetics – Parts A, B, C; Neural Networks and Learning Systems; Mechatronics; Control Systems Technology; Magnetics; Automation Science and Engineering; Industrial Informatics), Automatica, IEEE Control Systems Magazine, International Journal of Robust and Nonlinear Control, SIAM Journal on Control and Optimization, Systems and Control Letters, International Journal of Control, Journal of the Franklin Institute, IET Control Theory and Applications, International Journal of Adaptive Control and Signal Processing, Journal of Control Theory and Applications, International Journal of Neural Systems, Neural Networks, Journal of Optimal Control Applications and Methods, Transactions of the Institute of Measurement and Control, Control Engineering Practice, ACM Transactions on Autonomous and Adaptive Systems, Information Sciences, Neurocomputing, Neural Computing and Applications, Robotica, IMA Journal of Mathematical Control and Information, Journal of Defense Modeling and Simulation, Ad Hoc Networks.

  • Technical meetings and conferences, e.g. IEEE Conference on Decision and Control, American Control Conference, IFAC World Congress, European Control Conference, IEEE Multi-Conference on Systems and Control (MSC), IEEE International Conference on Control & Automation, International Joint Conference on Neural Networks, IEEE Mediterranean Conference on Control and Automation, IEEE Symposium Series on Computational Intelligence (IEEE ADPRL).

Dr.  Kyriakos G. Vamvoudakis
Dr. Kyriakos G. Vamvoudakis
  • (540) 231-6707
  • kyriakos@vt.edu
  • Aerospace & Ocean Engineering (MC0203)
    Randolph Hall, RM 226, Virginia Tech
    460 Old Turner St.
    Blacksburg, VA 24061