Vishnu Nanduri, PhD

Research

Reinforcement learning, game theory, and stochastic optimization, applied to deregulated electricity markets, carbon markets, and the energy-water-climate nexus.

Cited

550 citations and an h-index of 9. Work from the research years is still being cited today.

Google Scholar profile

Citations per yearGoogle Scholar, as of Oct 2026. 2026 is the year to date.
  1. 22007
  2. 62008
  3. 212009
  4. 272010
  5. 332011
  6. 272012
  7. 292013
  8. 302014
  9. 322015
  10. 422016
  11. 352017
  12. 402018
  13. 372019
  14. 412020
  15. 302021
  16. 292022
  17. 372023
  18. 262024
  19. 152025
  20. 92026
View as table
YearCitations
20072
20086
200921
201027
201133
201227
201329
201430
201532
201642
201735
201840
201937
202041
202130
202229
202337
202426
202515
2026 (to date)9

From the papers

The math behind the work: reinforcement learning and game theory for electricity and carbon markets.

Title block of the 2007 IEEE Transactions on Power Systems paper: A Reinforcement Learning Model to Assess Market Power Under Auction-Based Energy Pricing, by Vishnuteja Nanduri and Tapas K. Das.
My most cited paper, still cited in market design and reinforcement learning research.
  • Equations 8 and 9 from the 2007 paper: the R-value update rule and the average-reward update for each generator.
    The learning update: how each generator revises its bid values from market rewards.IEEE Transactions on Power Systems, 2007
  • One-line diagram of a 12-bus power network with seven generators and three load buses.
    The 12-bus test network the agents learned to bid on.IEEE Transactions on Power Systems, 2007
  • Equations defining the gain and bias equilibrium values and the long-run average reward for each player.
    Average-reward equilibrium values for n-player stochastic games.IIE Transactions, 2009
  • Definitions of value at risk and the conditional value at risk estimator, equation 1.
    Risk in the investment game: value at risk and conditional value at risk.IEEE Transactions on Power Systems, 2009

Journal articles

  1. 2015

    An Application of Analytics in Green Electricity Markets with Cap-and-Trade Programs

    Nanduri, V. and Otieno, W.

    Engineering Management Journal, April 2015

  2. 2015

    Impact of CO2 Cap-and-Trade Programs on Restructured Power Markets with Generation Capacity Investments

    Rocha, P., Das, T. K., Nanduri, V. and Botterud, A.

    International Journal of Electrical Power and Energy Systems, 71, 195 to 208

    DOI
  3. 2013

    A Competitive Markov Decision Process Model for the Energy-Water-Climate Change Nexus

    Nanduri, V. and Saavedra, I.

    Applied Energy, 111, 186 to 198

    DOI
  4. 2012DOI
  5. 2011DOI
  6. 2009DOI
  7. 2009

    A Survey of Critical Research Areas in the Energy Segment of Restructured Electricity Markets

    Nanduri, V. and Das, T. K.

    International Journal of Electrical Power and Energy Systems, 31(5), 181 to 191

    Number two on ScienceDirect's most downloaded list for the journal, April to June 2009.

    DOI
  8. 2009

    Generation Capacity Expansion in Energy Markets Using a Two-Level Game-Theoretic Model

    Nanduri, V., Das, T. K. and Rocha, P.

    IEEE Transactions on Power Systems, 24(3), 1165 to 1172

    DOI
  9. 2007

    A Reinforcement Learning Model to Assess Market Power under Auction-Based Energy Pricing

    Nanduri, V. and Das, T. K.

    IEEE Transactions on Power Systems, 22(1), 85 to 95

    Still cited in reinforcement learning and electricity market research today.

    DOI
  10. 2006

    Educating the STARS

    Okogbaa, G., Das, T. K., Martin-Vega, L., Centeno, G., Otieno, W. and Nanduri, V.

    Industrial Engineer, September 2006

Book chapter

  1. 2012

    A Survey of Carbon Market Mechanisms and Models

    Nanduri, V. and Kazemzadeh, N.

    Handbook of CO2 in Power Systems, Springer, pp. 89 to 105

    DOI

Conference papers

  1. 2011

    Application of Reinforcement Learning-based Algorithms in CO2 Allowance and Electricity Markets

    Nanduri, V.

    IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), Paris

    DOI
  2. 2011

    Assessing the Impact of Different Auction-based CO2 Allowance Allocation Mechanisms

    Nanduri, V. and Otieno, W.

    IEEE PES General Meeting, Detroit

    DOI
  3. 2008

    A Game Theoretic Approach for Generation Capacity Expansion in Restructured Power Markets

    Nanduri, V. and Das, T. K.

    IEEE PES General Meeting, Pittsburgh

    DOI

Theses

  1. Generation Expansion Planning in Restructured Energy Markets

    Nanduri, V.

    PhD dissertation, University of South Florida

    USF Outstanding Dissertation Award.

  2. Auction Performance Evaluation in Deregulated Electricity Markets

    Nanduri, V.

    MS thesis, University of South Florida

    First prize, IIE Graduate Research Award for Best Masters Thesis.

Awards

  • Teaching Excellence Award, College of Engineering and Applied Science, University of Wisconsin-Milwaukee
  • Outstanding Dissertation Award, University of South Florida
  • Best Paper, Energy sponsored sessions, INFORMS Annual Meeting
  • Judith Liebman Award, for outstanding service to the INFORMS student chapter at USF
  • First prize, IIE Graduate Research Award, best masters thesis
  • Finalist, best poster, INFORMS Annual Meeting

Service

  • Chair, IEEE Power and Energy Society, Milwaukee chapter
  • Secretary and Treasurer, INFORMS Energy, Natural Resources and the Environment section
  • Energy Track Chair, Industrial and Systems Engineering Research Conference (two years)
  • Energy Track Chair, INFORMS Annual Meeting
  • Faculty advisor, INFORMS student chapter, University of Wisconsin-Milwaukee
  • Founding member, UWM Energy Analytics Research Group

Reviewer for

  • IEEE Transactions on Power Systems
  • IEEE Transactions on Smart Grid
  • IEEE Transactions on Sustainable Energy
  • IIE Transactions
  • European Journal of Operational Research
  • Applied Energy
  • International Journal of Electrical Power and Energy Systems
  • Energy Journal
  • Energy Systems