Risk Management And Combinatorial Optimization For Large-Scale Demand Response And Renewable Energy Integration