A Hybrid Quantum Monte Carlo Method For Electron-Phonon Models