Quantum Nanophotonics with Ytterbium in Yttrium Orthovanadate