Efficient Robotic Manipulation With Scene Knowledge