Grounded Semantic Reasoning for Robotic Interaction with Real-World Objects