We devise machine vision methods to perceive structures and objects such that robots act in and learn from every day situations. This paves the way to automated manufacturing and robots performing household tasks. Solutions develop the situated approach to integrate task, robot and perception knowledge. Core expertise is safe navigation, 2D and 3D attention, object modelling, object class detection, affordance-based grasping, and manipulation of objects in relation to object functions.