This dataset contains over 250k frames of robot navigation in raw crowds in the city of Lausanne, Switzerland with the personal mobility robot Qolo in semi-autonomous navigation. It includes egocentric sets of frontal and rear 3D point clouds from Velodyne VLP-16 and labelled RGBD videos. The dataset is available here DOI:10.21227/ak77-d722, and data processing repository on GitHub.Funded by the EU CrowdBot project.