Skip to content

Autonomous Driving Turtlebot using BiSeNet segmentation network on RGBD data

Notifications You must be signed in to change notification settings

Shuai-Xie/Wali-turtlebot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Wali-turtlebot

Wali turtlebot is a self-driving turtlebot, using Scene Segmentation on RGBD data to make Path Planning.

auto_drive

1. Hardware

  • Turtlebot2
  • Jetson TX2
  • HIKVISION wireless camera (stereo)
  • Microsoft Kinect v1 (not intense, not outdoor)
  • Intel RealSense R200
  • HiSilicon970 (arm)

2. Wali ROS System Architecture

  • ROS Nodes communication (Service, Topic)
  • Turtlebot motion control using rospy (forward, left, right, back, and smoothly speed up)

wali_arc

3. BiSeNet-RGBD Architecture

bisenet_rgbd

BiSeNet-RGBD is trained on Princeton SUN-RGBD dataset. Now it can predict 37 class, we'll annotate some specific classes in our practical scenario using labelme in the future.

SUNRGB_37_label_map.png

BiSeNet-Wali

Compress BiSeNet with Structure Knowledge Distillation for Real-time image segmentation on wali-TX2.

Test scenes

  • indoor

indoor

  • outdoor

outdoor

Road Test

未设置匀变速运动,速度突变卡顿

添加匀变速运动之后,卡顿问题解决