Application Open:
Full-Time
Job Purpose:
MBZUAI is seeking an engineer to develop cutting-edge computer vision and perception systems that enable robotic embodiments to understand and interact with complex real-world environments. You will create multimodal sensing systems that provide rich environmental awareness for shared autonomy applications, enhancing the safety and capability of neurally-controlled robotic systems.
Key Responsibilities:
Computer Vision & Object Detection:
- Develop real-time object detection and recognition systems for manipulation tasks.
- Create robust pose estimation algorithms for 6DOF object tracking.
- Implement semantic scene understanding for contextual task planning.
- Design visual serving systems for precise manipulation guidance.
Multimodal Sensor Fusion:
- Integrate RGB-D cameras, force sensors, and tactile feedback for comprehensive perception.
- Develop sensor fusion algorithms that combine visual, proprioceptive, and tactile information.
- Create robust perception systems that handle occlusions, lighting changes, and dynamic environments.
- Design failure detection and recovery systems for sensor malfunctions.
Shared Autonomy Perception:
- Build intent prediction systems that anticipate user goals from visual context.
- Develop environmental constraint detection for safe motion planning.
- Create assistance systems that provide visual feedback to users about robot state.
- Design adaptive perception systems that learn user preferences and task patterns.
Real-Time Processing & Integration:
- Optimize perception algorithms for real-time performance on embedded systems.
- Develop efficient data processing pipelines for high-bandwidth sensor streams.
- Create robust calibration and synchronization systems for multiple sensors.
- Implement perception quality monitoring and adaptive sensing strategies.
Project Statistics & Reporting:
- Monitor and evaluate project milestones and deliverables, ensuring accurate tracking of task completion and adherence to timelines.
- Compile and present concise reports and performance dashboards for management and stakeholders, highlighting progress, risks, and outcomes.
- Generate actionable insights from project data to optimize execution, resource utilization, and overall research effectiveness.
Other Duties:
- Perform all other duties as reasonably directed by the line manager that are commensurate with these functional objectives.
Academic Qualification:
- Bachelor degree in Computer Science, Electrical Engineering, or related field.
- A postgraduate degree will be strongly preferred.
Professional Experience:
Essential
- Minimum 2 years with computer vision and 3D perception systems, or a related technical field.
- Strong programming skills in Python and C++, experience with OpenCV.
- Knowledge of deep learning for vision applications.
- Experience with camera systems and 3D sensors (RGB-D, LiDAR).
- Understanding of 3D geometry and coordinate transformations.
Preferred
- Experience with real-time robotics perception and sensor fusion.
- Background in object detection, tracking, and pose estimation.
- Knowledge of ROS and robotics software development.
- Experience with point cloud processing and 3D reconstruction.
- Familiarity with embedded systems and optimization for real-time performance.
