IDS 3D vision system helps robots assemble flat-pack furniture

As part of a research project, scientists at Nanyang Technological University, Singapore (NTU Singapore) have developed a robot that can independently assemble the individual components of an IKEA chair without interruption in less than 10 minutes. The robot consists of an Ensenso N35 3D camera from IDS and two robot arms equipped with grippers to pick up objects.

The robot hardware is designed to simulate how people mount objects: the "eyes" are replaced by a 3D camera and the "arms" by industrial robot arms capable of moving in six axes. Each arm is equipped with parallel grippers for picking up objects. Force sensors are attached to the wrists to determine how strongly the "fingers" grip and how strongly they bring objects into contact with each other. The robot starts the assembly process by taking 3D images of the parts lying on the ground to create a map of the estimated positions of the various components. This task is performed by an Ensenso 3D camera from IDS. The camera works according to the "projected texture stereo vision" principle (Stereo Vision), which imitates human vision. Two cameras acquire images from the same scene from two different positions. Although the cameras see the same scene content, there are different object positions according to the cameras' projection rays. Special matching algorithms compare the two images, search for corresponding points and visualise all point displacements in a Disparity Map. The Ensenso software can determine the 3D coordination for each individual image pixel or object point, in this case the chair components.

The challenge is to locate the components as precisely, quickly and reliably as possible in a confusing environment. This is ensured by the Ensenso camera's light-intensive projector. This produces a high-contrast texture on the object surface by using a pattern mask, even under difficult light conditions. The projected texture supplements the weak or non-existent object surface structure found on the components of the IKEA chair.

Although not required for this application, the N35 model used here even goes one step further: thanks to the integrated FlexView projector technology the pattern projected on the object surface of the components can be shifted to vary the texture on the surface. Acquiring multiple image pairs with different textures of the same object scene produces a lot more image points. Thus the components of the chair are displayed in 3D in a much higher resolution to make them easier for the robot to recognise. Another advantage is the robot hand-eye calibration function of the Ensenso software. Using a calibration plate, it ensures that the position of the camera coordinate system (in this case the stationary camera) is determined with respect to the base coordinate system (position of the component). This enables the robot's hand to react precisely to the image information and reaches exactly its destination.

Furniture assembly in less than 10 minutes

Professor Pham Quang Cuong of NTU explains: "For a robot, putting together an IKEA chair with such precision is more complex than it looks. The job of assembly, which may come naturally to humans, has to be broken down into different steps, such as identifying where the different chair parts are, the force required to grip the parts, and making sure the robotic arms move without colliding into each other. Through considerable engineering effort, we developed algorithms that will enable the robot to take the necessary steps to assemble the chair on its own."

The result: the NTU robot installs the "Stefan" chair from Ikea in just 8 minutes and 55 seconds. According to Professor Pham Quang Cuong, artificial intelligence will make the application even more independent and promising in the future: "We are looking to integrate more artificial intelligence into this approach to make the robot more autonomous so it can learn the different steps of assembling a chair through human demonstration or by reading the instruction manual, or even from an image of the assembled product."

The robot developed by the scientists at NTU Singapore is used for research into clever manipulation, an area of robotics that requires precise control of the forces and movements of special robot hands or fingers. This requires perfect interaction of all hardware and software components. 3D image processing using Ensenso stereo 3D cameras is the key to the solution. It convinces not only through accuracy, but also in terms of economy and speed. This marks real progress in furniture assembly - and not only here.

Learn more about the Ensenso N35 3D camera from IDS at www.ids-imaging.com.

IDS Imaging Development Systems

Landmark House
Station Road
Hook
RG27 9HA
UNITED KINGDOM

+44 (0)1256 962910

uksales@ids-imaging.com

www.ids-imaging.com

More applications
1 day ago
Individual service for signal integrity
The demands on connection technology performance are constantly increasing. By providing customised support, Phoenix Contact helps customers select connection components to ensure the highest possible signal integrity.
2 days ago
Aveva MES rises in the leader ranks of the latest Gartner report
Aveva’s Manufacturing Execution Systems (MES) offering, which is deployed in the UK & Ireland by AVEVA Select partners SolutionsPT, has been recognised as a global leader in industrial software in the latest 2022 Gartner Magic Quadrant for Manufacturing Execution Systems.
2 days ago
Harwin and MSA Components sign German distribution deal
Harwin is bringing greater strength to its German supply chain through a new strategic partnership with MSA Components. The agreement allows MSA to offer all the latest products from Harwin’s extensive portfolio.
2 days ago
Siemens selected by Microsoft for RAMP Programme
Siemens Digital Industries Software has been selected to participate in the Rapid Assured Microelectronics Prototypes (RAMP) Phase II initiative.
2 days ago
Kontron receives VDC Research’s Gold Award for vendor satisfaction
Kontron has been recognised for outstanding customer satisfaction. The company has received the Gold Vendor Satisfaction Award for IoT and Embedded Hardware technology from VDC Research.
3 days ago
Mouser wins Vishay Distributor of the Year Award
Mouser Electronics has received the 2021 High Service Distributor of the Year award from Vishay Intertechnology, one of the world’s largest manufacturers of discrete semiconductors and passive electronic components.
3 days ago
What changes does the new machinery regulation bring?
As the machinery regulation replaces machinery directive 2006/42/EC, Dirk Meyer, specialist engineer solution architect at Eaton, looks at what is changing.
3 days ago
Klüber Lubrication receives Schaeffler Supplier Award 2022
Schaeffler has awarded Klüber Lubrication with the Supplier Award 2022 in the field of quality. The jury emphasised in particular the global supplier's strong commitment to the compliance with quality standards.
4 days ago
Essentra Components cuts energy usage by 15% globally
An innovative energy reduction initiative based on the concept of insulated jackets is helping industrial components manufacturer Essentra Components cut its energy usage when heating machine barrels by 15% and save CO2 emissions in the process.
5 days ago
Fluke addresses requirements to improve operational efficiencies
Rising energy costs and more stringent legislation guiding sustainable practices is spurring companies to re-evaluate processes and seek new tools and technologies to reduce waste and overcome challenges in today’s industrial environments.

Login / Sign up