Automatic loading and unloading of pressed parts

A robot-based 3D measuring system is helping an automotive manufacturer reduce the cycle times of its press lines. Four Ensenso 3D cameras from IDS Imaging Development Systems provide the basic data and thus the platform for process automation.

Robots do monotonous workflows and less pleasant, repetitive tasks with brilliance. Combined with image processing, they become ‘seeing’ and reliable supporters of humans. They are used in quality assurance to check components, help with the assembly and positioning of components, detect errors and deviations in production processes and thus increase the efficiency of entire production lines.

An automobile manufacturer is taking advantage of this to improve the cycle time of its press lines. Together with the latter, VMT Vision Machine Technic Bildverarbeitungssysteme from Mannheim developed the robot-based 3D measuring system FrameSense for the fully automatic loading and unloading of containers. Pressed parts are thus safely and precisely inserted into or removed from containers.

The actual workflow that FrameSense is designed to automate is part of many manufacturing operations. A component comes out of a machine - here a press - and runs on a conveyor belt to a container. There it is stacked. As soon as the container is full, it is transported to the next production step, for example assembly into a vehicle.

Up to now, employees have been responsible for loading the containers. This actually simple subtask is more complex than one might think at first glance. In addition to the actual insertion process, the first step is to determine the appropriate free space for the part. At the same time, any interfering factors, such as interlocks, must be removed and a general check of the “load box” for any defects must be carried out. All these tasks are now to be taken over by a robot with a vision system - a technological challenge. This is because the containers also come from different manufacturers, are of different types and thus vary in some cases in their dimensions.

Type, shape and position inspection

For their fully automatic loading and unloading, the position of several relevant features of the containers must be determined for a so-called multi-vector correction of the robot. The basis is a type, shape and position check of the respective container. This is the only way to ensure process-reliable and collision-free path guidance of the loading robot.

All this has to be integrated into the existing production process. Time delays must be eliminated and the positioning of the components must be accurate to the millimetre.

To counter this, VMT uses four 3D cameras per system. The four sensors each record a part of the entire image field. This can consist of two containers, each measuring approximately 1.5 x 2 x 1.5 metres (D x W x H). Two of the cameras focus on one container. This results in data from two perspectives each for a higher information quality of the 3D point cloud.

These point clouds of all four sensors are combined for the subsequent evaluation. In the process, registrations of relevant features of the container take place in ROIs (Regions of Interest) of the total point cloud. A registration is the exact positioning of a feature using a model in all 6 degrees of freedom. In other ROIs, interference contours are searched for which could lead to collisions during loading.

Finally, the overall picture is compared with a stored reference model. In this way, the containers can be simultaneously checked for their condition and position in a fully automated manner. Even deformed or slanted containers can be processed. All this information is also recorded for use in a quality management system where the condition of all containers can be traced.

The calibration as well as the consolidation of the measurement data and their subsequent evaluation are carried out in a separate IPC (industrial computer) with screen visualisation, operating elements and connection to the respective robot control.

The main result of the image processing solution is the multi-vector correction. In this way, the robot is adjusted to be able to insert the component at the next possible, suitable deposit position. Secondary results are error messages due to interfering edges or objects in the container that would prevent filling.

Damaged containers that are in a generally poor condition can be detected and sorted out with the help of the data. The entire image processing takes place in the image processing software MSS (Multi Sensor Systems) developed by VMT. FrameSense is designed to be easy to use and can also be converted to other components directly on site.

Robust 3D camera system

On the camera side, VMT relies on Ensenso 3D cameras – initially on the X36 model. The current expansion stage of FrameSense is equipped with the Ensenso C variant. The reasons for the change are mainly the better projector performance – thanks to a new projection process – as well as a higher recording speed. In addition, the Ensenso C enables a larger measuring volume. This is an important criterion for FrameSense, because the robot can only reach the containers to be filled up to a certain distance.

The specifications of the Ensenso C thus correspond exactly to VMT’s requirements, as project manager and technology manager Andreas Redekop explains: “High projector performance and resolution together with fast data processing were our main technical criteria when selecting the camera. The installation in a fixed housing was also an advantage.”

The Ensenso C addresses current challenges in the automation and robotics industry. Compared to other Ensenso models, it provides both 3D and RGB colour information. Customers thus benefit from even more meaningful image data. The housing of the robust 3D camera system meets the requirements of protection class IP65/67. It offers a resolution of 5 MP and is available with baselines from current to approx. 455 mm. This means that even large objects can be reliably detected.

The camera is quick and easy to use and addresses primarily large-volume applications, for example in medical technology, logistics or factory automation.

By automatically loading and unloading containers and the integrated 3D container inspection, manual workstations can be automated with the help of FrameSense. Against the background of the shortage of skilled workers, the system can thus make an important contribution to process automation in the automotive industry, among others. It meets the prevailing challenges of the industry. Ensenso C provides the crucial basis for data generation and exceeds the requirements of many applications. Lukas Neumann from

Product management sees their added value especially here: “The high projector power and large sensor resolutions are particularly advantageous in the field of intralogistics. Here, high-precision components have to be gripped from a great distance with a large measuring volume.”

For other stacking or bin-picking applications in classic logistics, he could imagine a similar camera with high projector power but lower resolution and fast recording.

IDS Imaging Development Systems Ltd

Cheyenne House
West Street
FARNHAM
GU9 7EQ
UNITED KINGDOM

+44 (0) 1252 916656

uksales@ids-imaging.com

www.ids-imaging.com

More news
2 days ago
steute Technologies restructures its business fields
steute Technologies, an international technology company offering switches, intelligent sensors and wireless systems, has announced a comprehensive restructuring of its business fields.
2 days ago
Showcasing design, production and process engineering in the food and drink sect
Taking place on 1 May 2024 at the National Motorcycle Museum, Food Manufacturing Live serves the design, production, process and maintenance engineering teams across the UK food and drink manufacturing sector.
2 days ago
Understanding safety and security for the protection of human and machine
How do you master employee protection, liability protection, productivity and data protection? How do you increase your quality and simultaneously prevent manipulation on your machines? How do you protect your data and employees in equal measure? Pilz is hosting a free webinar on 15 December, 9:30-10:30 am, to address just these questions.
3 days ago
Schaffner opens new regional channels for its range of EMC solutions
EMC solutions provider, Schaffner, announces new partnerships with three distributors to further broaden the reach and scope of its product range and support services across Europe. The new agreements with Telerex, CATS and DSL Components will open new supplier corridors and enable customers to have local and faster access to products.
3 days ago
New SCARA robot transforms pick-and-place and assembly operations
ABB Robotics is expanding its industrial SCARA robot portfolio with the addition of the IRB 930. The new robot, compromising three variants capable of handling 12 kg and 22 kg payloads, has been designed to meet the demands of new growth opportunities in traditional and new markets.
3 days ago
Pilz CMSE training in high demand, as 10,000th graduate qualifies
With the CMSE qualification (Certified Machinery Safety Expert), Pilz created a completely new training programme for machinery safety in 2013. After a decade Pilz is now proud to congratulate the 10,000th graduate to successfully complete the CMSE examination.
3 days ago
New eBook offers expert insights on embedded security
Mouser Electronics announces a new eBook produced in collaboration with global semiconductor leader Analog Devices (ADI). In Embedded Security: Keeping Edge Data Safe, experts from ADI and other companies take a deep look at embedded security concepts and their importance.
4 days ago
New era beckons at UK’s largest online valve supplier
Gary Hopkinson, founder of Valves Online, a sales partner for Bürkert, has announced his retirement, planned for the end of this year. In March, the UK’s largest online valves supplier underwent a business acquisition by R&G Fluid Power Group. Gary has been assisting the transition while Valves Online is set to retain its successful business model.
4 days ago
Lowering production costs in the beverage industry
BrauBeviale, one of the leading capital goods fairs for the beverage industry worldwide, is due to take place in Nuremberg from November 28 to 30, 2023. Schaeffler will be on site with a presentation that focuses on solutions for economical and efficient beverage production.
4 days ago
NSK Europe makes significant environmental progress in FY2022-23
NSK Europe continues to make improvements to its environmental credentials, with the past 12 months seeing significant progress in a number of key metrics as the company works towards its ultimate carbon-neutral goal.

Login / Sign up