Loughborough University computer scientists have teamed up with a food production automation company for a project that looks to teach AI robots how to differentiate between food items so they can make sandwiches in real-world environments.
Project lead Dr Baihua Li, of the School of Science, hopes the research with Millitec Food Systems will “empower a range of new automation functions on food production conveyors and pipelines”.
Food manufacturing is the largest manufacturing industry within Europe, but the industry faces major problems with labour supply due to increased costs and a shortage of workers willing to undertake less-skilled roles.
Millitec supplies hi-tech manufacturing machinery and a range of robotic products for food production automation that look to plug this gap in the industry.
It has developed a range of technology that can assemble and pack sandwiches, with the intention of reducing intensive labour work required on production conveyors.
Their current sandwich-assemblers are able to assist in the sandwich-making process – for example, they can butter bread and cut sandwiches – but they are unable to undertake tasks that require them to differentiate between items, such as selecting salad toppings to put inside a sandwich.
The project with Loughborough University looks to take the robotic technology to the next level of intelligence.
Dr Li and her team of researchers are to develop machine vision and embedded artificial intelligence (AI) technology for the robot manipulators that will enable them to recognise a variety of items and carry out more advanced tasks such as picking-up the right elements in the right amount and order.
They will investigate using a low-cost reliable camera and sensing system on Millitec’s ‘Delta robots’, which, in essence, will allow the machines to “see”.
They will then develop algorithms that train the robots to recognise various breads and food ingredients, and accurately detect their location and orientation.
The academics will create the algorithms using ‘deep learning’ – a method of teaching a machine how to carry out tasks automatically without explicit human instructions.
This involves collecting thousands of images and getting a computer system to analyse them, so it learns what different items look like.
As well as being taught how to identify food items, the Millitec robots will be trained to spot and deal with errors on production conveyors, such as missing ingredients or items in the wrong position.
The developed technology will be deployed as an embedded system on Millitec’s existing automation machines, meaning prepacked sandwiches purchased from outlets such as petrol stations in the near future could have been made from start to finish by robots.
Dr Li commented: “Industry presents new challenges to our research and this project will deal with various challenges in real-world factory conditions and meet the commercial requirements in accuracy, safety and speed. The developed robust vision algorithms and camera-based sensing system will also reduce the system manufacturing cost.
“We will transfer the latest advances of our research in machine vision, deep learning and robotics to drive innovation for high care food manufacturing. Successful development and commercialisation of the robotics system will significantly reduce the human workforce and improve production quality and efficiency, allowing employees to focus on higher-value activities.”