"INTERBOT" INTERBOT - DEVELOPMENT OF AN HMI INTERFACE FOR PROGRAMMING ROBOTS USING VERBAL COMMANDS AND ARTIFICIAL VISION DESCRIPTION The tendencies towards the manufacture of a wide variety of products in smaller and smaller batch sizes (product customization) implies the need to readjust the productive means very frequently to each type of product. Although robots are very flexible equipment, their efficiency decreases if they need to be continuously reprogrammed to adapt to the specifications of each new product. The development of interfaces that allow the rapid reprogramming of a robot, and as far as possible almost intuitively by non-specialized personnel, is an option that is being approached from various perspectives. This type of interface is especially important in environments where human presence is important, such as manufacturing industries. Therefore, the objective of the project is to develop a collaborative robot programming interface, based on the recognition and execution of verbal commands by the robot in an industrial environment, from which a movement programming sequence can be generated. and its recording in the controller. OBJECTIVES The general objective of this project is to develop an advanced HMI interface, which allows collaborative robots to be programmed by recognizing verbal commands in industrial environments, from which a movement programming sequence can be generated and recorded in the controller. This process will be supported by an artificial vision system that will facilitate the fine adjustment of movements and the identification of objectives (parts / elements). The system developed will integrate sufficient security elements so that there is no risk of undue collisions or unexpected accidents. The specific objectives are: • Develop a word and phrase recognition system that can interact with the robot control even in industrial environments. • Integrate a 3D artificial vision system for shape recognition, which combined with the verbal command system allows adjusting robot movements • Develop a process for programming and repeating movements in the robot controller based on verbal commands and images. • Develop a robust security system and integrate it into the programming process. • Build an intuitive interface that integrates previous developments and facilitates programming tasks. • Develop a demonstration pilot project • Transmit the knowledge acquired to interested companies. Project Number: 22100060 Grant Agreement: IMDEEA / 2021/17 Duration: From 01/07/2021 to 31/07/2022 Coordinated in AIDIMME by: SÁNCHEZ ASINS, JOSÉ LUIS R&D Line: INDUSTRY 4.0 EXPLANATORY VIDEO RESULTS OBTAINED Year 2022: The results achieved in the project are the following: The voice recognition system has been developed, which transfers commands to the robot controller. However, the vision system is available on the robot, but it cannot be integrated simultaneously with voice control because there are conflicts with the controller to simultaneously activate both systems. The entire programming process is carried out entirely through voice control The verbal commands transmitted to the robot generate a programming sequence, and therefore a program for the robot. In this way, a sequence of simple movements can be generated by giving verbal commands. The necessary elements have been integrated into the robot to eliminate risks. Security has been evaluated, establishing appropriate guidelines for use of the system The interface to visualize the programming being carried out has been developed in the robot controller. An external support system has been developed to verify that programming is carried out correctly A pilot has been developed in a laboratory to demonstrate the system, and it has also been tested and validated in a company (MICUNA), evaluating its ease of use. 2022 Year: Summary of project results Deliverables:    Year 2022: Synthesis of the development of the project. Deliverables:    PUBLISHED NEWS general broadcast https://valenciaplaza.com/robots-ayudantes-atienden-orde (...) https://actualidad.aidimme.es/2022/11/03/congreso-habita (...) https://actualidad.aidimme.es/2022/10/21/finalizan-proye (...) https://www.interempresas.net/Robotica/Articulos/385646- (...) https://actualidad.aidimme.es/2022/04/19/mejora-eficienc (...) https://actualidad.aidimme.es/2022/04/07/proyectos-fimma (...) https://actualidad.aidimme.es/2022/03/02/especial-proyec (...) https://actualidad.aidimme.es/2021/12/17/aidimme-resulta (...) https://actualidad.aidimme.es/2021/11/30/aidimme-promuev (...) http://actualidad.aidimme.es/2021/09/22/presentacion-pro (...) Technical dissemination, transfer https://actualidad.aidimme.es/2022/10/18/aidimme-expone- (...) https://actualidad.aidimme.es/2022/07/04/informe-resulta (...) https://actualidad.aidimme.es/2022/06/14/aidimme-ofrece- (...) https://actualidad.aidimme.es/2022/03/22/la-iniciativa-i (...) https://actualidad.aidimme.es/2021/12/02/retos-para-la-p (...) https://actualidad.aidimme.es/2021/10/04/inicio-proyecto (...) https://actualidad.aidimme.es/2022/05/03/una-voz-una-ord (...) GRANT 215.000 € € TARGET AUDIENCE AND IMPACT MEASUREMENT 2696 Access to the project website 8227 Access to news published on own websites. Total Accesses: 10923 Objective Sectors by CNAE Objective Sectors by Activity MANUFACTURERS - Number of target companies: 108 (39 of the Valencian Community) TRACTOR COMPANIES Thanks to its support and signature of the "declaration of participation" the project has been funded. MANUFACTURAS PORTA CELI, SA IT8 SOFTWARE ENGINEERING, SL CFZ COBOTS, SL COMPANIES DIFFUSION R&D PROJECTS They want to know first-hand the evolution of the project, and its progress to the final result. COMPANIES TRANSFER KNOWLEDGE They will implement technologies, develop strategies or look for new models based on the results.