Revision as of 17:44, 18 September 2023

The utilization of AI in manufacturing processes has ushered in a new era of data-driven optimization and problem-solving. AI is a pivotal cornerstone, especially in Industry 4.0 and 5.0 applications, yielding advanced technologies to guide a new era of heightened efficiency, productivity, and refined decision-making. In this capacity, AI emerges as an indispensable force driving transformative advancements within the manufacturing domain, where data-driven insights and smart automation catalyze innovation and shape the future of industrial processes. The assessment of SoA approaches in the manufacturing realm helped us identify three concrete use cases for further investigation: (1) Rare event prediction, (2) Anomaly detection using process knowledge workflow, and (3) explaining the root cause of an event through causal knowledge.

PROJECTS

Project-1:Rare Event Prediction

There are different types of events that can be observed within autonomous systems. For example, our consideration on this topic led us to explore “rare events” as they are particularly important for smart manufacturing applications. Rare events are occurrences that take place with a significantly lower frequency than more common regular events. In manufacturing, predicting such events is particularly important, as they lead to unplanned downtime, shortening equipment lifespan, and high energy consumption. The occurrence of events is usually considered rare if observed in 5-10% of all instances, while the occurrence of less than 1% is considered extremely rare. The rarity of events is inversely correlated with the maturity of a manufacturing industry. Typically, the rarity of events causes the multivariate data generated within a manufacturing process to be highly imbalanced, which leads to bias in predictive models. To this end, we conducted a thorough survey to investigate prior art along four dimensions: (i) data acquisition methods, (ii) data preprocessing techniques, (iii) algorithmic approaches, and (iv) evaluation/assessment approaches. Figure X below summarizes the methods we looked at within each dimension

Regarding modeling rare event prediction, we first evaluated the role of data enrichment approaches combined with supervised machine-learning techniques. Predominantly, we explored using three data enrichment approaches; data augmentation, sampling and imputation. Our study is based on open real-world datasets we obtained from public data sources.

Project-2:Process Knowledge Workflow using PDDL

We proposed Process Knowledge Workflow (PKW) using Planning Domain Definition Language (PDDL) to detect anomalies in the assembly line (Figure 1&3). Specifically, the PKW uses multimodal data from robot sensors, conveyor belt sensors and camera to detect anomalies. The images from the camera will be processed using state-of-the-art object detection techniques to identify the objects of interest and the interactions among them. The data from the sensors will be utilized to detect the movement of the desired objects. Using this information, PKW will be constructed for the expected process. Then the PKW can serve as an orchestrator to identify anomalies in the sensor values. Based on the sensor values, the PKW will also have the ability to define and name the anomalies. We conducted an extensive survey of the list of sensors in the assembly line from neXt Future Factories lab and studied the type and range of data being generated. Using this, the first version of the PKW ontology will be constructed. A demonstration of PKW can be found in Figure 2.

Project-3:Explaining the root cause of an event through causal knowledge

Our goal is to utilize the process knowledge workflow to construct a sequential causal Bayesian network that captures both the input-output sequence of the process and the agent information. Specifically, we aim to create a model that can track the cause-and-effect relationships between the input commands, robot actions, and pipeline outputs in the assembly process. By doing so, we will be able to predict the impact of a given input/output and action combination on the assembly pipeline. If an anomaly occurs, we will use the causal Bayesian network to identify the possible root cause and explain the event.

Project-4:AI Empowered Personalized Education

We have surveyed the latest AI technologies for personalized education and have identified synergies with some active projects on using AI for education at AIISC. There is growing use of KGs along with statistical AI (i.e., neural network based) techniques for EduTech solutions using AI for Education. One use of KG is for capturing domain knowledge. For example, the EduTech company Embibe.com has developed comprehensive KG for all subjects and courses it supports. Another use of KG is for creating personalized KG to capture the history of student’s interaction with an AI based education application (e.g., what are all the topics students has learned and how well so that the AI based application can guide the next learning objective and help teachers and the students with personalized assessment). At AIISC we are using AI for education through gaming (e.g., teach strategies for solving Rubrics cube) and support analogy-based pedagogy to improve learning about complex topics with the aid of analogy with more familiar concepts. We identify Dynamic KG to be another interesting application for personalized education. Specifically, the use of a Dynamic KG would allow us to keep the course materials up to date with the latest developments while catering to the emerging demands of students’ learning goals. We believe our active project on AI supported Analogy based personalized learning has an interesting use-case for effectively explaining difficult manufacturing concepts to students. For example, consider the case where students are learning about a new concept: Data Interoperability. Using the analogy about the role of a translator in multilingual communication, we can explain the need for data interoperability to ensure seamless communication between different computer systems and software applications. This approach was tested in the workforce development context as part of the upcoming Summer AI Camp for High School students.

TEAM MEMBERS

Advised By - Amit Sheth

1. Ruwan Wickramarachchi
2. Chathurangi Shyalika
3. Utkarshani Jaimini
4. Revathy Venkataramanan
5. Vishal Pallagani