In April 2021, I started my PhD journey in Human-Computer Interaction (HCI) and Artificial Intelligence (AI) at Brunel University London’s Computer Science Department, within the College of Engineering, Design, and Physical Sciences. The path leading to my acceptance letter was challenging, particularly amidst the backdrop of the COVID-19 pandemic. However, receiving that letter symbolised a beacon of hope after navigating through a tumultuous period.
Opting to pursue a doctoral degree in HCI & AI stemmed from my desire to delve deeper into the dynamics between humans and computers. Drawing from my background as a software developer and my (then) current role as a Senior Lecturer and Course Leader, I had gained firsthand insight into the challenges faced by educators. Thus, my proposed focus centered on crafting an AI system tailored to enrich assessments in education, ultimately aiming to enhance the educational journey for both educators and students alike.
My research aim (what am I hoping to achieve?):
My research focuses on exploring pedagogical AI conversational agents, commonly known as chatbots, with a particular emphasis on their potential to revolutionise educational processes, particularly in the realm of assessments. Assessments, prevalent across all educational domains, often contribute to increased teacher workloads and evoke stress and anxiety among students. My aim is to leverage AI to streamline assessment procedures, thereby enhancing the student learning experience while alleviating the burden on educators. To achieve this, I plan to develop an LLM-augmented, emotionally intelligent pedagogical AI conversational agent. Subsequently, I will integrate this agent into educational assessment processes, meticulously examining its impact on student engagement and teacher workload. Through rigorous research, I aspire to ascertain the extent to which this innovative approach enhances the student experience and mitigates the challenges faced by educators.
My research plan (how am I going to achieve this?):
Literature Review: To begin, I will delve into existing literature relevant to my topic, conducting a thorough Systematic Literature Review and State-of-the-Art Survey on Pedagogical AI Conversational Agents. This will serve as the foundation for a thematic analysis of the subject. Subsequently, I intend to construct a Conceptual Framework that categorises the various agents within the educational domain, identifying areas warranting further investigation.
Pilot Study: Building upon this groundwork, I will embark on a pilot study. This will involve the development of an LLM-augmented, emotionally intelligent pedagogical AI conversational agent. I will employ Python (Flask) for its development and deploy it to willing participants to assess its impact on student engagement and teacher workload.
Subsequent study: Following the pilot study, I will analyse the data gathered to evaluate the effectiveness and efficiency of the emotionally intelligent LLM-augmented pedagogical AI conversational agent. This analysis will involve both quantitative metrics, such as engagement rates and workload assessments, as well as qualitative feedback from participants. Based on these findings, I will refine the agent’s design and functionality as necessary, ensuring its alignment with the needs and preferences of both students and educators. Additionally, I will explore avenues for scaling up the deployment of the agent and conducting larger-scale studies to further validate its efficacy in diverse educational settings. This iterative process of development and evaluation will contribute to the ongoing advancement of AI-driven pedagogical tools and their integration into educational practices.
Reflections:
These preliminary ideas represent the beginning of my research journey, subject to refinement as I progress. Embarking on this doctoral program fills me with enthusiasm and anticipation. I am incredibly fortunate to be guided by an outstanding supervisor whose mentorship has been immensely inspiring. I eagerly anticipate continuing our close collaboration until the completion of my thesis submission.
