Behavioural Analysis models for a project

I’m working on a project to create an AI-powered mock interview platform that assesses candidates’ technical skills and behavioral attributes. A key feature involves analyzing candidate behavior using audio and video input to gain insights into their performance. Specifically, we need models or frameworks that can handle attributes such as facial expressions, emotions, postures, gestures, and overall movement for video analysis, as well as tone, pitch, emotion, clarity, and fluency for audio analysis. Our goal is real-time analysis, processing the data during the interview without storing the raw video or audio. If you know of any powerful AI models, libraries or tools that can handle these tasks effectively, please leave your suggestions! Your suggestions will be very helpful to the success of our project.