Mixed-modality engagement assessment with biometrics