Bayesian Modeling For Heterogeneous Multivariate Data