I know there are a lot of forum posts regarding this topic, but however, they are not very clear for my understanding. This is why I again would like to bring this topic up and I am really looking forward in easy understanding information to further procedure.

So I know that there are some frequentist and some bayes ways to calculate quality criteria for HB estimation (as written in your Book: Becoming an Expert in Conjoint Analysis). But my understanding is lacking at the very beginning of this:

1) Which data do I use for those tests? Is it the part-worth utilities on individual level (so simply the result of the HB estimation in Sawtooth), or are other outputs needed (which need to be ticked in the miscellaneous options)? So when I want to perform a t-test with HB estimations, how do I proceed?

2) also do I perform those tests (e.g. the t-test) in an extern software like R, SPSS or Excel or is this done within Sawtooth LHS?

3) Lets say i am interested in comparing my HB estimation results to different groups (e.g. male/female) and I want to know a) if there are differences, b) if the differences are significant between those groups and c) where the differences are. How do you recommend to proceed?

4) My last questions regards the choice simulator: It is possible to perform a simulation (RFC) of different groups of respondents (like male/female). The result shows me the different Shares of preferences of those groups. But how do I test if those differences are significant? And furthermore lets say I not only simulate 2 scenarios and compare them but a matrix of 100 at the same time. Is there a possibility to provide significance information?

It is very clear how to perform those tests within the aggregate Logit estimations, but I am really lacking here. Thanks a lot for your help and again I apologize for bringing this frequently discussed topic up again.

All the best,

Boris