Important: Read this before posting to this forum

  1. This forum is for questions related to the use of Apollo. We will answer some general choice modelling questions too, where appropriate, and time permitting. We cannot answer questions about how to estimate choice models with other software packages.
  2. There is a very detailed manual for Apollo available at http://www.ApolloChoiceModelling.com/manual.html. This contains detailed descriptions of the various Apollo functions, and numerous examples are available at http://www.ApolloChoiceModelling.com/examples.html. In addition, help files are available for all functions, using e.g. ?apollo_mnl
  3. Before asking a question on the forum, users are kindly requested to follow these steps:
    1. Check that the same issue has not already been addressed in the forum - there is a search tool.
    2. Ensure that the correct syntax has been used. For any function, detailed instructions are available directly in Apollo, e.g. by using ?apollo_mnl for apollo_mnl
    3. Check the frequently asked questions section on the Apollo website, which discusses some common issues/failures. Please see http://www.apollochoicemodelling.com/faq.html
    4. Make sure that R is using the latest official release of Apollo.
  4. If the above steps do not resolve the issue, then users should follow these steps when posting a question:
    1. provide full details on the issue, including the entire code and output, including any error messages
    2. posts will not immediately appear on the forum, but will be checked by a moderator first. This may take a day or two at busy times. There is no need to submit the post multiple times.

Replication issues with WTP estimation results

Ask questions about the results reported after estimation. If the output includes errors, please include your model code if possible.
Post Reply
mnikrave
Posts: 6
Joined: 22 Jul 2022, 21:54

Replication issues with WTP estimation results

Post by mnikrave »

Dear all,

Thank you for the Apollo package and for the forum.

My colleague and I are trying to estimate a mixed logit model in WTP space for a DCE, for three different countries, individually. We work in parallel and replicate each other's work.

We both work on Windows, with the latest release of Apollo (0.2.7) and of R (4.2.1). Yet, when running the exact same code with the exact same data, ensuring to set the correct working directory to source file location, we find different estimation results for the WTP specifications for one country-subset. For the two other country subsets, we find the same WTP estimates across researchers. MNL and MMNL specifications in the preference space are also in line across researchers.

Do you have an idea of what could have happened and how to solve it ?

Thank you and best wishes
Mariam
stephanehess
Site Admin
Posts: 974
Joined: 24 Apr 2020, 16:29

Re: Replication issues with WTP estimation results

Post by stephanehess »

Mariam

it's kind of impossible for us to answer that question without seeing the results...

Stephane
--------------------------------
Stephane Hess
www.stephanehess.me.uk
mnikrave
Posts: 6
Joined: 22 Jul 2022, 21:54

Re: Replication issues with WTP estimation results

Post by mnikrave »

Hi Stephane,

Sure, here are the common code (solely rename for distinction) and both outputs (new post), ran with the same data. When comparing the output, scaling values and bytecodes appear different in the settings and functions section, despite using the same model.

Best wishes,
Mariam

############
Code:
############



# ################################################################# #
#### LOAD LIBRARY AND DEFINE CORE SETTINGS ####
# ################################################################# #

### Clear memory
rm(list = ls())

### Load Apollo library
library(apollo)

### Initialise code
apollo_initialise()

### Set core controls
apollo_control = list(
modelName = "MMNL_SUSINCHAIN_CB7_PT_PRIOR_WTP2",
modelDescr = "Code written together_chicken base",
indivID = "id",
mixing = TRUE,
nCores = 4,
workInLogs = FALSE
)

# ################################################################# #
#### LOAD DATA AND APPLY ANY TRANSFORMATIONS ####
# ################################################################# #

### Loading data from package
### if data is to be loaded from a file (e.g. called data.csv),
### the code would be: database = read.csv("data.csv",header=TRUE)
database = read.csv("SUSINCHAIN_FINAL8.csv",header=TRUE)

### Use only SP data
database = subset(database,database$country==3)

# ################################################################# #
#### DEFINE MODEL PARAMETERS ####
# ################################################################# #

### Vector of parameters, including any that are kept fixed in estimation

apollo_beta = c(asc_alt1 = -0.06235,
asc_alt2 = 0,
asc_none = -0.68856,
b_price_mu = -5,
b_price_sig = 0.01315,
b_cook_mu = 0.59419,
b_cook_sig = 0.08434,
b_eat_mu = 0.36438,
b_eat_sig = 0.08305,
b_pea_mu = -0.34364,
b_pea_sig = 0.08207,
b_inschick_mu = -0.76620,
b_inschick_sig = 0.09156,
b_cricket_mu = -2.08199,
b_cricket_sig = 0.11984,
b_worm_mu = -2.40879,
b_worm_sig = 0.13565,
b_mne_mu = 0.02511,
b_mne_sig = 0.04621,
b_bio_mu = 0.26311,
b_bio_sig = 0.04350,
b_eu_mu = 0.55187,
b_eu_sig = 0.06826,
b_local_mu = 0.73714,
b_local_sig = 0.06495)

### Vector with names (in quotes) of parameters to be kept fixed at their starting value in apollo_beta, use apollo_beta_fixed = c() if none
apollo_fixed = c("asc_alt2")

# ################################################################# #
#### DEFINE RANDOM COMPONENTS ####
# ################################################################# #

### Set parameters for generating draws
apollo_draws = list(
interDrawsType = "mlhs",
interNDraws = 1000,
interUnifDraws = c(),
interNormDraws = c("draws_price","draws_cook","draws_eat","draws_pea","draws_inschick","draws_cricket","draws_worm","draws_mne","draws_bio","draws_eu","draws_local"))

### Create random parameters
apollo_randCoeff = function(apollo_beta, apollo_inputs){
randcoeff = list()

randcoeff[["b_price"]] = -exp(b_price_mu + b_price_sig * draws_price)
randcoeff[["b_cook"]] = b_cook_mu + b_cook_sig * draws_cook
randcoeff[["b_eat"]] = b_eat_mu + b_eat_sig * draws_eat
randcoeff[["b_pea"]] = b_pea_mu + b_pea_sig * draws_pea
randcoeff[["b_inschick"]] = b_inschick_mu + b_inschick_sig * draws_inschick
randcoeff[["b_cricket"]] = b_cricket_mu + b_cricket_sig * draws_cricket
randcoeff[["b_worm"]] = b_worm_mu + b_worm_sig * draws_worm
randcoeff[["b_mne"]] = b_mne_mu + b_mne_sig * draws_mne
randcoeff[["b_bio"]] = b_bio_mu + b_bio_sig * draws_bio
randcoeff[["b_eu"]] = b_eu_mu + b_eu_sig * draws_eu
randcoeff[["b_local"]] = b_local_mu + b_local_sig * draws_local


return(randcoeff)
}

# ################################################################# #
#### GROUP AND VALIDATE INPUTS ####
# ################################################################# #

apollo_inputs = apollo_validateInputs()

# ################################################################# #
#### DEFINE MODEL AND LIKELIHOOD FUNCTION ####
# ################################################################# #

apollo_probabilities=function(apollo_beta, apollo_inputs, functionality="estimate"){

### Function initialisation: do not change the following three commands
### Attach inputs and detach after function exit
apollo_attach(apollo_beta, apollo_inputs)
on.exit(apollo_detach(apollo_beta, apollo_inputs))

### Create list of probabilities P
P = list()

### Create alternative specific constants and coefficients with interactions with socio-demographics

#b_peaa = b_pea + b_pea_shift_tins * (scenario == 2) + b_pea_shift_tsus * (scenario == 3)
#b_cricketa = b_cricket + b_cricket_shift_tins * (scenario == 2) + b_cricket_shift_tsus * (scenario == 3)
#b_inschicka = b_inschick + b_inschick_shift_tins * (scenario == 2) + b_inschick_shift_tsus * (scenario == 3)
#b_worma = b_worm + b_worm_shift_tins * (scenario == 2) + b_worm_shift_tsus * (scenario == 3)

### List of utilities: these must use the same names as in mnl_settings, order is irrelevant
V = list()
V[["alt1"]] = asc_alt1 + b_price * (price1 + b_cook * cook1 + b_eat * eat1 + b_pea * pea1 + b_inschick *inschick1 + b_cricket * cricket1 + b_worm * worm1 + b_mne *mne1 + b_bio * bio1 + b_eu * eu1 + b_local * local1)
V[["alt2"]] = asc_alt2 + b_price * (price2 + b_cook * cook2 + b_eat * eat2 + b_pea * pea2 + b_inschick *inschick2 + b_cricket * cricket2 + b_worm * worm2 + b_mne *mne2 + b_bio * bio2 + b_eu * eu2 + b_local * local2)
V[["none"]] = asc_none

### Define settings for MNL model component
mnl_settings = list(
alternatives = c(alt1=1, alt2=2, none=3),
avail = list(alt1=1, alt2=1, none=1),
choiceVar = choice,
utilities = V
)

### Compute probabilities using MNL model
P[["model"]] = apollo_mnl(mnl_settings, functionality)

### Take product across observation for same individual
P = apollo_panelProd(P, apollo_inputs, functionality)

### Average across inter-individual draws
P = apollo_avgInterDraws(P, apollo_inputs, functionality)

### Prepare and return outputs of function
P = apollo_prepareProb(P, apollo_inputs, functionality)
return(P)
}

# ################################################################# #
#### MODEL ESTIMATION ####
# ################################################################# #
model = apollo_estimate(apollo_beta, apollo_fixed,apollo_probabilities, apollo_inputs)

# ################################################################# #
#### MODEL OUTPUTS ####
# ################################################################# #

# ----------------------------------------------------------------- #
#---- FORMATTED OUTPUT (TO SCREEN) ----
# ----------------------------------------------------------------- #

apollo_modelOutput(model, modelOutput_settings=list(printPVal=TRUE))

# ----------------------------------------------------------------- #
#---- FORMATTED OUTPUT (TO FILE, using model name) ----
# ----------------------------------------------------------------- #

apollo_saveOutput(model, saveOutput_settings=list(printPVal=TRUE))
mnikrave
Posts: 6
Joined: 22 Jul 2022, 21:54

Re: Replication issues with WTP estimation results

Post by mnikrave »

#############
Model Output 1:
#############


Model run by EmiliaCD using Apollo 0.2.7 on R 4.2.1 for Windows.
www.ApolloChoiceModelling.com

Model name : MMNL_SUSINCHAIN_CB7_PT_PRIOR_WTP2
Model description : Code written together_chicken base
Model run at : 2022-08-26 11:36:53
Estimation method : bfgs
Model diagnosis : successful convergence
Number of individuals : 414
Number of rows in database : 4140
Number of modelled outcomes : 4140

Number of cores used : 4
Number of inter-individual draws : 1000 (mlhs)

LL(start) : -4654.11
LL(0) : -4548.25
LL(C) : -4540.65
LL(final) : -2921.45
Rho-square (0) : 0.3577
Adj.Rho-square (0) : 0.3524
Rho-square (C) : 0.3566
Adj.Rho-square (C) : 0.3513
AIC : 5890.89
BIC : 6042.78

Estimated parameters : 24
Time taken (hh:mm:ss) : 00:23:7.28
pre-estimation : 00:03:43.79
estimation : 00:08:35.38
post-estimation : 00:10:48.11
Iterations : 89
Min abs eigenvalue of Hessian : 0.207775

Unconstrained optimisation.

Estimates:
Estimate s.e. t.rat.(0) p(1-sided) Rob.s.e. Rob.t.rat.(0) p(1-sided)
asc_alt1 -0.09045 0.06848 -1.3209 0.093260 0.07589 -1.1919 0.11664
asc_alt2 0.00000 NA NA NA NA NA NA
asc_none -2.84957 0.14156 -20.1301 0.000000 0.17795 -16.0134 0.00000
b_price_mu -0.74496 0.09447 -7.8858 1.554e-15 0.11628 -6.4066 7.439e-11
b_price_sig 1.39819 0.10365 13.4901 0.000000 0.11254 12.4237 0.00000
b_cook_mu -1.29069 0.22086 -5.8440 2.548e-09 0.23005 -5.6104 1.009e-08
b_cook_sig 3.28305 0.20911 15.6998 0.000000 0.22517 14.5805 0.00000
b_eat_mu 0.11070 0.24504 0.4517 0.325726 0.26965 0.4105 0.34071
b_eat_sig 3.56962 0.22133 16.1282 0.000000 0.22748 15.6918 0.00000
b_pea_mu 2.04195 0.26701 7.6473 1.021e-14 0.31815 6.4182 6.893e-11
b_pea_sig -4.58045 0.28480 -16.0829 0.000000 0.31716 -14.4422 0.00000
b_inschick_mu 3.75138 0.27328 13.7274 0.000000 0.29012 12.9304 0.00000
b_inschick_sig 6.53406 0.46713 13.9876 0.000000 0.54602 11.9666 0.00000
b_cricket_mu 14.04226 1.00836 13.9258 0.000000 1.30601 10.7520 0.00000
b_cricket_sig 7.16602 0.84546 8.4759 0.000000 1.01431 7.0649 8.037e-13
b_worm_mu 18.85470 1.69435 11.1280 0.000000 2.17658 8.6625 0.00000
b_worm_sig -10.36252 1.27203 -8.1464 2.220e-16 1.52347 -6.8019 5.161e-12
b_mne_mu 0.46278 0.16781 2.7578 0.002909 0.20315 2.2780 0.01136
b_mne_sig 1.20875 0.17390 6.9508 1.816e-12 0.16523 7.3158 1.280e-13
b_bio_mu -1.03147 0.18234 -5.6567 7.713e-09 0.22022 -4.6839 1.407e-06
b_bio_sig 1.54259 0.12504 12.3363 0.000000 0.10977 14.0530 0.00000
b_eu_mu -2.31987 0.20187 -11.4917 0.000000 0.19989 -11.6056 0.00000
b_eu_sig 1.94218 0.22175 8.7584 0.000000 0.25061 7.7498 4.552e-15
b_local_mu -3.23368 0.20398 -15.8530 0.000000 0.21739 -14.8747 0.00000
b_local_sig 0.74914 0.17368 4.3133 8.040e-06 0.13649 5.4888 2.024e-08


Overview of choices for MNL model component :
alt1 alt2 none
Times available 4140.00 4140.0 4140.00
Times chosen 1388.00 1478.0 1274.00
Percentage chosen overall 33.53 35.7 30.77
Percentage chosen when available 33.53 35.7 30.77


Classical covariance matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig b_eat_mu b_eat_sig b_pea_mu b_pea_sig
asc_alt1 0.004689 0.002574 2.3360e-04 1.0327e-04 -4.7294e-04 5.2321e-04 -3.5437e-04 -5.2066e-04 -8.1721e-04 9.9130e-04
asc_none 0.002574 0.020039 -0.003444 0.001795 -0.003964 0.001884 -0.004536 -7.7101e-04 -0.003218 0.002870
b_price_mu 2.3360e-04 -0.003444 0.008924 -8.562e-05 -0.001092 9.5521e-04 -0.001265 -0.004451 -0.006997 0.004359
b_price_sig 1.0327e-04 0.001795 -8.562e-05 0.010742 -0.003954 7.8876e-04 4.3231e-04 0.001914 -0.004955 5.5152e-04
b_cook_mu -4.7294e-04 -0.003964 -0.001092 -0.003954 0.048778 -0.001725 0.033799 8.3876e-04 -0.004909 -0.001676
b_cook_sig 5.2321e-04 0.001884 9.5521e-04 7.8876e-04 -0.001725 0.043729 -0.008199 0.011866 -0.007494 -0.010678
b_eat_mu -3.5437e-04 -0.004536 -0.001265 4.3231e-04 0.033799 -0.008199 0.060047 0.007152 -0.001801 -0.002548
b_eat_sig -5.2066e-04 -7.7101e-04 -0.004451 0.001914 8.3876e-04 0.011866 0.007152 0.048986 0.006972 -0.021892
b_pea_mu -8.1721e-04 -0.003218 -0.006997 -0.004955 -0.004909 -0.007494 -0.001801 0.006972 0.071296 -0.018712
b_pea_sig 9.9130e-04 0.002870 0.004359 5.5152e-04 -0.001676 -0.010678 -0.002548 -0.021892 -0.018712 0.081112
b_inschick_mu -2.4937e-04 5.7450e-04 -0.005938 -0.001363 -0.015896 0.011554 -0.007761 0.013957 0.032724 -0.013846
b_inschick_sig -5.4424e-04 -0.004847 -0.007766 0.004653 0.010984 0.009340 0.039082 0.036040 0.019704 -0.022618
b_cricket_mu -0.002140 0.012709 -0.035169 0.020489 4.312e-05 4.2244e-04 0.019872 0.049012 0.059610 -0.029893
b_cricket_sig -0.001419 0.008817 -0.021150 0.020840 0.006109 -0.017223 0.024898 0.010763 0.024994 -0.009334
b_worm_mu -0.002143 0.024365 -0.057593 0.049355 0.020908 -0.002290 0.058335 0.072519 0.073043 -0.066752
b_worm_sig 5.3920e-04 -0.016764 0.036446 -0.041019 -0.004577 0.010591 -0.031597 -0.044484 -0.032258 0.042235
b_mne_mu -2.259e-06 -3.2381e-04 7.861e-05 -0.001274 -0.012536 0.006441 -0.016609 0.001481 -0.003742 -0.008831
b_mne_sig 7.412e-05 -1.1863e-04 0.001290 0.002024 -0.005366 0.010621 -8.6760e-04 0.007290 -0.002742 -0.002727
b_bio_mu -3.1735e-04 -0.001028 -1.5445e-04 -2.0922e-04 -0.013051 -4.2738e-04 -0.012785 0.007167 -0.006132 -0.007985
b_bio_sig -1.4259e-04 -9.7624e-04 -5.8871e-04 -7.3204e-04 0.002178 0.004247 -0.001007 0.010523 6.686e-05 -0.001030
b_eu_mu 3.0287e-04 -0.002433 0.001629 -0.001520 -0.014198 0.001874 -0.017974 -0.007359 -0.013551 0.010946
b_eu_sig -0.001016 -0.005805 -0.002012 5.7477e-04 -0.005306 -0.002942 0.003097 0.010539 0.024195 -0.022993
b_local_mu 5.4729e-04 -0.003143 0.003365 -0.002995 -0.006851 -0.006784 -0.011365 -0.016120 -0.011681 0.012166
b_local_sig -1.1545e-04 0.001685 -0.001497 0.001731 -0.008383 0.004277 -0.010626 0.002191 -1.7119e-04 -0.008885
b_inschick_mu b_inschick_sig b_cricket_mu b_cricket_sig b_worm_mu b_worm_sig b_mne_mu b_mne_sig b_bio_mu b_bio_sig
asc_alt1 -2.4937e-04 -5.4424e-04 -0.002140 -0.001419 -0.002143 5.3920e-04 -2.259e-06 7.412e-05 -3.1735e-04 -1.4259e-04
asc_none 5.7450e-04 -0.004847 0.012709 0.008817 0.024365 -0.016764 -3.2381e-04 -1.1863e-04 -0.001028 -9.7624e-04
b_price_mu -0.005938 -0.007766 -0.035169 -0.021150 -0.057593 0.036446 7.861e-05 0.001290 -1.5445e-04 -5.8871e-04
b_price_sig -0.001363 0.004653 0.020489 0.020840 0.049355 -0.041019 -0.001274 0.002024 -2.0922e-04 -7.3204e-04
b_cook_mu -0.015896 0.010984 4.312e-05 0.006109 0.020908 -0.004577 -0.012536 -0.005366 -0.013051 0.002178
b_cook_sig 0.011554 0.009340 4.2244e-04 -0.017223 -0.002290 0.010591 0.006441 0.010621 -4.2738e-04 0.004247
b_eat_mu -0.007761 0.039082 0.019872 0.024898 0.058335 -0.031597 -0.016609 -8.6760e-04 -0.012785 -0.001007
b_eat_sig 0.013957 0.036040 0.049012 0.010763 0.072519 -0.044484 0.001481 0.007290 0.007167 0.010523
b_pea_mu 0.032724 0.019704 0.059610 0.024994 0.073043 -0.032258 -0.003742 -0.002742 -0.006132 6.686e-05
b_pea_sig -0.013846 -0.022618 -0.029893 -0.009334 -0.066752 0.042235 -0.008831 -0.002727 -0.007985 -0.001030
b_inschick_mu 0.074681 0.077367 0.049434 0.008302 0.081011 -0.038109 -0.005482 0.007995 -0.008468 0.005954
b_inschick_sig 0.077367 0.218212 0.066031 0.023747 0.197487 -0.124492 -0.020853 0.018162 -0.019380 0.015128
b_cricket_mu 0.049434 0.066031 1.016791 0.784576 0.713183 -0.477986 -0.007098 -0.008695 -0.009867 0.006464
b_cricket_sig 0.008302 0.023747 0.784576 0.714801 0.517615 -0.379034 -0.003970 -0.015981 -4.5532e-04 -0.003476
b_worm_mu 0.081011 0.197487 0.713183 0.517615 2.870819 -2.078917 -0.026573 0.012724 -0.008620 0.006005
b_worm_sig -0.038109 -0.124492 -0.477986 -0.379034 -2.078917 1.618064 0.008091 -0.006031 -0.008020 -0.003627
b_mne_mu -0.005482 -0.020853 -0.007098 -0.003970 -0.026573 0.008091 0.028159 -0.001620 0.010661 -0.002582
b_mne_sig 0.007995 0.018162 -0.008695 -0.015981 0.012724 -0.006031 -0.001620 0.030242 0.001731 0.002076
b_bio_mu -0.008468 -0.019380 -0.009867 -4.5532e-04 -0.008620 -0.008020 0.010661 0.001731 0.033249 -0.003779
b_bio_sig 0.005954 0.015128 0.006464 -0.003476 0.006005 -0.003627 -0.002582 0.002076 -0.003779 0.015636
b_eu_mu -0.005286 -0.010935 -0.028552 -0.017633 -0.050289 0.022319 0.002314 -0.001576 -0.001596 0.002672
b_eu_sig 0.017590 0.024099 0.021911 0.014170 0.052050 -0.040393 0.001161 3.2301e-04 0.006768 0.002454
b_local_mu -0.005988 -4.6169e-04 -0.059159 -0.033601 -0.088313 0.043731 -0.004797 0.002240 -0.007796 0.002799
b_local_sig -0.001203 -0.002486 0.015994 0.005314 0.046055 -0.017918 0.007267 -1.5057e-04 0.008718 -0.002528
b_eu_mu b_eu_sig b_local_mu b_local_sig
asc_alt1 3.0287e-04 -0.001016 5.4729e-04 -1.1545e-04
asc_none -0.002433 -0.005805 -0.003143 0.001685
b_price_mu 0.001629 -0.002012 0.003365 -0.001497
b_price_sig -0.001520 5.7477e-04 -0.002995 0.001731
b_cook_mu -0.014198 -0.005306 -0.006851 -0.008383
b_cook_sig 0.001874 -0.002942 -0.006784 0.004277
b_eat_mu -0.017974 0.003097 -0.011365 -0.010626
b_eat_sig -0.007359 0.010539 -0.016120 0.002191
b_pea_mu -0.013551 0.024195 -0.011681 -1.7119e-04
b_pea_sig 0.010946 -0.022993 0.012166 -0.008885
b_inschick_mu -0.005286 0.017590 -0.005988 -0.001203
b_inschick_sig -0.010935 0.024099 -4.6169e-04 -0.002486
b_cricket_mu -0.028552 0.021911 -0.059159 0.015994
b_cricket_sig -0.017633 0.014170 -0.033601 0.005314
b_worm_mu -0.050289 0.052050 -0.088313 0.046055
b_worm_sig 0.022319 -0.040393 0.043731 -0.017918
b_mne_mu 0.002314 0.001161 -0.004797 0.007267
b_mne_sig -0.001576 3.2301e-04 0.002240 -1.5057e-04
b_bio_mu -0.001596 0.006768 -0.007796 0.008718
b_bio_sig 0.002672 0.002454 0.002799 -0.002528
b_eu_mu 0.040753 0.004626 0.020616 -8.5508e-04
b_eu_sig 0.004626 0.049173 -0.004188 0.001596
b_local_mu 0.020616 -0.004188 0.041608 -0.006655
b_local_sig -8.5508e-04 0.001596 -0.006655 0.030165

Robust covariance matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig b_eat_mu b_eat_sig b_pea_mu b_pea_sig
asc_alt1 0.005759 0.004079 9.964e-05 3.0120e-04 6.8826e-04 -8.832e-05 2.6771e-04 -0.001575 -0.002301 0.002513
asc_none 0.004079 0.031666 -0.003307 -0.002732 5.9883e-04 0.004988 -0.003581 -0.001486 -0.008414 0.006186
b_price_mu 9.964e-05 -0.003307 0.013521 0.001915 -0.002591 0.005781 -0.006489 -0.008279 -0.019103 0.006616
b_price_sig 3.0120e-04 -0.002732 0.001915 0.012666 -0.001347 4.6502e-04 0.004529 0.002770 -0.008095 5.0528e-04
b_cook_mu 6.8826e-04 5.9883e-04 -0.002591 -0.001347 0.052925 -0.005928 0.048444 0.008324 -0.002376 -0.002416
b_cook_sig -8.832e-05 0.004988 0.005781 4.6502e-04 -0.005928 0.050700 -0.016540 0.019991 -0.030550 -0.015403
b_eat_mu 2.6771e-04 -0.003581 -0.006489 0.004529 0.048444 -0.016540 0.072710 0.016918 0.011226 -0.002161
b_eat_sig -0.001575 -0.001486 -0.008279 0.002770 0.008324 0.019991 0.016918 0.051748 0.010732 -0.039367
b_pea_mu -0.002301 -0.008414 -0.019103 -0.008095 -0.002376 -0.030550 0.011226 0.010732 0.101218 -0.024861
b_pea_sig 0.002513 0.006186 0.006616 5.0528e-04 -0.002416 -0.015403 -0.002161 -0.039367 -0.024861 0.100589
b_inschick_mu -0.001382 -0.003209 -0.015730 -0.005832 -0.006799 -0.001160 0.008987 0.017788 0.060065 -0.015299
b_inschick_sig -0.001793 -0.008810 -0.022728 0.006231 0.037927 -0.005059 0.081309 0.057209 0.068777 -0.038674
b_cricket_mu -0.001061 0.001646 -0.076843 0.017083 0.057175 -0.080741 0.115768 0.066523 0.153879 -0.017226
b_cricket_sig 7.6122e-04 -1.8540e-04 -0.044666 0.024485 0.043469 -0.077768 0.088516 0.019430 0.083544 0.002431
b_worm_mu 0.003059 0.021620 -0.126597 0.046355 0.125461 -0.125132 0.242184 0.143824 0.245395 -0.114365
b_worm_sig -0.003738 -0.015427 0.073933 -0.044609 -0.064759 0.080285 -0.143866 -0.091130 -0.131677 0.087216
b_mne_mu -3.2567e-04 0.001331 0.005925 5.6852e-04 -0.026842 0.019788 -0.037209 6.8990e-04 -0.020329 -0.015078
b_mne_sig -6.5628e-04 8.2941e-04 0.002370 6.9054e-04 -0.006646 0.021602 -0.006183 0.011524 -0.015298 -0.006667
b_bio_mu -0.001201 -0.001105 0.004040 0.001584 -0.020264 0.012360 -0.024409 0.007888 -0.021504 -0.024722
b_bio_sig -3.4806e-04 -6.4096e-04 -0.001103 -6.2271e-04 0.007602 0.004576 0.007662 0.009916 0.001848 -3.0565e-04
b_eu_mu -4.3495e-04 -0.001034 0.004151 -0.001113 -0.024138 0.003280 -0.028761 -0.011666 -0.011405 0.008390
b_eu_sig -0.002737 -0.009142 -0.007074 0.002518 -0.006283 -0.011655 0.007395 0.018211 0.044742 -0.048309
b_local_mu 7.7160e-04 -0.001633 0.007229 -0.003680 -0.016582 -0.002947 -0.023506 -0.022975 -0.012506 0.018576
b_local_sig -5.2690e-04 0.001183 -0.002209 0.002794 -0.008791 0.003886 -0.010317 0.004723 0.001186 -0.014218
b_inschick_mu b_inschick_sig b_cricket_mu b_cricket_sig b_worm_mu b_worm_sig b_mne_mu b_mne_sig b_bio_mu b_bio_sig
asc_alt1 -0.001382 -0.001793 -0.001061 7.6122e-04 0.003059 -0.003738 -3.2567e-04 -6.5628e-04 -0.001201 -3.4806e-04
asc_none -0.003209 -0.008810 0.001646 -1.8540e-04 0.021620 -0.015427 0.001331 8.2941e-04 -0.001105 -6.4096e-04
b_price_mu -0.015730 -0.022728 -0.076843 -0.044666 -0.126597 0.073933 0.005925 0.002370 0.004040 -0.001103
b_price_sig -0.005832 0.006231 0.017083 0.024485 0.046355 -0.044609 5.6852e-04 6.9054e-04 0.001584 -6.2271e-04
b_cook_mu -0.006799 0.037927 0.057175 0.043469 0.125461 -0.064759 -0.026842 -0.006646 -0.020264 0.007602
b_cook_sig -0.001160 -0.005059 -0.080741 -0.077768 -0.125132 0.080285 0.019788 0.021602 0.012360 0.004576
b_eat_mu 0.008987 0.081309 0.115768 0.088516 0.242184 -0.143866 -0.037209 -0.006183 -0.024409 0.007662
b_eat_sig 0.017788 0.057209 0.066523 0.019430 0.143824 -0.091130 6.8990e-04 0.011524 0.007888 0.009916
b_pea_mu 0.060065 0.068777 0.153879 0.083544 0.245395 -0.131677 -0.020329 -0.015298 -0.021504 0.001848
b_pea_sig -0.015299 -0.038674 -0.017226 0.002431 -0.114365 0.087216 -0.015078 -0.006667 -0.024722 -3.0565e-04
b_inschick_mu 0.084171 0.120799 0.134745 0.055369 0.226770 -0.122276 -0.022511 0.003833 -0.028761 0.012218
b_inschick_sig 0.120799 0.298143 0.279277 0.151367 0.573594 -0.355021 -0.063437 0.017083 -0.057357 0.028721
b_cricket_mu 0.134745 0.279277 1.705656 1.261452 1.999112 -1.297258 -0.085186 -0.051619 -0.075125 0.013724
b_cricket_sig 0.055369 0.151367 1.261452 1.028830 1.436951 -0.974065 -0.053413 -0.046461 -0.039331 -4.6807e-04
b_worm_mu 0.226770 0.573594 1.999112 1.436951 4.737497 -3.245689 -0.144997 -0.044412 -0.094701 0.021723
b_worm_sig -0.122276 -0.355021 -1.297258 -0.974065 -3.245689 2.320949 0.071896 0.020969 0.033377 -0.008106
b_mne_mu -0.022511 -0.063437 -0.085186 -0.053413 -0.144997 0.071896 0.041271 0.006959 0.030934 -0.008231
b_mne_sig 0.003833 0.017083 -0.051619 -0.046461 -0.044412 0.020969 0.006959 0.027299 0.007973 0.002999
b_bio_mu -0.028761 -0.057357 -0.075125 -0.039331 -0.094701 0.033377 0.030934 0.007973 0.048495 -0.008515
b_bio_sig 0.012218 0.028721 0.013724 -4.6807e-04 0.021723 -0.008106 -0.008231 0.002999 -0.008515 0.012049
b_eu_mu -0.004411 -0.020538 -0.065541 -0.045570 -0.136883 0.075654 0.008933 0.003893 0.003682 -8.9920e-04
b_eu_sig 0.025978 0.051494 0.047482 0.032268 0.136730 -0.102622 -9.1513e-04 -0.002292 0.009674 0.002666
b_local_mu -5.9983e-04 -0.006087 -0.102301 -0.071773 -0.193722 0.113589 -6.9410e-04 0.006637 -0.008667 7.3654e-04
b_local_sig -0.002898 -0.007704 0.026606 0.018716 0.073767 -0.050567 0.010827 0.001096 0.013163 -0.004524
b_eu_mu b_eu_sig b_local_mu b_local_sig
asc_alt1 -4.3495e-04 -0.002737 7.7160e-04 -5.2690e-04
asc_none -0.001034 -0.009142 -0.001633 0.001183
b_price_mu 0.004151 -0.007074 0.007229 -0.002209
b_price_sig -0.001113 0.002518 -0.003680 0.002794
b_cook_mu -0.024138 -0.006283 -0.016582 -0.008791
b_cook_sig 0.003280 -0.011655 -0.002947 0.003886
b_eat_mu -0.028761 0.007395 -0.023506 -0.010317
b_eat_sig -0.011666 0.018211 -0.022975 0.004723
b_pea_mu -0.011405 0.044742 -0.012506 0.001186
b_pea_sig 0.008390 -0.048309 0.018576 -0.014218
b_inschick_mu -0.004411 0.025978 -5.9983e-04 -0.002898
b_inschick_sig -0.020538 0.051494 -0.006087 -0.007704
b_cricket_mu -0.065541 0.047482 -0.102301 0.026606
b_cricket_sig -0.045570 0.032268 -0.071773 0.018716
b_worm_mu -0.136883 0.136730 -0.193722 0.073767
b_worm_sig 0.075654 -0.102622 0.113589 -0.050567
b_mne_mu 0.008933 -9.1513e-04 -6.9410e-04 0.010827
b_mne_sig 0.003893 -0.002292 0.006637 0.001096
b_bio_mu 0.003682 0.009674 -0.008667 0.013163
b_bio_sig -8.9920e-04 0.002666 7.3654e-04 -0.004524
b_eu_mu 0.039957 0.009333 0.029424 -5.9587e-04
b_eu_sig 0.009333 0.062805 -0.003757 0.007016
b_local_mu 0.029424 -0.003757 0.047260 -0.009547
b_local_sig -5.9587e-04 0.007016 -0.009547 0.018629

Classical correlation matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig b_eat_mu b_eat_sig b_pea_mu b_pea_sig
asc_alt1 1.000000 0.265494 0.036111 0.014550 -0.03127 0.036539 -0.02112 -0.03435 -0.044695 0.05083
asc_none 0.265494 1.000000 -0.257511 0.122325 -0.12678 0.063654 -0.13078 -0.02461 -0.085130 0.07118
b_price_mu 0.036111 -0.257511 1.000000 -0.008744 -0.05236 0.048353 -0.05463 -0.21289 -0.277383 0.16202
b_price_sig 0.014550 0.122325 -0.008744 1.000000 -0.17273 0.036392 0.01702 0.08343 -0.179035 0.01868
b_cook_mu -0.031272 -0.126783 -0.052356 -0.172725 1.00000 -0.037356 0.62453 0.01716 -0.083242 -0.02664
b_cook_sig 0.036539 0.063654 0.048353 0.036392 -0.03736 1.000000 -0.16001 0.25637 -0.134216 -0.17929
b_eat_mu -0.021119 -0.130776 -0.054626 0.017021 0.62453 -0.160008 1.00000 0.13188 -0.027530 -0.03651
b_eat_sig -0.034354 -0.024609 -0.212890 0.083428 0.01716 0.256373 0.13188 1.00000 0.117972 -0.34731
b_pea_mu -0.044695 -0.085130 -0.277383 -0.179035 -0.08324 -0.134216 -0.02753 0.11797 1.000000 -0.24607
b_pea_sig 0.050830 0.071179 0.162018 0.018684 -0.02664 -0.179292 -0.03651 -0.34731 -0.246067 1.00000
b_inschick_mu -0.013326 0.014851 -0.230024 -0.048137 -0.26337 0.202175 -0.11590 0.23076 0.448461 -0.17790
b_inschick_sig -0.017014 -0.073306 -0.175972 0.096113 0.10647 0.095617 0.34143 0.34859 0.157974 -0.17001
b_cricket_mu -0.030987 0.089033 -0.369188 0.196045 1.9361e-04 0.002003 0.08042 0.21961 0.221394 -0.10409
b_cricket_sig -0.024518 0.073675 -0.264800 0.237817 0.03272 -0.097416 0.12018 0.05752 0.110715 -0.03876
b_worm_mu -0.018474 0.101585 -0.359810 0.281045 0.05587 -0.006462 0.14050 0.19338 0.161452 -0.13833
b_worm_sig 0.006190 -0.093100 0.303290 -0.311125 -0.01629 0.039815 -0.10137 -0.15801 -0.094975 0.11658
b_mne_mu -1.9658e-04 -0.013632 0.004959 -0.073258 -0.33824 0.183562 -0.40392 0.03988 -0.083518 -0.18477
b_mne_sig 0.006225 -0.004819 0.078548 0.112319 -0.13971 0.292061 -0.02036 0.18940 -0.059061 -0.05507
b_bio_mu -0.025416 -0.039822 -0.008966 -0.011070 -0.32407 -0.011208 -0.28613 0.17759 -0.125937 -0.15376
b_bio_sig -0.016653 -0.055152 -0.049836 -0.056483 0.07887 0.162407 -0.03285 0.38023 0.002002 -0.02892
b_eu_mu 0.021909 -0.085130 0.085425 -0.072648 -0.31845 0.044401 -0.36335 -0.16471 -0.251399 0.19038
b_eu_sig -0.066928 -0.184944 -0.096032 0.025008 -0.10834 -0.063450 0.05700 0.21473 0.408633 -0.36406
b_local_mu 0.039183 -0.108860 0.174628 -0.141673 -0.15206 -0.159041 -0.22737 -0.35707 -0.214458 0.20942
b_local_sig -0.009708 0.068527 -0.091209 0.096184 -0.21854 0.117749 -0.24966 0.05699 -0.003692 -0.17962
b_inschick_mu b_inschick_sig b_cricket_mu b_cricket_sig b_worm_mu b_worm_sig b_mne_mu b_mne_sig b_bio_mu b_bio_sig
asc_alt1 -0.01333 -0.017014 -0.030987 -0.024518 -0.018474 0.006190 -1.9658e-04 0.006225 -0.025416 -0.016653
asc_none 0.01485 -0.073306 0.089033 0.073675 0.101585 -0.093100 -0.013632 -0.004819 -0.039822 -0.055152
b_price_mu -0.23002 -0.175972 -0.369188 -0.264800 -0.359810 0.303290 0.004959 0.078548 -0.008966 -0.049836
b_price_sig -0.04814 0.096113 0.196045 0.237817 0.281045 -0.311125 -0.073258 0.112319 -0.011070 -0.056483
b_cook_mu -0.26337 0.106466 1.9361e-04 0.032716 0.055872 -0.016291 -0.338242 -0.139712 -0.324066 0.078874
b_cook_sig 0.20218 0.095617 0.002003 -0.097416 -0.006462 0.039815 0.183562 0.292061 -0.011208 0.162407
b_eat_mu -0.11590 0.341425 0.080422 0.120178 0.140500 -0.101367 -0.403920 -0.020360 -0.286135 -0.032848
b_eat_sig 0.23076 0.348586 0.219608 0.057517 0.193380 -0.158006 0.039879 0.189405 0.177594 0.380231
b_pea_mu 0.44846 0.157974 0.221394 0.110715 0.161452 -0.094975 -0.083518 -0.059061 -0.125937 0.002002
b_pea_sig -0.17790 -0.170010 -0.104092 -0.038765 -0.138330 0.116581 -0.184773 -0.055066 -0.153763 -0.028919
b_inschick_mu 1.00000 0.606052 0.179394 0.035932 0.174958 -0.109630 -0.119541 0.168228 -0.169931 0.174232
b_inschick_sig 0.60605 1.000000 0.140183 0.060128 0.249514 -0.209509 -0.266022 0.223570 -0.227524 0.258981
b_cricket_mu 0.17939 0.140183 1.000000 0.920294 0.417429 -0.372651 -0.041951 -0.049583 -0.053663 0.051262
b_cricket_sig 0.03593 0.060128 0.920294 1.000000 0.361336 -0.352442 -0.027981 -0.108691 -0.002953 -0.032880
b_worm_mu 0.17496 0.249514 0.417429 0.361336 1.000000 -0.964576 -0.093463 0.043185 -0.027901 0.028343
b_worm_sig -0.10963 -0.209509 -0.372651 -0.352442 -0.964576 1.000000 0.037903 -0.027264 -0.034576 -0.022804
b_mne_mu -0.11954 -0.266022 -0.041951 -0.027981 -0.093463 0.037903 1.000000 -0.055525 0.348423 -0.123042
b_mne_sig 0.16823 0.223570 -0.049583 -0.108691 0.043185 -0.027264 -0.055525 1.000000 0.054579 0.095472
b_bio_mu -0.16993 -0.227524 -0.053663 -0.002953 -0.027901 -0.034576 0.348423 0.054579 1.000000 -0.165756
b_bio_sig 0.17423 0.258981 0.051262 -0.032880 0.028343 -0.022804 -0.123042 0.095472 -0.165756 1.000000
b_eu_mu -0.09581 -0.115959 -0.140262 -0.103315 -0.147024 0.086914 0.068301 -0.044894 -0.043361 0.105849
b_eu_sig 0.29027 0.232644 0.097992 0.075580 0.138534 -0.143202 0.031212 0.008376 0.167379 0.088502
b_local_mu -0.10742 -0.004845 -0.287617 -0.194837 -0.255526 0.168540 -0.140145 0.063136 -0.209614 0.109723
b_local_sig -0.02534 -0.030644 0.091327 0.036189 0.156504 -0.081105 0.249333 -0.004985 0.275295 -0.116415
b_eu_mu b_eu_sig b_local_mu b_local_sig
asc_alt1 0.02191 -0.066928 0.039183 -0.009708
asc_none -0.08513 -0.184944 -0.108860 0.068527
b_price_mu 0.08543 -0.096032 0.174628 -0.091209
b_price_sig -0.07265 0.025008 -0.141673 0.096184
b_cook_mu -0.31845 -0.108342 -0.152064 -0.218544
b_cook_sig 0.04440 -0.063450 -0.159041 0.117749
b_eat_mu -0.36335 0.056996 -0.227371 -0.249664
b_eat_sig -0.16471 0.214734 -0.357071 0.056992
b_pea_mu -0.25140 0.408633 -0.214458 -0.003692
b_pea_sig 0.19038 -0.364064 0.209419 -0.179620
b_inschick_mu -0.09581 0.290270 -0.107418 -0.025341
b_inschick_sig -0.11596 0.232644 -0.004845 -0.030644
b_cricket_mu -0.14026 0.097992 -0.287617 0.091327
b_cricket_sig -0.10332 0.075580 -0.194837 0.036189
b_worm_mu -0.14702 0.138534 -0.255526 0.156504
b_worm_sig 0.08691 -0.143202 0.168540 -0.081105
b_mne_mu 0.06830 0.031212 -0.140145 0.249333
b_mne_sig -0.04489 0.008376 0.063136 -0.004985
b_bio_mu -0.04336 0.167379 -0.209614 0.275295
b_bio_sig 0.10585 0.088502 0.109723 -0.116415
b_eu_mu 1.00000 0.103344 0.500660 -0.024388
b_eu_sig 0.10334 1.000000 -0.092584 0.041430
b_local_mu 0.50066 -0.092584 1.000000 -0.187842
b_local_sig -0.02439 0.041430 -0.187842 1.000000

Robust correlation matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig b_eat_mu b_eat_sig b_pea_mu b_pea_sig
asc_alt1 1.000000 0.302044 0.01129 0.03527 0.03942 -0.005169 0.01308 -0.09122 -0.09528 0.104410
asc_none 0.302044 1.000000 -0.15982 -0.13644 0.01463 0.124477 -0.07463 -0.03672 -0.14861 0.109608
b_price_mu 0.011291 -0.159815 1.00000 0.14630 -0.09686 0.220804 -0.20696 -0.31300 -0.51638 0.179407
b_price_sig 0.035268 -0.136437 0.14630 1.00000 -0.05201 0.018351 0.14924 0.10818 -0.22608 0.014156
b_cook_mu 0.039423 0.014628 -0.09686 -0.05201 1.00000 -0.114442 0.78094 0.15906 -0.03247 -0.033114
b_cook_sig -0.005169 0.124477 0.22080 0.01835 -0.11444 1.000000 -0.27241 0.39029 -0.42647 -0.215692
b_eat_mu 0.013083 -0.074632 -0.20696 0.14924 0.78094 -0.272412 1.00000 0.27580 0.13086 -0.025271
b_eat_sig -0.091216 -0.036721 -0.31300 0.10818 0.15906 0.390287 0.27580 1.00000 0.14829 -0.545647
b_pea_mu -0.095285 -0.148614 -0.51638 -0.22608 -0.03247 -0.426465 0.13086 0.14829 1.00000 -0.246388
b_pea_sig 0.104410 0.109608 0.17941 0.01416 -0.03311 -0.215692 -0.02527 -0.54565 -0.24639 1.000000
b_inschick_mu -0.062770 -0.062164 -0.46627 -0.17862 -0.10186 -0.017751 0.11487 0.26953 0.65075 -0.166270
b_inschick_sig -0.043278 -0.090674 -0.35796 0.10139 0.30193 -0.041151 0.55224 0.46057 0.39591 -0.223325
b_cricket_mu -0.010705 0.007084 -0.50600 0.11623 0.19030 -0.274566 0.32873 0.22391 0.37034 -0.041588
b_cricket_sig 0.009889 -0.001027 -0.37870 0.21449 0.18629 -0.340506 0.32363 0.08421 0.25889 0.007556
b_worm_mu 0.018517 0.055818 -0.50020 0.18924 0.25056 -0.255322 0.41264 0.29047 0.35438 -0.165670
b_worm_sig -0.032328 -0.056906 0.41735 -0.26018 -0.18477 0.234045 -0.35021 -0.26295 -0.27167 0.180505
b_mne_mu -0.021124 0.036807 0.25082 0.02487 -0.57434 0.432577 -0.67924 0.01493 -0.31453 -0.234016
b_mne_sig -0.052340 0.028210 0.12335 0.03714 -0.17485 0.580654 -0.13877 0.30660 -0.29102 -0.127226
b_bio_mu -0.071875 -0.028206 0.15777 0.06390 -0.40000 0.249275 -0.41107 0.15746 -0.30694 -0.353959
b_bio_sig -0.041783 -0.032813 -0.08644 -0.05041 0.30102 0.185124 0.25886 0.39710 0.05293 -0.008779
b_eu_mu -0.028673 -0.029058 0.17860 -0.04948 -0.52491 0.072877 -0.53359 -0.25656 -0.17934 0.132347
b_eu_sig -0.143939 -0.204991 -0.24276 0.08928 -0.10897 -0.206552 0.10943 0.31944 0.56116 -0.607789
b_local_mu 0.046771 -0.042206 0.28598 -0.15039 -0.33156 -0.060195 -0.40099 -0.46458 -0.18082 0.269422
b_local_sig -0.050870 0.048710 -0.13920 0.18191 -0.27996 0.126439 -0.28032 0.15212 0.02731 -0.328444
b_inschick_mu b_inschick_sig b_cricket_mu b_cricket_sig b_worm_mu b_worm_sig b_mne_mu b_mne_sig b_bio_mu b_bio_sig
asc_alt1 -0.062770 -0.04328 -0.010705 0.009889 0.01852 -0.03233 -0.02112 -0.05234 -0.07187 -0.041783
asc_none -0.062164 -0.09067 0.007084 -0.001027 0.05582 -0.05691 0.03681 0.02821 -0.02821 -0.032813
b_price_mu -0.466271 -0.35796 -0.506001 -0.378702 -0.50020 0.41735 0.25082 0.12335 0.15777 -0.086437
b_price_sig -0.178624 0.10139 0.116229 0.214494 0.18924 -0.26018 0.02487 0.03714 0.06390 -0.050407
b_cook_mu -0.101862 0.30193 0.190297 0.186285 0.25056 -0.18477 -0.57434 -0.17485 -0.40000 0.301023
b_cook_sig -0.017751 -0.04115 -0.274566 -0.340506 -0.25532 0.23404 0.43258 0.58065 0.24927 0.185124
b_eat_mu 0.114872 0.55224 0.328734 0.323632 0.41264 -0.35021 -0.67924 -0.13877 -0.41107 0.258856
b_eat_sig 0.269527 0.46057 0.223912 0.084207 0.29047 -0.26295 0.01493 0.30660 0.15746 0.397098
b_pea_mu 0.650751 0.39591 0.370344 0.258889 0.35438 -0.27167 -0.31453 -0.29102 -0.30694 0.052926
b_pea_sig -0.166270 -0.22332 -0.041588 0.007556 -0.16567 0.18050 -0.23402 -0.12723 -0.35396 -0.008779
b_inschick_mu 1.000000 0.76256 0.355621 0.188155 0.35911 -0.27665 -0.38194 0.07996 -0.45018 0.383642
b_inschick_sig 0.762557 1.00000 0.391631 0.273304 0.48263 -0.42679 -0.57188 0.18936 -0.47700 0.479189
b_cricket_mu 0.355621 0.39163 1.000000 0.952255 0.70326 -0.65200 -0.32107 -0.23921 -0.26121 0.095734
b_cricket_sig 0.188155 0.27330 0.952255 1.000000 0.65087 -0.63035 -0.25921 -0.27723 -0.17608 -0.004204
b_worm_mu 0.359112 0.48263 0.703262 0.650872 1.00000 -0.97881 -0.32791 -0.12349 -0.19757 0.090920
b_worm_sig -0.276649 -0.42679 -0.652000 -0.630352 -0.97881 1.00000 0.23230 0.08330 0.09949 -0.048469
b_mne_mu -0.381938 -0.57188 -0.321067 -0.259208 -0.32791 0.23230 1.00000 0.20731 0.69145 -0.369117
b_mne_sig 0.079957 0.18936 -0.239212 -0.277228 -0.12349 0.08330 0.20731 1.00000 0.21911 0.165376
b_bio_mu -0.450175 -0.47700 -0.261210 -0.176081 -0.19757 0.09949 0.69145 0.21911 1.00000 -0.352258
b_bio_sig 0.383642 0.47919 0.095734 -0.004204 0.09092 -0.04847 -0.36912 0.16538 -0.35226 1.000000
b_eu_mu -0.076064 -0.18817 -0.251059 -0.224759 -0.31462 0.24843 0.21997 0.11787 0.08364 -0.040981
b_eu_sig 0.357300 0.37631 0.145072 0.126939 0.25066 -0.26879 -0.01797 -0.05535 0.17529 0.096918
b_local_mu -0.009510 -0.05128 -0.360320 -0.325491 -0.40941 0.34297 -0.01572 0.18478 -0.18104 0.030865
b_local_sig -0.073188 -0.10337 0.149262 0.135191 0.24831 -0.24319 0.39047 0.04862 0.43793 -0.301940
b_eu_mu b_eu_sig b_local_mu b_local_sig
asc_alt1 -0.02867 -0.14394 0.046771 -0.05087
asc_none -0.02906 -0.20499 -0.042206 0.04871
b_price_mu 0.17860 -0.24276 0.285985 -0.13920
b_price_sig -0.04948 0.08928 -0.150395 0.18191
b_cook_mu -0.52491 -0.10897 -0.331558 -0.27996
b_cook_sig 0.07288 -0.20655 -0.060195 0.12644
b_eat_mu -0.53359 0.10943 -0.400993 -0.28032
b_eat_sig -0.25656 0.31944 -0.464576 0.15212
b_pea_mu -0.17934 0.56116 -0.180820 0.02731
b_pea_sig 0.13235 -0.60779 0.269422 -0.32844
b_inschick_mu -0.07606 0.35730 -0.009510 -0.07319
b_inschick_sig -0.18817 0.37631 -0.051275 -0.10337
b_cricket_mu -0.25106 0.14507 -0.360320 0.14926
b_cricket_sig -0.22476 0.12694 -0.325491 0.13519
b_worm_mu -0.31462 0.25066 -0.409409 0.24831
b_worm_sig 0.24843 -0.26879 0.342969 -0.24319
b_mne_mu 0.21997 -0.01797 -0.015716 0.39047
b_mne_sig 0.11787 -0.05535 0.184776 0.04862
b_bio_mu 0.08364 0.17529 -0.181044 0.43793
b_bio_sig -0.04098 0.09692 0.030865 -0.30194
b_eu_mu 1.00000 0.18631 0.677114 -0.02184
b_eu_sig 0.18631 1.00000 -0.068953 0.20512
b_local_mu 0.67711 -0.06895 1.000000 -0.32177
b_local_sig -0.02184 0.20512 -0.321767 1.00000

20 worst outliers in terms of lowest average per choice prediction:
ID Avg prob per choice
1188 0.1723660
1131 0.1876989
1381 0.1971146
1023 0.2000503
1245 0.2078843
1348 0.2081108
1191 0.2404860
1274 0.2442710
1200 0.2466367
1260 0.2534544
1247 0.2572143
1233 0.2638303
1183 0.2684403
1140 0.2725287
1232 0.2750890
1034 0.2880844
1069 0.2888028
1172 0.2895293
1021 0.2945567
1057 0.2995179

Changes in parameter estimates from starting values:
Initial Estimate Difference
asc_alt1 -0.06235 -0.09045 -0.02810
asc_alt2 0.00000 0.00000 0.00000
asc_none -0.68856 -2.84957 -2.16101
b_price_mu -5.00000 -0.74496 4.25504
b_price_sig 0.01315 1.39819 1.38504
b_cook_mu 0.59419 -1.29069 -1.88488
b_cook_sig 0.08434 3.28305 3.19871
b_eat_mu 0.36438 0.11070 -0.25368
b_eat_sig 0.08305 3.56962 3.48657
b_pea_mu -0.34364 2.04195 2.38559
b_pea_sig 0.08207 -4.58045 -4.66252
b_inschick_mu -0.76620 3.75138 4.51758
b_inschick_sig 0.09156 6.53406 6.44250
b_cricket_mu -2.08199 14.04226 16.12425
b_cricket_sig 0.11984 7.16602 7.04618
b_worm_mu -2.40879 18.85470 21.26349
b_worm_sig 0.13565 -10.36252 -10.49817
b_mne_mu 0.02511 0.46278 0.43767
b_mne_sig 0.04621 1.20875 1.16254
b_bio_mu 0.26311 -1.03147 -1.29458
b_bio_sig 0.04350 1.54259 1.49909
b_eu_mu 0.55187 -2.31987 -2.87174
b_eu_sig 0.06826 1.94218 1.87392
b_local_mu 0.73714 -3.23368 -3.97082
b_local_sig 0.06495 0.74914 0.68419

Settings and functions used in model definition:

apollo_control
--------------
Value
modelName "MMNL_SUSINCHAIN_CB7_PT_PRIOR_WTP2"
modelDescr "Code written together_chicken base"
indivID "id"
mixing "TRUE"
nCores "4"
workInLogs "FALSE"
debug "FALSE"
seed "13"
HB "FALSE"
noValidation "FALSE"
noDiagnostics "FALSE"
calculateLLC "TRUE"
outputDirectory "C:/Users/EmiliaCD/Dropbox/Compus/2022/Susinchain/3_Daten/Syncronized/From zero/Final estimations/Portugal/ML - WTP/"
panelData "TRUE"
analyticGrad "TRUE"
analyticGrad_manualSet "FALSE"

Hessian routines attempted
--------------
numerical jacobian of LL analytical gradient

Scaling in estimation
--------------
Value
asc_alt1 0.09045374
asc_none 2.84956268
b_price_mu 0.74496503
b_price_sig 1.39819148
b_cook_mu 1.29069064
b_cook_sig 3.28305181
b_eat_mu 0.11069825
b_eat_sig 3.56962133
b_pea_mu 2.04194714
b_pea_sig 4.58045652
b_inschick_mu 3.75137168
b_inschick_sig 6.53406604
b_cricket_mu 14.04221112
b_cricket_sig 7.16603301
b_worm_mu 18.85461676
b_worm_sig 10.36255090
b_mne_mu 0.46277996
b_mne_sig 1.20875198
b_bio_mu 1.03147359
b_bio_sig 1.54259613
b_eu_mu 2.31986505
b_eu_sig 1.94218200
b_local_mu 3.23369011
b_local_sig 0.74914423

Scaling used in computing Hessian
--------------
Value
asc_alt1 0.09045374
asc_none 2.84956598
b_price_mu 0.74496499
b_price_sig 1.39819068
b_cook_mu 1.29069091
b_cook_sig 3.28304699
b_eat_mu 0.11069825
b_eat_sig 3.56962254
b_pea_mu 2.04194563
b_pea_sig 4.58045063
b_inschick_mu 3.75138146
b_inschick_sig 6.53406428
b_cricket_mu 14.04225697
b_cricket_sig 7.16601774
b_worm_mu 18.85470429
b_worm_sig 10.36252440
b_mne_mu 0.46277995
b_mne_sig 1.20875173
b_bio_mu 1.03147331
b_bio_sig 1.54259425
b_eu_mu 2.31986857
b_eu_sig 1.94218415
b_local_mu 3.23368373
b_local_sig 0.74914439


apollo_randCoeff
----------------
function(apollo_beta, apollo_inputs){
randcoeff = list()

randcoeff[["b_price"]] = -exp(b_price_mu + b_price_sig * draws_price)
randcoeff[["b_cook"]] = b_cook_mu + b_cook_sig * draws_cook
randcoeff[["b_eat"]] = b_eat_mu + b_eat_sig * draws_eat
randcoeff[["b_pea"]] = b_pea_mu + b_pea_sig * draws_pea
randcoeff[["b_inschick"]] = b_inschick_mu + b_inschick_sig * draws_inschick
randcoeff[["b_cricket"]] = b_cricket_mu + b_cricket_sig * draws_cricket
randcoeff[["b_worm"]] = b_worm_mu + b_worm_sig * draws_worm
randcoeff[["b_mne"]] = b_mne_mu + b_mne_sig * draws_mne
randcoeff[["b_bio"]] = b_bio_mu + b_bio_sig * draws_bio
randcoeff[["b_eu"]] = b_eu_mu + b_eu_sig * draws_eu
randcoeff[["b_local"]] = b_local_mu + b_local_sig * draws_local


return(randcoeff)
}
<bytecode: 0x0000019ea321b038>


apollo_probabilities
--------------------
function(apollo_beta, apollo_inputs, functionality="estimate"){

### Function initialisation: do not change the following three commands
### Attach inputs and detach after function exit
apollo_attach(apollo_beta, apollo_inputs)
on.exit(apollo_detach(apollo_beta, apollo_inputs))

### Create list of probabilities P
P = list()

### Create alternative specific constants and coefficients with interactions with socio-demographics

#b_peaa = b_pea + b_pea_shift_tins * (scenario == 2) + b_pea_shift_tsus * (scenario == 3)
#b_cricketa = b_cricket + b_cricket_shift_tins * (scenario == 2) + b_cricket_shift_tsus * (scenario == 3)
#b_inschicka = b_inschick + b_inschick_shift_tins * (scenario == 2) + b_inschick_shift_tsus * (scenario == 3)
#b_worma = b_worm + b_worm_shift_tins * (scenario == 2) + b_worm_shift_tsus * (scenario == 3)

### List of utilities: these must use the same names as in mnl_settings, order is irrelevant
V = list()
V[["alt1"]] = asc_alt1 + b_price * (price1 + b_cook * cook1 + b_eat * eat1 + b_pea * pea1 + b_inschick *inschick1 + b_cricket * cricket1 + b_worm * worm1 + b_mne *mne1 + b_bio * bio1 + b_eu * eu1 + b_local * local1)
V[["alt2"]] = asc_alt2 + b_price * (price2 + b_cook * cook2 + b_eat * eat2 + b_pea * pea2 + b_inschick *inschick2 + b_cricket * cricket2 + b_worm * worm2 + b_mne *mne2 + b_bio * bio2 + b_eu * eu2 + b_local * local2)
V[["none"]] = asc_none

### Define settings for MNL model component
mnl_settings = list(
alternatives = c(alt1=1, alt2=2, none=3),
avail = list(alt1=1, alt2=1, none=1),
choiceVar = choice,
utilities = V
)

### Compute probabilities using MNL model
P[["model"]] = apollo_mnl(mnl_settings, functionality)

### Take product across observation for same individual
P = apollo_panelProd(P, apollo_inputs, functionality)

### Average across inter-individual draws
P = apollo_avgInterDraws(P, apollo_inputs, functionality)

### Prepare and return outputs of function
P = apollo_prepareProb(P, apollo_inputs, functionality)
return(P)
}

<bytecode: 0x0000019ea3d80700>
mnikrave
Posts: 6
Joined: 22 Jul 2022, 21:54

Re: Replication issues with WTP estimation results

Post by mnikrave »

#############
Model Output 2:
#############



Model run by Nikravech using Apollo 0.2.7 on R 4.2.1 for Windows.
www.ApolloChoiceModelling.com

Model name : MMNL_SUSINCHAIN_CB7_PT_PRIOR_WTP2_Replication
Model description : Code written together_chicken base
Model run at : 2022-08-29 11:07:05
Estimation method : bfgs
Model diagnosis : successful convergence
Number of individuals : 414
Number of rows in database : 4140
Number of modelled outcomes : 4140

Number of cores used : 4
Number of inter-individual draws : 1000 (mlhs)

LL(start) : -4654.11
LL(0) : -4548.25
LL(C) : -4540.65
LL(final) : -2923.52
Rho-square (0) : 0.3572
Adj.Rho-square (0) : 0.3519
Rho-square (C) : 0.3561
Adj.Rho-square (C) : 0.3509
AIC : 5895.03
BIC : 6046.91

Estimated parameters : 24
Time taken (hh:mm:ss) : 00:31:26.06
pre-estimation : 00:04:50.56
estimation : 00:11:6.71
post-estimation : 00:15:28.78
Iterations : 89
Min abs eigenvalue of Hessian : 0.313723

Unconstrained optimisation.

Estimates:
Estimate s.e. t.rat.(0) p(1-sided) Rob.s.e. Rob.t.rat.(0) p(1-sided)
asc_alt1 -0.08022 0.06822 -1.1760 0.119800 0.07542 -1.0637 0.143734
asc_alt2 0.00000 NA NA NA NA NA NA
asc_none -2.81227 0.13967 -20.1351 0.000000 0.17311 -16.2459 0.000000
b_price_mu -0.76517 0.08391 -9.1193 0.000000 0.08711 -8.7839 0.000000
b_price_sig 1.37665 0.09998 13.7698 0.000000 0.11002 12.5131 0.000000
b_cook_mu -1.31505 0.21978 -5.9834 1.092e-09 0.22359 -5.8814 2.034e-09
b_cook_sig 3.18048 0.21997 14.4587 0.000000 0.24641 12.9073 0.000000
b_eat_mu -0.14523 0.24327 -0.5970 0.275254 0.26413 -0.5499 0.291209
b_eat_sig 3.61959 0.22568 16.0384 0.000000 0.25086 14.4287 0.000000
b_pea_mu 2.01341 0.22234 9.0554 0.000000 0.26024 7.7368 5.107e-15
b_pea_sig -4.14925 0.22456 -18.4774 0.000000 0.24955 -16.6272 0.000000
b_inschick_mu 3.72347 0.31259 11.9116 0.000000 0.36693 10.1476 0.000000
b_inschick_sig 5.31084 0.32057 16.5666 0.000000 0.31467 16.8773 0.000000
b_cricket_mu 14.03110 0.89307 15.7112 0.000000 1.04434 13.4353 0.000000
b_cricket_sig 7.70216 0.63666 12.0978 0.000000 0.62040 12.4148 0.000000
b_worm_mu 19.53712 1.40051 13.9500 0.000000 1.59676 12.2355 0.000000
b_worm_sig -11.27373 0.99128 -11.3729 0.000000 1.12675 -10.0056 0.000000
b_mne_mu 0.41903 0.15731 2.6637 0.003864 0.17295 2.4229 0.007699
b_mne_sig 1.45466 0.14149 10.2810 0.000000 0.15388 9.4534 0.000000
b_bio_mu -0.90742 0.16461 -5.5124 1.770e-08 0.17025 -5.3300 4.909e-08
b_bio_sig 1.41507 0.14067 10.0594 0.000000 0.14342 9.8665 0.000000
b_eu_mu -2.22735 0.23312 -9.5546 0.000000 0.30646 -7.2679 1.826e-13
b_eu_sig 1.56623 0.24528 6.3855 8.543e-11 0.34168 4.5839 2.281e-06
b_local_mu -3.10823 0.19532 -15.9135 0.000000 0.21459 -14.4844 0.000000
b_local_sig 0.56506 0.12672 4.4592 4.113e-06 0.09148 6.1767 3.273e-10


Overview of choices for MNL model component :
alt1 alt2 none
Times available 4140.00 4140.0 4140.00
Times chosen 1388.00 1478.0 1274.00
Percentage chosen overall 33.53 35.7 30.77
Percentage chosen when available 33.53 35.7 30.77


Classical covariance matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig
asc_alt1 0.004653 0.002459 9.170e-05 1.0755e-04 -1.3934e-04 3.1388e-04
asc_none 0.002459 0.019508 -0.002795 0.002155 -0.005183 7.0535e-04
b_price_mu 9.170e-05 -0.002795 0.007040 -6.7366e-04 -0.001742 -0.003688
b_price_sig 1.0755e-04 0.002155 -6.7366e-04 0.009995 -0.005969 -0.002255
b_cook_mu -1.3934e-04 -0.005183 -0.001742 -0.005969 0.048304 0.007050
b_cook_sig 3.1388e-04 7.0535e-04 -0.003688 -0.002255 0.007050 0.048387
b_eat_mu 8.570e-05 -0.003940 1.5715e-04 -0.001067 0.024508 -0.006511
b_eat_sig -3.1574e-04 3.3234e-04 -0.001239 0.002416 -0.009699 0.010041
b_pea_mu -1.5203e-04 -3.6271e-04 -0.003489 -0.002422 -0.003057 0.019001
b_pea_sig 8.3926e-04 -2.2531e-04 9.6671e-04 -6.9476e-04 0.006488 -0.003914
b_inschick_mu -5.4172e-04 -9.4773e-04 -0.006381 -0.004680 -0.003611 0.015961
b_inschick_sig -5.0464e-04 -0.002417 -0.003168 4.3872e-04 4.8728e-04 -7.1579e-04
b_cricket_mu -4.9671e-04 0.007683 -0.020729 0.020999 -0.014680 0.057684
b_cricket_sig -4.3262e-04 0.007958 -0.010198 0.015776 -0.015448 0.033595
b_worm_mu 1.5170e-04 0.014853 -0.034001 0.037062 0.002015 0.095334
b_worm_sig -3.7652e-04 -0.009702 0.019924 -0.029202 0.003422 -0.061858
b_mne_mu -1.3087e-04 -0.002047 -6.6946e-04 -0.001565 5.5265e-04 3.9894e-04
b_mne_sig -1.2063e-04 -0.002242 9.928e-05 -6.0840e-04 -0.003611 0.002631
b_bio_mu -2.7715e-04 -0.001509 1.2637e-04 -0.002040 -0.004361 -0.004400
b_bio_sig -3.840e-05 5.5704e-04 2.265e-05 0.001460 -0.006388 0.006942
b_eu_mu -5.867e-05 -0.004282 -3.7898e-04 -0.001977 -0.009319 -9.9399e-04
b_eu_sig -6.6450e-04 -0.005427 -0.002175 -0.001271 -0.003868 0.017251
b_local_mu 8.502e-06 -0.002611 0.002327 -0.002053 -0.009993 -0.009855
b_local_sig 1.2023e-04 -5.458e-05 -6.7943e-04 9.0915e-04 -0.004382 -0.002027
b_eat_mu b_eat_sig b_pea_mu b_pea_sig b_inschick_mu b_inschick_sig
asc_alt1 8.570e-05 -3.1574e-04 -1.5203e-04 8.3926e-04 -5.4172e-04 -5.0464e-04
asc_none -0.003940 3.3234e-04 -3.6271e-04 -2.2531e-04 -9.4773e-04 -0.002417
b_price_mu 1.5715e-04 -0.001239 -0.003489 9.6671e-04 -0.006381 -0.003168
b_price_sig -0.001067 0.002416 -0.002422 -6.9476e-04 -0.004680 4.3872e-04
b_cook_mu 0.024508 -0.009699 -0.003057 0.006488 -0.003611 4.8728e-04
b_cook_sig -0.006511 0.010041 0.019001 -0.003914 0.015961 -7.1579e-04
b_eat_mu 0.059182 -0.004600 -0.005091 0.002626 -0.018831 0.018849
b_eat_sig -0.004600 0.050933 0.012992 -0.023134 0.001743 0.019741
b_pea_mu -0.005091 0.012992 0.049436 -0.014764 0.021602 0.007601
b_pea_sig 0.002626 -0.023134 -0.014764 0.050427 -0.007933 -0.012195
b_inschick_mu -0.018831 0.001743 0.021602 -0.007933 0.097713 0.053455
b_inschick_sig 0.018849 0.019741 0.007601 -0.012195 0.053455 0.102768
b_cricket_mu 0.010186 0.030839 0.051233 -0.016361 0.043714 0.043260
b_cricket_sig -0.017980 0.025476 0.019923 -0.018576 0.023525 0.014003
b_worm_mu 0.027709 0.033850 0.069711 -0.018129 0.055255 0.057158
b_worm_sig -0.009940 -0.024661 -0.031404 0.012641 -0.019896 -0.025979
b_mne_mu 0.002859 -6.9847e-04 -0.005920 0.001097 0.002777 0.010137
b_mne_sig 0.007062 0.007825 0.003862 -0.007371 -0.006915 0.005563
b_bio_mu -0.012757 -0.002093 -0.006416 9.9156e-04 -6.1286e-04 -0.012740
b_bio_sig 0.001139 0.017692 0.006250 -0.008978 -0.006695 0.008169
b_eu_mu -0.021776 -0.003378 -0.010379 0.004376 -5.2873e-04 -0.011046
b_eu_sig -0.006488 0.021762 0.015833 -0.009840 0.009465 0.003577
b_local_mu -0.011391 -0.005010 -0.015314 0.003511 -0.012859 -0.008739
b_local_sig -8.5938e-04 -0.003504 0.001900 0.004818 2.3876e-04 -7.5982e-04
b_cricket_mu b_cricket_sig b_worm_mu b_worm_sig b_mne_mu b_mne_sig
asc_alt1 -4.9671e-04 -4.3262e-04 1.5170e-04 -3.7652e-04 -1.3087e-04 -1.2063e-04
asc_none 0.007683 0.007958 0.014853 -0.009702 -0.002047 -0.002242
b_price_mu -0.020729 -0.010198 -0.034001 0.019924 -6.6946e-04 9.928e-05
b_price_sig 0.020999 0.015776 0.037062 -0.029202 -0.001565 -6.0840e-04
b_cook_mu -0.014680 -0.015448 0.002015 0.003422 5.5265e-04 -0.003611
b_cook_sig 0.057684 0.033595 0.095334 -0.061858 3.9894e-04 0.002631
b_eat_mu 0.010186 -0.017980 0.027709 -0.009940 0.002859 0.007062
b_eat_sig 0.030839 0.025476 0.033850 -0.024661 -6.9847e-04 0.007825
b_pea_mu 0.051233 0.019923 0.069711 -0.031404 -0.005920 0.003862
b_pea_sig -0.016361 -0.018576 -0.018129 0.012641 0.001097 -0.007371
b_inschick_mu 0.043714 0.023525 0.055255 -0.019896 0.002777 -0.006915
b_inschick_sig 0.043260 0.014003 0.057158 -0.025979 0.010137 0.005563
b_cricket_mu 0.797566 0.487751 0.541947 -0.347982 0.005025 0.003798
b_cricket_sig 0.487751 0.405333 0.309326 -0.221869 -0.004326 -0.001333
b_worm_mu 0.541947 0.309326 1.961424 -1.333965 -0.008165 0.009774
b_worm_sig -0.347982 -0.221869 -1.333965 0.982640 0.005181 -0.010828
b_mne_mu 0.005025 -0.004326 -0.008165 0.005181 0.024746 0.005132
b_mne_sig 0.003798 -0.001333 0.009774 -0.010828 0.005132 0.020020
b_bio_mu -0.033949 -0.015286 -0.049349 0.026161 -1.4321e-04 0.002349
b_bio_sig 0.026845 0.016345 0.036776 -0.029539 -0.001876 0.005533
b_eu_mu -0.013860 0.014341 -0.006986 -0.013155 -0.005622 -0.004254
b_eu_sig 0.030499 0.028291 0.050752 -0.043075 -0.005135 0.004071
b_local_mu -0.041249 -0.009178 -0.056463 0.023258 -0.004946 0.002187
b_local_sig 0.011879 0.001809 0.024211 -0.011056 -3.6854e-04 -0.002439
b_bio_mu b_bio_sig b_eu_mu b_eu_sig b_local_mu b_local_sig
asc_alt1 -2.7715e-04 -3.840e-05 -5.867e-05 -6.6450e-04 8.502e-06 1.2023e-04
asc_none -0.001509 5.5704e-04 -0.004282 -0.005427 -0.002611 -5.458e-05
b_price_mu 1.2637e-04 2.265e-05 -3.7898e-04 -0.002175 0.002327 -6.7943e-04
b_price_sig -0.002040 0.001460 -0.001977 -0.001271 -0.002053 9.0915e-04
b_cook_mu -0.004361 -0.006388 -0.009319 -0.003868 -0.009993 -0.004382
b_cook_sig -0.004400 0.006942 -9.9399e-04 0.017251 -0.009855 -0.002027
b_eat_mu -0.012757 0.001139 -0.021776 -0.006488 -0.011391 -8.5938e-04
b_eat_sig -0.002093 0.017692 -0.003378 0.021762 -0.005010 -0.003504
b_pea_mu -0.006416 0.006250 -0.010379 0.015833 -0.015314 0.001900
b_pea_sig 9.9156e-04 -0.008978 0.004376 -0.009840 0.003511 0.004818
b_inschick_mu -6.1286e-04 -0.006695 -5.2873e-04 0.009465 -0.012859 2.3876e-04
b_inschick_sig -0.012740 0.008169 -0.011046 0.003577 -0.008739 -7.5982e-04
b_cricket_mu -0.033949 0.026845 -0.013860 0.030499 -0.041249 0.011879
b_cricket_sig -0.015286 0.016345 0.014341 0.028291 -0.009178 0.001809
b_worm_mu -0.049349 0.036776 -0.006986 0.050752 -0.056463 0.024211
b_worm_sig 0.026161 -0.029539 -0.013155 -0.043075 0.023258 -0.011056
b_mne_mu -1.4321e-04 -0.001876 -0.005622 -0.005135 -0.004946 -3.6854e-04
b_mne_sig 0.002349 0.005533 -0.004254 0.004071 0.002187 -0.002439
b_bio_mu 0.027098 -0.006923 -0.001709 -0.001165 -0.002277 -0.001211
b_bio_sig -0.006923 0.019789 5.3512e-04 0.010985 0.001538 -0.001918
b_eu_mu -0.001709 5.3512e-04 0.054344 0.023659 0.023784 0.002367
b_eu_sig -0.001165 0.010985 0.023659 0.060163 0.001672 4.2629e-04
b_local_mu -0.002277 0.001538 0.023784 0.001672 0.038150 0.002957
b_local_sig -0.001211 -0.001918 0.002367 4.2629e-04 0.002957 0.016057

Robust covariance matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig
asc_alt1 0.005688 0.003843 -6.320e-05 5.9017e-04 8.9024e-04 -2.511e-05
asc_none 0.003843 0.029966 -0.002634 -0.001733 7.0624e-04 0.003097
b_price_mu -6.320e-05 -0.002634 0.007588 4.2472e-04 -0.001955 -0.007437
b_price_sig 5.9017e-04 -0.001733 4.2472e-04 0.012104 -0.006666 -0.004387
b_cook_mu 8.9024e-04 7.0624e-04 -0.001955 -0.006666 0.049994 0.012503
b_cook_sig -2.511e-05 0.003097 -0.007437 -0.004387 0.012503 0.060718
b_eat_mu 0.001313 -6.4685e-04 6.1929e-04 0.001972 0.029133 -0.005346
b_eat_sig -0.001193 -7.4215e-04 -0.004373 0.003405 -0.018571 0.025896
b_pea_mu -9.1884e-04 -2.7171e-04 -0.007479 -0.001317 -0.011171 0.038271
b_pea_sig 0.002670 0.001417 0.002790 0.002570 0.012259 -0.008012
b_inschick_mu -0.001221 -0.001261 -0.012012 -0.010363 -1.1301e-04 0.029133
b_inschick_sig -2.5177e-04 -0.003223 -0.006668 -5.6426e-04 5.9107e-04 0.009354
b_cricket_mu 0.002797 -0.002423 -0.024325 0.025757 0.004619 0.099691
b_cricket_sig 0.001921 0.002690 -0.012396 0.016388 -0.009338 0.064737
b_worm_mu 0.009452 0.014134 -0.037205 0.043288 0.024676 0.184791
b_worm_sig -0.007551 -0.009741 0.018542 -0.036532 -0.016118 -0.127373
b_mne_mu 3.0142e-04 -0.001373 8.6738e-04 -0.001396 0.011664 -5.7535e-04
b_mne_sig -3.2895e-04 -0.003052 7.4861e-04 -1.7067e-04 0.001003 0.005883
b_bio_mu -7.1968e-04 -0.001858 0.002130 -0.004499 0.001885 -0.011329
b_bio_sig -2.9536e-04 -2.452e-05 -0.001182 0.003440 -0.010379 0.014679
b_eu_mu -0.001941 -0.005878 -0.002236 -0.002525 -0.023560 0.004896
b_eu_sig -0.002252 -0.006221 -0.007817 -0.001309 -0.018531 0.040294
b_local_mu -4.2203e-04 -0.003622 0.004072 -0.001048 -0.018280 -0.015207
b_local_sig 6.159e-05 -0.001017 -6.9421e-04 0.001899 -0.007746 -0.003551
b_eat_mu b_eat_sig b_pea_mu b_pea_sig b_inschick_mu b_inschick_sig
asc_alt1 0.001313 -0.001193 -9.1884e-04 0.002670 -0.001221 -2.5177e-04
asc_none -6.4685e-04 -7.4215e-04 -2.7171e-04 0.001417 -0.001261 -0.003223
b_price_mu 6.1929e-04 -0.004373 -0.007479 0.002790 -0.012012 -0.006668
b_price_sig 0.001972 0.003405 -0.001317 0.002570 -0.010363 -5.6426e-04
b_cook_mu 0.029133 -0.018571 -0.011171 0.012259 -1.1301e-04 5.9107e-04
b_cook_sig -0.005346 0.025896 0.038271 -0.008012 0.029133 0.009354
b_eat_mu 0.069766 -0.010289 -0.012438 0.016104 -0.032230 0.015763
b_eat_sig -0.010289 0.062931 0.037379 -0.039698 0.004964 0.018664
b_pea_mu -0.012438 0.037379 0.067724 -0.023965 0.037596 0.021391
b_pea_sig 0.016104 -0.039698 -0.023965 0.062273 -0.017974 -0.012957
b_inschick_mu -0.032230 0.004964 0.037596 -0.017974 0.134639 0.077523
b_inschick_sig 0.015763 0.018664 0.021391 -0.012957 0.077523 0.099019
b_cricket_mu 0.067368 0.044751 0.104439 0.011175 0.091353 0.137614
b_cricket_sig -4.2666e-04 0.035959 0.059874 -0.003876 0.056768 0.063780
b_worm_mu 0.110352 0.073366 0.173888 0.036257 0.112419 0.173314
b_worm_sig -0.072008 -0.048678 -0.099976 -0.037472 -0.034401 -0.095946
b_mne_mu 0.013411 -0.009855 -0.017366 0.013848 -0.004867 0.010203
b_mne_sig 0.014265 0.009828 -0.001022 -0.002088 -0.022770 0.001510
b_bio_mu -0.009602 -0.010575 -0.018628 -3.8748e-04 -0.016650 -0.026674
b_bio_sig 0.003229 0.027318 0.019923 -0.013977 -0.003785 0.011763
b_eu_mu -0.048163 0.014165 0.005945 -0.017539 0.016696 -0.007138
b_eu_sig -0.029318 0.053322 0.050867 -0.034869 0.024842 0.013469
b_local_mu -0.022389 -0.003608 -0.017943 0.002339 -0.014607 -0.011322
b_local_sig -0.002858 -0.001452 0.004589 0.003630 0.004352 0.002288
b_cricket_mu b_cricket_sig b_worm_mu b_worm_sig b_mne_mu b_mne_sig
asc_alt1 0.002797 0.001921 0.009452 -0.007551 3.0142e-04 -3.2895e-04
asc_none -0.002423 0.002690 0.014134 -0.009741 -0.001373 -0.003052
b_price_mu -0.024325 -0.012396 -0.037205 0.018542 8.6738e-04 7.4861e-04
b_price_sig 0.025757 0.016388 0.043288 -0.036532 -0.001396 -1.7067e-04
b_cook_mu 0.004619 -0.009338 0.024676 -0.016118 0.011664 0.001003
b_cook_sig 0.099691 0.064737 0.184791 -0.127373 -5.7535e-04 0.005883
b_eat_mu 0.067368 -4.2666e-04 0.110352 -0.072008 0.013411 0.014265
b_eat_sig 0.044751 0.035959 0.073366 -0.048678 -0.009855 0.009828
b_pea_mu 0.104439 0.059874 0.173888 -0.099976 -0.017366 -0.001022
b_pea_sig 0.011175 -0.003876 0.036257 -0.037472 0.013848 -0.002088
b_inschick_mu 0.091353 0.056768 0.112419 -0.034401 -0.004867 -0.022770
b_inschick_sig 0.137614 0.063780 0.173314 -0.095946 0.010203 0.001510
b_cricket_mu 1.090653 0.588539 1.245591 -0.804663 0.006305 0.007598
b_cricket_sig 0.588539 0.384895 0.695727 -0.485670 -0.004868 0.002349
b_worm_mu 1.245591 0.695727 2.549640 -1.742930 0.003811 0.024822
b_worm_sig -0.804663 -0.485670 -1.742930 1.269559 -0.016244 -0.040209
b_mne_mu 0.006305 -0.004868 0.003811 -0.016244 0.029911 0.012454
b_mne_sig 0.007598 0.002349 0.024822 -0.040209 0.012454 0.023678
b_bio_mu -0.103910 -0.053967 -0.152297 0.093905 0.002639 0.004262
b_bio_sig 0.059255 0.035611 0.095062 -0.068624 -0.005658 0.007661
b_eu_mu -0.019527 0.029293 -0.037375 0.011533 -0.020558 -0.007026
b_eu_sig 0.067095 0.068046 0.125704 -0.095935 -0.024169 0.005704
b_local_mu -0.061685 -0.010282 -0.097358 0.038448 -0.002942 0.006074
b_local_sig 0.025300 0.010579 0.030319 -0.011811 -0.005352 -0.004986
b_bio_mu b_bio_sig b_eu_mu b_eu_sig b_local_mu b_local_sig
asc_alt1 -7.1968e-04 -2.9536e-04 -0.001941 -0.002252 -4.2203e-04 6.159e-05
asc_none -0.001858 -2.452e-05 -0.005878 -0.006221 -0.003622 -0.001017
b_price_mu 0.002130 -0.001182 -0.002236 -0.007817 0.004072 -6.9421e-04
b_price_sig -0.004499 0.003440 -0.002525 -0.001309 -0.001048 0.001899
b_cook_mu 0.001885 -0.010379 -0.023560 -0.018531 -0.018280 -0.007746
b_cook_sig -0.011329 0.014679 0.004896 0.040294 -0.015207 -0.003551
b_eat_mu -0.009602 0.003229 -0.048163 -0.029318 -0.022389 -0.002858
b_eat_sig -0.010575 0.027318 0.014165 0.053322 -0.003608 -0.001452
b_pea_mu -0.018628 0.019923 0.005945 0.050867 -0.017943 0.004589
b_pea_sig -3.8748e-04 -0.013977 -0.017539 -0.034869 0.002339 0.003630
b_inschick_mu -0.016650 -0.003785 0.016696 0.024842 -0.014607 0.004352
b_inschick_sig -0.026674 0.011763 -0.007138 0.013469 -0.011322 0.002288
b_cricket_mu -0.103910 0.059255 -0.019527 0.067095 -0.061685 0.025300
b_cricket_sig -0.053967 0.035611 0.029293 0.068046 -0.010282 0.010579
b_worm_mu -0.152297 0.095062 -0.037375 0.125704 -0.097358 0.030319
b_worm_sig 0.093905 -0.068624 0.011533 -0.095935 0.038448 -0.011811
b_mne_mu 0.002639 -0.005658 -0.020558 -0.024169 -0.002942 -0.005352
b_mne_sig 0.004262 0.007661 -0.007026 0.005704 0.006074 -0.004986
b_bio_mu 0.028984 -0.011337 -0.002857 -0.012258 0.002878 -0.005122
b_bio_sig -0.011337 0.020570 0.005574 0.027287 -8.0934e-04 1.1119e-04
b_eu_mu -0.002857 0.005574 0.093921 0.074401 0.040468 0.008774
b_eu_sig -0.012258 0.027287 0.074401 0.116744 0.015338 0.006990
b_local_mu 0.002878 -8.0934e-04 0.040468 0.015338 0.046049 0.003030
b_local_sig -0.005122 1.1119e-04 0.008774 0.006990 0.003030 0.008369

Classical correlation matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig
asc_alt1 1.000000 0.258124 0.016021 0.01577 -0.009294 0.02092
asc_none 0.258124 1.000000 -0.238460 0.15430 -0.168847 0.02296
b_price_mu 0.016021 -0.238460 1.000000 -0.08031 -0.094482 -0.19983
b_price_sig 0.015770 0.154296 -0.080307 1.00000 -0.271634 -0.10253
b_cook_mu -0.009294 -0.168847 -0.094482 -0.27163 1.000000 0.14583
b_cook_sig 0.020918 0.022958 -0.199829 -0.10253 0.145830 1.00000
b_eat_mu 0.005164 -0.115969 0.007699 -0.04389 0.458380 -0.12167
b_eat_sig -0.020509 0.010543 -0.065443 0.10707 -0.195545 0.20225
b_pea_mu -0.010024 -0.011680 -0.187018 -0.10896 -0.062557 0.38850
b_pea_sig 0.054788 -0.007184 0.051306 -0.03095 0.131461 -0.07925
b_inschick_mu -0.025405 -0.021707 -0.243272 -0.14977 -0.052565 0.23213
b_inschick_sig -0.023076 -0.053989 -0.117760 0.01369 0.006916 -0.01015
b_cricket_mu -0.008153 0.061596 -0.276637 0.23519 -0.074793 0.29364
b_cricket_sig -0.009961 0.089496 -0.190897 0.24785 -0.110400 0.23989
b_worm_mu 0.001588 0.075932 -0.289339 0.26470 0.006546 0.30946
b_worm_sig -0.005568 -0.070077 0.239541 -0.29466 0.015709 -0.28368
b_mne_mu -0.012196 -0.093180 -0.050720 -0.09950 0.015985 0.01153
b_mne_sig -0.012498 -0.113447 0.008363 -0.04301 -0.116114 0.08455
b_bio_mu -0.024681 -0.065612 0.009149 -0.12396 -0.120533 -0.12152
b_bio_sig -0.004002 0.028352 0.001919 0.10379 -0.206617 0.22436
b_eu_mu -0.003689 -0.131507 -0.019375 -0.08483 -0.181892 -0.01938
b_eu_sig -0.039714 -0.158414 -0.105704 -0.05184 -0.071757 0.31974
b_local_mu 6.3810e-04 -0.095699 0.142012 -0.10515 -0.232789 -0.22936
b_local_sig 0.013909 -0.003084 -0.063903 0.07176 -0.157336 -0.07272
b_eat_mu b_eat_sig b_pea_mu b_pea_sig b_inschick_mu b_inschick_sig
asc_alt1 0.005164 -0.02051 -0.01002 0.054788 -0.025405 -0.023076
asc_none -0.115969 0.01054 -0.01168 -0.007184 -0.021707 -0.053989
b_price_mu 0.007699 -0.06544 -0.18702 0.051306 -0.243272 -0.117760
b_price_sig -0.043888 0.10707 -0.10896 -0.030946 -0.149767 0.013689
b_cook_mu 0.458380 -0.19555 -0.06256 0.131461 -0.052565 0.006916
b_cook_sig -0.121669 0.20225 0.38850 -0.079246 0.232126 -0.010151
b_eat_mu 1.000000 -0.08378 -0.09411 0.048063 -0.247635 0.241693
b_eat_sig -0.083778 1.00000 0.25891 -0.456474 0.024702 0.272854
b_pea_mu -0.094113 0.25891 1.00000 -0.295692 0.310808 0.106643
b_pea_sig 0.048063 -0.45647 -0.29569 1.000000 -0.113015 -0.169399
b_inschick_mu -0.247635 0.02470 0.31081 -0.113015 1.000000 0.533441
b_inschick_sig 0.241693 0.27285 0.10664 -0.169399 0.533441 1.000000
b_cricket_mu 0.046886 0.15301 0.25801 -0.081583 0.156590 0.151103
b_cricket_sig -0.116087 0.17730 0.14074 -0.129929 0.118208 0.068608
b_worm_mu 0.081329 0.10709 0.22387 -0.057645 0.126214 0.127309
b_worm_sig -0.041217 -0.11023 -0.14248 0.056788 -0.064210 -0.081752
b_mne_mu 0.074707 -0.01967 -0.16926 0.031052 0.056472 0.201023
b_mne_sig 0.205173 0.24505 0.12275 -0.231980 -0.156338 0.122648
b_bio_mu -0.318561 -0.05634 -0.17529 0.026824 -0.011910 -0.241420
b_bio_sig 0.033277 0.55727 0.19984 -0.284221 -0.152249 0.181147
b_eu_mu -0.383975 -0.06422 -0.20023 0.083603 -0.007256 -0.147813
b_eu_sig -0.108725 0.39314 0.29032 -0.178657 0.123443 0.045486
b_local_mu -0.239728 -0.11366 -0.35264 0.080056 -0.210610 -0.139569
b_local_sig -0.027878 -0.12252 0.06744 0.169305 0.006028 -0.018705
b_cricket_mu b_cricket_sig b_worm_mu b_worm_sig b_mne_mu b_mne_sig
asc_alt1 -0.008153 -0.009961 0.001588 -0.005568 -0.012196 -0.012498
asc_none 0.061596 0.089496 0.075932 -0.070077 -0.093180 -0.113447
b_price_mu -0.276637 -0.190897 -0.289339 0.239541 -0.050720 0.008363
b_price_sig 0.235187 0.247851 0.264695 -0.294659 -0.099502 -0.043010
b_cook_mu -0.074793 -0.110400 0.006546 0.015709 0.015985 -0.116114
b_cook_sig 0.293638 0.239890 0.309458 -0.283683 0.011529 0.084549
b_eat_mu 0.046886 -0.116087 0.081329 -0.041217 0.074707 0.205173
b_eat_sig 0.153011 0.177305 0.107095 -0.110234 -0.019674 0.245053
b_pea_mu 0.258013 0.140745 0.223868 -0.142483 -0.169260 0.122752
b_pea_sig -0.081583 -0.129929 -0.057645 0.056788 0.031052 -0.231980
b_inschick_mu 0.156590 0.118208 0.126214 -0.064210 0.056472 -0.156338
b_inschick_sig 0.151103 0.068608 0.127309 -0.081752 0.201023 0.122648
b_cricket_mu 1.000000 0.857845 0.433299 -0.393076 0.035769 0.030057
b_cricket_sig 0.857845 1.000000 0.346916 -0.351555 -0.043190 -0.014800
b_worm_mu 0.433299 0.346916 1.000000 -0.960863 -0.037063 0.049322
b_worm_sig -0.393076 -0.351555 -0.960863 1.000000 0.033227 -0.077204
b_mne_mu 0.035769 -0.043190 -0.037063 0.033227 1.000000 0.230568
b_mne_sig 0.030057 -0.014800 0.049322 -0.077204 0.230568 1.000000
b_bio_mu -0.230930 -0.145859 -0.214058 0.160324 -0.005530 0.100845
b_bio_sig 0.213682 0.182499 0.186668 -0.211833 -0.084762 0.277981
b_eu_mu -0.066576 0.096625 -0.021399 -0.056929 -0.153312 -0.128962
b_eu_sig 0.139230 0.181170 0.147741 -0.177160 -0.133078 0.117291
b_local_mu -0.236474 -0.073804 -0.206410 0.120125 -0.160976 0.079147
b_local_sig 0.104971 0.022428 0.136427 -0.088014 -0.018488 -0.136007
b_bio_mu b_bio_sig b_eu_mu b_eu_sig b_local_mu b_local_sig
asc_alt1 -0.024681 -0.004002 -0.003689 -0.03971 6.3810e-04 0.013909
asc_none -0.065612 0.028352 -0.131507 -0.15841 -0.09570 -0.003084
b_price_mu 0.009149 0.001919 -0.019375 -0.10570 0.14201 -0.063903
b_price_sig -0.123956 0.103794 -0.084827 -0.05184 -0.10515 0.071765
b_cook_mu -0.120533 -0.206617 -0.181892 -0.07176 -0.23279 -0.157336
b_cook_sig -0.121521 0.224357 -0.019384 0.31974 -0.22936 -0.072716
b_eat_mu -0.318561 0.033277 -0.383975 -0.10873 -0.23973 -0.027878
b_eat_sig -0.056337 0.557271 -0.064215 0.39314 -0.11366 -0.122520
b_pea_mu -0.175286 0.199837 -0.200234 0.29032 -0.35264 0.067435
b_pea_sig 0.026824 -0.284221 0.083603 -0.17866 0.08006 0.169305
b_inschick_mu -0.011910 -0.152249 -0.007256 0.12344 -0.21061 0.006028
b_inschick_sig -0.241420 0.181147 -0.147813 0.04549 -0.13957 -0.018705
b_cricket_mu -0.230930 0.213682 -0.066576 0.13923 -0.23647 0.104971
b_cricket_sig -0.145859 0.182499 0.096625 0.18117 -0.07380 0.022428
b_worm_mu -0.214058 0.186668 -0.021399 0.14774 -0.20641 0.136427
b_worm_sig 0.160324 -0.211833 -0.056929 -0.17716 0.12013 -0.088014
b_mne_mu -0.005530 -0.084762 -0.153312 -0.13308 -0.16098 -0.018488
b_mne_sig 0.100845 0.277981 -0.128962 0.11729 0.07915 -0.136007
b_bio_mu 1.000000 -0.298969 -0.044541 -0.02886 -0.07083 -0.058071
b_bio_sig -0.298969 1.000000 0.016318 0.31837 0.05597 -0.107597
b_eu_mu -0.044541 0.016318 1.000000 0.41376 0.52235 0.080121
b_eu_sig -0.028860 0.318371 0.413764 1.00000 0.03489 0.013715
b_local_mu -0.070832 0.055975 0.522350 0.03489 1.00000 0.119486
b_local_sig -0.058071 -0.107597 0.080121 0.01372 0.11949 1.000000

Robust correlation matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig
asc_alt1 1.000000 0.294343 -0.009620 0.07113 0.052793 -0.001351
asc_none 0.294343 1.000000 -0.174688 -0.09100 0.018246 0.072611
b_price_mu -0.009620 -0.174688 1.000000 0.04432 -0.100387 -0.346454
b_price_sig 0.071129 -0.090997 0.044317 1.00000 -0.270978 -0.161837
b_cook_mu 0.052793 0.018246 -0.100387 -0.27098 1.000000 0.226928
b_cook_sig -0.001351 0.072611 -0.346454 -0.16184 0.226928 1.000000
b_eat_mu 0.065890 -0.014147 0.026915 0.06787 0.493293 -0.082143
b_eat_sig -0.063043 -0.017090 -0.200115 0.12337 -0.331094 0.418938
b_pea_mu -0.046817 -0.006031 -0.329931 -0.04599 -0.191976 0.596820
b_pea_sig 0.141882 0.032805 0.128347 0.09362 0.219705 -0.130289
b_inschick_mu -0.044114 -0.019859 -0.375788 -0.25672 -0.001377 0.322208
b_inschick_sig -0.010609 -0.059175 -0.243253 -0.01630 0.008401 0.120637
b_cricket_mu 0.035510 -0.013404 -0.267388 0.22417 0.019781 0.387396
b_cricket_sig 0.041050 0.025046 -0.229374 0.24011 -0.067315 0.423472
b_worm_mu 0.078493 0.051134 -0.267479 0.24642 0.069116 0.469660
b_worm_sig -0.088861 -0.049940 0.188913 -0.29471 -0.063977 -0.458768
b_mne_mu 0.023109 -0.045846 0.057574 -0.07336 0.301621 -0.013501
b_mne_sig -0.028345 -0.114579 0.055848 -0.01008 0.029150 0.155169
b_bio_mu -0.056052 -0.063041 0.143627 -0.24021 0.049522 -0.270070
b_bio_sig -0.027306 -9.8783e-04 -0.094615 0.21804 -0.323668 0.415370
b_eu_mu -0.083992 -0.110798 -0.083758 -0.07488 -0.343818 0.064833
b_eu_sig -0.087393 -0.105175 -0.262621 -0.03482 -0.242563 0.478591
b_local_mu -0.026077 -0.097494 0.217810 -0.04439 -0.380974 -0.287592
b_local_sig 0.008927 -0.064250 -0.087113 0.18867 -0.378665 -0.157538
b_eat_mu b_eat_sig b_pea_mu b_pea_sig b_inschick_mu b_inschick_sig
asc_alt1 0.065890 -0.06304 -0.046817 0.141882 -0.044114 -0.010609
asc_none -0.014147 -0.01709 -0.006031 0.032805 -0.019859 -0.059175
b_price_mu 0.026915 -0.20012 -0.329931 0.128347 -0.375788 -0.243253
b_price_sig 0.067875 0.12337 -0.045993 0.093615 -0.256719 -0.016299
b_cook_mu 0.493293 -0.33109 -0.191976 0.219705 -0.001377 0.008401
b_cook_sig -0.082143 0.41894 0.596820 -0.130289 0.322208 0.120637
b_eat_mu 1.000000 -0.15528 -0.180946 0.244324 -0.332543 0.189648
b_eat_sig -0.155283 1.00000 0.572565 -0.634137 0.053931 0.236432
b_pea_mu -0.180946 0.57256 1.000000 -0.369024 0.393716 0.261216
b_pea_sig 0.244324 -0.63414 -0.369024 1.000000 -0.196290 -0.165007
b_inschick_mu -0.332543 0.05393 0.393716 -0.196290 1.000000 0.671406
b_inschick_sig 0.189648 0.23643 0.261216 -0.165007 0.671406 1.000000
b_cricket_mu 0.244223 0.17081 0.384280 0.042879 0.238393 0.418755
b_cricket_sig -0.002604 0.23105 0.370848 -0.025038 0.249371 0.326702
b_worm_mu 0.261649 0.18316 0.418463 0.090991 0.191874 0.344934
b_worm_sig -0.241953 -0.17222 -0.340954 -0.133271 -0.083206 -0.270608
b_mne_mu 0.293578 -0.22714 -0.385839 0.320865 -0.076694 0.187476
b_mne_sig 0.350988 0.25460 -0.025523 -0.054377 -0.403272 0.031179
b_bio_mu -0.213527 -0.24761 -0.420444 -0.009121 -0.266539 -0.497910
b_bio_sig 0.085246 0.75928 0.533786 -0.390538 -0.071925 0.260651
b_eu_mu -0.594990 0.18424 0.074547 -0.229342 0.148473 -0.074017
b_eu_sig -0.324857 0.62209 0.572067 -0.408945 0.198142 0.125276
b_local_mu -0.395001 -0.06702 -0.321308 0.043675 -0.185508 -0.167671
b_local_sig -0.118292 -0.06327 0.192770 0.159017 0.129654 0.079484
b_cricket_mu b_cricket_sig b_worm_mu b_worm_sig b_mne_mu b_mne_sig
asc_alt1 0.03551 0.041050 0.07849 -0.08886 0.02311 -0.02835
asc_none -0.01340 0.025046 0.05113 -0.04994 -0.04585 -0.11458
b_price_mu -0.26739 -0.229374 -0.26748 0.18891 0.05757 0.05585
b_price_sig 0.22417 0.240106 0.24642 -0.29471 -0.07336 -0.01008
b_cook_mu 0.01978 -0.067315 0.06912 -0.06398 0.30162 0.02915
b_cook_sig 0.38740 0.423472 0.46966 -0.45877 -0.01350 0.15517
b_eat_mu 0.24422 -0.002604 0.26165 -0.24195 0.29358 0.35099
b_eat_sig 0.17081 0.231047 0.18316 -0.17222 -0.22714 0.25460
b_pea_mu 0.38428 0.370848 0.41846 -0.34095 -0.38584 -0.02552
b_pea_sig 0.04288 -0.025038 0.09099 -0.13327 0.32087 -0.05438
b_inschick_mu 0.23839 0.249371 0.19187 -0.08321 -0.07669 -0.40327
b_inschick_sig 0.41875 0.326702 0.34493 -0.27061 0.18748 0.03118
b_cricket_mu 1.00000 0.908366 0.74695 -0.68382 0.03491 0.04728
b_cricket_sig 0.90837 1.000000 0.70231 -0.69477 -0.04537 0.02461
b_worm_mu 0.74695 0.702309 1.00000 -0.96876 0.01380 0.10102
b_worm_sig -0.68382 -0.694774 -0.96876 1.00000 -0.08336 -0.23191
b_mne_mu 0.03491 -0.045369 0.01380 -0.08336 1.00000 0.46798
b_mne_sig 0.04728 0.024610 0.10102 -0.23191 0.46798 1.00000
b_bio_mu -0.58444 -0.510950 -0.56024 0.48954 0.08964 0.16268
b_bio_sig 0.39561 0.400221 0.41510 -0.42465 -0.22811 0.34714
b_eu_mu -0.06101 0.154066 -0.07638 0.03340 -0.38787 -0.14900
b_eu_sig 0.18803 0.321007 0.23040 -0.24919 -0.40900 0.10849
b_local_mu -0.27525 -0.077234 -0.28413 0.15901 -0.07927 0.18394
b_local_sig 0.26481 0.186403 0.20755 -0.11459 -0.33825 -0.35419
b_bio_mu b_bio_sig b_eu_mu b_eu_sig b_local_mu b_local_sig
asc_alt1 -0.056052 -0.027306 -0.08399 -0.08739 -0.02608 0.008927
asc_none -0.063041 -9.8783e-04 -0.11080 -0.10517 -0.09749 -0.064250
b_price_mu 0.143627 -0.094615 -0.08376 -0.26262 0.21781 -0.087113
b_price_sig -0.240208 0.218042 -0.07488 -0.03482 -0.04439 0.188667
b_cook_mu 0.049522 -0.323668 -0.34382 -0.24256 -0.38097 -0.378665
b_cook_sig -0.270070 0.415370 0.06483 0.47859 -0.28759 -0.157538
b_eat_mu -0.213527 0.085246 -0.59499 -0.32486 -0.39500 -0.118292
b_eat_sig -0.247613 0.759284 0.18424 0.62209 -0.06702 -0.063267
b_pea_mu -0.420444 0.533786 0.07455 0.57207 -0.32131 0.192770
b_pea_sig -0.009121 -0.390538 -0.22934 -0.40895 0.04367 0.159017
b_inschick_mu -0.266539 -0.071925 0.14847 0.19814 -0.18551 0.129654
b_inschick_sig -0.497910 0.260651 -0.07402 0.12528 -0.16767 0.079484
b_cricket_mu -0.584438 0.395610 -0.06101 0.18803 -0.27525 0.264814
b_cricket_sig -0.510950 0.400221 0.15407 0.32101 -0.07723 0.186403
b_worm_mu -0.560241 0.415102 -0.07638 0.23040 -0.28413 0.207555
b_worm_sig 0.489537 -0.424654 0.03340 -0.24919 0.15901 -0.114588
b_mne_mu 0.089636 -0.228108 -0.38787 -0.40900 -0.07927 -0.338252
b_mne_sig 0.162677 0.347137 -0.14900 0.10849 0.18394 -0.354187
b_bio_mu 1.000000 -0.464323 -0.05476 -0.21072 0.07877 -0.328873
b_bio_sig -0.464323 1.000000 0.12682 0.55682 -0.02630 0.008474
b_eu_mu -0.054763 0.126816 1.00000 0.71052 0.61534 0.312939
b_eu_sig -0.210724 0.556822 0.71052 1.00000 0.20919 0.223619
b_local_mu 0.078767 -0.026297 0.61534 0.20919 1.00000 0.154326
b_local_sig -0.328873 0.008474 0.31294 0.22362 0.15433 1.000000

20 worst outliers in terms of lowest average per choice prediction:
ID Avg prob per choice
1188 0.1690916
1131 0.1894308
1023 0.1983931
1245 0.2032789
1348 0.2097972
1381 0.2264249
1274 0.2463131
1200 0.2482325
1247 0.2491906
1260 0.2513030
1233 0.2618677
1140 0.2736696
1183 0.2757899
1034 0.2876122
1191 0.2891988
1232 0.2899765
1057 0.2929139
1172 0.2951531
1069 0.2961669
1210 0.2979870

Changes in parameter estimates from starting values:
Initial Estimate Difference
asc_alt1 -0.06235 -0.08022 -0.01787
asc_alt2 0.00000 0.00000 0.00000
asc_none -0.68856 -2.81227 -2.12371
b_price_mu -5.00000 -0.76517 4.23483
b_price_sig 0.01315 1.37665 1.36350
b_cook_mu 0.59419 -1.31505 -1.90924
b_cook_sig 0.08434 3.18048 3.09614
b_eat_mu 0.36438 -0.14523 -0.50961
b_eat_sig 0.08305 3.61959 3.53654
b_pea_mu -0.34364 2.01341 2.35705
b_pea_sig 0.08207 -4.14925 -4.23132
b_inschick_mu -0.76620 3.72347 4.48967
b_inschick_sig 0.09156 5.31084 5.21928
b_cricket_mu -2.08199 14.03110 16.11309
b_cricket_sig 0.11984 7.70216 7.58232
b_worm_mu -2.40879 19.53712 21.94591
b_worm_sig 0.13565 -11.27373 -11.40938
b_mne_mu 0.02511 0.41903 0.39392
b_mne_sig 0.04621 1.45466 1.40845
b_bio_mu 0.26311 -0.90742 -1.17053
b_bio_sig 0.04350 1.41507 1.37157
b_eu_mu 0.55187 -2.22735 -2.77922
b_eu_sig 0.06826 1.56623 1.49797
b_local_mu 0.73714 -3.10823 -3.84537
b_local_sig 0.06495 0.56506 0.50011

Settings and functions used in model definition:

apollo_control
--------------
Value
modelName "MMNL_SUSINCHAIN_CB7_PT_PRIOR_WTP2_Replication"
modelDescr "Code written together_chicken base"
indivID "id"
mixing "TRUE"
nCores "4"
workInLogs "FALSE"
debug "FALSE"
seed "13"
HB "FALSE"
noValidation "FALSE"
noDiagnostics "FALSE"
calculateLLC "TRUE"
outputDirectory "C:/Users/Nikravech/Box/PhD_Food_Waste_TU/02_SUSINCHAIN/04_WP1/1.4_Explore_strategies_to_gain_trust/05_Analysis/07_R_Work/2_Synchronized/Emilias Results/Final/Portugal/ML - WTP/Replication/"
panelData "TRUE"
analyticGrad "TRUE"
analyticGrad_manualSet "FALSE"

Hessian routines attempted
--------------
numerical jacobian of LL analytical gradient

Scaling in estimation
--------------
Value
asc_alt1 0.08022041
asc_none 2.81226679
b_price_mu 0.76516809
b_price_sig 1.37664712
b_cook_mu 1.31504758
b_cook_sig 3.18047707
b_eat_mu 0.14523430
b_eat_sig 3.61959028
b_pea_mu 2.01340656
b_pea_sig 4.14925081
b_inschick_mu 3.72346577
b_inschick_sig 5.31084361
b_cricket_mu 14.03107157
b_cricket_sig 7.70216992
b_worm_mu 19.53718922
b_worm_sig 11.27370251
b_mne_mu 0.41902674
b_mne_sig 1.45466341
b_bio_mu 0.90741826
b_bio_sig 1.41507438
b_eu_mu 2.22734847
b_eu_sig 1.56623490
b_local_mu 3.10823045
b_local_sig 0.56505742

Scaling used in computing Hessian
--------------
Value
asc_alt1 0.08022041
asc_none 2.81226566
b_price_mu 0.76516832
b_price_sig 1.37664882
b_cook_mu 1.31504825
b_cook_sig 3.18047887
b_eat_mu 0.14523430
b_eat_sig 3.61959328
b_pea_mu 2.01340614
b_pea_sig 4.14925073
b_inschick_mu 3.72346518
b_inschick_sig 5.31084020
b_cricket_mu 14.03110045
b_cricket_sig 7.70216008
b_worm_mu 19.53712284
b_worm_sig 11.27373112
b_mne_mu 0.41902682
b_mne_sig 1.45466404
b_bio_mu 0.90741829
b_bio_sig 1.41507388
b_eu_mu 2.22734843
b_eu_sig 1.56623435
b_local_mu 3.10823134
b_local_sig 0.56505756


apollo_randCoeff
----------------
function(apollo_beta, apollo_inputs){
randcoeff = list()

randcoeff[["b_price"]] = -exp(b_price_mu + b_price_sig * draws_price)
randcoeff[["b_cook"]] = b_cook_mu + b_cook_sig * draws_cook
randcoeff[["b_eat"]] = b_eat_mu + b_eat_sig * draws_eat
randcoeff[["b_pea"]] = b_pea_mu + b_pea_sig * draws_pea
randcoeff[["b_inschick"]] = b_inschick_mu + b_inschick_sig * draws_inschick
randcoeff[["b_cricket"]] = b_cricket_mu + b_cricket_sig * draws_cricket
randcoeff[["b_worm"]] = b_worm_mu + b_worm_sig * draws_worm
randcoeff[["b_mne"]] = b_mne_mu + b_mne_sig * draws_mne
randcoeff[["b_bio"]] = b_bio_mu + b_bio_sig * draws_bio
randcoeff[["b_eu"]] = b_eu_mu + b_eu_sig * draws_eu
randcoeff[["b_local"]] = b_local_mu + b_local_sig * draws_local


return(randcoeff)
}
<bytecode: 0x000001f97bbcb190>


apollo_probabilities
--------------------
function(apollo_beta, apollo_inputs, functionality="estimate"){

### Function initialisation: do not change the following three commands
### Attach inputs and detach after function exit
apollo_attach(apollo_beta, apollo_inputs)
on.exit(apollo_detach(apollo_beta, apollo_inputs))

### Create list of probabilities P
P = list()

### Create alternative specific constants and coefficients with interactions with socio-demographics

#b_peaa = b_pea + b_pea_shift_tins * (scenario == 2) + b_pea_shift_tsus * (scenario == 3)
#b_cricketa = b_cricket + b_cricket_shift_tins * (scenario == 2) + b_cricket_shift_tsus * (scenario == 3)
#b_inschicka = b_inschick + b_inschick_shift_tins * (scenario == 2) + b_inschick_shift_tsus * (scenario == 3)
#b_worma = b_worm + b_worm_shift_tins * (scenario == 2) + b_worm_shift_tsus * (scenario == 3)

### List of utilities: these must use the same names as in mnl_settings, order is irrelevant
V = list()
V[["alt1"]] = asc_alt1 + b_price * (price1 + b_cook * cook1 + b_eat * eat1 + b_pea * pea1 + b_inschick *inschick1 + b_cricket * cricket1 + b_worm * worm1 + b_mne *mne1 + b_bio * bio1 + b_eu * eu1 + b_local * local1)
V[["alt2"]] = asc_alt2 + b_price * (price2 + b_cook * cook2 + b_eat * eat2 + b_pea * pea2 + b_inschick *inschick2 + b_cricket * cricket2 + b_worm * worm2 + b_mne *mne2 + b_bio * bio2 + b_eu * eu2 + b_local * local2)
V[["none"]] = asc_none

### Define settings for MNL model component
mnl_settings = list(
alternatives = c(alt1=1, alt2=2, none=3),
avail = list(alt1=1, alt2=1, none=1),
choiceVar = choice,
utilities = V
)

### Compute probabilities using MNL model
P[["model"]] = apollo_mnl(mnl_settings, functionality)

### Take product across observation for same individual
P = apollo_panelProd(P, apollo_inputs, functionality)

### Average across inter-individual draws
P = apollo_avgInterDraws(P, apollo_inputs, functionality)

### Prepare and return outputs of function
P = apollo_prepareProb(P, apollo_inputs, functionality)
return(P)
}
<bytecode: 0x000001f90082b0f0>
stephanehess
Site Admin
Posts: 974
Joined: 24 Apr 2020, 16:29

Re: Replication issues with WTP estimation results

Post by stephanehess »

Hi

I had a look at this, and I'm pretty sure what's happening relates to the seed and random draws.

Your model uses MLHS draws, which incorporate a random element. Now, Apollo will use the same seed on both machines, and so you should be able to get the same results. However, this will not be the case if one of the machines has generated some draws in an earlier run and you have not restarted the seed. What happens when on both machines, you start a new R session and then immediately estimate the model?

Stephane
--------------------------------
Stephane Hess
www.stephanehess.me.uk
mnikrave
Posts: 6
Joined: 22 Jul 2022, 21:54

Re: Replication issues with WTP estimation results

Post by mnikrave »

Hi Stephane,

We tried to reproduce the results by restarting a new R session and immediately estimating the model as you recommended, but both end up with the results we previously got.

Cheers,

Mariam

###############
#### Output####
##############


Model run by Nikravech using Apollo 0.2.7 on R 4.2.1 for Windows.
www.ApolloChoiceModelling.com

Model name : MMNL_SUSINCHAIN_CB7_PT_PRIOR_WTP2_NEWSTART
Model description : Code written together_chicken base
Model run at : 2022-09-05 10:07:36
Estimation method : bfgs
Model diagnosis : successful convergence
Number of individuals : 414
Number of rows in database : 4140
Number of modelled outcomes : 4140

Number of cores used : 4
Number of inter-individual draws : 1000 (mlhs)

LL(start) : -4654.11
LL(0) : -4548.25
LL(C) : -4540.65
LL(final) : -2923.52
Rho-square (0) : 0.3572
Adj.Rho-square (0) : 0.3519
Rho-square (C) : 0.3561
Adj.Rho-square (C) : 0.3509
AIC : 5895.03
BIC : 6046.91

Estimated parameters : 24
Time taken (hh:mm:ss) : 00:26:41.46
pre-estimation : 00:03:28.39
estimation : 00:09:41.84
post-estimation : 00:13:31.24
Iterations : 89
Min abs eigenvalue of Hessian : 0.313723

Unconstrained optimisation.

Estimates:
Estimate s.e. t.rat.(0) p(1-sided) Rob.s.e. Rob.t.rat.(0) p(1-sided)
asc_alt1 -0.08022 0.06822 -1.1760 0.119800 0.07542 -1.0637 0.143734
asc_alt2 0.00000 NA NA NA NA NA NA
asc_none -2.81227 0.13967 -20.1351 0.000000 0.17311 -16.2459 0.000000
b_price_mu -0.76517 0.08391 -9.1193 0.000000 0.08711 -8.7839 0.000000
b_price_sig 1.37665 0.09998 13.7698 0.000000 0.11002 12.5131 0.000000
b_cook_mu -1.31505 0.21978 -5.9834 1.092e-09 0.22359 -5.8814 2.034e-09
b_cook_sig 3.18048 0.21997 14.4587 0.000000 0.24641 12.9073 0.000000
b_eat_mu -0.14523 0.24327 -0.5970 0.275254 0.26413 -0.5499 0.291209
b_eat_sig 3.61959 0.22568 16.0384 0.000000 0.25086 14.4287 0.000000
b_pea_mu 2.01341 0.22234 9.0554 0.000000 0.26024 7.7368 5.107e-15
b_pea_sig -4.14925 0.22456 -18.4774 0.000000 0.24955 -16.6272 0.000000
b_inschick_mu 3.72347 0.31259 11.9116 0.000000 0.36693 10.1476 0.000000
b_inschick_sig 5.31084 0.32057 16.5666 0.000000 0.31467 16.8773 0.000000
b_cricket_mu 14.03110 0.89307 15.7112 0.000000 1.04434 13.4353 0.000000
b_cricket_sig 7.70216 0.63666 12.0978 0.000000 0.62040 12.4148 0.000000
b_worm_mu 19.53712 1.40051 13.9500 0.000000 1.59676 12.2355 0.000000
b_worm_sig -11.27373 0.99128 -11.3729 0.000000 1.12675 -10.0056 0.000000
b_mne_mu 0.41903 0.15731 2.6637 0.003864 0.17295 2.4229 0.007699
b_mne_sig 1.45466 0.14149 10.2810 0.000000 0.15388 9.4534 0.000000
b_bio_mu -0.90742 0.16461 -5.5124 1.770e-08 0.17025 -5.3300 4.909e-08
b_bio_sig 1.41507 0.14067 10.0594 0.000000 0.14342 9.8665 0.000000
b_eu_mu -2.22735 0.23312 -9.5546 0.000000 0.30646 -7.2679 1.826e-13
b_eu_sig 1.56623 0.24528 6.3855 8.543e-11 0.34168 4.5839 2.281e-06
b_local_mu -3.10823 0.19532 -15.9135 0.000000 0.21459 -14.4844 0.000000
b_local_sig 0.56506 0.12672 4.4592 4.113e-06 0.09148 6.1767 3.273e-10


Overview of choices for MNL model component :
alt1 alt2 none
Times available 4140.00 4140.0 4140.00
Times chosen 1388.00 1478.0 1274.00
Percentage chosen overall 33.53 35.7 30.77
Percentage chosen when available 33.53 35.7 30.77


Classical covariance matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig b_eat_mu
asc_alt1 0.004653 0.002459 9.170e-05 1.0755e-04 -1.3934e-04 3.1388e-04 8.570e-05
asc_none 0.002459 0.019508 -0.002795 0.002155 -0.005183 7.0535e-04 -0.003940
b_price_mu 9.170e-05 -0.002795 0.007040 -6.7366e-04 -0.001742 -0.003688 1.5715e-04
b_price_sig 1.0755e-04 0.002155 -6.7366e-04 0.009995 -0.005969 -0.002255 -0.001067
b_cook_mu -1.3934e-04 -0.005183 -0.001742 -0.005969 0.048304 0.007050 0.024508
b_cook_sig 3.1388e-04 7.0535e-04 -0.003688 -0.002255 0.007050 0.048387 -0.006511
b_eat_mu 8.570e-05 -0.003940 1.5715e-04 -0.001067 0.024508 -0.006511 0.059182
b_eat_sig -3.1574e-04 3.3234e-04 -0.001239 0.002416 -0.009699 0.010041 -0.004600
b_pea_mu -1.5203e-04 -3.6271e-04 -0.003489 -0.002422 -0.003057 0.019001 -0.005091
b_pea_sig 8.3926e-04 -2.2531e-04 9.6671e-04 -6.9476e-04 0.006488 -0.003914 0.002626
b_inschick_mu -5.4172e-04 -9.4773e-04 -0.006381 -0.004680 -0.003611 0.015961 -0.018831
b_inschick_sig -5.0464e-04 -0.002417 -0.003168 4.3872e-04 4.8728e-04 -7.1579e-04 0.018849
b_cricket_mu -4.9671e-04 0.007683 -0.020729 0.020999 -0.014680 0.057684 0.010186
b_cricket_sig -4.3262e-04 0.007958 -0.010198 0.015776 -0.015448 0.033595 -0.017980
b_worm_mu 1.5170e-04 0.014853 -0.034001 0.037062 0.002015 0.095334 0.027709
b_worm_sig -3.7652e-04 -0.009702 0.019924 -0.029202 0.003422 -0.061858 -0.009940
b_mne_mu -1.3087e-04 -0.002047 -6.6946e-04 -0.001565 5.5265e-04 3.9894e-04 0.002859
b_mne_sig -1.2063e-04 -0.002242 9.928e-05 -6.0840e-04 -0.003611 0.002631 0.007062
b_bio_mu -2.7715e-04 -0.001509 1.2637e-04 -0.002040 -0.004361 -0.004400 -0.012757
b_bio_sig -3.840e-05 5.5704e-04 2.265e-05 0.001460 -0.006388 0.006942 0.001139
b_eu_mu -5.867e-05 -0.004282 -3.7898e-04 -0.001977 -0.009319 -9.9399e-04 -0.021776
b_eu_sig -6.6450e-04 -0.005427 -0.002175 -0.001271 -0.003868 0.017251 -0.006488
b_local_mu 8.502e-06 -0.002611 0.002327 -0.002053 -0.009993 -0.009855 -0.011391
b_local_sig 1.2023e-04 -5.458e-05 -6.7943e-04 9.0915e-04 -0.004382 -0.002027 -8.5938e-04
b_eat_sig b_pea_mu b_pea_sig b_inschick_mu b_inschick_sig b_cricket_mu b_cricket_sig
asc_alt1 -3.1574e-04 -1.5203e-04 8.3926e-04 -5.4172e-04 -5.0464e-04 -4.9671e-04 -4.3262e-04
asc_none 3.3234e-04 -3.6271e-04 -2.2531e-04 -9.4773e-04 -0.002417 0.007683 0.007958
b_price_mu -0.001239 -0.003489 9.6671e-04 -0.006381 -0.003168 -0.020729 -0.010198
b_price_sig 0.002416 -0.002422 -6.9476e-04 -0.004680 4.3872e-04 0.020999 0.015776
b_cook_mu -0.009699 -0.003057 0.006488 -0.003611 4.8728e-04 -0.014680 -0.015448
b_cook_sig 0.010041 0.019001 -0.003914 0.015961 -7.1579e-04 0.057684 0.033595
b_eat_mu -0.004600 -0.005091 0.002626 -0.018831 0.018849 0.010186 -0.017980
b_eat_sig 0.050933 0.012992 -0.023134 0.001743 0.019741 0.030839 0.025476
b_pea_mu 0.012992 0.049436 -0.014764 0.021602 0.007601 0.051233 0.019923
b_pea_sig -0.023134 -0.014764 0.050427 -0.007933 -0.012195 -0.016361 -0.018576
b_inschick_mu 0.001743 0.021602 -0.007933 0.097713 0.053455 0.043714 0.023525
b_inschick_sig 0.019741 0.007601 -0.012195 0.053455 0.102768 0.043260 0.014003
b_cricket_mu 0.030839 0.051233 -0.016361 0.043714 0.043260 0.797566 0.487751
b_cricket_sig 0.025476 0.019923 -0.018576 0.023525 0.014003 0.487751 0.405333
b_worm_mu 0.033850 0.069711 -0.018129 0.055255 0.057158 0.541947 0.309326
b_worm_sig -0.024661 -0.031404 0.012641 -0.019896 -0.025979 -0.347982 -0.221869
b_mne_mu -6.9847e-04 -0.005920 0.001097 0.002777 0.010137 0.005025 -0.004326
b_mne_sig 0.007825 0.003862 -0.007371 -0.006915 0.005563 0.003798 -0.001333
b_bio_mu -0.002093 -0.006416 9.9156e-04 -6.1286e-04 -0.012740 -0.033949 -0.015286
b_bio_sig 0.017692 0.006250 -0.008978 -0.006695 0.008169 0.026845 0.016345
b_eu_mu -0.003378 -0.010379 0.004376 -5.2873e-04 -0.011046 -0.013860 0.014341
b_eu_sig 0.021762 0.015833 -0.009840 0.009465 0.003577 0.030499 0.028291
b_local_mu -0.005010 -0.015314 0.003511 -0.012859 -0.008739 -0.041249 -0.009178
b_local_sig -0.003504 0.001900 0.004818 2.3876e-04 -7.5982e-04 0.011879 0.001809
b_worm_mu b_worm_sig b_mne_mu b_mne_sig b_bio_mu b_bio_sig b_eu_mu
asc_alt1 1.5170e-04 -3.7652e-04 -1.3087e-04 -1.2063e-04 -2.7715e-04 -3.840e-05 -5.867e-05
asc_none 0.014853 -0.009702 -0.002047 -0.002242 -0.001509 5.5704e-04 -0.004282
b_price_mu -0.034001 0.019924 -6.6946e-04 9.928e-05 1.2637e-04 2.265e-05 -3.7898e-04
b_price_sig 0.037062 -0.029202 -0.001565 -6.0840e-04 -0.002040 0.001460 -0.001977
b_cook_mu 0.002015 0.003422 5.5265e-04 -0.003611 -0.004361 -0.006388 -0.009319
b_cook_sig 0.095334 -0.061858 3.9894e-04 0.002631 -0.004400 0.006942 -9.9399e-04
b_eat_mu 0.027709 -0.009940 0.002859 0.007062 -0.012757 0.001139 -0.021776
b_eat_sig 0.033850 -0.024661 -6.9847e-04 0.007825 -0.002093 0.017692 -0.003378
b_pea_mu 0.069711 -0.031404 -0.005920 0.003862 -0.006416 0.006250 -0.010379
b_pea_sig -0.018129 0.012641 0.001097 -0.007371 9.9156e-04 -0.008978 0.004376
b_inschick_mu 0.055255 -0.019896 0.002777 -0.006915 -6.1286e-04 -0.006695 -5.2873e-04
b_inschick_sig 0.057158 -0.025979 0.010137 0.005563 -0.012740 0.008169 -0.011046
b_cricket_mu 0.541947 -0.347982 0.005025 0.003798 -0.033949 0.026845 -0.013860
b_cricket_sig 0.309326 -0.221869 -0.004326 -0.001333 -0.015286 0.016345 0.014341
b_worm_mu 1.961424 -1.333965 -0.008165 0.009774 -0.049349 0.036776 -0.006986
b_worm_sig -1.333965 0.982640 0.005181 -0.010828 0.026161 -0.029539 -0.013155
b_mne_mu -0.008165 0.005181 0.024746 0.005132 -1.4321e-04 -0.001876 -0.005622
b_mne_sig 0.009774 -0.010828 0.005132 0.020020 0.002349 0.005533 -0.004254
b_bio_mu -0.049349 0.026161 -1.4321e-04 0.002349 0.027098 -0.006923 -0.001709
b_bio_sig 0.036776 -0.029539 -0.001876 0.005533 -0.006923 0.019789 5.3512e-04
b_eu_mu -0.006986 -0.013155 -0.005622 -0.004254 -0.001709 5.3512e-04 0.054344
b_eu_sig 0.050752 -0.043075 -0.005135 0.004071 -0.001165 0.010985 0.023659
b_local_mu -0.056463 0.023258 -0.004946 0.002187 -0.002277 0.001538 0.023784
b_local_sig 0.024211 -0.011056 -3.6854e-04 -0.002439 -0.001211 -0.001918 0.002367
b_eu_sig b_local_mu b_local_sig
asc_alt1 -6.6450e-04 8.502e-06 1.2023e-04
asc_none -0.005427 -0.002611 -5.458e-05
b_price_mu -0.002175 0.002327 -6.7943e-04
b_price_sig -0.001271 -0.002053 9.0915e-04
b_cook_mu -0.003868 -0.009993 -0.004382
b_cook_sig 0.017251 -0.009855 -0.002027
b_eat_mu -0.006488 -0.011391 -8.5938e-04
b_eat_sig 0.021762 -0.005010 -0.003504
b_pea_mu 0.015833 -0.015314 0.001900
b_pea_sig -0.009840 0.003511 0.004818
b_inschick_mu 0.009465 -0.012859 2.3876e-04
b_inschick_sig 0.003577 -0.008739 -7.5982e-04
b_cricket_mu 0.030499 -0.041249 0.011879
b_cricket_sig 0.028291 -0.009178 0.001809
b_worm_mu 0.050752 -0.056463 0.024211
b_worm_sig -0.043075 0.023258 -0.011056
b_mne_mu -0.005135 -0.004946 -3.6854e-04
b_mne_sig 0.004071 0.002187 -0.002439
b_bio_mu -0.001165 -0.002277 -0.001211
b_bio_sig 0.010985 0.001538 -0.001918
b_eu_mu 0.023659 0.023784 0.002367
b_eu_sig 0.060163 0.001672 4.2629e-04
b_local_mu 0.001672 0.038150 0.002957
b_local_sig 4.2629e-04 0.002957 0.016057

Robust covariance matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig b_eat_mu
asc_alt1 0.005688 0.003843 -6.320e-05 5.9017e-04 8.9024e-04 -2.511e-05 0.001313
asc_none 0.003843 0.029966 -0.002634 -0.001733 7.0624e-04 0.003097 -6.4685e-04
b_price_mu -6.320e-05 -0.002634 0.007588 4.2472e-04 -0.001955 -0.007437 6.1929e-04
b_price_sig 5.9017e-04 -0.001733 4.2472e-04 0.012104 -0.006666 -0.004387 0.001972
b_cook_mu 8.9024e-04 7.0624e-04 -0.001955 -0.006666 0.049994 0.012503 0.029133
b_cook_sig -2.511e-05 0.003097 -0.007437 -0.004387 0.012503 0.060718 -0.005346
b_eat_mu 0.001313 -6.4685e-04 6.1929e-04 0.001972 0.029133 -0.005346 0.069766
b_eat_sig -0.001193 -7.4215e-04 -0.004373 0.003405 -0.018571 0.025896 -0.010289
b_pea_mu -9.1884e-04 -2.7171e-04 -0.007479 -0.001317 -0.011171 0.038271 -0.012438
b_pea_sig 0.002670 0.001417 0.002790 0.002570 0.012259 -0.008012 0.016104
b_inschick_mu -0.001221 -0.001261 -0.012012 -0.010363 -1.1301e-04 0.029133 -0.032230
b_inschick_sig -2.5177e-04 -0.003223 -0.006668 -5.6426e-04 5.9107e-04 0.009354 0.015763
b_cricket_mu 0.002797 -0.002423 -0.024325 0.025757 0.004619 0.099691 0.067368
b_cricket_sig 0.001921 0.002690 -0.012396 0.016388 -0.009338 0.064737 -4.2666e-04
b_worm_mu 0.009452 0.014134 -0.037205 0.043288 0.024676 0.184791 0.110352
b_worm_sig -0.007551 -0.009741 0.018542 -0.036532 -0.016118 -0.127373 -0.072008
b_mne_mu 3.0142e-04 -0.001373 8.6738e-04 -0.001396 0.011664 -5.7535e-04 0.013411
b_mne_sig -3.2895e-04 -0.003052 7.4861e-04 -1.7067e-04 0.001003 0.005883 0.014265
b_bio_mu -7.1968e-04 -0.001858 0.002130 -0.004499 0.001885 -0.011329 -0.009602
b_bio_sig -2.9536e-04 -2.452e-05 -0.001182 0.003440 -0.010379 0.014679 0.003229
b_eu_mu -0.001941 -0.005878 -0.002236 -0.002525 -0.023560 0.004896 -0.048163
b_eu_sig -0.002252 -0.006221 -0.007817 -0.001309 -0.018531 0.040294 -0.029318
b_local_mu -4.2203e-04 -0.003622 0.004072 -0.001048 -0.018280 -0.015207 -0.022389
b_local_sig 6.159e-05 -0.001017 -6.9421e-04 0.001899 -0.007746 -0.003551 -0.002858
b_eat_sig b_pea_mu b_pea_sig b_inschick_mu b_inschick_sig b_cricket_mu b_cricket_sig
asc_alt1 -0.001193 -9.1884e-04 0.002670 -0.001221 -2.5177e-04 0.002797 0.001921
asc_none -7.4215e-04 -2.7171e-04 0.001417 -0.001261 -0.003223 -0.002423 0.002690
b_price_mu -0.004373 -0.007479 0.002790 -0.012012 -0.006668 -0.024325 -0.012396
b_price_sig 0.003405 -0.001317 0.002570 -0.010363 -5.6426e-04 0.025757 0.016388
b_cook_mu -0.018571 -0.011171 0.012259 -1.1301e-04 5.9107e-04 0.004619 -0.009338
b_cook_sig 0.025896 0.038271 -0.008012 0.029133 0.009354 0.099691 0.064737
b_eat_mu -0.010289 -0.012438 0.016104 -0.032230 0.015763 0.067368 -4.2666e-04
b_eat_sig 0.062931 0.037379 -0.039698 0.004964 0.018664 0.044751 0.035959
b_pea_mu 0.037379 0.067724 -0.023965 0.037596 0.021391 0.104439 0.059874
b_pea_sig -0.039698 -0.023965 0.062273 -0.017974 -0.012957 0.011175 -0.003876
b_inschick_mu 0.004964 0.037596 -0.017974 0.134639 0.077523 0.091353 0.056768
b_inschick_sig 0.018664 0.021391 -0.012957 0.077523 0.099019 0.137614 0.063780
b_cricket_mu 0.044751 0.104439 0.011175 0.091353 0.137614 1.090653 0.588539
b_cricket_sig 0.035959 0.059874 -0.003876 0.056768 0.063780 0.588539 0.384895
b_worm_mu 0.073366 0.173888 0.036257 0.112419 0.173314 1.245591 0.695727
b_worm_sig -0.048678 -0.099976 -0.037472 -0.034401 -0.095946 -0.804663 -0.485670
b_mne_mu -0.009855 -0.017366 0.013848 -0.004867 0.010203 0.006305 -0.004868
b_mne_sig 0.009828 -0.001022 -0.002088 -0.022770 0.001510 0.007598 0.002349
b_bio_mu -0.010575 -0.018628 -3.8748e-04 -0.016650 -0.026674 -0.103910 -0.053967
b_bio_sig 0.027318 0.019923 -0.013977 -0.003785 0.011763 0.059255 0.035611
b_eu_mu 0.014165 0.005945 -0.017539 0.016696 -0.007138 -0.019527 0.029293
b_eu_sig 0.053322 0.050867 -0.034869 0.024842 0.013469 0.067095 0.068046
b_local_mu -0.003608 -0.017943 0.002339 -0.014607 -0.011322 -0.061685 -0.010282
b_local_sig -0.001452 0.004589 0.003630 0.004352 0.002288 0.025300 0.010579
b_worm_mu b_worm_sig b_mne_mu b_mne_sig b_bio_mu b_bio_sig b_eu_mu
asc_alt1 0.009452 -0.007551 3.0142e-04 -3.2895e-04 -7.1968e-04 -2.9536e-04 -0.001941
asc_none 0.014134 -0.009741 -0.001373 -0.003052 -0.001858 -2.452e-05 -0.005878
b_price_mu -0.037205 0.018542 8.6738e-04 7.4861e-04 0.002130 -0.001182 -0.002236
b_price_sig 0.043288 -0.036532 -0.001396 -1.7067e-04 -0.004499 0.003440 -0.002525
b_cook_mu 0.024676 -0.016118 0.011664 0.001003 0.001885 -0.010379 -0.023560
b_cook_sig 0.184791 -0.127373 -5.7535e-04 0.005883 -0.011329 0.014679 0.004896
b_eat_mu 0.110352 -0.072008 0.013411 0.014265 -0.009602 0.003229 -0.048163
b_eat_sig 0.073366 -0.048678 -0.009855 0.009828 -0.010575 0.027318 0.014165
b_pea_mu 0.173888 -0.099976 -0.017366 -0.001022 -0.018628 0.019923 0.005945
b_pea_sig 0.036257 -0.037472 0.013848 -0.002088 -3.8748e-04 -0.013977 -0.017539
b_inschick_mu 0.112419 -0.034401 -0.004867 -0.022770 -0.016650 -0.003785 0.016696
b_inschick_sig 0.173314 -0.095946 0.010203 0.001510 -0.026674 0.011763 -0.007138
b_cricket_mu 1.245591 -0.804663 0.006305 0.007598 -0.103910 0.059255 -0.019527
b_cricket_sig 0.695727 -0.485670 -0.004868 0.002349 -0.053967 0.035611 0.029293
b_worm_mu 2.549640 -1.742930 0.003811 0.024822 -0.152297 0.095062 -0.037375
b_worm_sig -1.742930 1.269559 -0.016244 -0.040209 0.093905 -0.068624 0.011533
b_mne_mu 0.003811 -0.016244 0.029911 0.012454 0.002639 -0.005658 -0.020558
b_mne_sig 0.024822 -0.040209 0.012454 0.023678 0.004262 0.007661 -0.007026
b_bio_mu -0.152297 0.093905 0.002639 0.004262 0.028984 -0.011337 -0.002857
b_bio_sig 0.095062 -0.068624 -0.005658 0.007661 -0.011337 0.020570 0.005574
b_eu_mu -0.037375 0.011533 -0.020558 -0.007026 -0.002857 0.005574 0.093921
b_eu_sig 0.125704 -0.095935 -0.024169 0.005704 -0.012258 0.027287 0.074401
b_local_mu -0.097358 0.038448 -0.002942 0.006074 0.002878 -8.0934e-04 0.040468
b_local_sig 0.030319 -0.011811 -0.005352 -0.004986 -0.005122 1.1119e-04 0.008774
b_eu_sig b_local_mu b_local_sig
asc_alt1 -0.002252 -4.2203e-04 6.159e-05
asc_none -0.006221 -0.003622 -0.001017
b_price_mu -0.007817 0.004072 -6.9421e-04
b_price_sig -0.001309 -0.001048 0.001899
b_cook_mu -0.018531 -0.018280 -0.007746
b_cook_sig 0.040294 -0.015207 -0.003551
b_eat_mu -0.029318 -0.022389 -0.002858
b_eat_sig 0.053322 -0.003608 -0.001452
b_pea_mu 0.050867 -0.017943 0.004589
b_pea_sig -0.034869 0.002339 0.003630
b_inschick_mu 0.024842 -0.014607 0.004352
b_inschick_sig 0.013469 -0.011322 0.002288
b_cricket_mu 0.067095 -0.061685 0.025300
b_cricket_sig 0.068046 -0.010282 0.010579
b_worm_mu 0.125704 -0.097358 0.030319
b_worm_sig -0.095935 0.038448 -0.011811
b_mne_mu -0.024169 -0.002942 -0.005352
b_mne_sig 0.005704 0.006074 -0.004986
b_bio_mu -0.012258 0.002878 -0.005122
b_bio_sig 0.027287 -8.0934e-04 1.1119e-04
b_eu_mu 0.074401 0.040468 0.008774
b_eu_sig 0.116744 0.015338 0.006990
b_local_mu 0.015338 0.046049 0.003030
b_local_sig 0.006990 0.003030 0.008369

Classical correlation matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig b_eat_mu
asc_alt1 1.000000 0.258124 0.016021 0.01577 -0.009294 0.02092 0.005164
asc_none 0.258124 1.000000 -0.238460 0.15430 -0.168847 0.02296 -0.115969
b_price_mu 0.016021 -0.238460 1.000000 -0.08031 -0.094482 -0.19983 0.007699
b_price_sig 0.015770 0.154296 -0.080307 1.00000 -0.271634 -0.10253 -0.043888
b_cook_mu -0.009294 -0.168847 -0.094482 -0.27163 1.000000 0.14583 0.458380
b_cook_sig 0.020918 0.022958 -0.199829 -0.10253 0.145830 1.00000 -0.121669
b_eat_mu 0.005164 -0.115969 0.007699 -0.04389 0.458380 -0.12167 1.000000
b_eat_sig -0.020509 0.010543 -0.065443 0.10707 -0.195545 0.20225 -0.083778
b_pea_mu -0.010024 -0.011680 -0.187018 -0.10896 -0.062557 0.38850 -0.094113
b_pea_sig 0.054788 -0.007184 0.051306 -0.03095 0.131461 -0.07925 0.048063
b_inschick_mu -0.025405 -0.021707 -0.243272 -0.14977 -0.052565 0.23213 -0.247635
b_inschick_sig -0.023076 -0.053989 -0.117760 0.01369 0.006916 -0.01015 0.241693
b_cricket_mu -0.008153 0.061596 -0.276637 0.23519 -0.074793 0.29364 0.046886
b_cricket_sig -0.009961 0.089496 -0.190897 0.24785 -0.110400 0.23989 -0.116087
b_worm_mu 0.001588 0.075932 -0.289339 0.26470 0.006546 0.30946 0.081329
b_worm_sig -0.005568 -0.070077 0.239541 -0.29466 0.015709 -0.28368 -0.041217
b_mne_mu -0.012196 -0.093180 -0.050720 -0.09950 0.015985 0.01153 0.074707
b_mne_sig -0.012498 -0.113447 0.008363 -0.04301 -0.116114 0.08455 0.205173
b_bio_mu -0.024681 -0.065612 0.009149 -0.12396 -0.120533 -0.12152 -0.318561
b_bio_sig -0.004002 0.028352 0.001919 0.10379 -0.206617 0.22436 0.033277
b_eu_mu -0.003689 -0.131507 -0.019375 -0.08483 -0.181892 -0.01938 -0.383975
b_eu_sig -0.039714 -0.158414 -0.105704 -0.05184 -0.071757 0.31974 -0.108725
b_local_mu 6.3810e-04 -0.095699 0.142012 -0.10515 -0.232789 -0.22936 -0.239728
b_local_sig 0.013909 -0.003084 -0.063903 0.07176 -0.157336 -0.07272 -0.027878
b_eat_sig b_pea_mu b_pea_sig b_inschick_mu b_inschick_sig b_cricket_mu b_cricket_sig
asc_alt1 -0.02051 -0.01002 0.054788 -0.025405 -0.023076 -0.008153 -0.009961
asc_none 0.01054 -0.01168 -0.007184 -0.021707 -0.053989 0.061596 0.089496
b_price_mu -0.06544 -0.18702 0.051306 -0.243272 -0.117760 -0.276637 -0.190897
b_price_sig 0.10707 -0.10896 -0.030946 -0.149767 0.013689 0.235187 0.247851
b_cook_mu -0.19555 -0.06256 0.131461 -0.052565 0.006916 -0.074793 -0.110400
b_cook_sig 0.20225 0.38850 -0.079246 0.232126 -0.010151 0.293638 0.239890
b_eat_mu -0.08378 -0.09411 0.048063 -0.247635 0.241693 0.046886 -0.116087
b_eat_sig 1.00000 0.25891 -0.456474 0.024702 0.272854 0.153011 0.177305
b_pea_mu 0.25891 1.00000 -0.295692 0.310808 0.106643 0.258013 0.140745
b_pea_sig -0.45647 -0.29569 1.000000 -0.113015 -0.169399 -0.081583 -0.129929
b_inschick_mu 0.02470 0.31081 -0.113015 1.000000 0.533441 0.156590 0.118208
b_inschick_sig 0.27285 0.10664 -0.169399 0.533441 1.000000 0.151103 0.068608
b_cricket_mu 0.15301 0.25801 -0.081583 0.156590 0.151103 1.000000 0.857845
b_cricket_sig 0.17730 0.14074 -0.129929 0.118208 0.068608 0.857845 1.000000
b_worm_mu 0.10709 0.22387 -0.057645 0.126214 0.127309 0.433299 0.346916
b_worm_sig -0.11023 -0.14248 0.056788 -0.064210 -0.081752 -0.393076 -0.351555
b_mne_mu -0.01967 -0.16926 0.031052 0.056472 0.201023 0.035769 -0.043190
b_mne_sig 0.24505 0.12275 -0.231980 -0.156338 0.122648 0.030057 -0.014800
b_bio_mu -0.05634 -0.17529 0.026824 -0.011910 -0.241420 -0.230930 -0.145859
b_bio_sig 0.55727 0.19984 -0.284221 -0.152249 0.181147 0.213682 0.182499
b_eu_mu -0.06422 -0.20023 0.083603 -0.007256 -0.147813 -0.066576 0.096625
b_eu_sig 0.39314 0.29032 -0.178657 0.123443 0.045486 0.139230 0.181170
b_local_mu -0.11366 -0.35264 0.080056 -0.210610 -0.139569 -0.236474 -0.073804
b_local_sig -0.12252 0.06744 0.169305 0.006028 -0.018705 0.104971 0.022428
b_worm_mu b_worm_sig b_mne_mu b_mne_sig b_bio_mu b_bio_sig b_eu_mu
asc_alt1 0.001588 -0.005568 -0.012196 -0.012498 -0.024681 -0.004002 -0.003689
asc_none 0.075932 -0.070077 -0.093180 -0.113447 -0.065612 0.028352 -0.131507
b_price_mu -0.289339 0.239541 -0.050720 0.008363 0.009149 0.001919 -0.019375
b_price_sig 0.264695 -0.294659 -0.099502 -0.043010 -0.123956 0.103794 -0.084827
b_cook_mu 0.006546 0.015709 0.015985 -0.116114 -0.120533 -0.206617 -0.181892
b_cook_sig 0.309458 -0.283683 0.011529 0.084549 -0.121521 0.224357 -0.019384
b_eat_mu 0.081329 -0.041217 0.074707 0.205173 -0.318561 0.033277 -0.383975
b_eat_sig 0.107095 -0.110234 -0.019674 0.245053 -0.056337 0.557271 -0.064215
b_pea_mu 0.223868 -0.142483 -0.169260 0.122752 -0.175286 0.199837 -0.200234
b_pea_sig -0.057645 0.056788 0.031052 -0.231980 0.026824 -0.284221 0.083603
b_inschick_mu 0.126214 -0.064210 0.056472 -0.156338 -0.011910 -0.152249 -0.007256
b_inschick_sig 0.127309 -0.081752 0.201023 0.122648 -0.241420 0.181147 -0.147813
b_cricket_mu 0.433299 -0.393076 0.035769 0.030057 -0.230930 0.213682 -0.066576
b_cricket_sig 0.346916 -0.351555 -0.043190 -0.014800 -0.145859 0.182499 0.096625
b_worm_mu 1.000000 -0.960863 -0.037063 0.049322 -0.214058 0.186668 -0.021399
b_worm_sig -0.960863 1.000000 0.033227 -0.077204 0.160324 -0.211833 -0.056929
b_mne_mu -0.037063 0.033227 1.000000 0.230568 -0.005530 -0.084762 -0.153312
b_mne_sig 0.049322 -0.077204 0.230568 1.000000 0.100845 0.277981 -0.128962
b_bio_mu -0.214058 0.160324 -0.005530 0.100845 1.000000 -0.298969 -0.044541
b_bio_sig 0.186668 -0.211833 -0.084762 0.277981 -0.298969 1.000000 0.016318
b_eu_mu -0.021399 -0.056929 -0.153312 -0.128962 -0.044541 0.016318 1.000000
b_eu_sig 0.147741 -0.177160 -0.133078 0.117291 -0.028860 0.318371 0.413764
b_local_mu -0.206410 0.120125 -0.160976 0.079147 -0.070832 0.055975 0.522350
b_local_sig 0.136427 -0.088014 -0.018488 -0.136007 -0.058071 -0.107597 0.080121
b_eu_sig b_local_mu b_local_sig
asc_alt1 -0.03971 6.3810e-04 0.013909
asc_none -0.15841 -0.09570 -0.003084
b_price_mu -0.10570 0.14201 -0.063903
b_price_sig -0.05184 -0.10515 0.071765
b_cook_mu -0.07176 -0.23279 -0.157336
b_cook_sig 0.31974 -0.22936 -0.072716
b_eat_mu -0.10873 -0.23973 -0.027878
b_eat_sig 0.39314 -0.11366 -0.122520
b_pea_mu 0.29032 -0.35264 0.067435
b_pea_sig -0.17866 0.08006 0.169305
b_inschick_mu 0.12344 -0.21061 0.006028
b_inschick_sig 0.04549 -0.13957 -0.018705
b_cricket_mu 0.13923 -0.23647 0.104971
b_cricket_sig 0.18117 -0.07380 0.022428
b_worm_mu 0.14774 -0.20641 0.136427
b_worm_sig -0.17716 0.12013 -0.088014
b_mne_mu -0.13308 -0.16098 -0.018488
b_mne_sig 0.11729 0.07915 -0.136007
b_bio_mu -0.02886 -0.07083 -0.058071
b_bio_sig 0.31837 0.05597 -0.107597
b_eu_mu 0.41376 0.52235 0.080121
b_eu_sig 1.00000 0.03489 0.013715
b_local_mu 0.03489 1.00000 0.119486
b_local_sig 0.01372 0.11949 1.000000

Robust correlation matrix:
asc_alt1 asc_none b_price_mu b_price_sig b_cook_mu b_cook_sig b_eat_mu
asc_alt1 1.000000 0.294343 -0.009620 0.07113 0.052793 -0.001351 0.065890
asc_none 0.294343 1.000000 -0.174688 -0.09100 0.018246 0.072611 -0.014147
b_price_mu -0.009620 -0.174688 1.000000 0.04432 -0.100387 -0.346454 0.026915
b_price_sig 0.071129 -0.090997 0.044317 1.00000 -0.270978 -0.161837 0.067875
b_cook_mu 0.052793 0.018246 -0.100387 -0.27098 1.000000 0.226928 0.493293
b_cook_sig -0.001351 0.072611 -0.346454 -0.16184 0.226928 1.000000 -0.082143
b_eat_mu 0.065890 -0.014147 0.026915 0.06787 0.493293 -0.082143 1.000000
b_eat_sig -0.063043 -0.017090 -0.200115 0.12337 -0.331094 0.418938 -0.155283
b_pea_mu -0.046817 -0.006031 -0.329931 -0.04599 -0.191976 0.596820 -0.180946
b_pea_sig 0.141882 0.032805 0.128347 0.09362 0.219705 -0.130289 0.244324
b_inschick_mu -0.044114 -0.019859 -0.375788 -0.25672 -0.001377 0.322208 -0.332543
b_inschick_sig -0.010609 -0.059175 -0.243253 -0.01630 0.008401 0.120637 0.189648
b_cricket_mu 0.035510 -0.013404 -0.267388 0.22417 0.019781 0.387396 0.244223
b_cricket_sig 0.041050 0.025046 -0.229374 0.24011 -0.067315 0.423472 -0.002604
b_worm_mu 0.078493 0.051134 -0.267479 0.24642 0.069116 0.469660 0.261649
b_worm_sig -0.088861 -0.049940 0.188913 -0.29471 -0.063977 -0.458768 -0.241953
b_mne_mu 0.023109 -0.045846 0.057574 -0.07336 0.301621 -0.013501 0.293578
b_mne_sig -0.028345 -0.114579 0.055848 -0.01008 0.029150 0.155169 0.350988
b_bio_mu -0.056052 -0.063041 0.143627 -0.24021 0.049522 -0.270070 -0.213527
b_bio_sig -0.027306 -9.8783e-04 -0.094615 0.21804 -0.323668 0.415370 0.085246
b_eu_mu -0.083992 -0.110798 -0.083758 -0.07488 -0.343818 0.064833 -0.594990
b_eu_sig -0.087393 -0.105175 -0.262621 -0.03482 -0.242563 0.478591 -0.324857
b_local_mu -0.026077 -0.097494 0.217810 -0.04439 -0.380974 -0.287592 -0.395001
b_local_sig 0.008927 -0.064250 -0.087113 0.18867 -0.378665 -0.157538 -0.118292
b_eat_sig b_pea_mu b_pea_sig b_inschick_mu b_inschick_sig b_cricket_mu b_cricket_sig
asc_alt1 -0.06304 -0.046817 0.141882 -0.044114 -0.010609 0.03551 0.041050
asc_none -0.01709 -0.006031 0.032805 -0.019859 -0.059175 -0.01340 0.025046
b_price_mu -0.20012 -0.329931 0.128347 -0.375788 -0.243253 -0.26739 -0.229374
b_price_sig 0.12337 -0.045993 0.093615 -0.256719 -0.016299 0.22417 0.240106
b_cook_mu -0.33109 -0.191976 0.219705 -0.001377 0.008401 0.01978 -0.067315
b_cook_sig 0.41894 0.596820 -0.130289 0.322208 0.120637 0.38740 0.423472
b_eat_mu -0.15528 -0.180946 0.244324 -0.332543 0.189648 0.24422 -0.002604
b_eat_sig 1.00000 0.572565 -0.634137 0.053931 0.236432 0.17081 0.231047
b_pea_mu 0.57256 1.000000 -0.369024 0.393716 0.261216 0.38428 0.370848
b_pea_sig -0.63414 -0.369024 1.000000 -0.196290 -0.165007 0.04288 -0.025038
b_inschick_mu 0.05393 0.393716 -0.196290 1.000000 0.671406 0.23839 0.249371
b_inschick_sig 0.23643 0.261216 -0.165007 0.671406 1.000000 0.41875 0.326702
b_cricket_mu 0.17081 0.384280 0.042879 0.238393 0.418755 1.00000 0.908366
b_cricket_sig 0.23105 0.370848 -0.025038 0.249371 0.326702 0.90837 1.000000
b_worm_mu 0.18316 0.418463 0.090991 0.191874 0.344934 0.74695 0.702309
b_worm_sig -0.17222 -0.340954 -0.133271 -0.083206 -0.270608 -0.68382 -0.694774
b_mne_mu -0.22714 -0.385839 0.320865 -0.076694 0.187476 0.03491 -0.045369
b_mne_sig 0.25460 -0.025523 -0.054377 -0.403272 0.031179 0.04728 0.024610
b_bio_mu -0.24761 -0.420444 -0.009121 -0.266539 -0.497910 -0.58444 -0.510950
b_bio_sig 0.75928 0.533786 -0.390538 -0.071925 0.260651 0.39561 0.400221
b_eu_mu 0.18424 0.074547 -0.229342 0.148473 -0.074017 -0.06101 0.154066
b_eu_sig 0.62209 0.572067 -0.408945 0.198142 0.125276 0.18803 0.321007
b_local_mu -0.06702 -0.321308 0.043675 -0.185508 -0.167671 -0.27525 -0.077234
b_local_sig -0.06327 0.192770 0.159017 0.129654 0.079484 0.26481 0.186403
b_worm_mu b_worm_sig b_mne_mu b_mne_sig b_bio_mu b_bio_sig b_eu_mu
asc_alt1 0.07849 -0.08886 0.02311 -0.02835 -0.056052 -0.027306 -0.08399
asc_none 0.05113 -0.04994 -0.04585 -0.11458 -0.063041 -9.8783e-04 -0.11080
b_price_mu -0.26748 0.18891 0.05757 0.05585 0.143627 -0.094615 -0.08376
b_price_sig 0.24642 -0.29471 -0.07336 -0.01008 -0.240208 0.218042 -0.07488
b_cook_mu 0.06912 -0.06398 0.30162 0.02915 0.049522 -0.323668 -0.34382
b_cook_sig 0.46966 -0.45877 -0.01350 0.15517 -0.270070 0.415370 0.06483
b_eat_mu 0.26165 -0.24195 0.29358 0.35099 -0.213527 0.085246 -0.59499
b_eat_sig 0.18316 -0.17222 -0.22714 0.25460 -0.247613 0.759284 0.18424
b_pea_mu 0.41846 -0.34095 -0.38584 -0.02552 -0.420444 0.533786 0.07455
b_pea_sig 0.09099 -0.13327 0.32087 -0.05438 -0.009121 -0.390538 -0.22934
b_inschick_mu 0.19187 -0.08321 -0.07669 -0.40327 -0.266539 -0.071925 0.14847
b_inschick_sig 0.34493 -0.27061 0.18748 0.03118 -0.497910 0.260651 -0.07402
b_cricket_mu 0.74695 -0.68382 0.03491 0.04728 -0.584438 0.395610 -0.06101
b_cricket_sig 0.70231 -0.69477 -0.04537 0.02461 -0.510950 0.400221 0.15407
b_worm_mu 1.00000 -0.96876 0.01380 0.10102 -0.560241 0.415102 -0.07638
b_worm_sig -0.96876 1.00000 -0.08336 -0.23191 0.489537 -0.424654 0.03340
b_mne_mu 0.01380 -0.08336 1.00000 0.46798 0.089636 -0.228108 -0.38787
b_mne_sig 0.10102 -0.23191 0.46798 1.00000 0.162677 0.347137 -0.14900
b_bio_mu -0.56024 0.48954 0.08964 0.16268 1.000000 -0.464323 -0.05476
b_bio_sig 0.41510 -0.42465 -0.22811 0.34714 -0.464323 1.000000 0.12682
b_eu_mu -0.07638 0.03340 -0.38787 -0.14900 -0.054763 0.126816 1.00000
b_eu_sig 0.23040 -0.24919 -0.40900 0.10849 -0.210724 0.556822 0.71052
b_local_mu -0.28413 0.15901 -0.07927 0.18394 0.078767 -0.026297 0.61534
b_local_sig 0.20755 -0.11459 -0.33825 -0.35419 -0.328873 0.008474 0.31294
b_eu_sig b_local_mu b_local_sig
asc_alt1 -0.08739 -0.02608 0.008927
asc_none -0.10517 -0.09749 -0.064250
b_price_mu -0.26262 0.21781 -0.087113
b_price_sig -0.03482 -0.04439 0.188667
b_cook_mu -0.24256 -0.38097 -0.378665
b_cook_sig 0.47859 -0.28759 -0.157538
b_eat_mu -0.32486 -0.39500 -0.118292
b_eat_sig 0.62209 -0.06702 -0.063267
b_pea_mu 0.57207 -0.32131 0.192770
b_pea_sig -0.40895 0.04367 0.159017
b_inschick_mu 0.19814 -0.18551 0.129654
b_inschick_sig 0.12528 -0.16767 0.079484
b_cricket_mu 0.18803 -0.27525 0.264814
b_cricket_sig 0.32101 -0.07723 0.186403
b_worm_mu 0.23040 -0.28413 0.207555
b_worm_sig -0.24919 0.15901 -0.114588
b_mne_mu -0.40900 -0.07927 -0.338252
b_mne_sig 0.10849 0.18394 -0.354187
b_bio_mu -0.21072 0.07877 -0.328873
b_bio_sig 0.55682 -0.02630 0.008474
b_eu_mu 0.71052 0.61534 0.312939
b_eu_sig 1.00000 0.20919 0.223619
b_local_mu 0.20919 1.00000 0.154326
b_local_sig 0.22362 0.15433 1.000000

20 worst outliers in terms of lowest average per choice prediction:
ID Avg prob per choice
1188 0.1690916
1131 0.1894308
1023 0.1983931
1245 0.2032789
1348 0.2097972
1381 0.2264249
1274 0.2463131
1200 0.2482325
1247 0.2491906
1260 0.2513030
1233 0.2618677
1140 0.2736696
1183 0.2757899
1034 0.2876122
1191 0.2891988
1232 0.2899765
1057 0.2929139
1172 0.2951531
1069 0.2961669
1210 0.2979870

Changes in parameter estimates from starting values:
Initial Estimate Difference
asc_alt1 -0.06235 -0.08022 -0.01787
asc_alt2 0.00000 0.00000 0.00000
asc_none -0.68856 -2.81227 -2.12371
b_price_mu -5.00000 -0.76517 4.23483
b_price_sig 0.01315 1.37665 1.36350
b_cook_mu 0.59419 -1.31505 -1.90924
b_cook_sig 0.08434 3.18048 3.09614
b_eat_mu 0.36438 -0.14523 -0.50961
b_eat_sig 0.08305 3.61959 3.53654
b_pea_mu -0.34364 2.01341 2.35705
b_pea_sig 0.08207 -4.14925 -4.23132
b_inschick_mu -0.76620 3.72347 4.48967
b_inschick_sig 0.09156 5.31084 5.21928
b_cricket_mu -2.08199 14.03110 16.11309
b_cricket_sig 0.11984 7.70216 7.58232
b_worm_mu -2.40879 19.53712 21.94591
b_worm_sig 0.13565 -11.27373 -11.40938
b_mne_mu 0.02511 0.41903 0.39392
b_mne_sig 0.04621 1.45466 1.40845
b_bio_mu 0.26311 -0.90742 -1.17053
b_bio_sig 0.04350 1.41507 1.37157
b_eu_mu 0.55187 -2.22735 -2.77922
b_eu_sig 0.06826 1.56623 1.49797
b_local_mu 0.73714 -3.10823 -3.84537
b_local_sig 0.06495 0.56506 0.50011

Settings and functions used in model definition:

apollo_control
--------------
Value
modelName "MMNL_SUSINCHAIN_CB7_PT_PRIOR_WTP2_NEWSTART"
modelDescr "Code written together_chicken base"
indivID "id"
mixing "TRUE"
nCores "4"
workInLogs "FALSE"
debug "FALSE"
seed "13"
HB "FALSE"
noValidation "FALSE"
noDiagnostics "FALSE"
calculateLLC "TRUE"
outputDirectory "C:/Users/Nikravech/Box/PhD_Food_Waste_TU/02_SUSINCHAIN/04_WP1/1.4_Explore_strategies_to_gain_trust/05_Analysis/07_R_Work/2_Synchronized/Emilias Results/Final/Portugal/ML - WTP/"
panelData "TRUE"
analyticGrad "TRUE"
analyticGrad_manualSet "FALSE"

Hessian routines attempted
--------------
numerical jacobian of LL analytical gradient

Scaling in estimation
--------------
Value
asc_alt1 0.08022041
asc_none 2.81226679
b_price_mu 0.76516809
b_price_sig 1.37664712
b_cook_mu 1.31504758
b_cook_sig 3.18047707
b_eat_mu 0.14523430
b_eat_sig 3.61959028
b_pea_mu 2.01340656
b_pea_sig 4.14925081
b_inschick_mu 3.72346577
b_inschick_sig 5.31084361
b_cricket_mu 14.03107157
b_cricket_sig 7.70216992
b_worm_mu 19.53718922
b_worm_sig 11.27370251
b_mne_mu 0.41902674
b_mne_sig 1.45466341
b_bio_mu 0.90741826
b_bio_sig 1.41507438
b_eu_mu 2.22734847
b_eu_sig 1.56623490
b_local_mu 3.10823045
b_local_sig 0.56505742

Scaling used in computing Hessian
--------------
Value
asc_alt1 0.08022041
asc_none 2.81226566
b_price_mu 0.76516832
b_price_sig 1.37664882
b_cook_mu 1.31504825
b_cook_sig 3.18047887
b_eat_mu 0.14523430
b_eat_sig 3.61959328
b_pea_mu 2.01340614
b_pea_sig 4.14925073
b_inschick_mu 3.72346518
b_inschick_sig 5.31084020
b_cricket_mu 14.03110045
b_cricket_sig 7.70216008
b_worm_mu 19.53712284
b_worm_sig 11.27373112
b_mne_mu 0.41902682
b_mne_sig 1.45466404
b_bio_mu 0.90741829
b_bio_sig 1.41507388
b_eu_mu 2.22734843
b_eu_sig 1.56623435
b_local_mu 3.10823134
b_local_sig 0.56505756


apollo_randCoeff
----------------
function(apollo_beta, apollo_inputs){
randcoeff = list()

randcoeff[["b_price"]] = -exp(b_price_mu + b_price_sig * draws_price)
randcoeff[["b_cook"]] = b_cook_mu + b_cook_sig * draws_cook
randcoeff[["b_eat"]] = b_eat_mu + b_eat_sig * draws_eat
randcoeff[["b_pea"]] = b_pea_mu + b_pea_sig * draws_pea
randcoeff[["b_inschick"]] = b_inschick_mu + b_inschick_sig * draws_inschick
randcoeff[["b_cricket"]] = b_cricket_mu + b_cricket_sig * draws_cricket
randcoeff[["b_worm"]] = b_worm_mu + b_worm_sig * draws_worm
randcoeff[["b_mne"]] = b_mne_mu + b_mne_sig * draws_mne
randcoeff[["b_bio"]] = b_bio_mu + b_bio_sig * draws_bio
randcoeff[["b_eu"]] = b_eu_mu + b_eu_sig * draws_eu
randcoeff[["b_local"]] = b_local_mu + b_local_sig * draws_local


return(randcoeff)
}
<bytecode: 0x000001b5e10b7920>


apollo_probabilities
--------------------
function(apollo_beta, apollo_inputs, functionality="estimate"){

### Function initialisation: do not change the following three commands
### Attach inputs and detach after function exit
apollo_attach(apollo_beta, apollo_inputs)
on.exit(apollo_detach(apollo_beta, apollo_inputs))

### Create list of probabilities P
P = list()

### Create alternative specific constants and coefficients with interactions with socio-demographics

#b_peaa = b_pea + b_pea_shift_tins * (scenario == 2) + b_pea_shift_tsus * (scenario == 3)
#b_cricketa = b_cricket + b_cricket_shift_tins * (scenario == 2) + b_cricket_shift_tsus * (scenario == 3)
#b_inschicka = b_inschick + b_inschick_shift_tins * (scenario == 2) + b_inschick_shift_tsus * (scenario == 3)
#b_worma = b_worm + b_worm_shift_tins * (scenario == 2) + b_worm_shift_tsus * (scenario == 3)

### List of utilities: these must use the same names as in mnl_settings, order is irrelevant
V = list()
V[["alt1"]] = asc_alt1 + b_price * (price1 + b_cook * cook1 + b_eat * eat1 + b_pea * pea1 + b_inschick *inschick1 + b_cricket * cricket1 + b_worm * worm1 + b_mne *mne1 + b_bio * bio1 + b_eu * eu1 + b_local * local1)
V[["alt2"]] = asc_alt2 + b_price * (price2 + b_cook * cook2 + b_eat * eat2 + b_pea * pea2 + b_inschick *inschick2 + b_cricket * cricket2 + b_worm * worm2 + b_mne *mne2 + b_bio * bio2 + b_eu * eu2 + b_local * local2)
V[["none"]] = asc_none

### Define settings for MNL model component
mnl_settings = list(
alternatives = c(alt1=1, alt2=2, none=3),
avail = list(alt1=1, alt2=1, none=1),
choiceVar = choice,
utilities = V
)

### Compute probabilities using MNL model
P[["model"]] = apollo_mnl(mnl_settings, functionality)

### Take product across observation for same individual
P = apollo_panelProd(P, apollo_inputs, functionality)

### Average across inter-individual draws
P = apollo_avgInterDraws(P, apollo_inputs, functionality)

### Prepare and return outputs of function
P = apollo_prepareProb(P, apollo_inputs, functionality)
return(P)
}
<bytecode: 0x000001b5e1c50c98>
stephanehess
Site Admin
Posts: 974
Joined: 24 Apr 2020, 16:29

Re: Replication issues with WTP estimation results

Post by stephanehess »

Hi

and this happens with this model, but with others, you get the same results even though they also use mixing with MLHS draws?

Stephane
--------------------------------
Stephane Hess
www.stephanehess.me.uk
mnikrave
Posts: 6
Joined: 22 Jul 2022, 21:54

Re: Replication issues with WTP estimation results

Post by mnikrave »

Hi,

Yes, with other models using the MLHS draws, we manage to get the same results without any issues.

Cheers,
Mariam
stephanehess
Site Admin
Posts: 974
Joined: 24 Apr 2020, 16:29

Re: Replication issues with WTP estimation results

Post by stephanehess »

that's very odd. could you share the full code with me outside the forum for both models?
--------------------------------
Stephane Hess
www.stephanehess.me.uk
Post Reply