## Support #1273

### Weights_considering survey complex structure ?

80%

**Description**

Dear Support,

I have a question on how to analyse weights.

In the handouts of the Moodle, I found that I should

consider the survey complex design and set data this way with STATA.

svyset psu [pw=weight], strata(strata) singleunit(centered).

Now, I am interested in clustering the standard errors by individual (pid)

or in running a random effect model to account for individual heterogeneity,

but STATA does not allow to svy data in this way

and run this kind of model (which should be reasonable).

Would you think that it is possible to avoid controlling for the complex structure of the

survey? If not, what would I actually miss?

Thank you.

Best,

Lydia

### History

#### #1 Updated by Stephanie Auty 9 months ago

**Private**changed from*Yes*to*No***Assignee**set to*Olena Kaminska***Category**set to*Weights*

#### #2 Updated by Olena Kaminska 9 months ago

Lydia,

Indeed some statistical analyses do not work with svy command. One of such is multilevel models, random effect model is one of these. Two options are available to you: check with an expert on multilevel modelling and whether you may need to use a specialist software to run the model that would enable you to take into account full sample design.

Second option, use Stata and random effects model with weights - you should be able to use weights with this. Also, use person ID and PSU as two nested clusters (depending on your data setup - this may be different). This way you will be ignoring only stratification which does not influence your point estimates and makes your confidence intervals slightly wider. Talk to an expert though about potential effect on within and between variance estimates if you are interested in them.

Hope this helps,

Olena

#### #3 Updated by Lydia Palumbo 9 months ago

Thank you. It does.

I think that in this way it is possible to use svyset because

I can create a variable that considers both PSU and ID within a strata.

So the command should be:

svyset psupid [pw=weight], strata(strata) ...

I will check if this makes sense with an expert in multilevel.

Thank you again.

Lydia

#### #4 Updated by Olena Kaminska 9 months ago

Lydia,

No, you shouldn't combine PSU and ID - as the results will be wrong. If you have to choose you should use the higher level clustering: PSU. You could also explore an option of using SSU (as ID) with PSU, as in this example:

https://www.stata.com/support/faqs/statistics/stratified-multiple-stage-designs/

Best,

Olena

#### #5 Updated by Lydia Palumbo 9 months ago

Thank you. Yes, I realized that the combination was nonsense.Thank you for the link.

I was not sure how to set the individual level in the design. This should help.

Best,

Lydia

#### #6 Updated by Stephanie Auty 9 months ago

**% Done**changed from*0*to*80***Assignee**changed from*Olena Kaminska*to*Lydia Palumbo***Status**changed from*New*to*Feedback*

#### #7 Updated by Lydia Palumbo 9 months ago

Hi,

I do have another question about multistage sampling.

My sampling strategy is to consider only those who formed their union within the panel.

Should I apply a factor of correction for this? I am using longitudinal weights.

Thank you and best,

Lydia

#### #8 Updated by Olena Kaminska 9 months ago

Lydia,

Yes, you can take couples into account. If you want you can specify three levels of clustering: PSUs, couples and individuals. Then I assume you will have observations within individuals.

Hope this helps,

Olena

#### #9 Updated by Lydia Palumbo 8 months ago

Hi,

I am using longitudinal weights to analyse the event between t an t+1.

Now I am questioning whether I am using the correct weights. I noticed that once the

boost for Scotland/NI is done, those who attrited before wave 10/12 and

had a weight of 0, are then given a positive weight.

Which weight should I use for these units? Should I consider them as part of the sample

(like as they were truncated for some time)?

I would say yes because otherwise there would not

be the representativeness of GB, but I am not very sure.

I would appreciate your input.

Thank you and best,

Lydia

#### #10 Updated by Stephanie Auty 8 months ago

**Assignee**changed from*Lydia Palumbo*to*Olena Kaminska*

#### #11 Updated by Olena Kaminska 8 months ago

Lydia,

Thank you for your question. Could you clarify? Are you creating your own weights or are you using ours? If you are using ours - they are correct and you don't need to worry about zeros etc. In our weights ui weight may be positive while ub or us weights are zero. This is due to how they are calculated and this is correct. More importantly in a pooled analysis using us, ub and ui weights together throughout time will give you correct results.

If this doesn't answer your question could you provide more details on which weights your are using in your analysis?

Olena

#### #12 Updated by Lydia Palumbo 8 months ago

Hi Olena,

Sorry. I was not clear. I will rephrase the issue.

I am doing a pooled cross-sectional analysis (with the events in t+1)

with all the waves from BHPS and UKHLS, including Scottish, Northern Irish

Sample, IEMB and EMB. I am using longitudinal weights, as you said.

For BHPS

Waves from 1 to 9 I am using b`w’_lrwght.

Waves 10 to 12 b`w’_lrwtsw1;

Waves 13 to 18, b`w’_lrwtuk1.

For UKHLS

Wave 1 `w’_indinus_xw,

Waves 2 to 6 `w’_indinub_lw

Waves from 7 on `w’_indinui_lw.

Are they correct?

I noticed that those individuals that were having b`w’_lrwght = 0

between wave 1 and 9 (because they missed one wave) are given

a positive weight from wave 10 (by using b`w’_lrwtsw1) or from wave 13

(by using b`w’_lrwtuk1). They would have a weight of 0 if I used b`w’_lrwght

for all the waves (I do not do that because I want also to have boosts).

So my question is whether I have to include those who had a weight of 0

between wave 1 and 9 and then a positive one from wave 10 or 13 on.

Hope this is clear. Please tell me if I could be more explicit.

Thank you and best regards,

Lydia

#### #13 Updated by Lydia Palumbo 8 months ago

I forgot one part. If possible, I would like to do

a robustness check by using cross-sectional (or design) weights

in t and apply my own correction for individual and

partners' non-response, as we spoke on the phone.

Would it be possible to be advised on how to perform it?

Thank you again.

Best,

Lydia

#### #14 Updated by Olena Kaminska 8 months ago

Lydia,

My suggestion would be use longitudinal enumeration weight at time t, and conditional on it being positive predict personal response to wave t and wave t+1 at the same time. This will be valid for OSMs only.

Hope this helps,

Olena

#### #15 Updated by Olena Kaminska 8 months ago

And to respond to your earlier question, the weights that you suggested are correct. The reason that some zero weights become non-zero at wave 10 and 13 is also correct and indeed is related to new modelling for boosts. I suggest that you include everyone in the model and rely on weights to exclude people (people are excluded if a weight is zero). If you want to change anything like have people with zero weights in your model you have to create your own tailored weights. Otherwise I always suggest that your choice to include or exclude people should be only substantive (categories of social groups etc.) and never related to their response pattern or samples - as long as you use weights your results are representative.

Thanks,

Olena