Analysing the estimation results

This forum is closed. You can read the posts but cannot write. We have migrated the forum to a new location where you will have to reset your password.
Forum rules
This forum is closed. You can read the posts but cannot write. We have migrated the forum to a new location (https://forum.dynare.org) where you will have to reset your password.

Analysing the estimation results

Postby irisqueiroz » Sun Aug 25, 2013 11:02 pm

I just finished my estimation problem and I want to know if it was good estimation.

1. How can I know if the parameters were well identificated?
2. How can I know if the estimation converged? (multivariate MCMC diagnostic)
3. How can I know about the acceptance rates?

Thanks!
irisqueiroz
 
Posts: 15
Joined: Mon Jan 21, 2013 2:39 pm

Re: Analysing the estimation results

Postby jpfeifer » Mon Aug 26, 2013 8:54 am

1. Use the identification command.
2. If you used at least two chains, the convergence diagnostics are displayed.
3. The acceptance rates are displayed by Dynare. They should also be stored in the MC_record field in the recent snapshot. Otherwise, they should be stored in the metropolis.log file in the metropolis subfolder.
------------
Johannes Pfeifer
University of Cologne
https://sites.google.com/site/pfeiferecon/
jpfeifer
 
Posts: 6940
Joined: Sun Feb 21, 2010 4:02 pm
Location: Cologne, Germany

Re: Analysing the estimation results

Postby ger163609 » Thu Sep 05, 2013 2:20 pm

Hello!

I am also struggling with the assessment of the estimation quality, especially regarding the MCMC diagnostics.
Dynare spits out the MCMC/BrooksGelman statistics, and there are a few aspects to check to confirm convergence: The blue and red line have to get close and both lines have to settle down. As far as I see it right these check points are assessed by visual judgement.
My question:
Is there some sort of a "hard criterion" to judge properly whether the estimation has converged? Is there some sort of a test in dynare?

Thanks in advance!
ger163609
 
Posts: 21
Joined: Tue Nov 20, 2012 7:30 pm

Re: Analysing the estimation results

Postby jpfeifer » Thu Sep 05, 2013 6:48 pm

We are working on implementing a hard critierion, but it will still take some time. In LeSage's econometrics toolbox there is the coda-command that computes the Geweke and Raferty/Lewis diagnostics. You could use those functions.
------------
Johannes Pfeifer
University of Cologne
https://sites.google.com/site/pfeiferecon/
jpfeifer
 
Posts: 6940
Joined: Sun Feb 21, 2010 4:02 pm
Location: Cologne, Germany

Re: Analysing the estimation results

Postby ger163609 » Fri Sep 06, 2013 9:01 am

thank you for the quick reply!
Well, as I am not a specialist in programming I am firstly looking for some rule of thumb. What do you think about the convergence statistics attached below? Are they o.k.?
Attachments
MCMC7.pdf
(8.91 KiB) Downloaded 178 times
MCMC5.pdf
(8.08 KiB) Downloaded 152 times
MCMC1.pdf
(8.53 KiB) Downloaded 157 times
ger163609
 
Posts: 21
Joined: Tue Nov 20, 2012 7:30 pm

Re: Analysing the estimation results

Postby jpfeifer » Fri Sep 06, 2013 9:41 am

Most of them look OK, but some of them are still borderline.
------------
Johannes Pfeifer
University of Cologne
https://sites.google.com/site/pfeiferecon/
jpfeifer
 
Posts: 6940
Joined: Sun Feb 21, 2010 4:02 pm
Location: Cologne, Germany

Re: Analysing the estimation results

Postby ger163609 » Fri Sep 06, 2013 10:57 am

Thanks a lot for your reply!
What would you suggest? I use mode-compute=9 and I am already up to 200000 iterations (2 Markov chains). My acceptation rate is at about 28%. Does increasing the number of iterations help? Or adding another sequence? I am asking because estimation already lasts a long time.
Thanks in advance!
ger163609
 
Posts: 21
Joined: Tue Nov 20, 2012 7:30 pm

Re: Analysing the estimation results

Postby jpfeifer » Fri Sep 06, 2013 11:34 am

More iterations should help. Try using the results after your first 200000 draws (which you should have) as starting value for mode_compute=9. In the next sequence of convergence plots the drift is then hopefully gone.
------------
Johannes Pfeifer
University of Cologne
https://sites.google.com/site/pfeiferecon/
jpfeifer
 
Posts: 6940
Joined: Sun Feb 21, 2010 4:02 pm
Location: Cologne, Germany

Re: Analysing the estimation results

Postby ger163609 » Fri Sep 06, 2013 3:45 pm

Thanks jpfeifer!

I tried what you suggested, i.e. I used the posterior means of the previous simulation as starting values and extended the number of iterations to 300000. However, the results do not look much better. I attached some of thee MCMC diagnostics below.

Is it common to just judge theim visually?

Have a nice weekend!
Attachments
MCMC5.pdf
(7.31 KiB) Downloaded 134 times
MCMC4.pdf
(7.35 KiB) Downloaded 211 times
MCMC3.pdf
(6.93 KiB) Downloaded 107 times
MCMC2.pdf
(7.96 KiB) Downloaded 110 times
MCMC1.pdf
(7.69 KiB) Downloaded 121 times
ger163609
 
Posts: 21
Joined: Tue Nov 20, 2012 7:30 pm

Re: Analysing the estimation results

Postby jpfeifer » Sat Sep 07, 2013 8:13 am

Actually, it looks better now. If in doubt, try repeating with more MCMC draws.
------------
Johannes Pfeifer
University of Cologne
https://sites.google.com/site/pfeiferecon/
jpfeifer
 
Posts: 6940
Joined: Sun Feb 21, 2010 4:02 pm
Location: Cologne, Germany


Return to Dynare help

Who is online

Users browsing this forum: No registered users and 8 guests