The information matrix is the covariance matrix of the score

A Tutorial on Fisher Information:

  1. In the frequentist paradigm, Fisher information is used to construct hypothesis tests and confidence intervals using maximum likelihood estimators
  2. In the Bayesian paradigm, Fisher information is used to define a default prior
  3. In the minimum description length paradigm, Fisher information is used to measure model complexity