In the Davidson method, an attempt is made to accelerate the convergence of the preconditioned projection Algorithm 11.8 by changing the Rayleigh quotient at each inner iteration step.
For simplicity, we describe here only the most naive
version of the Davidson method, without restart,
for the pencil (cf. [99,100,335,329,387]):
The method was quite intricate to study theoretically; cf. [88,390]. It is common to use the Davidson method with an indefinite preconditioner (often the diagonal of ), which further complicates the theoretical analysis.
The Davidson method is popular particularly in the chemistry community (see [232,275]), where the involved matrices are typically diagonally dominant. For such problems, the method often converges quickly even with a simple diagonal preconditioner.