It doesn't matter whether or not the perturbation is Hermitian. One poses the eigenvalue problem in block form with one block corresponding to each unperturbed eigenvalue and obtains a coupled system for the block coefficients. For simplicity assume that in a basis where the unperturbed Hamiltonian is diagonal, the perturbed Hamiltonian is H=(H11H12H21H22), where H11 is the block corresponding to the degenerate eigenvalue E0 of interest. Then the eigenvalue problem takes the form (E−H11)ψ1−H12ψ2=0,
−H21ψ1+(E−H22)ψ2=0.
Here the dimension of
ψ1 is the algebraic multiplicity of the unperturbed eigenvalue
E0. By construction,
E−H22 is nonsingular for
E close to the unperturbed eigenvalue
E0. Thus we can formally solve the second equation for
ψ2 and insert the result into the first equation. This results in a nonlinear eigenvalue problem
Hred(E)ψ1=0, which is still exact. First order perturbation theory amounts to linearizing
Hred(E) around
E=E0 and then solving the resulting linear eigenvalue problem.
A detailed exposition of perturbation theory in the presence of degeneracy is given in
Klein, D. J. "Degenerate perturbation theory." The Journal of Chemical Physics 61.3 (1974): 786-798.