Аннотация:
The paper is devoted to the analysis of stability of the stationary rotation of a system of $n$
identical point vortices located at the vertices of a regular $n$-gon of radius $R_0$ inside a circular domain of radius $R$.
Havelock stated (1931) that the corresponding linearized system has exponentially growing
solutions for $n\geqslant 7$ and in the case $2\leqslant n \leqslant6$ — only if the parameter $p={R_0^2}/{R^2}$ is greater than a certain
critical value: $p_{*n}<p<1$. In the present paper the problem of nonlinear stability is studied for all other cases $0<p\leqslant p_{*n},$$n=2,\dots,6$.
Necessary and sufficient conditions for stability and instability for $n\neq 5 $ are formulated. A detailed proof for
a vortex triangle is presented. A part of the stability conditions is substantiated by the fact that the relative
Hamiltonian of the system attains a minimum on the trajectory of the stationary motion of the vortex triangle. The case
where the sign of the Hamiltonian is alternating requires a special approach. The analysis uses results of
KAM theory. All resonances up to and including the 4th order occurring here are enumerated and investigated. It has turned out
that one of them leads to instability.