Find all positive integers $n$ such that $\phi (n)$ is a divisor of $n^2+3$.