One of such group is $(3, 3)$ - upper triangle matrix group over $\mathbb{Z}/p \mathbb{Z}$ with diagonal elements $1$, and therefore $n = 3$. Note that if $n = 2, G$ is abelian.

This is also a useful thread: http://mathoverflow.net/questions/31553/finite-nonabelian-groups-of-odd-order