The current stable release series is Rhythmbox 0.10.x. The stable release series only receives bug fixes and translation updates, so it should always be safe to upgrade to a newer 0.10.x version.
There are no official binary packages of Rhythmbox. Supporting binary versions for many different operating systems is too difficult, so we don't even try. However several users have created binary packages, and they are available from many sites on the Internet.
The 0.11 series of releases are development releases, in which we add new features and make other changes that don't go into stable releases. Sooner or later, we'll start a new stable release series that incorporates all these changes.
The 0.11 series also requires newer versions of the libraries that Rhythmbox depends on.