Don't use apt to install ruby, because it installs system-wide which makes gem management difficult. Try using something like rvm, it will work a lot better.