There is updateR function in the installr package. Run the function in RGui and follow the onscreen instructions. This will update R to a newer version and copy all your old libraries to the new R version. Make sure you follow all the onscreen guides accordingly.