Shadyar's answer works, but just be really careful not to mess up /etc/passwd (like I did), or it's very hard to correct.

Another (?safer) way is to just append a "cd /your/target/starting/directory/" to the ~/.bashrc file. As suggested by Aigbe above.