Django in it of itself is a large package, so I wouldn't be too worried about this.

When combined with the fact that pycharm has to do background indexing for code completion on the whole django database this can also take a long time.

If you really wanted you could try clearing the cache by doing this:

File -> Invalidate caches and restart

This will cause pycharm to reindex