The Manifest.toml file updates when you do certain things in Julia:
Adding a package
Removing a package
Updating packages
If you use a different Julia version than the project version.
Editing a package locally can add a special path to Manifest.toml.
So I think you can check if the versions are same and avoid modify packages unless it is necessary.