Simply using a directory that's not named src/ doesn't require any arguments, by default colcon will recursively search for packages in the current directory.

You can specify a specific directory with --base-paths and/or add an empty file named COLCON_IGNORE to your other directories that should be ignored.

https://colcon.readthedocs.io/en/released/reference/discovery-arguments.html