Considering your old iMac is running Catalina. it is likely that many of the apps will not be compatible with the new Mac Mini, especially 32 bit apps which are no longer supported for quite some time. Also, be aware that macOS will soon not support Intel apps on the Apple Silicon apps with Rosetta2 as that will be soon to go away in the next coupe years.
So, putting your data files on an external drive and manually re-installing apps on the new Mini (the ones that still may be compatible) is the best approach. You will likely need to manually set your preferences in the new install. This may not be as bad as it sounds but the fresh install can help to remove old baggage that has been carried along by the apps for years that is really no longer of any use. This also gives the option of getting rid of all the junk that has built up from the old iMac.
Things like Music, Movies, and Photos libraries can easily be put on the external drive and all you need to do is point the apps to their new location.
Another thing, you will also need a second hard drive to back up all your data, unless your data is of little importance should the hard drive fail.