The feature is called ”Swap apps":
- Tap the three dots on F-Droid main screen on device A and device B
- Tap on Swap apps
- Connect to the same wifi or connect over bluetooth
- Select apps to share
- Swap!
I’ve only used the feature on their very beginning and it was unstable. I guess it has improved a lot, but I don’t have two Android devices to test it anymore.