Thanks to @havhingstor@mstdn.social and @ctietze@mastodon.social for the hint I needed to solve my Binding problem. Custom bindings for the win.

#swiftui