You should post this in the pre-release forum, ideally :)
Edit: ahh, actually, open your ~/.REAPER/reaper.ini, find the line that says "gdk_borderless_are_override_redirect=auto", and change it to =1. That'll take care of it! Maybe I can make it autodetect i3 and use that option...