I’m really surprised you are seeing this happen. Just to be clear and to make sure we are on the same page, currently, once you go to question 3 or 4, and then rotate the device to see the app in landscape mode, when the UI is in landscape, it still is showing that particular question, right?
In Logcat, are you seeing any logs to suggest that the Activity is being recreated?