Steps to reproduce:

1. Create a pool.
2. Click on resize pool.
3. Click on Modify raid level.
4. Once the dropdown to select raid appears, click on Back button
5. Now click on Add disks.
6. Instead of the screen asking for "Would you like to change the raid level also?"
   the screen with select raid level dropdown appears.