Issues with Rider when it finds a .sln file in a non .NET project

I am trying to open a non .NET React app in Rider and if it finds a .sln file in any subfolder, it opens it even when I select to open the folder as a Directory option.
There's some kind of solution entry after it opens the directory. When I close the solution and try the process again, I am stuck at the open dialog. I click the Open button and it never does anything after that. Even after restarting Rider. 
One time I renamed the folder and it was able to open it afterward. 

Also, I deleted the .sln file to get around this issue. 

If I tell Rider to open the folder as a directory, it should ignore any solution and project files.