You can do it this way:
1.- Select a server from the left panel list.
2.- Select the server you want to clean the favorites
3.- Click on the 'Edit' button or select the 'Settings' option from the contextual menu.
4.- Edit the 'Path' list, click on '-' to remove favorite paths.