I did. I had a couple minutes left and wanted to make sure I hadn't missed any treasure chests. I only left him there once in all my playthroughs, and that was just to see what Relm's dream was.
Another question somewhat similar, did any once else figure out the Lete River leveling trick on their own?