Another Rewrite?

I was watching the TV this evening and I was inspired. The trouble is, I'm inspired to rewrite the lot. I'm thinking if I compress the first book into Act 1 of a new book, and then

flow straight into what would have been Book 2 in Act 2.

This would mean an utter and complete rewrite of the entire novel.

I'm plotting out what it would look like now.

This would be the third version of this book but I just want to make it perfect. I want it to be a really entertaining, so that my readers enjoy the story.

There's a bunch of good stuff in the version I have now so I'd have to move that over and adjust it accordingly.

Am I fidgeting with the story for the sake of fidgeting with it or will this really benefit the story? Maybe if I plot out the story properly I would be able to make sure that every element of the story moves the narrative on. It would also highlight the journey the characters make.

So, it looks like I'm starting again from scratch. It'll depend on what my beta readers say, but if the story would benefit from Book 2 starting in Act 2 of Book 1, then I'm going to do it.