If you got rid of Joy Behar who is the most annoying old bag on the show and always interrupts her fellow co-hosts along with Whoopi Goldberg who is a "know nothing" when it comes to making valid points I would imagine your ratings would improve.
It's only a matter of time before this show is cancelled for lack of content.
Not even a new set can revive the low ratings. Miss the days of Meredith Viera and Barbra Walters who were class acts.