'Well, the only silver lining I could see to it is that Ianto would still be on the show, and with Jack gone he'd probably have more screentime. So if Ianto is still around and being awesome I'd still watch, but it probably wouldn't entertain me as much.'
That could be a silver lining.

For me the best part of Torchwood has always been the Jack/Ianto interaction, John and Gareth really have such great chemistry.