OTOH, I really don't want to see every comment to every thread I've ever replied to.

That's why, if I were designing it, I'd make it one of your global options: "Automatically track any entry to which I reply? (Yes/No)" And I'd allow selective opting out; after all, you can opt-in to a specific entry now, so you should also be able to opt out of it.