Prince William and Queen Camilla have allegedly caused a lot of "family angst" due to taking a "harder line" on Andrew's scandal.