Investigation catches real estate agents breaking the law to keep commissions high, hamper competition and block private sellers.