The builder and the developer of Sydney’s ‘The Eliza’ apartment building have sought special leave with the High Court after they lost their challenge to a referee report that found it was reasonable for the owners to block them from rectifying defects.