The £500m regeneration scheme has become increasingly derelict as the company which owns the site has made little progress on plans.