The Federal Government is warning local governments they will need to spend $300 million in infrastructure funding quickly or they will lose it.