Losing four ministers in seven months shows the government is falling apart, the National Party leader says.