About 60 firefighters are tackling a blaze at the North Shore Refuse Transfer Station.
Fire and Emergency said it received the report of the fire in Rosedale at about 8.30pm.
It said 13 fire trucks were at the blaze, including a ladder truck and specialist trucks.
There have been no reports of injuries or homes threatened.
The cause of the fire is unknown.
Waitematā fire district assistant commander Shaun Thornton said the fire broke out in a pile of rubbish in the Waste Management transfer station.
"It was a reasonably sized pile and a reasonably sized fire, so the initial crews got to work with some fairly big hoses, and an aerial truck which puts out a lot of water. They managed to knock the fire and protect the building.
"It was big enough to need a third alarm attendance - about a dozen trucks, about 60 firefighters."
He said crews would be working to dampen the area down for the next few hours.
"It doesn't appear that there's any structural damage to the building. It's quite high roofed building ... it's steel construction."
The team would take a closer look at the damage and CCTV footage in the morning.
Since there were no residential houses nearby, there was no need for warnings, he said.
"The smoke is dissipating quickly."