Searches took place in the lower Newtownards Road area, with two security alerts being declared after suspicious objects were discovered.
The operation went on into the early hours of Saturday morning.
It involved searches of three residential properties and one business premises.
Police Service of Northern Ireland (PSNI) Det Ch Supt Andy Hill described the seizures were significant.
"We are really pleased about being able to take these weapons off the streets that would, we feel, have been used to harm the community," he said.
"The reckless storage of these explosive devices meant local police had to close the roads and evacuate residents in two separate areas of the lower Newtownards Road last night, causing disruption for local people trying to go about their business.
"We thank the public for their patience."
He added that the paramilitary crime task force remains committed to the "relentless pursuit" of the East Belfast UVF and appealed to anyone with any information about paramilitaries and their criminal activity to contact police.
The East Belfast UVF are a fraction of the loyalist paramilitary group the Ulster Volunteer Force (UVF), which murdered more than 500 people during the Troubles in Northern Ireland.
In 1994, they declared a ceasefire stating they would end their violence.
In recent years, the East Belfast UVF has been targeted by police investigating drug dealing and other criminality.
In 2021, the group were linked to a gathering of masked men in Pitt Park in east Belfast.