The two 14 and 15 year old boys were picked up from a parking lot of a nearby hotel.
Sources said the boys broke into the communication and cultural department of the ministry through the roof by bringing down a wall.
A team of police, equipped with a dog squad, later found the two boys hiding beneath cars in the parking lot along with the stolen property, including taxi cards, cameras, phones and a small amount of cash, police and ministry sources said.
“We are talking about a few hundred Euros,” said senior ministry official Markku Meriluoto.
Police said the two teenagers admitted committing the burglary. Police, however, said the burglary had not put any sensitive information at risk.