The children of Israel constructed the ark of the covenant according to the specifications revealed to Moses on Mount Sinai. The ark of the covenant was lost during the Babylonian destruction of Jerusalem and the Temple in 586 BCE. No one knows what happened to it at that time.
When the Jewish people returned from captivity in the days of Ezra and Nehemiah and rebuilt the Temple in Jerusalem, they did not make a new ark. They built replicas of all the other Temple furnishings, just as Solomon had done, but they did not feel that they had the Almighty's permission to make a replica ark of the covenant. Therefore, the holy of holies was left ark-less throughout the entire second Temple period. The sages explain that inside the holy of holies was a foundation stone, a piece of bedrock, on which the ark used to sit during the days of first Temple.
Talmudic lore contains several traditions about the ark. Some of the sages insisted that the ark was carried away by the Babylonians and never seen again. Others held that Jeremiah the prophet or King Josiah had hidden the ark away prior to the Babylonian conquest.
One tradition has it that the ark was hidden in a secret cellar below the chamber of the woodshed where wood for the altar fires were kept. There it remained hidden through the Babylonian destruction, but its location was forgotten. According to this tradition, it once happened in the days of the second Temple that a priest whiling away his time in the chamber of the woodshed noticed that one of the floor pavers was different from the others. He was about to lift it to investigate when he was struck down dead. Later, two priests were gathering wood for the altar when one dropped his axe on that same paver. Fire leapt up from the floor and killed him. Though stories like this are entertaining, they are only apocryphal anecdotes with no real historical basis. They are no more reliable than the modern-day pseudo-archaeologists and sensationalist junk scholars who claim to have found the ark or to know where it is hidden.
The prophet Jeremiah says that in the Messianic era, when all nations are gathered to Jerusalem, the ark of the covenant will not even be missed. This implies that, though it will not be missed, it will still be missing:
"It shall be in those days when you are multiplied and increased in the land," declares the LORD, "they will no longer say, 'The ark of the covenant of the LORD.' And it will not come to mind, nor will they remember it, nor will they miss it, nor will it be made again. At that time they will call Jerusalem 'The Throne of the LORD,' and all the nations will be gathered to it, to Jerusalem, for the name of the LORD; nor will they walk anymore after the stubbornness of their evil heart." (Jeremiah 3:16-17)
