Who was the only former president to later serve in the Senate?

After his presidency came to an end in 1869, Johnson returned to his home state of Tennessee and remained active in the Democratic Party.