By December 1836 he was working as recording clerk of the treasury department and in 1840 was promoted to chief clerk. In 1841 he was appointed a first lieutenant in the Republic of Texas Marine Corps, but resigned after a cruise to the Yucatán under Commodore Edwin W. Moore. Swisher served as chief clerk of the auditor's office at Washington-on-the-Brazos, as clerk of the Ninth Congress of the Republic of Texas, and as clerk of the Convention of 1845. In 1846 he was elected colonel of the first regiment of Thomas Green's brigade of Texas militia, and in January 1847 he raised a company of rangers for service in the Mexican War, but got no farther than San Antonio before the United States victory at Buena Vista made the company unnecessary. His younger brother, James Monroe Swisher, served as a private in Capt. Benjamin McCulloch's company of Col. John C. Hays's First Regiment, Texas Mounted Riflemen.
In 1848 Swisher was appointed auditor of public accounts, and in 1852 he became a banker in Austin. On January 23, 1860, Governor Sam Houston appointed him paymaster of the Texas Rangers, a position he held until Texas seceded from the Union. Swisher was an ardent unionist, but after secession became an accomplished fact he threw his support behind the Confederacy. In 1862 he was sent to London to exchange Texas securities for war materials but was frustrated when the state's United States bonds were declared nonnegotiable. On promise of exchange for Texas cotton, he then ordered supplies delivered to Matamoros, but when he returned to Texas he was dismissed from his post on charges of unionist sympathies. Swisher nevertheless spent the remainder of the war in Matamoros as purchasing agent for Col. John S. Ford's Confederate forces. From 1865 until 1868 he ran a banking and commission house in Galveston. Then, after returning to Austin, he organized and until 1870 served as president of a stock company for the construction of the city's street-railway system. Swisher married Maria W. Sims, a native of Virginia, at Washington-on-the-Brazos on May 28, 1844; they had two children. Maria died on April 13, 1870, and Swisher married Helen "Nellie" A. Nickerson, a teacher at Medina, on January 1, 1873; they had two daughters. After Nellie's death in March 1875 Swisher married Bella French in Austin in October 1878. Swisher died on March 11, 1891, and was buried in Oakwood Cemetery, Austin. He was a Mason. His reminiscences of early Texas and the battle of San Jacinto are preserved in the Barker Texas History Center, University of Texas at Austin, and were published in a truncated version as Swisher's Memoirs by Mary R. Maverick Green in 1932.
30° 16.552, -097° 43.646