Back when George Washington was first elected president, there were no political parties. Soon after, in 1796, the Federalist party, founded by Alexander Hamilton, and the Democratic-Republican party, founded by Thomas Jefferson and James Madison, were formed. The point of these parties was to form alliances with those who share the same beliefs as you. If you wanted something done with the country, you needed some help, and joining a political party is just the way to get it. Though the two parties were created for the same purposes, they both had many different political views.
The Federalist party was all about having a strong national government. Alexander Hamilton, founder of the Federalist party, thought