Patterson may not be known as much for his wrestling prowess as he is known for challenging racial barriers in the south.
He started a union in Florida, Georgia, and the Carolinas. He also spoke out against poor working conditions for wrestlers and sued for racial discrimination, and as a result, was blacklisted from wrestling.