CPUs are categorized based on the number of cores (single, dual, quad, hexa, octa, deca) and the type of chip used for processing data. They can also be classified by the scale of integration, such as transistor CPUs, small-scale integration CPUs, large-scale integration CPUs, and microprocessors. These categorizations help differentiate CPUs based on performance capabilities and technological advancements.