A worldwide epidemic of obesity and its associated metabolic disorders raise the significance of adipocytes, their origins and characteristics. Our previous study has demonstrated that interscapular brown adipose tissue (BAT), but not intramuscular adipose, is derived from the Pax3-expressing cell lineage. Here, we show that various depots of subcutaneous (SAT) and visceral adipose tissue (VAT) are highly heterogeneous in the Pax3 lineage origin. Interestingly, the relative abundance of Pax3 lineage cells in SAT depots is inversely correlated to expression of BAT signature genes including Prdm16, Pgc1a (Ppargc1a) and Ucp1. FACS analysis further demonstrates that adipocytes differentiated from non-Pax3 lineage preadipocytes express higher levels of BAT and beige adipocyte signature genes compared with the Pax3 lineage adipocytes within the same depots. Although both Pax3 and non-Pax3 lineage preadipocytes can give rise to beige adipocytes, the latter contributes more significantly. Consistently, genetic ablation of Pax3 lineage cells in SAT leads to increased expression of beige cell markers. Finally, non-Pax3 lineage beige adipocytes are more responsive to cAMP-agonist-induced Ucp1 expression. Taken together, these results demonstrate widespread heterogeneity in Pax3 lineage origin, and its inverse association with BAT gene expression within and among subcutaneous adipose depots.