An estimated third of the world’s population is latently infected with Mycobacterium tuberculosis (Mtb), with no clinical signs of tuberculosis (TB), but lifelong risk of reactivation to active disease. The niches of persisting bacteria during latent TB infection remain unclear. We detect Mtb DNA in peripheral blood selectively in long-term repopulating pluripotent hematopoietic stem cells (LT-pHSCs) as well as in mesenchymal stem cells from latently infected human donors. In mice infected with low numbers of Mtb, that do not develop active disease we, again, find LT-pHSCs selectively infected with Mtb. In human and mouse LT-pHSCs Mtb are stressed or dormant, non-replicating bacteria. Intratracheal injection of Mtb-infected human and mouse LT-pHSCs into immune-deficient mice resuscitates Mtb to replicating bacteria within the lung, accompanied by signs of active infection. We conclude that LT-pHSCs, together with MSCs of Mtb-infected humans and mice serve as a hitherto unappreciated quiescent cellular depot for Mtb during latent TB infection.