rRNA genes consist of long tandem repeats clustered on chromosomes, and their products are important functional components of the ribosome. In common wheat (Triticum aestivum), rDNA loci from the A and D genomes were largely lost during the evolutionary process. This biased DNA elimination may be related to asymmetric transcription and epigenetic modifications caused by the polyploid formation. Here, we observed both sets of parental nucleolus organizing regions (NORs) were expressed after hybridization, but asymmetric silencing of one parental NOR was immediately induced by chromosome doubling, and reversing the ploidy status could not reactivate silenced NORs. Furthermore, increased CHG and CHH DNA methylation on promoters was accompanied by asymmetric silencing of NORs. Enrichment of H3K27me3 and H3K9me2 modifications was also observed to be a direct response to increased DNA methylation and transcriptional inactivation of NOR loci. Both A and D genome NOR loci with these modifications started to disappear in the S4 generation and were completely eliminated by the S7 generation in synthetic tetraploid wheat. Our results indicated that asymmetric epigenetic modification and elimination of rDNA sequences between different donor genomes may lead to stable allopolyploid wheat with increased differentiation and diversity.