Xylan is the most abundant hemicellulosic polysaccharide in the cell walls of grasses and is pivotal for the assembly of distinct cell wall structures that govern various cellular functions. Xylan also plays a crucial role in regulating biomass recalcitrance, ultimately affecting the utilization potential of lignocellulosic materials. Over the past decades, our understanding of the xylan biosynthetic machinery and cell wall organization has substantially improved, due to the innovative application of multiple state-of-the-art techniques. Notably, novel xylan-based nanostructures have been revealed in the cell walls of xylem vessels, promoting a more extensive exploration of the role of xylan in the formation of cell wall structures. This Update summarizes recent achievements in understanding xylan biosynthesis, modification, modeling and compartmentalization in grasses, providing a brief overview of cell wall assembly from the perspective of xylan. We also discuss the potential for tailoring xylan to facilitate the breeding of elite energy and feed crops.