Awarded an ALCF Director’s Discretionary allocation on Polaris at Argonne for our project, “Depth Scaling and Feature Learning Dynamics in Deep Transformers.” Grateful to the ALCF team.