Transormers Keep Calm and Roll Out