If you want to understand how *easy* it is to fail at agile, answer this question:
Can the developers* decline** to implement a feature without political consequences?
* Not their manager. The developers.
** Not just put it in the backlog but actually declare "It won't be implemented." No asking again later.
Unless you can answer "yes" (and have enough insight into the org and its stakeholders to give a definitive answer) then everything else is just going through the agile motions.