The Rwandan army said several military generals, including a former chief of staff, have retired in a major reshuffle that saw more than 1,000 personnel sacked.
Kagame made the remarks during his first address after being sworn in for another term this week.
Kagame was sworn in Sunday for a fourth term, saying regional peace was a "priority" in the face of ongoing conflict in the neighbouring Democratic Republic of Congo.
Rwanda's all-powerful President Paul Kagame was sworn in Sunday for a fourth term.
Kagame won over 99% of the vote, according to preliminary results announced on Monday.
Rwanda's President Paul Kagame won a crushing election victory that will extend his iron-fisted rule by another five years, according to partial results issued on Monday.
Subscribe to our newsletter and stay updated on the latest developments and special offers!
Join