In a perfect world without air resistance, the top of the swing would have the most potential energy, but the least amount of kinetic energy. As the pendulum falls down, it gains more kinetic energy as it travels faster due to gravitational acceleration but loses more potential energy as it loses height. The total amount of energy in the system (the sum of kinetic and potential energy) stays the same.
