GO for it!!!!, You don't need to be very fit or speedy.
I know some one with walking difficulties, she has trained her dog to go ahead and she takes the short cut to the next obstacle.

It obviously helps to be fast in competitions, however it all depends at what level you compete or if you compete at all I know lots of people who do agility but don't enter competitions
