Is it illegal in America to ride a horse on major roads?

You see police on horses in metropolitan areas and horse-drawn carriages on the roads during holiday times. Do they need a special permit, or can anyone do that? I mean, if I wanted to, could I just decide tomorrow that I wanted to ride a horse everywhere and just take it on the road like a car? xD Can you ride horses on sidewalks?