Here’s a list of places where you can rent bicycles.
Also, Citi Bike is a very cool bike sharing system. You pay by the hour and have the option of picking up your bike in one place and leave it at a different one. Here’s a map with all the stations where you can pick-up and drop off your Citi Bike.