The New York Theatre Guide (sister site of the London Theatre Guide) has reviews of both Broadway and Off-Broadway shows as well as other show information.
Since its founding in April 2004, OffOffOnline has reviewed over 2,000 shows. It covers off-off Broadway theater in all five boroughs of New York City, and occasionally Off-Broadway and Broadway theater.
The Internet Theater Magazine of Reviews, Features, Annotated Listings. No longer being actively updated, but still contains reviews dating back to 1996.