Note that this only gives info about the FHA as applied to your decision-making about to whom to rent. Note that the FHA applies to ALL rental situations in terms of your communication with prospective renters, in that you may never make "discriminatory" statements in your communications with renters, even if you are exempt from the FHA in your decision making process.
Note there can be big differences state to state. In California, you're only exempt from FHA laws in decision making if you rent out a room in your house that you live in, and only ONE room to ONE renter.
But in Virginia:
Virginia Fair Housing Law Exemptions (§ 36-96.2)
An owner with three (3) or less single family homes. An owner residing in an “owner occupied” building consisting of 4 units or less (Mrs. Murphy). An owner of a single family home rented or sold without the use of a real estate agent or broker.