Authorities say the house had issues with the outdoor kitchen, the pool and fencing. The home did not have a rental permit, meaning it was not inspected for safety as required by town code.
Owners Pamela and Peter Miller are facing 29 code violations for lacking rental, plumbing and building permits.
The two sisters from Maryland died in an early morning fire on Aug. 3. when they were on vacation with their family.
Southampton town officials believe the fire started in the outdoor kitchen.
The Suffolk County District Attorney's Office told News 12 it's still discussing bringing criminal charges.