The court-appointed trustee of Bernard Madoff’s defunct firm is going after the millionaire middlemen who acted as witting or unwitting accomplices to Madoff’s $65 billion Ponzi scheme.

Financier and philanthropist J. Ezra Merkin assented Tuesday to step down as manager of his hedge funds and to place them into receivership.

The younger brother and business partner of convicted felon Bernard Madoff is under increasing scrutiny from investigators, as well as from victims of the $65 billion fraud.

The wife of accused swindler Bernard Madoff argues that their $7 million Manhattan penthouse and an additional $62 million in assets belong to her.