Has he done that permanently, or has he merely paused things?

The Administration is openly discussing eliminating the agency and folding it into the state department, and Elon Musk - who holds a formal position within the Administration - stated that Trump had agreed to shut it down and that they spent the weekend putting the agency "through the wood chipper." It's appropriate to criticize the Administration for proposing to do something completely in violation of law, even if they haven't finished doing it yet.

It's worth noting that the Administration doesn't have the power to "pause" an entire agency and shut down the entire thing for a quarter of the fiscal year just because he disagrees with the policy behind it. Congress created that agency and Congress authorized their activities and Congress appropriated the funds - the President's job is to "faithfully execute" that policy choice, not refuse to do it altogether because he thinks Congress got it wrong. The President has a lot of permissible choices to make in implementing policy, which gives him some wiggle room in how he does that - but at some point day becomes night, and "wiggle room" does not reach just deciding to cease all of an agency's functions for some non-trivial length of time just because he doesn't like what Congress chose.