-- If the ends of the wire loop are open (not connected to anything) then there's never any current in it, no matter what you do with the magnet.
-- If there's some kind of conductor between the ends of the wire loop, then
-- While you're pushing the magnet, a current is flowing in the wire. The current creates a magnetic field around the wire, and some of the energy you're using to push gets stored in the magnetic field.
-- When you stop pushing and the magnet stops moving, the energy stored in the magnetic field keeps the current flowing in the wire for a short time, and then everything stops.
This all happens so fast, and lasts for such a short time, that you'd never notice it unless you were set up with special equipment to measure it.