what is wrong with my fuel pump?

I recently had fuel pump replaced now before i crank it it i have to replace the electric fuel pump fuse and jump it off and it runs fine until its turned off . The check engine light is not on and it does sputter a little bit.It has a breatherlyer machine on the car,but they say its not the reason for this happening.I am at my wits end with this car! Please help suggest what I should do . No warning lights come on.I've took it back to the place that fixed it twice already.