Why does my truck spit and sputter when voltage regulator is pklug but if i unplug it it runs fine?

ok ive replaced the volt reg alt and battery but my truck just started spitting and sputtering so i unpluged volt reg and it stopped but why is it doin that cause goin down the road it gets really annoying and embarrasing cause im president of a chapter of a nationwide truck club i just need help bad