Yea there's something definitely wrong with that. I'm guessing your car has the K24 turbo that takes forever to spool, but damn I love the sound it makes going into 4k rpm!!!
maybe you need to re-time the engine? Something really small could be throwing it off. If you don't have a boost gauge, get one and check that out. Check your exhaust system for restriction too.