I concur. With the huge difference in stack sizes and his lack of a preflop raise, chances are you are ahead and he is just trying to intimidate you.