Should I have folded to the mini-raise?

Villian has been fairly aggro, but I do not have any better read on him than that. By his stack size, he has won a few pots. Please comment on all aspects of my play, especially my re-raise to his mini-raise and the fold when he re-re-raised me. I figured that KK, AA, 56, AQ, or a set could all be possibilities for his hand, so I decided to fold.

PokerStars No-Limit Hold'em, $1.00 BB (9 handed) converter

UTG ($98.50)
Hero ($49.95)
MP1 ($38.30)
MP2 ($65.35)
MP3 ($107.85)
CO ($107.80)
Button ($98.50)
SB ($36.40)
BB ($128.75)

Preflop: Hero is UTG+1 with J[img]/images/graemlins/club.gif[/img], J[img]/images/graemlins/diamond.gif[/img].
<font color="#666666">1 fold</font>, <font color="#CC3333">Hero raises to $5</font>, <font color="#666666">6 folds</font>, BB calls $4.

Flop: ($10.50) 5[img]/images/graemlins/spade.gif[/img], Q[img]/images/graemlins/club.gif[/img], 6[img]/images/graemlins/heart.gif[/img] <font color="#0000FF">(2 players)</font>
BB checks, <font color="#CC3333">Hero bets $6</font>, <font color="#CC3333">BB raises to $12</font>, <font color="#CC3333">Hero raises to $25</font>, <font color="#CC3333">BB raises to $38</font>, Hero folds.

Final Pot: $73.50

Results in white below: <font color="#FFFFFF">
No showdown. BB wins $73.50. </font>