How closely are you watching your food intake? I suggest recording every thing you put in your mouth for at least 2 weeks to see if there are some hidden calorie-busters in your daily meal plan.
Also, remember about liquid calories. Sodas, sweet teas, alcohol, etc. can really up your caloric intake.