As long as your BP is found elevated above the average at any one time, in the office or at home, you should seriously consider pharmacological intervention.
Other factors which you should consider: your age, your weight, your height ,bmi, your geneticl predisposition, family history of cardio...