Yep, it's OK.
10-1-1 "The distance penalty for any foul may be declined."
Your sitch is where we normally see this happen, since many kickers are more comfortable from their normal distance. I always ask the kicker "You want to leave it here, or move it up?"