Naturally, private property owners may apply whatever restrictions they want. Whether or not these restrictions violate one’s constitutional rights is for the civil courts to decide. But the only statutory restrictions on a permit holder are secured areas such as airports and federal buildings.