balance of axiom and inference rules

when reading Hilbert-style deduction system, I find that there actually exist some interchangable relation between axiom and inference rules.
that is to say, we can transform some axiom into inference rules, and vice versa.