Riddonkulous

I am the part you seldom see, yet without me, towers fall. I drink in the dark so others can eat in the light. Pull me up, and I may take the past with me. In numbers I hide at the base of powers, in words I hide at the base of meaning. What am I?