Umm… actually recalling information is INT.

The first line under “intelligence” in the PHB is:

“An Intelligence check comes into play when you need to draw on logic, education, memory, or deductive reasoning.”

Hell, even the keen mind feat, which gives you perfect memory for a month, gives you INT.