Childhood is a period (not a single moment), so habitual actions, states, and ongoing situations use imperfetto. Specific memorable events use passato remoto.
Passato Remoto vs Imperfetto — Childhood Memories1 / 10
La casa in cui _____ aveva un enorme ciliegio in giardino.