Maybe they’re not passive fillers, perhaps I just prefer the way the language flows without them. Rather than saying “I had learned” I prefer something like “I learned when I was young” because it’s more descriptive and engaging.