Yes, it could be your fuel filter. But not my first guess.
If it were me, i'd check idle speed first. Get it adjusted to as close to 1300 as you can. Then if you still have the problem, I'll bet it's the fpr, before the fuel filter.
A clogged filter will be more limiting at higher rpm than at an idle. Seems like you'd see trouble at rpm's higher than an idle. But that's more of my theory and experience than a fact. I don't know how you 'check' a fuel filter, other than the obvious; to see if it flows. I usually just replace them. But it cant hurt to do that too, if your up to the task. It's inside the tank, and accessed from underneath.
One last thought, be sure your gas tank vent hose is routed properly and not kinked or clogged. I don't think that's the problem, but one of those things to check since you'll have the tank lifted.