Provide a Mercurial preference which allows to hide inactive branches. You can do this by passing the "-a" flag to the branches call. The docs state it (hg help branches):

If a/-active is specified, only show active branches. A branch is
considered active if it contains repository heads.