[ixpmanager] Infra Aggregate Graph not Working After Removing a Switch

[ozikat]

Hey Carlos,

Thanks for the info. We forgot to update back the list here for future 
reference.

After going through the Port(s) belong to the members, noticed there 
were some lag ports were wrongly selected, after re-configure (it was 
non lag) the member port on IXP manager portal, it's start showing the 
graphs.

I think the challenge here is when there are 50k lines of config on 
MRTG, need to turn on all the debugs info and going through line by 
line. We did what you mentioned on *Check aggregates*, that helps to 
identify the issues, with a bit of bash scripting, snmpwalk (hundred of 
ports!) to verify it's working and match back to MRTG config.

We also had the same issue with the Sflow graph, which not MRTG related, 
however we found out there were lag port misconfigured and cause the RRD 
not able to insert the data.

Your steps were clearly explained and we wish we knew it earlier from 
you on the troubleshooting :)

Thanks a lot Carlos, Barry and IXP Manager community!


On 27/09/2025 08:02, Carlos Perez wrote:
> Hi OzaR,
>
> Here’s a quick guide on how to recover a deleted switch in IXP Manager.
> If a switch was deleted (instead of just being set inactive), the 
> infra-aggregate graphs may break because MRTG aggregates still 
> reference its ports.
>
> Steps to recover:
>
> Re-create the switch in IXP Manager
>
> On the CLI:
>
> cd /path/to/ixp-manager
> php artisan ixp:create-switch
>
> (or via the web GUI: Infrastructure → Switches → Add Switch)
>
> Use the same name / shortname / hostname as the old device.
>
> After creation, edit the switch and set:
>
> Active = off
>
> Poll = off
> This way MRTG won’t poll it, but it will still exist so aggregates 
> don’t break.
>
> Re-generate MRTG configuration
> Run the generator and reload MRTG:
>
> php artisan mrtg:generate
> service mrtg restart   # or wait for cron
>
> Check aggregates
> Open the aggregate block (e.g. location-aggregate-00002-bits) in the 
> new mrtg.cfg and confirm that all referenced targets exist. The “Use 
> of uninitialized value” error should now be gone.
>
> Re-attach historical data (optional)
> The old RRD files are still in MRTG’s WorkDir (e.g. /var/lib/mrtg/rrd/).
> As long as the switch shortname/ifIndex match the old ones, MRTG will 
> reuse the existing RRDs and the historical graphs will reappear.
>
> Alternative: DB restore
> If the switch was only soft-deleted in the DB (check the deleted_at 
> field in the switch table), you can clear it:
>
> UPDATE switch SET deleted_at = NULL, active = 0, poll = 0 WHERE id = <ID>;
>
> Then regenerate MRTG as above.
> If it was hard-deleted, re-creating it (step 1) is the only option 
> unless you restore from a DB backup.
>
> Note from CRIX practice:
> At CRIX we recently migrated data from two switches we were about to 
> remove into a new switch first, so all historical graphs were 
> preserved. Once migration was complete, we set the old switches to 
> inactive (poll off) and only later deleted them. This approach avoids 
> broken aggregates and keeps continuity of historical data.
>
> CarlosP.
>
> *From: *ixpmanager <ixpmanager-bounces at inex.ie> on behalf of ozikat 
> via ixpmanager <ixpmanager at inex.ie>
> *Date: *Thursday, 18 September 2025 at 10:07
> *To: *Barry O'Donovan (INEX) <barry.odonovan at inex.ie>, INEX IXP 
> Manager Users Mailing List <ixpmanager at inex.ie>
> *Cc: *ozikat <ozikat12 at gmail.com>
> *Subject: *Re: [ixpmanager] Infra Aggregate Graph not Working After 
> Removing a Switch
>
> One more thing, the deleted/removed Swtich on IXP Manager portal, it's
> not appear on mrtg.cfg config file though. Hence the stats should be
> working i assume.
>
>
>
> On 19/09/2025 00:00, Barry O'Donovan (INEX) wrote:
> >
> >
> >> The switch has been removed from IXP manager, will try add it back and
> >> uncheck poll and active
> >>
> >
> > If it’s been removed fully, then do no re-add it if the objective is to
> > remove it.
> >
> > I asked you to uncheck those boxes because you told me you had made no
> > changes to IXP Manager.
> >
> > I’m now unclear as to whether you always had the switch removed from IXP
> > Manager, or just recently deleted it? If it was just recently, please
> > see if it resolved the issue.
> >
> >
>
> _______________________________________________
> INEX IXP Manager mailing list
> ixpmanager at inex.ie
> Unsubscribe or change options here: 
> https://www.inex.ie/mailman/listinfo/ixpmanager
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.inex.ie/pipermail/ixpmanager/attachments/20250929/1b4dda23/attachment.htm>