[ixpmanager] peer-to-peer statistics | sFlow

Vladislav Leontjev vladislav.leontjev at gmail.com
Fri Mar 22 08:01:10 GMT 2019


Hello Nick,

I appreciate your help very much, thank you.

1. grapher.php ok got it back! :)

Is it ok for the output of rrdtool dump
p2p.ipv4.bytes.src-00001.dst-00003.rrd:
I mean flow is reading the data correctly? (there's only one bgp session(to
a testing bird rs) with no tarffic for now (from every peering client/port)
and I've got two testing peers) or it's an error;
......
                        <!-- 2019-03-21 02:00:00 EET / 1553126400 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-03-21 04:00:00 EET / 1553133600 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-03-21 06:00:00 EET / 1553140800 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-03-21 08:00:00 EET / 1553148000 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-03-21 10:00:00 EET / 1553155200 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-03-21 12:00:00 EET / 1553162400 -->
<row><v>NaN</v><v>NaN</v></row>
                </database>
        </rra>
        <rra>
                <cf>MAX</cf>
                <pdp_per_row>24</pdp_per_row> <!-- 7200 seconds -->

                <params>
                <xff>5.0000000000e-01</xff>
                </params>
                <cdp_prep>
                        <ds>
                        <primary_value>NaN</primary_value>
                        <secondary_value>0.0000000000e+00</secondary_value>
                        <value>0.0000000000e+00</value>
                        <unknown_datapoints>3</unknown_datapoints>
                        </ds>
                        <ds>
                        <primary_value>NaN</primary_value>
                        <secondary_value>0.0000000000e+00</secondary_value>
                        <value>0.0000000000e+00</value>
                        <unknown_datapoints>3</unknown_datapoints>
                        </ds>
                </cdp_prep>
                <database>
                        <!-- 2019-01-18 02:00:00 EET / 1547769600 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 04:00:00 EET / 1547776800 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 06:00:00 EET / 1547784000 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 08:00:00 EET / 1547791200 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 10:00:00 EET / 1547798400 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 12:00:00 EET / 1547805600 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 14:00:00 EET / 1547812800 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 16:00:00 EET / 1547820000 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 18:00:00 EET / 1547827200 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 20:00:00 EET / 1547834400 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-18 22:00:00 EET / 1547841600 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-19 00:00:00 EET / 1547848800 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-19 02:00:00 EET / 1547856000 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-19 04:00:00 EET / 1547863200 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-19 06:00:00 EET / 1547870400 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-19 08:00:00 EET / 1547877600 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-19 10:00:00 EET / 1547884800 -->
<row><v>NaN</v><v>NaN</v></row>
                        <!-- 2019-01-19 12:00:00 EET / 1547892000 -->
<row><v>NaN</v><v>NaN</v></row>

This graph indicates that the RRD files are being generated, but that
they contain no data.  Can you run "sflow-to-rrd-handler --debug" and
see if the output contains lines like "DEBUG: accepted update for: ..."?

#./sflow-to-rrd-handler --macdbtype=configured --debug (using
--macdbtype=configured as you suggested previously cause of FATAL: could
not read IXP Manager API call on
http://10.81.7.10/api/v4/sflow-db-mapper/learned-macs)
It simply hangs without any output; Can it be cause of minimal(1 bgp
session) or none traffic being there as I've mentioned above?

P.S. Only in a week I'll have an ability to move all this stuff into the
real production SW; Before that I want to get it (IXP manager cfg, sFlow)
work here (in a lab).
I want to understand: Does it from configuration perspective and sFlow
everything functioning as it should be? I mean: As far as traffic will be
high enough I'll see graphs as it should be?

Thank you.

Vladislav.

чт, 21 мар. 2019 г. в 23:25, Nick Hilliard <nick at foobar.org>:

> Hi Vladislav,
>
> Vladislav Leontjev wrote on 20/03/2019 14:29:
> >
> ----------------------------------------------------------------------------
> >   /srv/ixpmanager/config/grapher.php
> >
> -----------------------------------------------------------------------------
> >
> >          'sflow' => [
> >              // show sflow / p2p links on the frontend
> >              'enabled' => env( 'GRAPHER_BACKEND_SFLOW_ENABLED', false ),
> >
> >              // for larger IXPs, it's quite intensive to display all the
> > graphs
> >              'show_graphs_on_index_page' => env(
> > 'GRAPHER_BACKEND_SFLOW_SHOW_ON_INDEX', false ),
> >
> >              // where to find the MRTG rrd files
> >              'root'  => env( 'GRAPHER_BACKEND_SFLOW_ROOT',
> > 'http://10.81.7.10/grapher-sflow/' ),
> >          ],
>
> oops, you shouldn't change this file under any circumstances.  Can you
> reset this file using "git checkout"?
>
> Any customisation you might need to make can be handled in .env.
>
> > ------------------------------------------------------------------------
> > /srv/ixpmanager/.env
> > ------------------------------------------------------------------------
> > GRAPHER_BACKENDS="mrtg|sflow"
> > GRAPHER_BACKEND_SFLOW_ENABLED=true
> > GRAPHER_BACKEND_SFLOW_ROOT="http://10.81.7.10/grapher-sflow"
> > GRAPHER_ACCESS_CUSTOMER=0
> > GRAPHER_ACCESS_P2P=1
> >
> > ----------------------------------------------------------------
>
> that looks correct.
>
> > Files have been gathered as it should be;
> > #/var/www/ixp_p2p/ipv4/bytes/p2p/src-00001$ ls
> > p2p.ipv4.bytes.src-00001.dst-00003.rrd
>
> You should use "rrdtool dump p2p.ipv4.bytes.src-00001.dst-00003.rrd" to
> ensure that sflow is reading the data correctly.
>
> > I have got 2 peering ports UP and till now 2 rrd files accordingly;
> > will leave "./sflow-to-rrd-handler --macdbtype=configured" for sometime
> > to gather more of them;
> >
> > ------------------------------------------------------------------
> > local install of apache: added lines (used apache the same which was
> > installed with IXP manager)
> > ------------------------------------------------------------------
> > /etc/apache2/apache2.conf
> >
> > Alias /grapher-sflow /var/www/ixp_p2p
> > <Directory "/data/ixpmatrix">
> >          Options None
> >          AllowOverride None
> > </Directory>
> > ----------------------------------------------------------------
> > shows the content of /var/www/ixp_p2p with all of its subdirs
> > http://10.81.7.10/grapher-sflow/
> > visual prtn-src:of apache https://prnt.sc/n0ijkk
>
> Correct.
>
> > -------------------------------------------------------------
> > /usr/local/etc/ixpmanager.conf
> > -------------------------------------------------------------
> >
> > <sql>
> >          dbase_type      = mysql
> >          dbase_database  = ixpmanager
> >          dbase_username  = ixpmanager
> >          dbase_password  = *
> >          dbase_hostname  = 127.0.0.1
> >          #dbase_portname = /tmp/mysql.sock
> > </sql>
> >
> > <ixp>
> >          sflow_rrdcached = 0
> >          sflowtool = /usr/local/bin/sflowtool
> >          sflowtool_opts = -4 -p 6343 -l
> >          sflow_rrddir = /var/www/ixp_p2p
> > #       debug = 1
> >          apikey = *
> >          apibaseurl = http://10.81.7.10/api/v4
> >          macdbtype = configured
> > </ixp>
> >
> > Do I understand wright:
> >
> > 1. If I see some page NOT with "dummy" and NOT with "no image found" it
> > means it's normally tries to interpreter sflow
> > converted *.rrd's? -> visual prtn-src:of vlan graph:
> https://prnt.sc/n0im4x
>
> The "dummy" / "no image found" are only for mrtg, not sflow.
>
> > 2. As far as there will be enough *.rrd files the graph
> > visual prtn-src:of vlan graph: https://prnt.sc/n0im4x
> > will be shown with in/out statistics at the bottom as it should be?
> > 3. GRAPHER_BACKENDS="mrtg|sflow" - tries to use mrtg -> failed -> then
> > sflow?
>
> no, it means that the Grapher back-end uses both mrtg and sflow.  These
> are separate things: the MRTG grapher produces interface graphs and the
> sflow grapher produces point-to-point graphs.
>
> > 4. from log means: production.ERROR: No backend available to process
> > this graph
> > It's because of mrtg is not installed?
> > 5. Do I understand documentation in a wright way: Overall peering graph
> > is available only by mrtg? I need to implement it too them?
>
> yes, you need to install mrtg if you want regular interface graphs.
>
> Nick
>
> >
> > Thank you.
> >
> > Vladislav.
> >
> > ср, 20 мар. 2019 г. в 11:00, Nick Hilliard <nick at foobar.org
> > <mailto:nick at foobar.org>>:
> >
> >     Vladislav Leontjev wrote on 20/03/2019 06:42:
> >      > ./sflow-to-rrd-handler --macdbtype=configured
> >      >
> >      > runs whitout any error output; In my understanding I should then
> get
> >      > rrd files into my mentioned dir in cfg?
> >      >
> >
> >     Yes, if there are MAC addresses defined in the database, you should
> see
> >     .rrd files in a bunch of subdirectories in /var/www.
> >
> >     If you're not seeing any files in there, then you need to use
> "--debug"
> >     to see what's happening.
> >
> >      > I'm using V4.9.2; In my situation (till next bug-fix) the way to
> get
> >      > *.rrd is ./sflow-to-rrd-handler --macdbtype=configured ? or did I
> >      > mess up something?
> >     Just stick with v4.9.2 for the moment.
> >
> >     Nick
> >
> > _______________________________________________
> > INEX IXP Manager mailing list
> > ixpmanager at inex.ie
> > Unsubscribe or change options here:
> https://www.inex.ie/mailman/listinfo/ixpmanager
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.inex.ie/pipermail/ixpmanager/attachments/20190322/d6d29b04/attachment-0001.html>


More information about the ixpmanager mailing list