<div dir="ltr"><div>Sorry proccess was missed,</div><div dir="ltr">Waited for sometime and here they are:<div><br></div><div><div># ./sflow-to-rrd-handler --macdbtype=configured --debug</div><div>DEBUG: dropped update for: protocol: 4 vlan: 80 srcvli: 1 dstvli: 0 pktsize: 1522 samplerate: 8192</div><div>DEBUG: rejected: FLOW,10.81.7.25,17,0,0007ebea2860,00155d5c6135,0x0800,80,0,10.81.15.50,10.81.15.52,1,0x00,255,8,0,0x00,1522,110,8192</div><div>DEBUG: starting rrd flush at time interval: 6535.309006, time: 1553244422</div><div>DEBUG: individual: building update for vlan: 80 type: bytes protocol: 4 srcvli: 1</div><div>DEBUG: individual: building update for vlan: 80 type: bytes protocol: 4 srcvli: 3</div><div>DEBUG: aggregate: building update for vlan: 80 type: bytes protocol: 4 file: /var/www/ixp_p2p/ipv4/bytes/aggregate/aggregate.ipv4.bytes.vlan00080.rrd</div><div>DEBUG: individual: building update for vlan: 80 type: pkts protocol: 4 srcvli: 1</div><div>DEBUG: individual: building update for vlan: 80 type: pkts protocol: 4 srcvli: 3</div><div>DEBUG: aggregate: building update for vlan: 80 type: pkts protocol: 4 file: /var/www/ixp_p2p/ipv4/pkts/aggregate/aggregate.ipv4.pkts.vlan00080.rrd</div><div>DEBUG: individual: building update for vlan: 80 type: bytes protocol: 6 srcvli: 1</div><div>DEBUG: individual: building update for vlan: 80 type: bytes protocol: 6 srcvli: 3</div><div>DEBUG: aggregate: building update for vlan: 80 type: bytes protocol: 6 file: /var/www/ixp_p2p/ipv6/bytes/aggregate/aggregate.ipv6.bytes.vlan00080.rrd</div><div>DEBUG: individual: building update for vlan: 80 type: pkts protocol: 6 srcvli: 1</div><div>DEBUG: individual: building update for vlan: 80 type: pkts protocol: 6 srcvli: 3</div><div>DEBUG: aggregate: building update for vlan: 80 type: pkts protocol: 6 file: /var/www/ixp_p2p/ipv6/pkts/aggregate/aggregate.ipv6.pkts.vlan00080.rrd</div><div>DEBUG: flush completed at 1553244423</div><div>DEBUG: dropped update for: protocol: 4 vlan: 80 srcvli: 1 dstvli: 0 pktsize: 1522 samplerate: 8192</div><div>DEBUG: rejected: FLOW,10.81.7.25,17,0,0007ebea2860,00155d5c6135,0x0800,80,0,10.81.15.50,10.81.15.52,1,0x00,255,8,0,0x00,1522,110,8192</div><div>DEBUG: starting rrd flush at time interval: 157.036471, time: 1553244579</div><div>DEBUG: individual: building update for vlan: 80 type: bytes protocol: 4 srcvli: 3</div><div>DEBUG: individual: building update for vlan: 80 type: bytes protocol: 4 srcvli: 1</div><div>DEBUG: aggregate: building update for vlan: 80 type: bytes protocol: 4 file: /var/www/ixp_p2p/ipv4/bytes/aggregate/aggregate.ipv4.bytes.vlan00080.rrd</div><div>DEBUG: individual: building update for vlan: 80 type: pkts protocol: 4 srcvli: 3</div><div>DEBUG: individual: building update for vlan: 80 type: pkts protocol: 4 srcvli: 1</div><div>DEBUG: aggregate: building update for vlan: 80 type: pkts protocol: 4 file: /var/www/ixp_p2p/ipv4/pkts/aggregate/aggregate.ipv4.pkts.vlan00080.rrd</div><div>DEBUG: individual: building update for vlan: 80 type: bytes protocol: 6 srcvli: 3</div><div>DEBUG: individual: building update for vlan: 80 type: bytes protocol: 6 srcvli: 1</div><div>DEBUG: aggregate: building update for vlan: 80 type: bytes protocol: 6 file: /var/www/ixp_p2p/ipv6/bytes/aggregate/aggregate.ipv6.bytes.vlan00080.rrd</div><div>DEBUG: individual: building update for vlan: 80 type: pkts protocol: 6 srcvli: 3</div><div>DEBUG: individual: building update for vlan: 80 type: pkts protocol: 6 srcvli: 1</div><div>DEBUG: aggregate: building update for vlan: 80 type: pkts protocol: 6 file: /var/www/ixp_p2p/ipv6/pkts/aggregate/aggregate.ipv6.pkts.vlan00080.rrd</div><div>DEBUG: flush completed at 1553244579</div></div><div><br></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">пт, 22 мар. 2019 г. в 10:01, Vladislav Leontjev <<a href="mailto:vladislav.leontjev@gmail.com">vladislav.leontjev@gmail.com</a>>:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hello Nick,</div><div><br></div><div>I appreciate your help very much, thank you. <br></div><div><br></div><div><span style="color:rgb(80,0,80)">1. graphe</span><span style="color:rgb(80,0,80)">r.php</span> ok got it back! :) <br></div><div><div><br></div></div><div>Is it ok for the output of rrdtool dump p2p.ipv4.bytes.src-00001.dst-00003.rrd:</div><div>I mean flow is reading the data correctly? (there's only one bgp session(to a testing bird rs) with no tarffic for now (from every peering client/port) and I've got two testing peers) or it's an error;</div><div>......<br></div><div><div> <!-- 2019-03-21 02:00:00 EET / 1553126400 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-03-21 04:00:00 EET / 1553133600 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-03-21 06:00:00 EET / 1553140800 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-03-21 08:00:00 EET / 1553148000 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-03-21 10:00:00 EET / 1553155200 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-03-21 12:00:00 EET / 1553162400 --> <row><v>NaN</v><v>NaN</v></row></div><div> </database></div><div> </rra></div><div> <rra></div><div> <cf>MAX</cf></div><div> <pdp_per_row>24</pdp_per_row> <!-- 7200 seconds --></div><div><br></div><div> <params></div><div> <xff>5.0000000000e-01</xff></div><div> </params></div><div> <cdp_prep></div><div> <ds></div><div> <primary_value>NaN</primary_value></div><div> <secondary_value>0.0000000000e+00</secondary_value></div><div> <value>0.0000000000e+00</value></div><div> <unknown_datapoints>3</unknown_datapoints></div><div> </ds></div><div> <ds></div><div> <primary_value>NaN</primary_value></div><div> <secondary_value>0.0000000000e+00</secondary_value></div><div> <value>0.0000000000e+00</value></div><div> <unknown_datapoints>3</unknown_datapoints></div><div> </ds></div><div> </cdp_prep></div><div> <database></div><div> <!-- 2019-01-18 02:00:00 EET / 1547769600 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 04:00:00 EET / 1547776800 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 06:00:00 EET / 1547784000 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 08:00:00 EET / 1547791200 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 10:00:00 EET / 1547798400 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 12:00:00 EET / 1547805600 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 14:00:00 EET / 1547812800 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 16:00:00 EET / 1547820000 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 18:00:00 EET / 1547827200 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 20:00:00 EET / 1547834400 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-18 22:00:00 EET / 1547841600 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-19 00:00:00 EET / 1547848800 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-19 02:00:00 EET / 1547856000 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-19 04:00:00 EET / 1547863200 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-19 06:00:00 EET / 1547870400 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-19 08:00:00 EET / 1547877600 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-19 10:00:00 EET / 1547884800 --> <row><v>NaN</v><v>NaN</v></row></div><div> <!-- 2019-01-19 12:00:00 EET / 1547892000 --> <row><v>NaN</v><v>NaN</v></row></div></div><div><br></div><div>This graph indicates that the RRD files are being generated, but that <br>they contain no data. Can you run "sflow-to-rrd-handler --debug" and <br>see if the output contains lines like "DEBUG: accepted update for: ..."? </div><div><br></div><div><div>#./sflow-to-rrd-handler --macdbtype=configured --debug (using --macdbtype=configured as you suggested previously cause of FATAL: could not read IXP Manager API call on <a href="http://10.81.7.10/api/v4/sflow-db-mapper/learned-macs" target="_blank">http://10.81.7.10/api/v4/sflow-db-mapper/learned-macs</a>)</div><div>It simply hangs without any output; Can it be cause of minimal(1 bgp session) or none traffic being there as I've mentioned above?</div></div><div><br></div><div>P.S. Only in a week I'll have an ability to move all this stuff into the real production SW; Before that I want to get it (IXP manager cfg, sFlow) work here (in a lab).<br></div><div>I want to understand: Does it from configuration perspective and sFlow everything functioning as it should be? I mean: As far as traffic will be high enough I'll see graphs as it should be?<br></div><div><br></div><div>Thank you.</div><div><br></div><div>Vladislav.<br></div></div></div></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">чт, 21 мар. 2019 г. в 23:25, Nick Hilliard <<a href="mailto:nick@foobar.org" target="_blank">nick@foobar.org</a>>:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi Vladislav,<br>
<br>
Vladislav Leontjev wrote on 20/03/2019 14:29:<br>
> ----------------------------------------------------------------------------<br>
> /srv/ixpmanager/config/grapher.php<br>
> -----------------------------------------------------------------------------<br>
> <br>
> 'sflow' => [<br>
> // show sflow / p2p links on the frontend<br>
> 'enabled' => env( 'GRAPHER_BACKEND_SFLOW_ENABLED', false ),<br>
> <br>
> // for larger IXPs, it's quite intensive to display all the <br>
> graphs<br>
> 'show_graphs_on_index_page' => env( <br>
> 'GRAPHER_BACKEND_SFLOW_SHOW_ON_INDEX', false ),<br>
> <br>
> // where to find the MRTG rrd files<br>
> 'root' => env( 'GRAPHER_BACKEND_SFLOW_ROOT', <br>
> '<a href="http://10.81.7.10/grapher-sflow/" rel="noreferrer" target="_blank">http://10.81.7.10/grapher-sflow/</a>' ),<br>
> ],<br>
<br>
oops, you shouldn't change this file under any circumstances. Can you <br>
reset this file using "git checkout"?<br>
<br>
Any customisation you might need to make can be handled in .env.<br>
<br>
> ------------------------------------------------------------------------<br>
> /srv/ixpmanager/.env<br>
> ------------------------------------------------------------------------<br>
> GRAPHER_BACKENDS="mrtg|sflow"<br>
> GRAPHER_BACKEND_SFLOW_ENABLED=true<br>
> GRAPHER_BACKEND_SFLOW_ROOT="<a href="http://10.81.7.10/grapher-sflow" rel="noreferrer" target="_blank">http://10.81.7.10/grapher-sflow</a>"<br>
> GRAPHER_ACCESS_CUSTOMER=0<br>
> GRAPHER_ACCESS_P2P=1<br>
> <br>
> ----------------------------------------------------------------<br>
<br>
that looks correct.<br>
<br>
> Files have been gathered as it should be;<br>
> #/var/www/ixp_p2p/ipv4/bytes/p2p/src-00001$ ls<br>
> p2p.ipv4.bytes.src-00001.dst-00003.rrd<br>
<br>
You should use "rrdtool dump p2p.ipv4.bytes.src-00001.dst-00003.rrd" to <br>
ensure that sflow is reading the data correctly.<br>
<br>
> I have got 2 peering ports UP and till now 2 rrd files accordingly;<br>
> will leave "./sflow-to-rrd-handler --macdbtype=configured" for sometime<br>
> to gather more of them;<br>
> <br>
> ------------------------------------------------------------------<br>
> local install of apache: added lines (used apache the same which was <br>
> installed with IXP manager)<br>
> ------------------------------------------------------------------<br>
> /etc/apache2/apache2.conf<br>
> <br>
> Alias /grapher-sflow /var/www/ixp_p2p<br>
> <Directory "/data/ixpmatrix"><br>
> Options None<br>
> AllowOverride None<br>
> </Directory><br>
> ----------------------------------------------------------------<br>
> shows the content of /var/www/ixp_p2p with all of its subdirs<br>
> <a href="http://10.81.7.10/grapher-sflow/" rel="noreferrer" target="_blank">http://10.81.7.10/grapher-sflow/</a><br>
> visual prtn-src:of apache <a href="https://prnt.sc/n0ijkk" rel="noreferrer" target="_blank">https://prnt.sc/n0ijkk</a><br>
<br>
Correct.<br>
<br>
> -------------------------------------------------------------<br>
> /usr/local/etc/ixpmanager.conf<br>
> -------------------------------------------------------------<br>
> <br>
> <sql><br>
> dbase_type = mysql<br>
> dbase_database = ixpmanager<br>
> dbase_username = ixpmanager<br>
> dbase_password = *<br>
> dbase_hostname = 127.0.0.1<br>
> #dbase_portname = /tmp/mysql.sock<br>
> </sql><br>
> <br>
> <ixp><br>
> sflow_rrdcached = 0<br>
> sflowtool = /usr/local/bin/sflowtool<br>
> sflowtool_opts = -4 -p 6343 -l<br>
> sflow_rrddir = /var/www/ixp_p2p<br>
> # debug = 1<br>
> apikey = *<br>
> apibaseurl = <a href="http://10.81.7.10/api/v4" rel="noreferrer" target="_blank">http://10.81.7.10/api/v4</a><br>
> macdbtype = configured<br>
> </ixp><br>
> <br>
> Do I understand wright:<br>
> <br>
> 1. If I see some page NOT with "dummy" and NOT with "no image found" it <br>
> means it's normally tries to interpreter sflow<br>
> converted *.rrd's? -> visual prtn-src:of vlan graph: <a href="https://prnt.sc/n0im4x" rel="noreferrer" target="_blank">https://prnt.sc/n0im4x</a><br>
<br>
The "dummy" / "no image found" are only for mrtg, not sflow.<br>
<br>
> 2. As far as there will be enough *.rrd files the graph<br>
> visual prtn-src:of vlan graph: <a href="https://prnt.sc/n0im4x" rel="noreferrer" target="_blank">https://prnt.sc/n0im4x</a><br>
> will be shown with in/out statistics at the bottom as it should be?<br>
> 3. GRAPHER_BACKENDS="mrtg|sflow" - tries to use mrtg -> failed -> then <br>
> sflow?<br>
<br>
no, it means that the Grapher back-end uses both mrtg and sflow. These <br>
are separate things: the MRTG grapher produces interface graphs and the <br>
sflow grapher produces point-to-point graphs.<br>
<br>
> 4. from log means: production.ERROR: No backend available to process <br>
> this graph<br>
> It's because of mrtg is not installed?<br>
> 5. Do I understand documentation in a wright way: Overall peering graph <br>
> is available only by mrtg? I need to implement it too them?<br>
<br>
yes, you need to install mrtg if you want regular interface graphs.<br>
<br>
Nick<br>
<br>
> <br>
> Thank you.<br>
> <br>
> Vladislav.<br>
> <br>
> ср, 20 мар. 2019 г. в 11:00, Nick Hilliard <<a href="mailto:nick@foobar.org" target="_blank">nick@foobar.org</a> <br>
> <mailto:<a href="mailto:nick@foobar.org" target="_blank">nick@foobar.org</a>>>:<br>
> <br>
> Vladislav Leontjev wrote on 20/03/2019 06:42:<br>
> > ./sflow-to-rrd-handler --macdbtype=configured<br>
> ><br>
> > runs whitout any error output; In my understanding I should then get<br>
> > rrd files into my mentioned dir in cfg?<br>
> ><br>
> <br>
> Yes, if there are MAC addresses defined in the database, you should see<br>
> .rrd files in a bunch of subdirectories in /var/www.<br>
> <br>
> If you're not seeing any files in there, then you need to use "--debug"<br>
> to see what's happening.<br>
> <br>
> > I'm using V4.9.2; In my situation (till next bug-fix) the way to get<br>
> > *.rrd is ./sflow-to-rrd-handler --macdbtype=configured ? or did I<br>
> > mess up something?<br>
> Just stick with v4.9.2 for the moment.<br>
> <br>
> Nick<br>
> <br>
> _______________________________________________<br>
> INEX IXP Manager mailing list<br>
> <a href="mailto:ixpmanager@inex.ie" target="_blank">ixpmanager@inex.ie</a><br>
> Unsubscribe or change options here: <a href="https://www.inex.ie/mailman/listinfo/ixpmanager" rel="noreferrer" target="_blank">https://www.inex.ie/mailman/listinfo/ixpmanager</a><br>
> <br>
</blockquote></div>
</blockquote></div>