[rancid] Newline issue

Discussion:

Merijn Evertse

2017-01-26 08:42:35 UTC

Hello,

The rancid run on our Fortigate units has a small issue. Every hour or so we get the following:

- set two-factor-ftm-expiry 72

+ set two-fact

+ or-ftm-expiry 72

Or

- set virtual-server-hardware-acceleration enable

+ set vi

+ rtual-server-hardware-acceleration enable

I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

On Vyos it looks like:

- # chassis_asset_tag: show hardware pci

- # 3091-1101-9766-6577-4039-0090-06

+ # chassis_asset_tag: 3091-1101-9766-6577-4039-0090-06

Related one hour earlier:

- # chassis_asset_tag: 3091-1101-9766-6577-4039-0090-06

+ # chassis_asset_tag: show hardware pci #

+ 3091-1101-9766-6577-4039-0090-06

And here the command itself is shown.

Kind regards,

Merijn Evertse

heasley

2017-01-26 15:23:37 UTC

Permalink

Post by Merijn Evertse
Hello,
- set two-factor-ftm-expiry 72
+ set two-fact
+ or-ftm-expiry 72
Or
- set virtual-server-hardware-acceleration enable
+ set vi
+ rtual-server-hardware-acceleration enable

This is most likely either the pager or some out-of-band like logs being
written to the vty while the config is being collected. fnlogin should
be disabling the pager; verify that your aaa configuration is allowing
it to do so.

Post by Merijn Evertse
I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

vyos is not supported by rancid and i've never used it, but it is probably
the same cause. For the cisco too, and that is almost definitely your aaa
not allowing it to disable the pager; but there are a few cisco platforms
that have no way to disable the pager.

Post by Merijn Evertse
- # chassis_asset_tag: show hardware pci
- # 3091-1101-9766-6577-4039-0090-06
+ # chassis_asset_tag: 3091-1101-9766-6577-4039-0090-06
- # chassis_asset_tag: 3091-1101-9766-6577-4039-0090-06
+ # chassis_asset_tag: show hardware pci #
+ 3091-1101-9766-6577-4039-0090-06
And here the command itself is shown.
Kind regards,
Merijn Evertse
_______________________________________________
Rancid-discuss mailing list
http://www.shrubbery.net/mailman/listinfo/rancid-discuss

Merijn Evertse

2017-01-30 14:47:40 UTC

Permalink

Hello,

Thank you for the response.
I checked the commands for disabling pager and they work. I also verified that debugging is disabled and is not logging to console.
Also the issue is not exactly every hour, some runs go without problems and some have this issue.

Merijn Evertse

-----Oorspronkelijk bericht-----
Van: heasley [mailto:***@shrubbery.net]
Verzonden: donderdag 26 januari 2017 16:24
Aan: Merijn Evertse <***@trans-ix.nl>
CC: rancid-***@shrubbery.net
Onderwerp: Re: [rancid] Newline issue

This is most likely either the pager or some out-of-band like logs being written to the vty while the config is being collected. fnlogin should be disabling the pager; verify that your aaa configuration is allowing it to do so.

Post by Merijn Evertse
I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

vyos is not supported by rancid and i've never used it, but it is probably the same cause. For the cisco too, and that is almost definitely your aaa not allowing it to disable the pager; but there are a few cisco platforms that have no way to disable the pager.

heasley

2017-01-30 19:39:07 UTC

Permalink

Post by Merijn Evertse
Hello,
Thank you for the response.
I checked the commands for disabling pager and they work. I also verified that debugging is disabled and is not logging to console.
Also the issue is not exactly every hour, some runs go without problems and some have this issue.
Merijn Evertse

Can you show us an example from a cisco that is doing this?

Post by Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: donderdag 26 januari 2017 16:24
Onderwerp: Re: [rancid] Newline issue

This is most likely either the pager or some out-of-band like logs being written to the vty while the config is being collected. fnlogin should be disabling the pager; verify that your aaa configuration is allowing it to do so.

Post by Merijn Evertse
I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

vyos is not supported by rancid and i've never used it, but it is probably the same cause. For the cisco too, and that is almost definitely your aaa not allowing it to disable the pager; but there are a few cisco platforms that have no way to disable the pager.

Merijn Evertse

2017-01-30 20:04:24 UTC

Permalink

Hello,

Sorry it seems this has not happened for quite some time, so you can disregard the mentioning of Cisco :-)

Merijn Evertse

-----Oorspronkelijk bericht-----
Van: heasley [mailto:***@shrubbery.net]
Verzonden: maandag 30 januari 2017 20:39
Aan: Merijn Evertse <***@trans-ix.nl>
CC: heasley <***@shrubbery.net>; rancid-***@shrubbery.net
Onderwerp: Re: [rancid] Newline issue

Can you show us an example from a cisco that is doing this?

Post by Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: donderdag 26 januari 2017 16:24
Onderwerp: Re: [rancid] Newline issue

This is most likely either the pager or some out-of-band like logs being written to the vty while the config is being collected. fnlogin should be disabling the pager; verify that your aaa configuration is allowing it to do so.

Post by Merijn Evertse
I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

vyos is not supported by rancid and i've never used it, but it is probably the same cause. For the cisco too, and that is almost definitely your aaa not allowing it to disable the pager; but there are a few cisco platforms that have no way to disable the pager.

heasley

2017-01-30 20:28:13 UTC

Permalink

Post by Merijn Evertse
Hello,
Sorry it seems this has not happened for quite some time, so you can disregard the mentioning of Cisco :-)

ok; then as the rancid user, please repeatedly run

export NOPIPE=YES
fnrancid -dl hostname

until you see the problem in the hostname.new file. Then provide the
hostname.raw file to me as an attachment. Hopefully I can identify the
cause from that.

Post by Merijn Evertse
Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: maandag 30 januari 2017 20:39
Onderwerp: Re: [rancid] Newline issue

Can you show us an example from a cisco that is doing this?

Post by Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: donderdag 26 januari 2017 16:24
Onderwerp: Re: [rancid] Newline issue

This is most likely either the pager or some out-of-band like logs being written to the vty while the config is being collected. fnlogin should be disabling the pager; verify that your aaa configuration is allowing it to do so.

Post by Merijn Evertse
I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

vyos is not supported by rancid and i've never used it, but it is probably the same cause. For the cisco too, and that is almost definitely your aaa not allowing it to disable the pager; but there are a few cisco platforms that have no way to disable the pager.

Merijn Evertse

2017-01-30 20:51:53 UTC

Permalink

Hello,

I have run it 20 times on 2 different Fortigate units and it never happens.
I have run the normal rancid-run 1 time and it happened on 2 units.
Always the same lines, around line 138 or 140 on every Fortigate device.

Merijn Evertse

-----Oorspronkelijk bericht-----
Van: heasley [mailto:***@shrubbery.net]
Verzonden: maandag 30 januari 2017 21:28
Aan: Merijn Evertse <***@trans-ix.nl>
CC: heasley <***@shrubbery.net>; rancid-***@shrubbery.net
Onderwerp: Re: [rancid] Newline issue

Post by Merijn Evertse
Hello,
Sorry it seems this has not happened for quite some time, so you can
disregard the mentioning of Cisco :-)

ok; then as the rancid user, please repeatedly run

export NOPIPE=YES
fnrancid -dl hostname

until you see the problem in the hostname.new file. Then provide the hostname.raw file to me as an attachment. Hopefully I can identify the cause from that.

Post by Merijn Evertse
Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: maandag 30 januari 2017 20:39
Onderwerp: Re: [rancid] Newline issue

Can you show us an example from a cisco that is doing this?

Post by Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: donderdag 26 januari 2017 16:24
Onderwerp: Re: [rancid] Newline issue

This is most likely either the pager or some out-of-band like logs being written to the vty while the config is being collected. fnlogin should be disabling the pager; verify that your aaa configuration is allowing it to do so.

Post by Merijn Evertse
I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

vyos is not supported by rancid and i've never used it, but it is probably the same cause. For the cisco too, and that is almost definitely your aaa not allowing it to disable the pager; but there are a few cisco platforms that have no way to disable the pager.

heasley

2017-01-30 21:22:27 UTC

Permalink

Post by Merijn Evertse
Hello,
I have run it 20 times on 2 different Fortigate units and it never happens.
I have run the normal rancid-run 1 time and it happened on 2 units.
Always the same lines, around line 138 or 140 on every Fortigate device.
Merijn Evertse

hrm, lack of a tty - probably. Are you absolutely positive that the pager
is being disabled?

if so, I suppose this process has to be repeated for the cron & rancid-run
process. set NOPIPE=YES in rancid.conf and change rancid.types.base:
-fortigate;script;fnrancid
+fortigate;script;fnrancid -d

and run rancid-run or let cron run. I expect this to leave the .raw file
behind as below.

Post by Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: maandag 30 januari 2017 21:28
Onderwerp: Re: [rancid] Newline issue

Post by Merijn Evertse
Hello,
Sorry it seems this has not happened for quite some time, so you can
disregard the mentioning of Cisco :-)

ok; then as the rancid user, please repeatedly run
export NOPIPE=YES
fnrancid -dl hostname
until you see the problem in the hostname.new file. Then provide the hostname.raw file to me as an attachment. Hopefully I can identify the cause from that.

Post by Merijn Evertse
Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: maandag 30 januari 2017 20:39
Onderwerp: Re: [rancid] Newline issue

Can you show us an example from a cisco that is doing this?

Post by Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: donderdag 26 januari 2017 16:24
Onderwerp: Re: [rancid] Newline issue

This is most likely either the pager or some out-of-band like logs being written to the vty while the config is being collected. fnlogin should be disabling the pager; verify that your aaa configuration is allowing it to do so.

Post by Merijn Evertse
I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

vyos is not supported by rancid and i've never used it, but it is probably the same cause. For the cisco too, and that is almost definitely your aaa not allowing it to disable the pager; but there are a few cisco platforms that have no way to disable the pager.

Merijn Evertse

2017-01-30 21:47:59 UTC

Permalink

Hello,

Got the raw file of this happening and afterwards of recovering to the normal line.
These files include the password and certificate fields, and a lot of other stuff from my customer, so instead on sending it to you I ran a 'diff' on the files.

Besides the changing password and certificate info the only lines are:
37c37
< System time: Mon Jan 30 13:33:16 2017
---

System time: Mon Jan 30 13:40:53 2017

42c42
< #conf_file_ver=3430384035283229748
---

#conf_file_ver=753099238288986698

169,170c169
< set tcp-tim
< ewait-timer 1
---

set tcp-timewait-timer 1

Merijn Evertse

-----Oorspronkelijk bericht-----
Van: heasley [mailto:***@shrubbery.net]
Verzonden: maandag 30 januari 2017 22:22
Aan: Merijn Evertse <***@trans-ix.nl>
CC: heasley <***@shrubbery.net>; rancid-***@shrubbery.net
Onderwerp: Re: [rancid] Newline issue

hrm, lack of a tty - probably. Are you absolutely positive that the pager is being disabled?

if so, I suppose this process has to be repeated for the cron & rancid-run process. set NOPIPE=YES in rancid.conf and change rancid.types.base:
-fortigate;script;fnrancid
+fortigate;script;fnrancid -d

and run rancid-run or let cron run. I expect this to leave the .raw file behind as below.

-----Oorspronkelijk bericht-----
Verzonden: maandag 30 januari 2017 21:28
Onderwerp: Re: [rancid] Newline issue

Post by Merijn Evertse
Hello,
Sorry it seems this has not happened for quite some time, so you can
disregard the mentioning of Cisco :-)

ok; then as the rancid user, please repeatedly run
export NOPIPE=YES
fnrancid -dl hostname
until you see the problem in the hostname.new file. Then provide the hostname.raw file to me as an attachment. Hopefully I can identify the cause from that.

Post by Merijn Evertse
Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: maandag 30 januari 2017 20:39
Onderwerp: Re: [rancid] Newline issue

Can you show us an example from a cisco that is doing this?

Post by Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: donderdag 26 januari 2017 16:24
Onderwerp: Re: [rancid] Newline issue

This is most likely either the pager or some out-of-band like logs being written to the vty while the config is being collected. fnlogin should be disabling the pager; verify that your aaa configuration is allowing it to do so.

Post by Merijn Evertse
I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

vyos is not supported by rancid and i've never used it, but it is probably the same cause. For the cisco too, and that is almost definitely your aaa not allowing it to disable the pager; but there are a few cisco platforms that have no way to disable the pager.

heasley

2017-01-30 21:50:43 UTC

Permalink

Post by Merijn Evertse
Hello,
Got the raw file of this happening and afterwards of recovering to the normal line.
These files include the password and certificate fields, and a lot of other stuff from my customer, so instead on sending it to you I ran a 'diff' on the files.
37c37
< System time: Mon Jan 30 13:33:16 2017
---

System time: Mon Jan 30 13:40:53 2017

42c42
< #conf_file_ver=3430384035283229748
---

#conf_file_ver=753099238288986698

169,170c169
< set tcp-tim
< ewait-timer 1
---

set tcp-timewait-timer 1

Sorry, that doesnt help me. you can send the raw files directly to me rather
than the list.

Post by Merijn Evertse
Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: maandag 30 januari 2017 22:22
Onderwerp: Re: [rancid] Newline issue

hrm, lack of a tty - probably. Are you absolutely positive that the pager is being disabled?
-fortigate;script;fnrancid
+fortigate;script;fnrancid -d
and run rancid-run or let cron run. I expect this to leave the .raw file behind as below.

-----Oorspronkelijk bericht-----
Verzonden: maandag 30 januari 2017 21:28
Onderwerp: Re: [rancid] Newline issue

Post by Merijn Evertse
Hello,
Sorry it seems this has not happened for quite some time, so you can
disregard the mentioning of Cisco :-)

ok; then as the rancid user, please repeatedly run
export NOPIPE=YES
fnrancid -dl hostname
until you see the problem in the hostname.new file. Then provide the hostname.raw file to me as an attachment. Hopefully I can identify the cause from that.

Post by Merijn Evertse
Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: maandag 30 januari 2017 20:39
Onderwerp: Re: [rancid] Newline issue

Can you show us an example from a cisco that is doing this?

Post by Merijn Evertse
-----Oorspronkelijk bericht-----
Verzonden: donderdag 26 januari 2017 16:24
Onderwerp: Re: [rancid] Newline issue

This is most likely either the pager or some out-of-band like logs being written to the vty while the config is being collected. fnlogin should be disabling the pager; verify that your aaa configuration is allowing it to do so.

Post by Merijn Evertse
I also see this sometimes on other devices, Cisco, Vyos etc.
It seems that something goes wrong reading the lines and the code sees a newline where it shouldn't.

vyos is not supported by rancid and i've never used it, but it is probably the same cause. For the cisco too, and that is almost definitely your aaa not allowing it to disable the pager; but there are a few cisco platforms that have no way to disable the pager.