Discussion:
[rancid] fresh rancid 3.2 install
Josten, Michael
2015-06-25 07:35:01 UTC
Permalink
Hello everyone,

I did a fresh rancid 3.2 install on a test machine before upgrading our productive system from 2.3.8 to 3.2.
We use many Brocade switches ( FCX, ICX, MLX, RX, SX Series ) and some ProCurves. I already read through the mailing list
to find someone with similar problems and NO, my router.db file doesn't contain ":" as separator :P
OS is Ubuntu 14.04. Rancid compiled with default options. Logfile says sth. like this

----------------------------------------------

Trying to get all of the configs.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
!
=====================================
Getting missed routers: round 1.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
!
=====================================
Getting missed routers: round 2.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
----------------------------------------------

Clogin works on all devices.
flogin also works, BUT when I try to send a command while being logged in with flogin the dreadfull "TIMEOUT reached" occurs
which doesn't happen when I am logged in via clogin.

Files and folders should all have correct rights and flags



With best regards

Michael Josten
Alan McKinnon
2015-06-25 07:46:33 UTC
Permalink
Post by Josten, Michael
Hello everyone,
I did a fresh rancid 3.2 install on a test machine before upgrading our
productive system from 2.3.8 to 3.2.
We use many Brocade switches ( FCX, ICX, MLX, RX, SX Series ) and some
ProCurves. I already read through the mailing list
to find someone with similar problems and NO, my router.db file doesn’t
contain “:” as separator :P
OS is Ubuntu 14.04. Rancid compiled with default options. Logfile says sth. like this
----------------------------------------------
Trying to get all of the configs.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
!
=====================================
Getting missed routers: round 1.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
!
=====================================
Getting missed routers: round 2.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
----------------------------------------------
Clogin works on all devices.
flogin also works, BUT when I try to send a command while being logged
in with flogin the dreadfull “TIMEOUT reached” occurs
which doesn’t happen when I am logged in via clogin.
Files and folders should all have correct rights and flags
Michael,

"dreadful" is the right word :-)

All the errors you post are rancid-speak for "something went wrong", but
the code is in no position to give you any clues. First:

did the faulty devices work OK on 2.3.8?
are the problem devices all of one type? (i.e. something like all your
Ciscos still work great, but all the HPs now fail, or similar?)

You probably need to run the *rancid scripts individually on each device
using the -d debug flag, then go through the output line by line seeing
exactly where it went wrong. Considering how kit works and what rancid
has to do to get the job done, there's a huge numnber of places where
the process can bork.
--
Alan McKinnon
***@gmail.com
Josten, Michael
2015-06-25 09:27:17 UTC
Permalink
-----Ursprüngliche Nachricht-----
Von: Rancid-discuss [mailto:rancid-discuss-***@shrubbery.net] Im Auftrag von Alan McKinnon
Gesendet: Donnerstag, 25. Juni 2015 09:47
An: rancid-***@shrubbery.net
Betreff: Re: [rancid] fresh rancid 3.2 install
Post by Josten, Michael
Hello everyone,
I did a fresh rancid 3.2 install on a test machine before upgrading
our productive system from 2.3.8 to 3.2.
We use many Brocade switches ( FCX, ICX, MLX, RX, SX Series ) and some
ProCurves. I already read through the mailing list to find someone
with similar problems and NO, my router.db file doesn't contain ":" as
separator :P OS is Ubuntu 14.04. Rancid compiled with default options.
Logfile says sth. like this
----------------------------------------------
Trying to get all of the configs.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
!
=====================================
Getting missed routers: round 1.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
!
=====================================
Getting missed routers: round 2.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
----------------------------------------------
Clogin works on all devices.
flogin also works, BUT when I try to send a command while being logged
in with flogin the dreadfull "TIMEOUT reached" occurs which doesn't
happen when I am logged in via clogin.
Files and folders should all have correct rights and flags
Michael,

"dreadful" is the right word :-)

All the errors you post are rancid-speak for "something went wrong", but the code is in no position to give you any clues. First:

did the faulty devices work OK on 2.3.8?
are the problem devices all of one type? (i.e. something like all your Ciscos still work great, but all the HPs now fail, or similar?)

You probably need to run the *rancid scripts individually on each device using the -d debug flag, then go through the output line by line seeing exactly where it went wrong. Considering how kit works and what rancid has to do to get the job done, there's a huge numnber of places where the process can bork.




--
Alan McKinnon
***@gmail.com


Hello Alan,

yes the devices work fine on 2.3.8. I checked devices of several types on version 3.2.
Running the script in debug mode fixed one problem so far. I forgot to add "add autoenable * 1" to my .cloginrc file.
However we have a new problem now ;)

This is the log for "rancid-run" on a Brocade ICX6610 switch stack running on ironware 8.x
=====================================
Trying to get all of the configs.
icxdckr02: found unexpected command - "write term"
icxdckr02: missed cmd(s): show running-config
icxdckr02: End of run not found
!
=====================================

I wondered why rancid needs the command "write term" for brocade devices ( which don't support the command )
so I looked up /usr/local/rancid/etc/rancid.types.base and commented out all foundry commands and added

foundry;command;foundry::ShowRun;show running-config

Which resulted in


Trying to get all of the configs.
icxdckr02: missed cmd(s): all commands
icxdckr02: End of run not found
!
=====================================
Getting missed routers: round 1.
icxdckr02: missed cmd(s): all commands
icxdckr02: End of run not found
!
=====================================
Getting missed routers: round 2.
icxdckr02: missed cmd(s): all commands
icxdckr02: End of run not found
!

Writing "show running" via flogin is no problem.

Best regards
Michael
Alan McKinnon
2015-06-25 13:18:35 UTC
Permalink
Post by Josten, Michael
-----Ursprüngliche Nachricht-----
Gesendet: Donnerstag, 25. Juni 2015 09:47
Betreff: Re: [rancid] fresh rancid 3.2 install
Post by Josten, Michael
Hello everyone,
I did a fresh rancid 3.2 install on a test machine before upgrading
our productive system from 2.3.8 to 3.2.
We use many Brocade switches ( FCX, ICX, MLX, RX, SX Series ) and some
ProCurves. I already read through the mailing list to find someone
with similar problems and NO, my router.db file doesn't contain ":" as
separator :P OS is Ubuntu 14.04. Rancid compiled with default options.
Logfile says sth. like this
----------------------------------------------
Trying to get all of the configs.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
!
=====================================
Getting missed routers: round 1.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
!
=====================================
Getting missed routers: round 2.
mlxkr01: missed cmd(s): all commands
mlxkr01 flogin error: Error: TIMEOUT reached
mlxkr01: End of run not found
----------------------------------------------
Clogin works on all devices.
flogin also works, BUT when I try to send a command while being logged
in with flogin the dreadfull "TIMEOUT reached" occurs which doesn't
happen when I am logged in via clogin.
Files and folders should all have correct rights and flags
Michael,
"dreadful" is the right word :-)
did the faulty devices work OK on 2.3.8?
are the problem devices all of one type? (i.e. something like all your Ciscos still work great, but all the HPs now fail, or similar?)
You probably need to run the *rancid scripts individually on each device using the -d debug flag, then go through the output line by line seeing exactly where it went wrong. Considering how kit works and what rancid has to do to get the job done, there's a huge numnber of places where the process can bork.
--
Alan McKinnon
Hello Alan,
yes the devices work fine on 2.3.8. I checked devices of several types on version 3.2.
Running the script in debug mode fixed one problem so far. I forgot to add "add autoenable * 1" to my .cloginrc file.
However we have a new problem now ;)
This is the log for "rancid-run" on a Brocade ICX6610 switch stack running on ironware 8.x
=====================================
Trying to get all of the configs.
icxdckr02: found unexpected command - "write term"
icxdckr02: missed cmd(s): show running-config
icxdckr02: End of run not found
!
=====================================
I wondered why rancid needs the command "write term" for brocade devices ( which don't support the command )
so I looked up /usr/local/rancid/etc/rancid.types.base and commented out all foundry commands and added
foundry;command;foundry::ShowRun;show running-config
Which resulted in
Trying to get all of the configs.
icxdckr02: missed cmd(s): all commands
icxdckr02: End of run not found
!
=====================================
Getting missed routers: round 1.
icxdckr02: missed cmd(s): all commands
icxdckr02: End of run not found
!
=====================================
Getting missed routers: round 2.
icxdckr02: missed cmd(s): all commands
icxdckr02: End of run not found
!
Writing "show running" via flogin is no problem.
Based on experience with getting kit to play nicely with rancid, I'd say
there's something wrong with your prompt, as rancid can't identify the
line that starts the "show running-config" output.

Do you get the normal "PROMPT FOUND" output in debug mode?
Any clues in the output around the area where it searches for command
output?

These problems often turn out to be regex-related.
--
Alan McKinnon
***@gmail.com
Josten, Michael
2015-06-26 05:20:19 UTC
Permalink
Based on experience with getting kit to play nicely with rancid, I'd say there's something wrong with your prompt, as rancid can't identify the line that starts the "show running-config" output.

Do you get the normal "PROMPT FOUND" output in debug mode?
Any clues in the output around the area where it searches for command output?

These problems often turn out to be regex-related.


--
Alan McKinnon
***@gmail.com



Good morning,

i did some testing with flogin and a brocade ICX6610 device. The script seems to struggle when the returned output exceeds one page. Command output
with lots of output don't work, just as "show run". If I got this right, this might explain the "end of run not found" in my rancid logs.
Instead of returning to user prompt flogin repeats

spawn id exp0 sent < >
spawn id exp6 sent < >

I just try to make my best guess here.

cheerio
Michael
Alan McKinnon
2015-06-26 06:09:02 UTC
Permalink
Post by Josten, Michael
Based on experience with getting kit to play nicely with rancid, I'd say there's something wrong with your prompt, as rancid can't identify the line that starts the "show running-config" output.
Do you get the normal "PROMPT FOUND" output in debug mode?
Any clues in the output around the area where it searches for command output?
These problems often turn out to be regex-related.
--
Alan McKinnon
Good morning,
i did some testing with flogin and a brocade ICX6610 device. The script seems to struggle when the returned output exceeds one page. Command output
with lots of output don't work, just as "show run". If I got this right, this might explain the "end of run not found" in my rancid logs.
Instead of returning to user prompt flogin repeats
spawn id exp0 sent < >
spawn id exp6 sent < >
I just try to make my best guess here.
That makes a lot of sense actually, expect is getting confused.

I don't have access to any brocade devices at all or your device output,
so it's hard to help further with specifics. I'm assuming flogin manages
the login portion OK, and runs the command properly.

Have you checked for end-of-page markers (eg <--more-->)?

You should also be able to run flogin with -c <command> to check that it
gives back the correct output. Compare with what you get logging in
manually and typing commands directly.
--
Alan McKinnon
***@gmail.com
Loading...