On Demand Auto Attendant for CallManager Express

pushbutton

I’ve done my fair share of CallManager Express (CME) installations over the years, many of which were for small businesses.  I usually get to try and replace an old battleship of a phone system that has been running for a long time but has either finally given up the ghost or can’t be repaired due to the company being out of business.  When I do replace these units, the usual desire is to make it behave the same way as the old system.  For the most part, this is a pretty easy proposition.  That is, until it comes to auto attendants.  The automated recording that helps callers find the correct extension or leave a message is becoming an important part of the small business as employers start cutting back on expenses and use fewer people and more technology.  One case recently that had me baffled was a request for an on-demand auto attendant.

This particular customer had an old phone system that had finally failed.  They had decided on a CME system to replace it.  One feature they said they could not live without was the ability to toggle on a recording to handle calls.  This usually happened during lunch or during a meeting when all people at the office would be involved in some manner or another.  The receptionist wanted to push a button and enable the recording until the meeting or lunch had passed, then come back and toggle off the recording to allow calls to be answered by a human being again.  I nodded along slowly as the wheels started turning, because to my knowledge there was no feature inherent to the system that would do this.

After some thinking and planning and more than a few failed lab mockups, I finally found the answer in a combination of unlikely related features.  The first involved handling incoming calls to multiple phones in a manner that would allow redirection of calls.  This isn’t possible with parallel hunt groups in CME, as logging a phone into a hunt group changes all the forwarding behaviors of the phone.  It will only obey the hunt list settings and ignore almost everything else, include call-forward all.  The second issue was finding a way to have the auto attendant answer the call when invoked, as the standard method of using auto attendants either involve enabling it for all calls at all times or using a schedule to enable specific greetings after hours or on holidays.  As an aside, this is the real value in a solutions integrator.  It’s easy enough to check a few boxes and type a few lines to get something to work the way it says it will on the box.  A real integrator will make a system behave how the user wants it to behave, regardless of whether or not there’s a checkbox to do it.

Step 1: Fix Incoming Call Behavior

This ended up being the most technology-dependent part of the equation.  CME used to have a hard time handling a parallel (or broadcast) hunt group that rang a group of phones at one time.  Prior to CME 4.3, this feature was only available for SIP phones.  After 4.3, Cisco finally ported the parallel hunt group to SCCP phones (my preferred method for configuring phones in CME).  The only catch was that the phone hunting behavior followed the rules for hunt groups.  In order to make the incoming calls do something else, I had to find a way to make the calls ring multiple phones without a hunt group.  The answer actually came to me when I found an old page referencing a hacked together broadcast hunt group prior to CME 4.3.  This ingenious solution used a group of overlaid directory numbers (DNs) to mimic a broadcast hunt group.  A group of DNs was necessary because a DN in CME can only be single or dual-line.  With a dual line phone, two calls can hit the phone at once.  The third call is forced off to voice mail or some other behavior as dictated by the call forwarding configuration.  The second part of this solution was delivered in CME 4.0 – the octo line.

For those not familiar, the octo line creates a special DN capable of handling eight simultaneous incoming and outgoing calls across multiple extensions.  This looks to me like an attempt to create a basic form of call queuing in CME.  By creating a construct to handle more than two calls at once, you’ve in effect created something to can do basic call center call routing.  In this case, I created one octo-line DN and put it on the two phones used by reception at this business:

ephone-dn  1 octo-line
  number 100
  description Outside Call
  name Outside Call

Now I can make the calls ring on two phones without creating a hunt group.  That also means I can call-forward the phones as needed.

Step 2: Invoke Auto Attendant On Demand

This one was a bit trickier.  Enabling an auto attendant for a dialed number is easy.  How do we make that number only work when toggled?  Time schedules were out for this customer, as they were never sure when they were going to need to enable the auto attendant.  That means I have to find a way to call the auto attendant DN when needed.  But how to do that on CME?  The answer came to me in a flash of insight – night service.

Night service is a configuration setting that allows a system to be configured for a time schedule when the participating phones will ring in a special manner or pattern.  The idea is that when a business is closed, a designated phone can be monitored by personnel, such as janitorial staff or second shift, and be answered without modifying the open hours configuration.  In this case, we’re going to use the night service code to invoke the night service configuration when needed.  Normally, this command would be used when night service is active in order to disable it.  Here, we’re doing the exact opposite.  Also one more thing to note – the night service code command requires the code to be prefixed with an asterisk.  That works well, as the asterisk isn’t usually dialed as part of a number, so this signals that it’s something special.  I usually use either the extension number (as below) or the last four digits of the main telephone number as a mnemonic trigger.  The first part of the config is easy:

telephony-service
  night-service code *100

Now, we need to go back to the octo-line DN that we previously configured and add an additional setting to control the night service function.  In this instance, I’m using 501 as the pre-configured auto attendant dial-in number:

ephone-dn 1 octo-line
  call-forward night-service 501

The only remaining task to make this a true “push button” service is to enable a speed dial on the ephone itself.  That part is also easy:

ephone 1
  speed-dial 1 *100 label Auto Attendant

Now all the user needs to do is push the button on their phone labeled “Auto Attendant” and it will enable night service for all incoming calls.  Pushing the button again will disable it.  You can also add the command night-service bell to the ephone-dn in order to display a message that night service is active.

There are a number of other tricks that you can do with the basic building blocks presented by CME to make it behave just like a customer’s old phone system.  This should allow you to ease any transition and allay any fears they might have.  After all the users are comfortable with the new phones and phone behavior, you can start introducing new features to them like unified messaging or single number reach.  People are very open to change once they figure out nothing has really changed.

Independence From Oversight

Secrets

Just when I think I’ve just about run out of things to write about when it comes to blogging and independence, the real world goes and gives me a nice topic on a silver platter.

For those that may not have heard, there was a bit of an issue at the 2013 Consumer Electronics Show (CES).  At most of these shows, the various media outlets that cover the event will look at the gadgets or products that the vendors are showcasing and pick a few to win “best of show awards.”  Most of the time, this involves writing a little bit about the product and giving it some press.  CNET does this for the CES every year.  This year, one of the products they were going to give an award to was the multi-channel commercial skipping DVR from Dish Networks called Hopper.  According to a few reports, this was going to be the Best in Show winner out of everything at CES.  There was just one problem.  The parent company of CNET is CBS Interactive.  CBS, along with ABC, NBC, and Fox, is suing Dish over the Hopper DVR.  When word got out that CNET was about to give a huge award to a product that CBS despises and wants to destroy, the big wigs at CBS interactive stepped in and rescinded the award for Hopper and told the CNET editors to revote.  There was a footnote in the article noting that CNET wouldn’t award to products under litigation in the future, but the genie was already out of the bottle.  There was a lot of discussion about the rights that CBS Interactive had to step in and squash the award based on something going on in a different area of CBS.  One of CNET’s writers quit over objectivity issues.  People started wondering how you could be objective if you had overlords with agendas.  I sat back and smiled to myself.

Many people take to social media to find a voice when they can’t have one.  Anonymous Twitter accounts, nameless blogs, and even venting on Facebook allow people to stay in the shadows while airing dirty laundry or putting frustrations out in public.  These people get a lot of value out of using social media to feel better without being seen.  The risk of being found out and muzzled is very real.  That is something I absolutely will not stand for.  When I started this blog, I did it to put my thoughts down on paper.  I had a lot to say and wanted to see if anyone would read it.  Now, over two years later, I’ve said a lot of things.  Some are funny.  Some are insightful.  Others still are inflammatory or even downright rude.  But each of them represent thoughts and feelings that are mine.  If someone else were to come to me and ask me to remove a post because they disagreed with the content, we’d have a nice discussion and perhaps an offer to draft a rebuttal.  However, the post would stay up.  If I had someone come to me and order me to delete something because it didn’t jive with the corporate byline or didn’t fit the image that was being project, I would come unglued.  No one tells me what to write.  By the same token, no one tells me what not to write.

I’m generally respectful of embargoes and requests for delayed posting.  I understand the reasoning behind that.  There are press kits and release dates and other things that go into product launches.  If you give me awesome info ahead of time and ask me to hold off writing about it until a certain date, I’ll give you the benefit of the doubt.  After all, you asked nicely.  Other times, I write about things that may not be public knowledge, like the Meraki acquisition.  I went out on a bit of a limb when I posted that.  Had someone contacted me and asked me to take it down, I would probably have smiled and asked, “So it’s true then?”  The information that I used to draft that post was one part accidental public leak, one part conjecture, and one part analysis.  There would have been no reason to remove it.  For someone to ask me to put the genie back in the bottle smacks of a kind of control that hasn’t been seen in the broader media in more than 30 years.

Asking anyone to take down a disagreeable blog post is akin to asking Woodward and Bernstein to unpublish their articles about Watergate.  It’s like asking the New York Times to rescind the Pentagon Papers.  Those of us that write have a right to make our opinions heard.  That those opinions may conflict with the opinions of others is the basis for discussion and compromise.  You don’t have to agree with anything I say.  That doesn’t mean that I’m not going to say it.  People take umbrage with what I say.  They write articles disagreeing with me, sometimes vehemently.  I don’t ask them to take down their writing.  I look at it as a challenge.  I see it as an opportunity to make my position even more clear and win some of the undecided people over to my side.  The same applies to my writing.  I will correct errors or restate points when they are unclear.  But I will not remove a post because someone is upset about it.

I answer to one person on this blog: me.  I’m the name behind everything here, and I’m the one that must answer for what’s written.  No one can force me to put something up.  No one can force me to take something down.  That comes with a lot of responsibility.  It’s storm that you have to weather some times.  In the end, it speaks volumes about integrity and fairness and all sorts of other things we sometimes take for granted in both the old and new media.  I also have to be cognizant of this going forward.  I’ve already found myself in situations where my blog has had an impact on future employment, both good and bad.  I feel that this is important enough to me to bring up quickly in the negotiation process.  My blog is a part of me.  An extension of my will and thoughts.  If you aren’t willing or able to deal with the things that I say here and feel that you have some right to dictate terms to me,  then I think the conversation is over.  And as my mother will be the first to tell you, I can be very stubborn when the time comes.

I think what’s most important in this whole story is that you must find a voice that allows you to say what you feel needs to be said.  You should never put yourself into a position for anyone to tell you what you should and shouldn’t write or say.  The only way the someone can be truly objective and open is to create from a position free from constraint.  It’s only after we’re free to say what we want when one’s real voice can be heard.

Frame of Reference

Got a second?  Awesome.  Go grab a watch.  I promise this won’t take long.

Back already?  Even better.  That probably took a few seconds to find, right?  Now, look at the watch and count off thirty seconds.  Just wait and watch.  I’ll be here when you’re done.

Thirty seconds doesn’t seem like a lot of time.  It feels longer when you’re watching each second pass looking at a watch or a clock.  For some things though, thirty seconds is an eternity.  In the IT world, thirty seconds might as well be a year to some protocols and processes.  Think about some things that can happen in thirty seconds:

6 EIGRP hello packets (by default)

300 OSPF hellos when configured for sub-second failover (ip ospf dead-interval minimal hello-multiplier 5)

VMware notices a host has failed and HA starts moving it to a different hypervisor (12 seconds from last hello to start isolation, 15 seconds from start of isolation to begin moving hosts)

3.75 gigbytes of data transferred over a 1 Gbps link

All that in such a short amount of time.  Yet, for most of us thirty seconds isn’t worth bothering to notice.  We think on time scales of a minute or an hour or even a day.  I recently had to quote the amount of time that it would take for me to install a new system.  When I told them it would take me 40 hours, the response was incredulous.  How on earth could it take that many hours to install this widget?!?  When I told them I thought a week was plenty of time to take care of this thing, the person responded with “Oh.  Why didn’t you say that it would only take you a week the first time?”  I shook my head in disbelief.

When we start talking about a project, we all need to make sure our frame of reference matches.  I deal with lots of projects as an education VAR that need to be done in a specific time frame.  I have a lot more flexibility than others in my maintenance windows.  Spring breaks and summer vacations are prime times to rip out pieces of the network and replace all manner of things.  However, despite my best efforts to wrap everything up by the end of my window, I’m always warned that extra projects need to be completed “before school starts.”  My frame of reference for my extended maintenance window was several weeks.  Now, my project is being extended and compressed into the span of a few days, since this extra work always seems to come around the first of August.  If this had been discovered and planned for ahead of time, it could have been completed with a minimum of fuss.  My frame of reference of a few weeks was totally different that the customer’s frame of reference of a few days before school starts.

It’s a fact of life that people run on totally different frames of reference.  Some think about the day in minute-long increments.  They always seem busy and sometimes on edge.  Every part of the day is filled with something.  Others have a longer-term approach.  Their schedule is measured in days or even weeks.  They can seem lackadaisical or even relaxed.  Their outlook is that things will be done in due time.  When these two types of people meet on a project, the results can be disastrous.  The hares will spend a lot of time spinning their wheels, waiting for the rest to finish and gradually become bored and antsy. The tortoises will become overwhelmed shortly, feeling rushed without taking the time to digest what’s going on.  The key to getting buy in from everyone is to make sure that the frames of reference and time schedules are agreed upon before commencement of the project.  Making sure everyone is on the same page helps alleviate issues after everything gets started.


Tom’s Take

I know that syncing a frame of reference can be hard.  I’m one of the “hares” above.  I’m a hard charger and a quick mover.  When I work with others that don’t share the same attitude, I tend to find myself growing disillusioned.  I’ve found over the years that the key to preventing this is to make sure that I lay everything out ahead of time with the people that I’ll be working with.  I want to make sure we’re all synced up before we get started.  By getting on the same page before opening the book, there’s no need to worry about confused expectations.  Besides, all it takes is thirty seconds of explanation to save hours of pain down the road.

Change The CCIE Portal Login!

It’s been said that achieving the CCIE is one of the more painful processes in networking and certification.  There’s a lot of time and effort that must be expended to obtain those singular digits that identify you as an internetworking expert in the eyes of Cisco.  However, the pain doesn’t always end after you get your CCIE.

All the information accrued by a CCIE candidate lives in a database somewhere at Cisco.  The access method for this database is somewhat archaic.  When you attempt to access any information from the http://www.cisco.com/go/ccie landing page, you must first log in using your Cisco Connection Online (CCO) login.  This is a pretty standard login for anything on the Cisco website, from software downloads to partner page access.  Once you input the information to log into your CCO account, you aren’t automatically granted access to the CCIE portal.  Instead, you are redirected to https://tools.cisco.com/CCIE/Schedule_Lab/CCIEOnline/jsp/UpdateProfile_Form.jsp.  For those that might not otherwise be familiar with this page, here’s what it looks like:

CCIE Login Page - Thanks to @MrTugs

CCIE Login Page – Thanks to @MrTugs

Anyone that has taken the CCIE written, tried to schedule the CCIE lab, or has passed the lab knows the pain of this page.  In order to access your score report or CCIE logos or even schedule a lab exam, you must first provide the laundry list of random information.  The candidate ID is easy enough to find since it’s the CSCO number that tracks you through the Cisco certification program.  The rest of the info is the pain point.

Why is it that almost twenty years after the inception of the program that I still need to provide my written score report information?  I could understand providing all this information the first time I log into the system.  PearsonVUE and Prometric require similar information from your first testing score report in order to tie your database record to a test and begin to track you in their system.  If I had to provide the score report for the first time to tie the CCIE written exam to my CSCO number, I would totally understand.  However, I need to provide my written score EVERY. TIME. I. LOG. IN.  Even after I pass the CCIE lab, I still need to remember that score to access my certification record.  If you’re someone that has taken several recertification exams it can be painful.  If you’re been a CCIE as long as Terry Slattery, it’s downright excruciating.  If you’re considering a multiple CCIE, the process is even worse.  You have to log into the system with your specific track score report in order to schedule a lab.  Don’t have your CCIE Voice score report handy?  Better not log in with your CCIE R&S information.  You won’t have access to schedule the lab for Voice.  It’s almost like the CCIE database is a series of separate databases running on someone’s desktop in RTP.

EDIT: Marko Milivojevic (@icemarkom) pointed out to me that the database is consistent if you are a multiple CCIE holder.  Using any one of your written exams allows you to log in and see all of your records.  You still need to use a track-specific written test to schedule the associated lab exam, however.

Cisco has a certification tracking database located at http://www.cisco.com/go/certifications/login.  It holds all the information related to non-CCIE certifications.  It also happens to be integrated with the CCO login completely.  I used to have to login to the Cisco Cert Tracker with my CSCO ID, but now I just have to login with my regular CCO login and I’m passed right on through to the pertinent information.  There’s even a field in the Cert Tracker for my CCIE number.  However, there is no information to be found related to the CCIE itself.  I’m pretty sure this has a lot to do with the historical separation between the CCIE team and the rest of the certification organization.  The CCIE was always held apart from everything else, both due to its grandfatherly status in the certification industry and the lack of any prerequisites to take the written exam.  It has only been recently that the CCIE team has been folded into the greater Cisco Certifications team.  If they truly are a part of the greater whole, it’s high time to start bring the CCIE portal over to the Cert Tracker.

I can’t see any reason to continue to require CCIEs in good standing to remember a decade-old score report in order to access a logo or look up a lab exam date.  I can see logging in with the score report information the first time to tie everything together to a candidate record.  But after that, you should only need to login with your CCO login or your CSCO number.  That information should be a unique enough value to guarantee non-overlapping logins.  You already require the CCIE candidate to have a valid CSCO number in order to take the written at a PearsonVUE testing center.  Why not use it as the sole login credential?


Tom’s Take

I’ve known too many CCIE candidates that have frantically tried to recall their written test information when the dreaded lab score report email comes.  I had my info saved in Chrome so it would auto-fill when I got to that page.  It worked until I changed laptops and didn’t import my Chrome info.   I had to dig through a filing cabinet to track down the information I needed to login.  Think about the CCIEs that have been certified for more than a decade.  Why should they be forced to produce information that has been lost to time?  My written score has been displaced by RSTP timers and EIGRP admin distance numbers.  Sure, I could keep that info somewhere safe (like a 1Password entry), but I think the better fix would be to bring the CCIE database into the 21st century and integrate it with all the other tools that Cisco provides.  You can stage the migration over the course of a few months.  Even just allowing your CCO login to access the CCIE portal would be a huge step forward.  I know this is a delicate process that has been going on for many years.  But the process is broken and silly and it’s time that someone fixed it.

 

IP Addresses in Entertainment

Fake IP

Every time I sit down to watch a TV show or movie and they mention computers or hacking, I get amused.  I know that I’m probably going to see some attempt to make computer hacking look cool or downright scary.  Whether it be highly stylized like Hackers or fairly accurate like the power plant hack in The Matrix Reloaded, there are always little details that get glossed over.  In many cases, one of these is the IP addressing of the systems themselves.  If the producers and writers of the film even choose to show an IP address on the screen, it’s usually so wrong that I laugh at a totally inappropriate moment of drama.

The practice of using fictitious numbering schemes for things in entertainment goes back several decades.  The first known instance of a movie using a fake number for something was in Panic in Year Zero back in 1962.  For the first time, the writers used a fictitious phone number starting with 555 instead of a real telephone number.  Even though 555 prefixes were used for things like directory assistance, they weren’t widely deployed.  As such, the 555 prefix became synonymous with a “fake” phone number.  555-0100 through 555-0199 are the only official numbers in that range set aside for fictitious use, however many people still associate that prefix with a phone number that won’t work in the real world.

Hollywood has been trying for some time to come up with IP addresses that look real enough to pass the sniff test but are totally false.  Sometimes that works.  Other times, you end up with Law and Order.  In particular, the SVU flavor of that show has been known to produce IP address ranges that don’t even come close to looking real.  This page documents a couple of the winners from that show when the police start tracing an offender by their IP address.  Some of them look almost real.  Others seem to have an octet that jumps above 255.  Still others have 4-digit octets or other oddities that don’t quite measure up.  Sure, it heightens the suspense when people can see what the detectives are doing, but for those of us that know enough to be dangerous, it pulls you out of the moment.  It would be like watching ER and hearing the doctors start talking about brain surgery, only to start cutting open a patient’s arm to get to it.

TCP/IP has a large number of address ranges that can be used in a fictitious manner. For instance, Class E experimental addresses (240.0.0.0/4) were set aside and hard coded into most OSes as unavailable.  The address range for example use and documentation purposes 192.0.2.0/24 can also serve as a safe fictitious range.  Then there’s RFC 1918.  These addresses are used for private network ranges and must be NATed to work correctly on the public internet due to their non-routability.  These would be perfect for use in movies, as they represent networks that most people use daily.  They would look believable to those of us that know what to look for.  However, I think the producers and writers avoid doing that because of the inherent curiosity of people.

The greatest example of this comes courtesy of Tommy Tutone.  The band hit radio gold with their song “867-5309/Jenny” back in 1982.  Unlike 555, 867 is a widely used prefix code in the North American Numbering Plan (NANP).  There are numerous stories of people that have received that phone number and been cursed with popularity.  One story from Brown university tells of unsuspecting freshmen that move into the dorm room with that telephone number.  The phone calls never stop until a request is made to shut down the line.  Even back in 1982, the regional Bell companies were seeing huge spikes in telephone calls to that one number.  In many cases, they had to disconnect it in order to keep the traffic to a reasonable level.  If you’re curious, you can hear some of the messages left for the unfortunate possessors of that cursed number over at http://www.jennynetwork.com

People are compelled to try things they see in movies.  This article in the Chicago Tribune talks about the writer memorizing a realistic looking number from a movie and going home to call it several times before giving up.  The movie Magnolia included the real number 877-TAME-HER which the movie studio used to record Tom Cruise giving an in-character speech about his system for the purposes of marketing.  That’s all well and good in the real world when someone gets a few occasional prank calls or other harmless issues.  What happens in a computer network when someone sees a 10.0.0.0/8 address on TV and then decides to try and hack it?  What if they call the police and say that the computer address of a murder or a predator is on their network?  This can cause huge issues for network admins.  The nightmare of trying to explain to people that just because the Gibson in Hackers 3 is at 192.168.1.2 doesn’t mean they get to assault the mail server every day would get old really fast.  And when it comes to IPv6, the opportunity for even more trouble arises.

I was a long-time player of the MMORPG City of Heroes.  One of the reasons that I liked playing it so much was the lore and back story to the world.  I was one of the players that read all of the fluff text to get a better sense of what the writers were trying to do.  Imagine my surprise when I was playing a new mission a several months ago and ran across a little Easter egg.  One of the writers decided that the imaginary world of Paragon City had long ago ran out of IPv4 addresses and decided to upgrade to IPv6.  One of the consoles in the game had a reference to an IPv6 address – 3015:db6:97c4:9e1:2420:9b3f:073:8347.  I was excited.  Finally, someone in the entertainment industry realized we were running out of IPv4!  Then I started thinking.  Right now, the allocations to the RIRs all start with 2001.  Eventually, once we get the intergalactic Internet up and running, we might end up getting into the 3000 range.  It might be a hundred years before the address above is allocated to someone.  By then, most everyone will have forgotten City of Heroes ever existed.  Putting real IPv6 addresses in movies and on TV does run the risk of having people “hacking the Gibson” when you least expect it.  I think you’ll see that even in those far-flung ranges, the odds of a fake address on TV coinciding with a real IPv6 server or workstation address, even on a global scale, is pretty slim.  Despite the fact that all our systems will be globally reachable, the IPv6 address space is so large that no two systems are likely to even overlap.  Add in neighbor discovery, duplicate address detection, and the uniqueness of a MAC address (which forms the basis of EUI-64 addressing and SLAAC) and you can see how difficult it would be.


Tom’s Take

In case the name of my blog didn’t warn you…I’m a nerd.  When I see something inaccurate in a movie, I tend to point it out.  That’s why I don’t watch Armageddon any more.  I understand that writers and directors are trying to entertain people.  When you’re trying to do that, sometimes the details get sacrificed for the sake of telling a good story.  However, when it comes to something that can represented easily for the most realistic look possible, the creative team involved should do that.  Whether it be the night sky in Titanic or the address of the mainframe in a techno thriller, I want the people that care about the production values of a movie to show me how much they care.  With the advent of IPv6, I think creating fake addresses to put in movies and other entertainment will be easier.  Given the vast range of available space it doesn’t take too much effort to pull out something “techy sounding” to put in a movie script.  Trust me, the nerds out there will thank you for it.

Mountain Lion PL-2303 Driver Crash Fix

Now that I’ve switched to using my Mac full time for everything, I’ve been pretty happy with the results.  I even managed to find time to upgrade to Mountain Lion in the summer.  Everything went smoothly with that except for one little hitch with a piece of hardware that I use almost daily.

If you are a CLI jockey like me, you have a USB-to-Serial adapter in your kit.  Even though the newer Cisco devices are starting to use USB-to-mini USB cables for console connections, I find these to be fiddly and problematic at times.  Add in the amount of old, non-USB Cisco gear that I work on regularly and you can seem my need for a good old fashioned RJ-45-to-serial rollover cable.  My first laptop was the last that IBM made with a built-in serial port.  Since then, I’ve found myself dependent on a USB adapter.  The one that I have is some no-name brand, but like most of those cables it has the Prolific PL-2303 chipset.  This little bugger seems to be the basis for almost all serial-to-USB connectivity except for Keyspan adapters.  While the PL-2303 is effective and cheap, it’s given me no end of problems over the past couple of years.  When I upgraded my Lenovo to Windows 7 64-bit, the drivers available at the time caused random BSOD crashes when consoled into a switch.  I could never nail down the exact cause, but a driver point release fixed it for the time being.  When I got my Macbook Air, it came preinstalled with Lion.  There were lots of warnings that I needed to make sure to upgrade the PL-2303 drivers to the latest available on the Prolific support site in order to avoid problems with the Lion kernel.  I dutifully followed the directions and had no troubles with my USB adapter.  Until I upgraded to Mountain Lion.

After I upgraded to 10.8, I started seeing some random behaviors I couldn’t quite explain.  Normally, after I’m done consoling into a switch or a router, I just close my laptop and throw it back in my bag.  I usually remember after I closed it and put it to sleep that I need to pull out the USB adapter.  After Mountain Lion, I was finding that I would open my laptop back up and see that it had rebooted at some point.  All my apps were still open and had the data preserved, but I found it odd that things would spontaneously reboot for no reason.  I found the culprit one day when I yanked the USB adapter out while my terminal program (ZTerm) was still open.  Almost instantly, I got a kernel panic followed by a reboot.  I had finally narrowed down my problem.  I tried closing ZTerm before unplugging the cable and everything behaved as it should.  It appeared the the issue stemmed from having the terminal program actively accessing the port then unplugging it.  I searched around and found that there were a few people reporting the same issue.  I even complained about it a bit on Twitter.

Santino Rizzo (@santinorizzo) heard my pleas for sanity and told me about a couple of projects that created open source versions of the PL-2303 driver.  Thankfully, someone else had noticed that Prolific was taking their sweet time updating things and took matters into their own hands.  The best set of directions to go along with the KEXT that I can find are here:

http://www.xbsd.nl/2011/07/pl2303-serial-usb-on-osx-lion.html

For those not familiar with OS X, a KEXT is basically a driver or DLL file.  Copying it to System/Library/Extensions places in in the folder where OS X looks for device drivers.  Make sure you get rid of the old Prolific driver if you have it installed before you install the OS PL-2303 driver.  Once you’ve run the commands list on the site above, you should be able to plug in your adapter and then unplug it without any nasty crashes.  One other note – the port used to connect in ZTerm changed when I used the new drivers.  Instead of it being /dev/USBSerial or something of that nature, it’s now PL2303-<random digits>.  It also changed the <random digits> when I moved it from one USB port to another.  Thankfully for me, ZTerm remembers the USB ports and will try them all when I launch it until it find the right adapter.  There is some discussion in the comments of the post above about creating a symlink for a more consistent pointer.


Tom’s Take

Writing drivers is hard.  I’ve seen stats that say up to 90% of all Windows crashes are caused by buggy drivers.  Even when drivers appear to work just fine, things can be a little funny.  Thankfully, in the world of *NIX, people that get fed up with the way things work can just pull out their handy IDE and write their own driver.  Not exactly the easiest thing in the world to do but the results speak for themselves.  When the time comes that vendors either can’t or won’t support their hardware in a timely fashion, I take comfort in knowing that the open source community is ready to pick up the torch and make things work for us.

2012 Depleted, Time to Adopt ::2013

It’s been 366 days since my last post about goals for 2012.  How’d I do on my list for the past year?

1. Juniper – Dropped the ball on this one.  I spent more time seeing Juniper gear being installed all over the place and didn’t get my opportunity to fire up the JNCIA-Junos liked I wanted.  I’m planning to change all that sooner rather than later.  Doug Hanks even gave me a good head start on immersion learning of the MX Series.

2. Data Center – I did get a little more time on some Nexus gear, but not nearly enough to call it good for this goal.  Every time I sat down to start looking at UCS, I kept getting pulled away on some other project.  If the rumblings I’m hearing in the DC arena are close to accurate, I’m going to wish I’d spent more time on this.

3. Advanced Virtualization – While I didn’t get around to taking either of the VCAP tests in 2012, I did spend some more time on virtualization.  I was named a vExpert for 2012, gave a virtualization primer presentation, and even attended my first VMUG meeting.  I also started listening to the vBrownBag podcast put on by ProfessionalVMware.  They have a ton of material that I’m going to start reviewing so I can go out and at least take the DCD test soon.

4. Moving to the Cloud – Ah ha! At last something that I nailed.  I moved a lot of my documents and data into cloud-based storage.  I leveraged Dropbox, Skydrive, and Google Docs to keep my documentation consistent across multiple platforms.  As I continue forward, I’m going to keep storing my stuff in the big scary cloud so I can find it whenever I need it.

Looks like I’ve got two fails, one tie, and one win.  Still not the 50% that I had hoped for, but it’s funny how real life tends to pull you in a different direction that you anticipate.  Beyond attending a few more Tech Field Day events and Cisco Live, I also attended a Cisco Unified Communications Partner Beta Training launch event and the Texas IPv6 Task Force Winter Summit.  It was this last event that really got me thinking about what I wanted to do in the coming year.

I think that 2013 is going to be a huge year for IPv6 adoption on the Internet.  We’ve been living in the final depletion phase of IPv4 for a whole year now.  We can no longer ignore the fact that IPv6 is the future.  I think the major issue with IPv6 adoption is getting the word out to people.  Some of the best and brightest are doing their part to talk to people about enabling IPv6.  The Texas IPv6 Task Force meeting showed me that a lot of great people are putting in the time and effort to try and drive people into the future.  However, a lot of this discussion is happening outside of people’s view.  Mailing lists aren’t exactly browsing-friendly.  Not everyone can drop what they’re doing for a day or two to go to a task force meeting.  However, people do have the spare time to read a blog post on occasion.  That’s where I come in.

In 2013, I’m going to do my part to get the word out about IPv6.  I’m going to spend more time writing about it.  I’m going to write posts about enabling it on all manner of things.  Hypervisors, appliances, firewalls, routers, and even desktops are on the plate.  I want to take the things I’m learning about IPv6 and apply them to the world that I work in.  I don’t know how service providers are going to to enable IPv6.  However, I can talk about enabling CallManager to use IPv6 and register IP phones without IPv4 addresses.  I can work out the hard parts and the gotchas so that you won’t have to.  I’ve already decided that any presentation that I give in 2013 will be focused on IPv6.  I’ve already signed up for one slot later in the year with a possibility of having a second.  I applied for a presentation slot at the Rocky Mountain IPv6 Task Force meeting in April.  I want to hone my skills talking to people about IPv6.  I’m also going to try and make a lot more blog posts about IPv6 in the coming year.  I want to take away all the scary uncertainty behind the protocol and make it more agreeable to people that want to learn about it without getting scared off by the litany of RFCs surrounding it.  To that end, I’m going to start referring to this year as ::2013.  The more we get familiar with seeing IPv6 notation in our world, the better off we’ll be in the long run.  Plus, it gives me a tag that I can use to show how important IPv6 is to me.

A shorter set of goals this year doesn’t mean a more modest one.  Focus is a good thing in the long run for me.  Being an agent of change when it comes to IPv6 is something that I’m passionate about.  Sure, I’m still going to make the occasional NAT post.  I may even have some unnice things to say about vendors and IPv6 support.  The overall idea is that we keep the discussion focused on moving forward and making IPv6 more widely adopted.  It’s the least I can do to try and leave my mark on the Internet in some other way besides posting cat pictures or snarky memes.  It’s also a goal that is going to keep progressing and never really be finished until the lights are turned out on the last IPv4 webserver out there.  Until that fateful day, here’s hoping that ::2013 is a good year for all.

Marketing By Subtraction

After my posts on presentation tips, I had a couple of people ask me what I would like to see in a presentation.  While I’m kind of difficult to nail down when it comes to the things I’d like to see companies showing me when they get up to pitch something, there is one thing I absolutely would love to see go away in 2013.  I’m getting very tired of seeing marketing based solely on differential marketing.  In other words, your entire marketing message is “We’re Not Those Guys.”

I’ve seen a lot of material recently that follows this methodology.  There might be a cursory mention of features or discussion of capabilities, but even that usually gets framed as in the manner of pointing out what the other products don’t do.  Presentations, marketing guides, and even commercials do this quite a bit.  The biggest example that I’ve seen recently is this commercial by Samsung:

Note that while I use an iPhone, I really don’t take sides in the smartphone marketing battle.  People use what works for them.  However, Samsung has decided to make a marketing campaign that is short on features and long on “gotchas.”  This whole ad is focused on pointing out the difference in features between the two devices.  However, it does by way of concentrating on how the iPhone is bad or lacking rather than spending time talking about what their device has instead.  When the ad is over, I wonder if people are ready to buy Samsung’s product because it has awesome features or because it’s not an iPhone (or in this case, not something used by “those people”).

Could you imagine how this would play out if other mundane items were marketed in a similar manner?  Think about going into a grocery store and seeing ads for apples that say things like “Better taste than oranges!” or “No need to peel like other fruits!”  How about a pet store using marketing such as, “Buy a cat! Less mess than dogs!” or “Take home the superior four legged friend!  Dogs are 10 times friendlier than cats!”

We don’t market other items quite the same way we do in tech.  Even car manufacturers have finally moved away from solely marketing based of differentiation with competitors.  You don’t see as many commercials focused on brand-vs-brand arguments.  Instead, you see a list of features presented in tabular format or something similar.  Even though the feature sets are usually cherry-picked to support the producer of the marketing, there is at least the illusion of balance.

I think it’s time that companies start spending their budgets on telling us what their product does and spend much less time on telling me how they are different than their competitors.  Yes, I know that we will never really be able to eliminate competitive marketing.  There are just some things you can’t get away from.  However, buyers are much more interested in the features of what you’re selling.  If you spend your entire presentation telling me how your widget is better or faster or cheaper than the other company, the potential customer will walk away and be thinking about the other product.  Some might even be tempted to go try out the other product to see if your assertions are true.  In either case, you’ve shifted the discussion from something you control to something you can’t.  If your customers are spending the majority of their time talking about something that isn’t your product, you aren’t doing it right.  It takes a tremendous amount of faith to put your product’s capabilities out there and let the stand on their own.  If you’ve built it right or designed it as well as possible you shouldn’t be worried.  Instead, take that leap of faith and let me decide what works best for me.  After all, you don’t want me to be left with the impression that the only thing unique about your product is that your aren’t your competitors.

Learn Why Things Work

As a nerd, I can safely say that Star Trek II: The Wrath of Khan is the best of all the Star Trek films.  It has great character development, and engaging story, and even some fun dialog.  One throwaway line in particular caught my attention recently and made me think about certifications and studying.

In the first big dramatic scene, the bad guy (Khan) has the good guy (Kirk) outgunned and at his mercy.  While scrambling to find a solution to this unwinnable situation, he settles on the gambit of hacking the bad guy’s ship.  When the green lieutenant asks the good guy why he needs the secret code (prefix code) for the bad guy’s ship, the good guy admonishes the lieutenant with the following line:

You have to learn why things work on a starship.

In a movie filled with other great quotes and scenes, this one throwaway line goes unnoticed.  I even had to find a copy of the script to be sure I got it right.  But when it comes to certification, that line holds a lot of power.  You might even say that it sums up the totality of the certification process, as well as the reason why some people that pass still have trouble in the real world.

Everything in networking, or IT for that matter, follows a set of rules.  Programs execute based on a set of instructions.  Electrical signals follow the laws of physics.  Unlike the Matrix, these rules are very seldom flexible.  The same inputs almost always produce the same outputs.  There is no magic or mystical explanation for these behaviors.  Everything does what it does because of these rules.

When you take the time to learn why a protocol behaves in a specific way or why a device  exhibits a certain erratic behavior during troubleshooting, you have a more complete understanding of all the factors that go into that behavior.  Just like in the above example, the good guy is the old veteren of many starship voyages.  He knows why ships behave they way they do.  Because he knows why the ships have a prefix code, he knows how to exploit that behavior against someone that doesn’t know in order to escape the situation.  Someone without knowledge of why things are the way they are would miss that as a possibility simply because it doesn’t exist to them.

Far too often, people seeking certification don’t want to know why something behaves in the way that it does.  They simply want to know the answer to the question or they want to learn the trivia facts in order to satisfy the multiple choice part of the exam.  When it comes time to apply that knowledge those students that don’t understand things beyond fact memorization can’t cope.  For example, look at a simple layer 2 bridging loop.  Most people that have experienced this will tell you simply that it takes the entire network down. Easy enough to explain why it’s bad.  But why does it do this?  You have to dig a little deeper to find the answer.  You have to understand that bridges forward unknown unicast frames out of every port except the ingress port.  Then you have to know there isn’t a method for layer 2 Time To Live (TTL) so those unicast frames can eventually age out of the network.  Finally, you have to know that the impact of all those unicast frames being constantly forwarded out of the bridge eventually overwhelms the CPU and causes the bridge to stop forwarding traffic of all kinds because it can’t keep up.  There’s a lot of why in that explanation.  Learning all of it means you know a myriad of ways to prevent the problem from happening in the first place.  Knowing why means when you develop a new protocol down the road you can address those things and fix them (hello L2 TTL!)

If you skip the why, you miss out on a huge part of troubleshooting and configuration.  Every command has a reason for existing.  Every setting has a valid excuse for being included.  Taking the extra time to learn about those things is what separates the good network rock stars from the rest of the pack.  The dedication and time invested in learning something that completely really shows to potential employers and people conducting technical interviews.  But don’t take my word for it.  Instead, listen to CCIE Instructor Marko Milivojevic:

I couldn’t have said it better myself.

Lightening The Linksys Load

If you’re in the mood to pick up an interesting present for someone this holiday season, you may be in luck. Rumor has it that Cisco is looking to offload Linksys. Again. According to the rumors, Cisco is shopping Linksys to manufacturers of TVs for a lot less than the $500 million they paid for it a decade ago. This isn’t the first time that there have been rumors about the demise of Linksys. A year and a half ago, I even had something to say about it. My opinion of the situation hasn’t really changed from that previous blog post. What has changed is the way that Linksys has been marketed.

Cisco has known for a while that it’s fighting a losing battle in the consumer market. Cheaper vendors have been attacking them on price. Premium vendors have been offering significantly more advanced devices. It also doesn’t help that the Linksys brand itself has been murky for the past several months. Cisco has attached the Linksys name not only to the shrink wrapped boxes you find in your favorite dying big box retailer but also to many of their small business products as well. You can now buy a Linksys phone system, switches, wireless APs, and routers. Many of these products used to carry a Cisco SMB brand but were rebranded in order to give Linksys a bit more robust feel. This was probably a bad decision on Cisco’s part. No matter which piece of equipment you choose to carry the Linksys logo, most of your SMB customer base is going to have visions of trying to buy a wireless router at Best Buy. I had a very similar conversation a few years ago with D-Link. One of their reps came in to try and sell me on their enterprise line of switches. At this point I said to myself, “D-Link makes enterprise gear?!?” I was informed they were a large vendor of this type of gear. They were rather popular in Europe, according to the rep. My response? “So is David Hasselhoff.” No matter what you build with that brand, you’re still going to conjure images of your consumer brand. Linksys shares that same fate.

Cisco has made no secret that they want to start moving toward software as the core of their network offerings. When John Chambers finally retires in a couple of years, he wants to be sure that he hit his last market transition. In order to make the voyage to the Land of Software he’s going to have to shed some weight. I think Linksys is the biggest piece of that weight. After the Flip and ümi closures last year, Chambers needed some breathing room before turning the lights out in other areas. Linksys still holds enough value to fetch a fair price on the open market. Seeing as it’s being shopped to TV manufacturers this would be an excellent opportunity for a mid-market player to catch up to Samsung or Vizio in terms of network offerings. All these devices are going to need to be networked. Most of them come with wireless cards today. With 802.11ad still too far off to be of useful impact today for short-range high speed networking, manufacturers are going to need a stop-gap solution today. Likewise, Cisco has to make the decision whether or not to invest the R&D in the brand to get to those new protocols and devices. Most consumers today own an 802.11n wireless router of some kind. Those people are unlikely to buy a new device until there’s a protocol change or some kind of massive increase in throughput. And even when it does come time to make that upgrade, users are unlikely to spend the kind of money that it would take to recover the cost of development. If Cisco really wants to concentrate on software in the future, doubling down on unprofitable hardware today makes little sense.


Tom’s Take

My Cisco Valet Plus, which is really just a rebranded Linksys WRT310N, now sits on my bookshelf unused. I finally decided to move on to something that fits my usage profile better. I settled on an Apple Airport Extreme. I now have dual band radios, guest access, and a USB port for my Time Machine backups. I might have been able to get a lot of this in a Linksys device, but I grew tired of trying to figure out which one I needed. There was also a lot of feature similarity between the hardware that only seemed to be limited by firmware instead of hardware. For better or worse, I didn’t buy Linksys. Cisco is hoping that someone will buy it from them now. That buyer is going to get an entrenched consumer networking product that has some life left in it. As for Cisco, they get to rid themselves of a peculiar albatross that has weighed heavily on them as of late. Lets hope the Linksys Diet pays off.