cc/td/doc/product/rtrmgmt/vpnsc/mpls/1_1
hometocprevnextglossaryfeedbacksearchhelp
PDF

Table of Contents

Administering Customer Edge Routers

Administering Customer Edge Routers

This chapter provides the fundamental concepts and considerations, as well as our recommendations, for administering customer edge routers (CEs) in a service provider environment. Before MPLS VPN Solution software can be appropriately deployed to deliver services to customers, the question of whether the CEs are to be managed by the service provider or not must be answered.

Unmanaged CE Considerations

One of the options available to the service provider is to not manage the CEs connected to the service provider network. For the service provider, the primary advantage of unmanaged CEs is administrative simplicity.

If the CEs are unmanaged, the provider can use IPv4 connectivity for all management traffic. MPLS VPN Solution software is not employed for provisioning or managing unmanaged CEs.

Figure 6-1 shows a basic topology with unmanaged CEs. Note that the network management subnet has a direct link to the service provider MPLS core network.


Figure 6-1: Service Provider Network and Unmanaged CEs


Regarding unmanaged CEs, service providers should note the following considerations:

There is no IP connectivity between a PE and an unmanaged CE. Thus, there is no access to the unmanaged CE via SNMP, Telnet, and so forth. The service provider cannot view the configuration or the traps of the unmanaged CE.

Managed CE Considerations

The alternative to unmanaged CEs is managed CEs, that is, customer edge routers managed by the service provider. Managed CEs can be wholly within the service provider's administrative domain or co-managed between the provider and the customer, although CE co-management poses a number of ongoing administrative challenges and is not recommended.

For information on how you define a CE as a managed CE, refer to the "Adding the Customer Edge Routers to a Site" section.

Regarding managed CEs, service providers should note the following considerations:

The following sections discuss the concepts and issues required for administering a managed CE environment.

What Is the Network Management Subnet?

The network management subnet begins with the MPLS VPN Solution workstation and the Cisco IP Manager workstations connected on a LAN or subnet.

The MPLS VPN Solution network management subnet is required when the provider's service offering entails the management of CEs. Once a CE is in a VPN, it is no longer accessible by means of conventional IPv4 routing unless one of the techniques described in this chapter is employed.

Figure 6-2 shows the network management subnet and the devices that may be required to connect to it:


Figure 6-2: The MPLS VPN Solution Network Management Subnet


Access to VPN Issues

The core issues with regard to gaining access to VPNs are as follows:

MPLS VPN Solution does not handle any of these responsibilities---doing so must be designed and implemented by the service provider.
Before you provision a CE in the MPLS VPN Solution software, you might be able to reach the CE via IPv4 connectivity, but the moment the product deploys a task, you cannot reach that CE any more---unless you have first implemented the network management subnet.

The Network Management Subnet Implementation Techniques

The network management subnet must have access to Management CEs (MCEs), PEs, and the NetFlow Collector devices.

The network management subnet is appropriate---and necessary---only if there is an intent to have managed CEs connected via an in-band connection. In-band indicates a single link or permanent virtual circuit (PVC) that carries both the customer's VPN traffic, as well as the provider's network management traffic.

Management CE (MCE)

The network management subnet is connected to the Management CE (MCE). The MCE emulates the role of a customer edge router (CE), but the MCE is in provider space and serves as a network operations center gateway router. The MCE is part of a management site as defined in the MPLS VPN Solution software.

For information on defining a CE as an MCE within MPLS VPN Solution software, see the "Implementing the Management VPN Technique" section.

Management PE (MPE)

The Management PE (MPE) emulates the role of a PE in the provider core network. The MPE connects the MCE to the provider core network. An MPE can have a dual role as both a PE and the MPE.

The MPE needs access to the following devices:

Device Connectivity Function

    1. Customer Edge Routers (CEs)

Access from the network management subnet into the VPNs

Provision or change configuration and collect SA Agent performance data

    2. Shadow routers

Access from the network management subnet into the VPNs

A simulated CE used to measure data travel time between two devices

    3. Provider Edge Routers (PEs)

standard IP connectivity

Provision or change configuration

    4. NetFlow Collector

standard IP connectivity

Collect data

At the current time, MPLS VPN Solution recommends three main network management subnet implementation techniques:

The MPE-MCE link uses a Management VPN (see the "Management VPN Technique" section) to connect to managed CEs. To connect to the PEs and NetFlow Connector, the MPE-MCE link uses a parallel IPv4 link.
The MPE-MCE link uses the Extranet Multiple VPN technique (see the "Extranet Multiple VPN Technique" section) to connect to managed CEs. To connect to the PEs and NetFlow Connector, the MPE-MCE link uses a parallel IPv4 link.
In the Out-of-Band technique, the MCE has IPv4 connectivity (that is, not MPLS VPN connectivity) to all the CEs and PEs in the network (see the "Out-of-Band Technique" section). In this context, out-of-band signifies a separate link between PEs that carries the provider's management traffic.

The network management subnet technique the provider chooses to implement depends on many factors, which are discussed later in this chapter.

Management VPN Technique

The Management VPN technique is the default method provisioned by MPLS VPN Solution. A key concept for this implementation technique is that all the CEs in the network are a member of the management VPN. To connect to the PEs and NetFlow Collector, the MPE-MCE link uses a parallel IPv4 link. Figure 6-3 shows a typical topology for the Management VPN technique.


Figure 6-3: Typical Configuration for a Management VPN Network


When employing the Management VPN technique, the MPE-MCE link uses a management VPN to connect to managed CEs. To connect to the PEs and NetFlow Connector, the MPE-MCE link employs a parallel IPv4 link.

Each CE in a customer VPN is also added to the management VPN by selecting the Join the management VPN option in the service request wizard (see the "About Provisioning PE-CE Links in the Management VPN" section). The function of the management route map is to allow only the routes to the specific CE into the management VPN. The Cisco IOS supports only one export route map and one import route map per VRF (and therefore, per VPN).

As shown in Figure 6-3, a second parallel non-MPLS VPN link is required between the MPE and MCE to reach the PEs and the NetFlow Collector host.

For information on how to provision a Management VPN in MPLS VPN Solution software, see the "Implementing the Management VPN Technique" section.


Note Implementation of the Management VPN technique requires Cisco IOS 12.07 or higher.

Advantages

The advantages involved in implementing the Management VPN technique are as follows:

Extranet Multiple VPN Technique

A key concept for this network management subnet technique is that the MPE-MCE pair are part of all the customer's VPNs. When you a add new VPN to the Extranet Multiple VPN, you must create a service request each time a VPN is defined to add that VPN to the MPE-MCE pair, and thus to the network management subnet. To connect to the PEs and NetFlow Connector, the MPE-MCE link uses a parallel IPv4 link. Figure 6-4 shows a typical topology for the Extranet Multiple VPN.


Figure 6-4: Extranet Multiple VPN


In the Extranet Multiple VPN (sometimes referred to as the rainbow VPN), several security and access list considerations exist, but these considerations are centralized at the MPE and MCE devices.

The MPE includes the BGP routes to all customer routes. This should constrained such that only the CE subnet routes are imported to the interior gateway protocol.

Advantages

The advantages in implementing the Extranet Multiple VPN technique are as follows:

Out-of-Band Technique

The Out-of-Band technique does not employ a management VPN to manage the CEs. Out-of-band connectivity is provided by IPv4 links. Out-of-band signifies a separate link between PEs that carries the provider's management traffic. As shown in Figure 6-5, the MCE provides separation between the provider's routes and the customer's routes.


Figure 6-5: Out-of-Band Technique


The Out-of-Band technique has the advantage of being relatively simple to set up, and no management VPN is required. However, its disadvantages are that it is expensive since it requires an IPv4 connection to each CE. Also, due to the delicate staging requirements for this technique, the Out-of-Band implementation does have a high degree of complexity.

CE Staging Guidelines

This section summarizes the general considerations to take into account when staging CEs.

    1. Define the VPN in MPLS VPN Solution, and use the MPLS VPN Solution software to update the configuration of the PE and CE that supports it on the network management subnet.

    2. Go to Cisco IP Manager and define the CE object.

This assumes that all PE objects are already defined in Cisco IP Manager.

    3. Cisco recommends that you connect the CE (with no configuration---directly off the delivery truck) to a terminal server on the same LAN as MPLS VPN Solution.Inform Cisco IP Manager can about the terminal server and the port to which the CE is attached.

    4. Use a Cisco IP Manager template to configure everything on the CE except the interface toward the PE and the loopback interface that has the management address on it.

Use Cisco IP Manager to configure customer-facing LANs, customer-facing routing protocols, user names, passwords, VTY definitions, and so forth.

    5. Update Cisco IP Manager's definition of the CE object to reflect the changes made to user names and passwords.

At this point, you are ready to go to MPLS VPN Solution. In MPLS VPN Solution, it is possible to define the target to represent the CE in such a way that the synchronization with Cisco IP Manager works smoothly. Note that a well-chosen naming scheme helps until Cisco IP Manager and MPLS VPN Solution are more fully integrated.
It should not be necessary to provide MPLS VPN Solution user names and passwords, but it would still be a good idea to do so in case configuration file collection is required while the CE is still attached to the network management subnet. If you do provide MPLS VPN Solution user names and passwords, the optimal IP address would be the alias offered by the terminal server for access to the CE (not the address of the terminal server itself).

    6. In MPLS VPN Solution, provision normally, and request downloading of configlets to both the PE and the CE.

When the product uses Cisco IP Manager for downloading configlets, it uses the administrative information in Cisco IP Manager, including terminal server access for the CE. The PE provisions normally.

    7. The PE is now in the field, but configured for service; the CE is in the network management subnet, fully configured and ready to ship.

    8. Finally, update the object definitions in Cisco IP Manager and MPLS VPN Solution to reflect the fact that the CE has been shipped.

You can remove the terminal server information and replace it with the management IP address given by MPLS VPN Solution.

Securing the Management Network

If you use MPLS VPN Solution for IP allocation, you know the set of legal IP addresses for management access to CEs. Therefore, you can deny all packets that do not originate from an MPLS VPN Solution IP address pool. (If the network employs non-auto-picked IP addressing, augment the notion of "pool" to cover all legal IP addresses for a CE interface to a PE.) You can also limit access precisely to those hosts on the network management subnet that need it.

The CE access lists between IP pool addresses and the network management subnet hosts should also specify the required ports for access (using Telnet). It is important to limit the port numbers. Cisco IP Manager uses TFTP; MPLS VPN Solution uses SNMP when it can (see the "Using TFTP to Transport Router Configuration Files" section). Those three ports are the only permissible ones. Access to the Orbix process running on either the Cisco IP Manager or MPLS VPN Solution hosts should particularly be denied.

Cisco recommends the following access rules of type:

Apply these access rules outbound on the CE on its interface up to the PE so that only MPLS VPN Solution and Cisco IP Manager can send packets, and then only to management addresses. Additional rules of type are as follows:

These rules should apply on the CE as an input list on its link from the PE. Thus, only responses are allowed in---general CEs cannot start a session to the management machines---and then only from legal IP addresses.

Given these rules of type, only the CE can send packets into the network management subnet, and even those must be in response to a network management subnet query. Spoofing could be an issue, but for that Cisco recommends anti-spoofing access lists as part of the basic configuration of CEs at customer sites---deny all packets coming from within a site marked with a management address.) The CEs do not need the CE-PE link when returning management packets.

Another option is to suppress the network management subnet; that is, you can set up static addresses with /32 subnet masks on the PE---one for each host on the network management subnet needing to receive packets from CEs. At a minimum, that would be the MPLS VPN Solution host and the Cisco IP Manager host. No other routes need to be allowed into the VRF supporting the network management subnet.

Build the local entries in the VRF like this:

IP route VRF Management <MPLS VPN Solution Host/32 CE_address>
IP route VRF Management <CIPM Host/32 CE_address>

The term "VRF Management" is for illustration purposes only; MPLS VPN Solution builds all this and picks a name for the VRF.

To prevent injections of inappropriate routes, it is helpful to add this command:

IP route VRF Management 0.0.0.0/0 Null0

That is all you want to put in the local VRF table. From there, it dynamically learns all the routes to the other CEs.

However, you cannot prevent it also knowing a directly connected route for the link between this PE and the Management CE. You must protect against customer attempts to gain access to the Management CE. The access lists described above control only transit traffic across that CE.

Therefore, Cisco recommends that the PE have an access list applied outbound on the link to the CE in the following form:

permit packets to {MPLS VPN Solution Host, CIPM Host}
deny everything else

This is simple, and it means customers cannot gain access to the Management CE.

Cisco recommends the following:

    1. In the PE configuration file, enter the following commands:

    ip route vrf management MPLS VPN Solution host ip/32 <mce
    ip route vrf management cipm host ip/32 <mce
    
To dump unknowns, add this command:
    ip route vrf management 0.0.0.0/0 Null0
    

    2. Whenever possible, use statics on the Management CE too---use a static or set of statics covering legal management addresses, as discussed above.

If dynamic routing is absolutely required (meaning it is not known which addresses might be used for CE-PE links, which is not recommended), then you can use RIP. However, Cisco recommends doing so one way only: redistribute BGP into RIP on the PE, but do not redistribute back. MPLS VPN Solution makes two-way redistributions in such cases, so add the RIP configuration manually when setting this up. Route maps could apply here, but as noted, running dynamic routing is generally undesirable.

    3. The most important access lists are output and input lists on the Management CE.

The output access list: On the Management CE, connected to Link B (with access to the VPNs), make an output access list as follows:
     permit {MPLS VPN Solution host, CIPM host} to <pool
     deny all
    
The input access list is as follows:
     permit <pool to {MPLS VPN Solution host, CIPM host} with tcp-established
     deny all
    

    4. To protect the Management CE, create an output access list on the PE's link B interface:

     permit to {MPLS VPN Solution host, CIPM host}
     deny all
    

    5. If desired, also place an access list to protect the IPv4 link, depending on the service provider's own access needs to the network management subnet.


hometocprevnextglossaryfeedbacksearchhelp
Posted: Fri Apr 21 10:59:21 PDT 2000
Copyright 1989 - 2000©Cisco Systems Inc.