Cisco IronPort and Exchange 2016

If you have been following my blogs over the years you should be aware that I’ve always been using Exchange Edge Transport servers in front of my Mailbox servers for message hygiene purposes. My last (well known) environment looked like this:


There are two Mailbox servers (Exchange 2013 and Exchange 2016) and two Edge Transport servers (also Exchange 2013 and Exchange 2016). MX records point to both Edge Transport servers and there are two Edge Synchronizations. And the Edge Transport servers were capable for DKIM signing (as posted in a previous blogpost), but lacked DKIM verification and DMARC validation.

The most important part in the Edge Transport server is the Real Time Blocklist, configured to use Spamhaus for connection filtering. While this works pretty well (there still is quite some spam that gets delivered into mailboxes) there is always room for improvement. I have been looking at cloud solution, but they didn’t always deliver what was expected.

A couple of my customers are using Cisco Email Security (previously known as IronPort) solutions on-premises and are happy with it, so time to start testing a Cisco Email Security appliance (CES) in my own environment.

Setting up the CES

The CES is available as a physical device, but also as a virtual device. Unfortunately (says the Microsoft consultant in me) only as a vmware VM, but since I also have a vmware server running that’s not a problem. Deploying the virtual machine is because of the OVF solution a piece of cake. Connect three NICs (management, internal and external) and you’re good. My Cisco contact told me it’s a common practice to use a one arm deployment, but I did a two arm deployment, resulting in a configuration like this:


The management network is (by default), the internal network is configured to use my network while the external network is configured with the address. The FQDN of the device is, in DNS this points to the above mentioned IP address and I have PTR records configured for this IP address.

Afther the initial setup (where entering the license file via PUTTY in the CLI was the most challenging) you can continue with the System Settings in the GUI. The default domain is, enter a reporting address and a time server as shown in the following screenshot:


After entering the system settings you can continue with the network configuration. Enter a default gateway (on the public interface), a public and internal IP address and enter a forwarding address for inbound messages (i.e. the Exchange 2013 and Exchange 2016 servers) as shown in the following screenshot:


The last step is to configure the message security options like enabling the Reputation filtering, IronPort anti-spam, Sophos anti-virus and outbreak filters as shown in the following screenshot:


After reviewing the configuration you’re good to go and once accepted the device configures itself. This took only a few minutes, and I immediately started receiving configuration messages from the CES. Some of these made no sense, it looks like the device starts sending out messages before the device is fully configured, but at least it worked well.


The next step is to create a Send Connector in the Exchange configuration, using the CES as a smarthost. All outbound mail is routed through the CES, since this has a proper FQDN, IP address and PTR record other servers on the Internet will accept my email messages.

Adding additional domains

Besides my test domain I want my and domains to use the CES. First is to add the domains in the Recipients Address Table (RAT) so that the CES will accept messages for this domain. The second (and last) step is to configure an SMTP route for these domains so the messages will be delivered on my Exchange servers. Note to self: use the commit changes button after entering the domain configuration data 🙂

When checking inbound email on my platform (using Remote Connectivity Analyzer) you can clearly see that mail is going through the CES:


Message Hygiene

To understand message hygiene in the CES we have to take a closer look at the mail flow in the CES. This is called the Email pipeline and consists of three parts:

  • Receipt – this is the initial step in receiving a message, i.e. accepting the connection, check for policies and validate the recipient
  • Work queue – when connected the message enter the work queue where filtering, safelist/blocklist, anti-spam/anti-virus, outbreak filtering and quarantining takes place.
  • Delivery – responsible for delivering the incoming message to the Exchange server.

One of the most important parts on any email security solution is connection filtering, you want to make sure that you only accept messages from trusted sources. Messages coming from sources known as spammers should not be accepted. On an Exchange Edge Transport server you can configure Realtime Block Lists (RBL) and I often use SpamHaus for this, as explained in my blogpost about configuring the Edge Transport Server.

The CES is using Sender Reputation Filtering to achieve this. Sender Reputation Filtering is using SenderBase Reputation Service which is using the SenderBase affiliate network. The SenderBase Reputation Service assigns a SenderBase Reputation Score (SBRS) to email senders based on complaint rates, message volume statistics, and data from public blacklists and open proxy lists. The SenderBase Reputation Score helps to differentiate legitimate senders from spam sources. The SBRS can vary between -10 (most likely to be spam) to +10 (most likely to be legitimate).


After working with this for a couple of week now (in default configuration) I have to admit it is working extremely well. I haven’t received any spam messages so far, the only message I don’t want to receive are legitimate messages from primarily vendor sales departments.


By default, the CES is configured with a self-signed certificate. This certificate is only used for accessing the CES (for management purposes). To use TLS on this server you have to request (or import) a 3rd party SSL certificate.

After importing the SSL certificate you have to configure the listener and the mail flow policies on the Host Address Table (HAT). When configured you can use the site to check if your site is TLS ready:


If you check the incoming TLS messages (the next day) you can see how many TLS encrypted messages are received. Personally I am a bit surprised that I still received 21 unencrypted messages yesterday (an average Tuesday).



Reporting is always interesting, and the CES sends out reports (in PDF) every day. One of these reports is about incoming messages. As can be seen in the following screenshot a lot of messages are blocked by the Sender Reputation Filtering:


In the same PDF you can see an overview of the sending (threat message) domains:


Outbound messages

The CES can (should?) also be used for outbound messages. The mailflow in my environment is changed, the Edge Transport servers are no longer used. Instead, a Send Connector is created and the CES is configured as a smart host on the Send Conector.

During installation, the 2nd network interface was configured to relay outbound messages, and the FQDN of outbound messages is configured to use so outbound messages appear to come from

I have configured a reverse DNS entry, so when using I can check if this is correct:


So, when a receiving SMTP host does a reverse lookup on my sending IP address they will see that there’s a match with my FQDN. So far I haven’t heard any complaints about messages not being delivered 🙂


The Exchange Edge Transport servers can be used for connection filtering and content filtering using keywords can be configured as well. Besides this the Edge Transport servers are not really an anti-spam solution. Most of the times I see Edge Transport servers they are used as a mail relay server sitting in the network’s DMZ.

For message hygiene there are several solutions, and the last couple of weeks I have been playing with the Cisco Email Security appliance (running on Vmware). I must say, I am VERY IMPRESSED by the appliance. Installation was very easy to do, and using the ESA (Email Security Appliance) User Manual (consisting of 1216 pages 🙂 ) you can do a real deep dive into message hygiene.

At this moment I have an almost default configuration for inbound and outbound mailflow (including multiple domains and mailboxes) and I haven’t seen any spam since the installation.

In the upcoming blog posts I will go more into details about for example configuring anti-spam, DKIM signing, DMARC etc. using the Cisco Email Security appliance.

Exchange 2016, backup and recovery databases

Last week I got a request from a customer. A long time ago I posted a blogpost on Exchange 2010 recovery databases, but after the customer migrated to Exchange 2016 his procedure around recovery databases didn’t work anymore. His request was basically to rewrite my blogpost.

For this blogpost I have a pretty simple Exchange 2016 Mailbox server, configured with one Mailbox database which is stored on a dedicated disk, and I’m using Windows Server Backup to backup the entire Mailbox database disk (VSS full backup).

Don’t pay too much attention to the naming of my Exchange server and the Mailbox database I’m using here. In fact, this is an Exchange 2016 hybrid server I’m misusing for the purpose of this blog Smile

Recovery database

You can restore a mailbox database to its original location and mount again, but you can also use a Recovery Database to restore and recover your data. A recovery database is a mailbox database that can be mounted on your Exchange server, but it is not visible for regular users but only for the Exchange administrator. The Exchange administrator can access this recovery database and recover data, for example create a PST of a particular mailbox in this database.

When restoring a database from backup, select the restore option and follow the wizard. When you reach the Select Recovery Type window select Applications as shown in the following screenshot.


Continue reading Exchange 2016, backup and recovery databases

Windows Server 2016 Hyper-V quickly fills up system disk

Recently I had to replace my two lab servers, so I bought two brand new HP DL360-Gen9 servers. Lots of memory and a number of disks and processor capacity. Two weeks after installing Windows 2016 Hyper-V I noticed that my system disk (C:\ drive, approx. 185 GB) was filling up rapidly.


Initially I thougt it was the paging file (with 192 GB internal memory this can be an issue) but this was not the case since the paging file was located on drive D:\

Further investigation revealed that most data was located in the directory C:\ProgramData\Microsoft\Windows\Hyper-V\Virtual Machines, where all VM related files are located (except the virtual hard disks which were located in D:\Hyper-V\Virtual Hard Disks). It turned out to be very dynamic data located in .VMRS file. When a VM was turned off the VMRS file was gone, as soon as the VM was turned on again dir VMRS file was allocated again, and the size of the file was identical to the amount of memory of the Virtual Machine as can be seen in the following screenshot:


Next I’ve been looking at the smart paging option in Hyper-V, but this only makes sense when using dynamic memory, which was not the case in my environment (VMs were running Exchange 2013/2016).

Production snapshots are new in Windows 2016 Hyper-V. Production snapshots use VSS to create a snapshot (where the traditional snapshots create a system state using .VSV and .BIN files) so that would make sense in my scenario. But disabling snapshots at all on a VM basis didn’t make any difference, and the .VMRS files were still created.

The last option I had was the Automatic Stop Action option in Hyper-V (on a per VM basis). Using this option you can control what happens when the host shuts down. By default it is set to Save the virtual machine state, so when the Hyper-V host shuts down the entire VM is saved at that particular moment. To achieve this, space on disk is reserved equal to the amount of memory used by VM. Other options here are Turn off the virtual machine and Shut down the guest operating system.


Bingo, this was my issue. Save state will certainly have performance benefits, but I prefer to use the shut down option in my lab environment. After changing this on (most of) my VMs I have plenty of free space on my system disk Glimlach

This mailbox database contains one or more mailboxes

After moving all mailboxes from a mailbox database to other mailbox databases (both in Exchange 2016), including archive and arbitration mailboxes the mailbox database still cannot be deleted. Trying to remove the mailbox database still generates the following error message:

This mailbox database contains one or more mailboxes, mailbox plans, archive mailboxes, public folder mailboxes or arbitration mailboxes, Audit mailboxes. To get a list of all mailboxes in this database, run the command Get-Mailbox -Database <Database ID>. To get a list of all mailbox plans in this database, run the command Get-MailboxPlan.


Get-Mailbox -Arbitration or Get-Mailbox -Archive doesn’t return anything.

Exchange 2016 introduced a new type of mailbox, the auditlog mailbox. This can be returned by the Get-Mailbox -Auditlog command:


Move this auditlog mailbox to another mailbox database and the old mailbox is now fully empty and can be deleted.


A blue screen on your Windows box, is there anyone that has never seen it? One place you don’t want to see this is on your Exchange server.

While upgrading 3 Exchange 2013 CU12 servers for a customer to Exchange 2013 CU15 I experienced a blue screen while updating the UM components, resulting in the following screen:


A quick search on Google (search on “swin1.sys”) revealed that McAfee was the culprit. I’m not a fan of installing (file level) anti-virus software on an Exchange server, and IMHO it’s not needed when you have a properly secured environment.

I was successful installing CU15 on the Edge Transport servers earlier, but it turned out that these servers were not running McAfee software.

Uninstalling the McAfee agent is not a big deal, just a matter of deselecting the server in the EPO console. The McAfee Solidifier didn’t want to uninstall, not via the EPO console nor via Add/Remove Programs.

According to the McAfee knowledgebase article KB75902 you can uninstall this software using a command line with the following commands:

sc stop scsrvc
sc delete scsrvc
sc delete swin
"\Program Files (x86)\McAfee\Common Framework\Mctray.exe" unloadplugin=scormcpl.dll
del /Q "C:\WINDOWS\system32\drivers\swin.sys"
rmdir /S /Q C:\Solidcore
rmdir /S /Q "C:\Program Files\McAfee\Solidcore"
rmdir /S /Q "C:\ProgramData\McAfee\Solidcore"
reg delete "HKLM\SOFTWARE\Network Associates\ePolicy Orchestrator\Application Plugins\SOLIDCOR5000_WIN" /f
reg delete "HKLM\SOFTWARE\Classes\Installer\Features\4E9BD2348836F234A9BD168E87F25439" /f
reg delete "HKLM\SOFTWARE\Classes\Installer\Products\4E9BD2348836F234A9BD168E87F25439" /f
reg delete "HKLM\SOFTWARE\Microsoft\Windows\CurrentVersion\Uninstall\{432DB9E4-6388-432F-9ADB-61E8782F4593}" /f

After running these commands and a reboot I was able to finalize the installation of Exchange 2013 CU15.