Remote debugging with Visual Studio

In a perfect software development environment, an engineer can design, develop, and debug on a single system. Conveniently, building and debugging a project can be accomplished a single key stroke: for example, pressing F5 in Microsoft’s Visual Studio. Unfortunately, many projects do not allow for local debugging. Some examples of this:

  • Resolving bugs which only occur on specific systems
  • Developing for a project which only runs on an operating system which is not a beneficial development system (e.g. Windows Home Server or simply an older version of Microsoft Windows such as Windows Vista or Windows XP)

While most software projects allow for simplified build and debug options via a software test-harness project or limited project build. There are typically times when remote debugging is required. Fortunately, Visual Studio offers a very robust remote debugger feature.

Requirements:

  • Microsoft Visual Studio 2013, 2010, 2008, or 2005 (VS Express not supported)
  • Remote Tools for Visual Studio
  • A host (development) PC running Windows and Visual Studio
  • A target (debug) PC running Windows
  • Your software project, symbol files, and source code

One-time setup of host system:

Setting up the host system is fairly easy. Simply install Visual Studio, which should already be installed if you’re using your existing development system then configure the firewall to allow network communication between the host and the remote systems. Here are the three typical firewall options you have:

  • If you do not have a firewall installed then there is nothing to do.
  • If you are running a third-party firewall such as Norton Internet Security then simply disable the firewall temporarily during remote debugging. This is my personal preference since I rarely remote debug and I prefer not to permanently open ports in my firewall. I accomplish this by right-clicking on Norton Internet Security located in the tray icon and select Disable Smart Firewall and then select “15 minutes.” This usually provides me enough time to debug and it also automatically re-enables the firewall in case I forget.   You can always disable the firewall for extended times if debugging is taking longer than expected
  • If you’re running Windows built-in firewall then type “firewall” in Windows search to locate and run “Windows Firewall with advanced security” then create the following rules
firewall
Windows firewall utility
  • Allow Visual Studio application: Inbound Rules (on left side) | New Rule (on right-side) | Program | This program path | locate the path to your Visual Studio dev e.g. %VSInstallDirectory%\Common7\IDE\devenv.exe | Allow the Connection | Domain=checked, Private=checked, Public=checked | provide any rule name you wish
  • Allow DCOM services on port 135: Inbound Rules (on left side) | New Rule (on right-side) | Port | TCP | Specific Local Ports = 135 | Allow the Connection | Domain=checked, Private=checked, Public=checked | provide any rule name you wish
  • Allow IPSec services on ports 500 and 4500: Inbound Rules (on left side) | New Rule (on right-side)| Port | UDP | Specific Local Ports = 500,4500 | Allow the Connection | Domain=checked, Private=checked, Public=checked | provide any rule name you wish

See the “One-time setup of remote system” below for example screen-shots of the firewall wizard.  Now your host system is all configured. Now it’s time to configure the remote system.

One-time setup of remote system:

The initial setting up the remote system involves opening ports in your firewall for communication and providing privileges to the Remote Debugging Monitor utility.

First, locate the Remote Debugging Monitor utility. This is included with the Visual Studio install set. Two versions of the utility are included, one for debugging on 32-bit applications (x86) and a second for debugging 64-bit applications (x64). The utilities are found on the installation drive under the Visual Studio install folder (for example, Visual Studio 2010 can be found here %SystemDrive%\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\IDE\Remote Debugger). If you do not have this folder in your Visual Studio install-set then you can re-install Visual Studio and select “All Components.”

The two versions of the Remote Debugging Monitor will be located in their x86 folder (for 32-bit) and x64 folder (for 64-bit). For example, for Visual Studio 2010:

  • C:\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\IDE\Remote Debugger\x64
  • C:\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\IDE\Remote Debugger\x86

Which version of the utilities do you need? You’ll need to install the version which matches the “bit-ness” of the application you are debugging. Examples:

  • Debugging a 32-bit application on a 64-bit target system: use x86
  • Debugging a 32-bit application on a 32-bit target system: use x86
  • Debugging a 64-bit application on a 64-bit target system: use x64

Copy the entire utilities folder (either “x86” or “x64”) from the Visual Studio folder to a folder of your choice on your remote debugging system. I prefer to copy the folder directly to the Desktop and then rename the folder to identify the version of Visual Studio the tools came from as well as the “bit-ness” (for example x86_vs2010, x64_vs2013, x86_2005, etc).

desktop shortcuts
desktop shortcuts

Configuring the firewall is very simple by letting the Microsoft msvsmon.exe utility configure itself on first-run. To do so, launch msvsmon.exe on the remote debugging system. You will be prompted, “do you want to automatically configure the firewall?”   Select Yes, and all the ports and privileges will be configured for you. If you find this is not working or you want to configure the firewall manually then follow the following steps (otherwise continue to the next section, “Configuring a debug session”). Here are two common options to configure the firewall on the remote system:

  • If you do not have a firewall installed then there is nothing to do.
  • If you’re running Windows built-in firewall then type “firewall” in Windows search to locate and run “Windows Firewall with advanced security” then create the following rules

wiz1wiz2wiz3wiz4

Windows firewall utility wizard
Windows firewall utility wizard
  • Allow Remote Debugging Monitor application: Inbound Rules (on left side) | New Rule (on right-side) | Program | This program path | locate the path to the Remote Debugger Monitor e.g. msvsmon.exe | Allow the Connection | Domain=checked, Private=checked, Public=checked | provide any rule name you wish
  • Allow DCOM/NETBIOS/SMB services on port 135, 139, 445: Inbound Rules (on left side) | New Rule (on right-side) | Port | TCP | Specific Local Ports = 135,139,445 | Allow the Connection | Domain=checked, Private=checked, Public=checked | provide any rule name you wish
  • Allow NETBOIS services on ports 137 and 138: Inbound Rules (on left side) | New Rule (on right-side)| Port | UDP | Specific Local Ports = 137,138 | Allow the Connection | Domain=checked, Private=checked, Public=checked | provide any rule name you wish
  • Allow IPSec services on ports 500 and 4500: Inbound Rules (on left side) | New Rule (on right-side)| Port | UDP | Specific Local Ports = 500,4500 | Allow the Connection | Domain=checked, Private=checked, Public=checked | provide any rule name you wish

Now your remote debugging system is all configured. It’s time to setup a debug session.

 Configuring a debug session:

Now that the one-time configuration of the host system running Visual Studio and the remote debugging system running the Remote Debugging Monitor is complete, you can setup a debugging session quickly and easily.

The general steps for starting a new debug session are:

  1. Build your project via Visual Studio (this ensures the latest code, symbols, and executable files are all in-sync and available)
  2. Copy the executable files and symbol files to the remote system
  3. Register/install all executable files necessary to your project on the remote system
  4. Launch the Remote Debugging Monitor utility on the remote system
  5. Launch your application on the remote system
  6. Attach the Visual Studio debugger on your host system to your running application on the remote system

You will repeat these six steps every time you create a new debug session. I recommend automating steps 2 – 5 via a batch file or Power Shell script.   Not only will automation make the setup process quick, it will also make it less error-prone.   As an additional side-benefit you can use the script as a source of documentation; making it easy to recall what files must be installed, registered, and started before a debug session for your specific project.

Each script you create will be unique to each project. Scripts will have commonality since they tend to accomplish the same actions (stopping services, copying files, registering services, starting the remote debugger, etc). Here is an example of a script I use after building my project with Visual Studio. It takes care of all the heavy lifting; making sure my project is configured on the target debug system.

echo on

REM *** stop my service if it’s currently running
net stop "Jojo Manager Service"

REM *** unregister the service with Windows
"C:\Program Files\Jojo\jojoserve.exe" /UnRegServer

REM *** copy all project files from host development system
REM *** to the local debug system. Including debug PDB symbol files
copy /Y "\\MyShare\Code\Projects\Jojo\jojoserve\Debug\jojoserve.exe" "C:\Program Files\Jojo\"

copy /Y "\\MyShare\Code\Projects\Jojo\jojoserve\Debug\jojoserve.pdb" "C:\Program Files\Jojo\"

copy /Y "\\MyShare\Code\Projects\Jojo\UI\WHSAddIn\bin\Debug\HomeServerConsoleTab.Jojo.dll" "C:\Program Files\Windows Home Server\"

copy /Y "\\MyShare\Code\Projects\Jojo\UI\WHSAddIn\bin\Debug\HomeServerConsoleTab.jojo.pdb" "C:\Program Files\Windows Home Server\"

copy /Y "\\MyShare\Code\Projects\Jojo\UI\WHSAddIn\obj\Debug\Interop.jojoserveLib.dll" "C:\Program Files\Windows Home Server\"

REM *** register the new debug version of the service
"C:\Program Files\Jojo\jojoserve.exe" /Service

echo off
pause

An example debug session:

Now that you understand the general configuration and flow of Remote Debugging and how to connect the host and target systems, let’s run-through an example of the remote debugging process.

  1. Build your project using Visual Studio

I recommend performing a full rebuild before a debug session. This will ensure you are running the latest code as well as getting the latest symbol and executable files.

  1. Run your automated batch file to copy and register project files

Copy your project executable (.exe and .dll) and symbol (.pdb) files to the remote debugging system. Ensure they are all re-registered with the operating system if necessary (e.g. COM objects, Windows services). See above to view a sample batch file to assist with copying and registering files.   Note, if you are debugging a native executable then you do not need to copy the .pdb symbol files to the remote system; native symbol files are only required on the local host system.

  1. Launch the Remote Debugging Monitor utility on the remote system

Locate the Microsoft Debugging utility named msvsmon.exe which you copied to the remote debugging system during the one-time setup. Double click to launch the Remote Debugging Monitor.

Remote Debug Utility waiting for connection
Remote Debug Utility waiting for connection

The remote system is now waiting for a connection from your host system running the Visual Studio debugger.

  1. Launch your application on the remote system

Launch your project executable on the remote system and return to your host system to establish the debug connection.

  1. Attach the Visual Studio debugger on your host system to your running application on the remote system

Return to the host system and open Visual Studio. From the main menu bar select Debug | Attach To Process…

Attach host to remote process
Attach host to remote process

Select the following options to connect the Visual Studio debugger to the remote host:

Transport: set this value to “Default.”

Qualifier: this value specifies the name of the target debug system. Its full form is DOMAIN\USER_NAME@PC_NAME. If your local network uses a Domain then you must use the full syntax. If your local network does not use a domain then you can specify the name of the target PC (you can locate the PC name in the Remote Debugging Utility output window or via Computer | Properties | Computer Name). The user name is the name of the user logged into the remote system. You can find this name in the Remote Debugging Utility output window.

Remote debugging system connected to host
Remote debugging system connected to host

Attach To: press the Select button to specify the type of executable you are attaching to. For example, native, managed .NET 2x, or managed .NET 4x

Select the type of executable you are attaching to
Select the type of executable you are attaching to

Locate the name of the process you want to attach to. The Available Processes list-box will display all of the processes running on the target system specified in the Qualifier field

Select the process you have setup to debug on the remote system and press Attach. Visual Studio will then attach to the remote system and give you the ability to debug exactly like you would debug a local process. Very powerful!

Remote debugging system connected to host
Remote debugging system connected to host

As you can see, Microsoft Visual Studio offers a very powerful debugger allowing you to debug across multiple systems. Your first choice of debugging platforms will always be local but if that cannot be accomplished then rest assured, with a little bit of setup, you have access to the same debugging features across a remote system.

Tips:

  • Keep a copy of the Remote Debug Tools on a local server share for easy access. If you develop for multiple systems then you’ll need to access various versions (x86, x64, ARM) of the tools. Easy access and setup are key to a happy day
  • Use batch files or power-shell scripts to copy required files (exe, dll, symbols, etc) to the target PC and initialize your project requirements. If you create these scripts during your first debug session then you can use them as reference documentation in the future to easily recall which files are required to setup a debug session.   Automating your development processes always make you more successful and less error prone
  • Each version of Visual Studio includes its own version of the Remote Debugging Utilities so if you develop products with multiple versions of Visual Studio then keep multiple copies of the utilizes stored on an easily accessible network share
  • Create an Administrator account on the target debugger machine with the same username and password that you use on your host development system. When remote debugging, log in with those credentials on the remote system. This makes the process of connecting your host and target much easier since you have the same account privileges on both systems
  • Save hard drive space on the remote debugging system when debugging a native application. Symbol files (.pdb) for native applications only have to exist on the host system while symbol files for managed applications (such as C#) must exist on the remote debugging system in the same folder as the application.   Don’t copy large .pdb files to the remote debugging system for your native components
  • If you cannot create any break-points within Visual Studio after you have connected to your remote process then terminate the debug session (Debug | Terminate Process) then rebuild your project, copy all project and symbol files from your build to the remote system and reconnect the debugger. When attaching to the remote process, verify that you have the correct executable type (e.g. native, managed .NET 2x, managed .NET 4x, etc) set in the “Attach To” within in the Attach To Process box

Using Hyper-V services to simplify the software development cycle

Hyper-V for software developers:

An efficient and well-defined development environment is required for a software engineer to be effective.  A major part of this environment is the testing/certification system (i.e. the Operating System available to install and test the software under development).  Microsoft’s Hyper-V is a service which runs on 64-bit versions of Microsoft Windows Server and Windows 8.1 Pro.  It is an excellent tool to enable a simple and effective test environment for software developers. Hyper-V virtualization services is a key part of my software development process.  Below, I share how I setup, configure, and utilize the service for my everyday development and testing needs.

Pros:

  • not necessary to purchase new hardware
  • easy to reconfigure the operating system to a “clean” or “well defined” state for testing
  • able to share images of operating systems easily with other developers
  • faster setup and re-configure times
  • easy to roll-back to a previous state to get a fresh look at a software bug

Cons:

  • A 64-bit version of Microsoft Server (or Windows 8.1 Pro) operating system is required to install the host Hyper-V service
  • An Intel or AMD microprocessor with hardware-assisted virtualization must be available and configured by you in the BIOS

Requirements:

  • Windows Server 2008 or later, Windows 8.1 (64-bit) Pro/Enterprise
  • A x64-based processor  (64-bit)
  • A BIOS with hardware-assisted virtualization. This is available in processors that include a virtualization option such as Intel Virtualization Technology (Intel VT) or AMD Virtualization (AMD-V)
  • A BIOS with hardware-enforced Data Execution Prevention (DEP) must be available and be enabled. Specifically, you must enable the Intel XD bit (execute disable bit) or AMD NX bit (no execute bit).

The first requirement to utilize Hyper-V is to install the host service on your Windows Server or Windows 8 Pro/Enterprise system.  This is a one-time setup as described below.

Enabling Intel VT or AMD-V in the BIOS:

Enabling the Intel Virtualization Technology (Intel VT) or AMD Virtualization (AMD-V) feature in your processor via the BIOS is required to run Hyper-V.  Unfortunately, not all processors have this feature.  If the processor in your host system does not have this feature then you can either purchase a new processor or use a different virtualization host such as Virtual Box which does not require hardware virtualization. To verify that your processor’s Virtualization Technology is enabled, restart your PC and enter the BIOS menu (note: there is no common PC BIOS or BIOS interface so you should refer to your motherboard/CPU documentation for detailed information about your specific system).  Enter the BIOS as your system is restarting (typically press the Delete, F1, ESC, or Alt-F4 keys).  Once you’re in the BIOS menu look for a setting title Intel Virtualization Technology or VT-x.  This could be under the Advanced CPU, Chipset, Advanced, or Other sub-menu.  Make sure the setting is Enabled and save the BIOS settings and restart your system. If you can’t locate the setting you can simple try installing Hyper-V.  If the virtualization feature is enabled (as it would be by default with most modern AMD processors) then Hyper-V will work fine.  If the feature is NOT installed then you will get a warning during installation and you will not be allowed to continue until the virtualization feature is enabled.

Installing Microsoft Hyper-V services on Windows Server:

From the Windows Start Menu, search for the Server Manager and launch it

launch the server manager
launch the server manager

In the Console Tree on the left-side, right-click Roles and select Add Roles.  .

select add roles
select add roles

The Add Role Wizard  will be displayed.  Click-though the wizard and select Hyper-V from the Select Server Roles page.  If Hyper-V is already installed then simply click the Cancel button and move along to the next section.  Otherwise, press the Install button and click-through the Confirmation and Progress pages to complete the installation

add role wizard
add role wizard

Installing Microsoft Hyper-V services on Windows 8.1:

In the Control Panel, click Programs, and then click Programs and Features.  Click Turn Windows features on or off.  Click Hyper-V, click OK, and then click Close.

Launching the Hyper-V Console:

From the Windows Start menu, search for the Hyper V Manager and launch it

launch hyper-v manager
launch hyper-v manager

When you launch the Hyper-V manager you will see a list of all current virtual machines (guest operating systems) that you have created.  Selecting a virtual machine from the top-center view will display a list of each of the snapshots you have created for that virtual machine.

hyper-v manager view
hyper-v manager view

Your view of virtual machines will be empty if this is the first time you have run the Hyper-V manager.

Creating a new virtual machine:

In the Actions pane located in the upper-right select New | Virtual Machine.  The New Virtual Machine wizard will be displayed.

hyper-v wizard - startup
hyper-v wizard – startup

Click Next and enter a description of your new Virtual Machine such as “Windows Server 2012 Essentials” or “Windows 8.”  Click Next to configure the amount of memory accessible to the virtual machine.

hyper-v wizard - VM name
hyper-v wizard – VM name

Enter the amount of memory you want the guest operating system in you new virtual machine to have access to.  Note this physical memory must exist in the host system running Hyper-V.  So you should make this value only as large as you actually need.  Make sure you take into account the actual amount of RAM required by the operating system you are going to install in the virtual machine (for example Windows Small Business Server 2011 requires a minimum of 1024 MB).  You can always change this value later so don’t be too concerned about absolute requirements or optimizations for your system at this time.  Click Next to configure your network.

hyper-v wizard - configure memory
hyper-v wizard – configure memory

Configure the network you want the guest operating system to have access to.   It’s best to select the LAN.  Doing so will allow the installed guest operating system to appear on your local network just like a normal physical system.  You will have access to  file sharing, internet access, and (most important to us developers) remote debugging features.  Click Next to configure the size and location of the virtual hard drive.

hyper-v wizard - configure network
hyper-v wizard – configure network

Enter a name for your new virtual machine.  It will always have the file extension vhd.  You should name it something relevant so you will be able to match the vhd file with the operating system you install within the virtual machine.  For example,  if I create a virtual machine named, “Windows 2012 Server Essentials” then I would name the virtual machine something like, “ws2012essentials.vhd” so I can immediately identify the vhd file when exploring the Windows file system. Enter the location of your new virtual machine.  I prefer to save all virtual machines on a secondary data drive away from the Windows operating system drive of the Hyper-V host not only for easier storage management but also a slight boost in efficiency by reducing the amount of hard drive seeks between both the Hyper-V host and the virtual machine.  But you can place the vhd files where ever you prefer as long as there is enough space on the hard drive. Enter the size in Gigabytes of the virtual hard drive.  The best size is dependent on the guest operating system you install in the virtual machine.  There’s quite a bit of trial and error to get this value just right for your needs.  I recommend leaving the default value of 127GB.  You can increase size of the virtual hard drive later if you need.  Press Next to configure the guest operating system and attached CD/DVD devices. hyper-v create 5

Finally, locate the iso file containing the operating system you want to install into your new virtual machine.  You can download iso files directly from Microsoft’s MSDN site.  This iso file will be mounted in the virtual machine as a CD/DVD device an allow you to install the operating system on the first boot of the virtual machine.  Press Next to view the final settings of the new virtual machine.

hyper-v wizard - configure guest operating system
hyper-v wizard – configure guest operating system

If all your virtual machine settings look okay then click Finish to finalize the process.  A new virtual hard disk will be created with the name you specified in the folder you specified.  Return to the Hyper-V manager and you will see the name of your new virtual machine in the Virtual Machines pane located in the top-center of the window.

hyper-v wizard - verify final settings
hyper-v wizard – verify final settings

Now your new virtual machine is setup and you can install the operating system into it.  Double-click the virtual machine within the Hyper-V manager to start it.   You will see the virtual machine starts in a disabled state.

hyper-v first launch
hyper-v first launch

From the virtual machine select Action | Start to launch the install process of the new virtual machine.

hyper-v install guest OS
hyper-v install guest OS

Now the install process will begin loading directly from the iso file you specified when creating the virtual machine.  Finish the install process just like you would on any machine any you are done.

hyper-v install OS
hyper-v install OS

Launching a virtual machine:

After you have created one of more virtual machines you can launch them directly from the Hyper-V Manager.  Double-click the virtual machine from the Virtual Machine pane located at top-center then click Action | Start.

Creating and utilizing snapshots:

Snapshots give you the ability to freeze an operating system at a point in time.  This is perfect for testing before-and-after issues and compatibility with other software. To create a new snapshot for a virtual machine select the virtual machine from the Virtual Machines pane, right-click and select Snapshot.

hyper-v snapshot
hyper-v snapshot

Managing virtual machine images:

It’s best to manage your virtual machines directly through the Hyper-V Manager.  You can create, edit, and delete directly through the manager’s user-interface.  With that, it’s good to know that all virtual machines,  virtual hard disks, and snap shots are stored on a local hard drive on the Hyper-V host system.  You can locate this folder via Windows Explorer.  Open an Explorer window to the folder you specified during the virtual machine creation wizard.  For example, in my case I save all virtual machine files on a data drive D:

hyper-v explore
hyper-v explore

Tips and tricks:

  • Backup your virtual machine image files.  Be aware of the folder containing the virtual machine, virtual hard drive, and snap shot files.  If you don’t run an image backup on your Hyper-V host machine then make sure you backup those specific folders.  Regenerating all your virtual machines would not be fun!
  • Create a snapshot immediately after installing a new operating system on your virtual machine.  The ability to rollback to a “clean” system will be helpful at some point trying to track-down a bug
  • Install the Hyper-V host on the most powerful and memory-filled system you have available.  Each virtual machine will gobble memory from the host so if you want to run multiple virtual machines simultaneously you’ll need more RAM.  Also, a multi-core CPU is much more friendly to running virtual machines.
  • Create a library of virtual machines with all the operating systems you develop for.   Have them available at a moments notice for quick efficient testing of your code.  If your product supports all the way back to Windows XP then so should your VM library.
  •  Share virtual machine images with other developers.  Unlike physical hardware which might not always be compatible, you can share some, or all, of your VM library with other developers in your company.  As long as they use Hyper-V it’s all good.  When creating a new library you can divvy up the work, save time, helping each other build a VM library.
  • Add multiple languages to your VM library.  We’ve all seen some bugs which are only reproducible in certain languages.  Add some Japanese, German, and other native VM’s to your library based on the target audience of your software.