What are SSH Keys?

Written by Sean Blanton on February 3, 2021

Share This Article

Updated on January 23, 2024

If you spend enough time in an IT environment and with the rise of cloud infrastructure such as AWS, you will likely come across the term SSH keys. If you’ve already come across this IT term, then you might find yourself wondering, what are SSH keys?

SSH (Secure Shell) keys are an access credential that is used in the SSH protocol and they are foundational to modern Infrastructure-as-a-Service platforms such as AWS, Google Cloud, and Azure. 

Before this post delves into an explanation on what are SSH keys, let’s take a quick look at the SSH protocol.



Get full-scale identity, access, and device management.

The History of The SSH Protocol

The first version of the SSH protocol was developed in the summer of 1995 by Tatu Ylonen. Tatu was a researcher at the University of Helsinki when a sniffing attack was discovered on the university network. A sniffing attack intercepts and logs the traffic that takes place on a network and can provide attackers with usernames and passwords which can then be used to gain access to critical IT assets.

Thousands of credentials were impacted, including those belonging to community partnerships. This sniffing attack motivated Tatu to figure out how to make networks more secure, and this ultimately led to the creation of the SSH protocol (SSH.com).

Today, the SSH protocol is widely used to login remotely from one system into another, and its strong encryption makes it ideal to carry out tasks such as issuing remote commands and remotely managing network infrastructure and other vital system components. This is especially important in the era of cloud infrastructure and remote work.

To use the SSH protocol, a couple pieces of software need to be installed. The remote systems need to have a piece of software called an SSH daemon, and the system used to issue commands and manage the remote servers needs to have a piece of software called the SSH client. These pieces of software are necessary to create a proper communication channel using the SSH protocol (DigitalOcean).

Essentially, SSH keys are an authentication method used to gain access to an encrypted connection between systems and then ultimately use that connection to manage the remote system.

What are SSH keys?

SSH keys come in many sizes, but a popular choice is an RSA 2048-bit encryption, which is comparable to a 617 digit long password. On Windows systems, it is possible to generate your own SSH key pair by downloading and using an SSH client like PuTTY.

On Mac and Linux systems, it is possible to generate an SSH key pair using a terminal window. Watch the video below to find out how to generate your own RSA key pair on Mac and Linux.

SSH keys always come in pairs, and every pair is made up of a private key and a public key. Who or what possesses these keys determines the type of SSH key pair. If the private key and the public key remain with the user, this set of SSH keys is referred to as user keys.

If the private and public keys are on a remote system, then this key pair is referred to as host keys. Another type of SSH key is a session key. When a large amount of data is being transmitted, session keys are used to encrypt this information.  

Now let’s take a closer look at how a private key and public key work. To keep things simple, we will focus on how user keys work.   

How User Keys Work

In a user key set, the private key remains on the system being used to access the remote system (i.e. the user’s desktop or laptop) and is used to decrypt information that is exchanged in the SSH protocol.

Private keys should never be shared with anyone and should be secured on a system – i.e. the system is secured (full disk encryption, MFA), in the user’s possession, and the private key is secured via passphrase. 

A public key is used to encrypt information, can be shared, and is used by the user and the remote server. On the server end, the public key is saved in a file that contains a list of authorized public keys. On the user’s side, the public SSH key is stored in an SSH key management software or in a file on their computer.  

Using SSH Keys

First Steps – SSH Key Generation

Before you can start using SSH keys, first you need to generate your own SSH key pair on the system you would like to use to access a remote system. Please see the instructions below.

Linux/Mac Instructions:

Recommended: Install or Update OpenSSH

sudo apt-get update

sudo apt-get install openssh-server

First, load a command line terminal and type the following command:

Your two key files will be created in the /HOME/.ssh/ directory by default, including your private key, but you may specify a direct location. Never share your private key.

$HOME/.ssh/id_rsa.pub (public key

$HOME/.ssh/id_rsa (private net)

Per above, you’ll be given the option to set a passphrase to make it more difficult for unauthorized users to log into your accounts by protecting the confidentiality of your keypairs.

Your public key is uploaded to your server to use SSH key authentication for access control. The ssh-copy-id command, which is part of the OpenSSH package, can be used to automate the transfer process in the syntax of: 

ssh-copy-id username@host

You may also add the key to your account using JumpCloud, or by manually placing the public SSH key on the remote server (DigitalOcean).

Mac and Linux with CLI – jumpcloud-1

Windows Instructions:

Download and install the PuTTY SSH keygen program.

  • Load the PuTTYgen program
  • Click the Generate button and select RSA (SSH-2)
    • You may opt for a 4096 bit key, but some applications may not accept it and it may result in increased CPU usage during the ‘handshake’ process.
  • Key in a passphrase for additional security
  • You must select Save private key and specify a location
    • Do not share this file with unauthorized individuals
    • You can copy and paste your public key from the field above with Select All or hit the Save public key button.
  • You may add the key to your account using JumpCloud

Windows SSH Pair Keygen using PuTTY – jumpcloud-1

How SSH Key Authentication Works

After completing the steps mentioned above, use your terminal to enter in your ssh username and the IP address of the remote system in this format: ssh username@my_ip_address. This will initiate a connection to the remote system using the SSH protocol.

The protocol and specified username will then tell the remote server which public key to use to authenticate you. Then the remote server will use that public key to encrypt a random challenge message that is sent back to the client. This challenge message is decrypted using the private key on your system. 

Once the message is decrypted, it is combined with a previously arranged session ID and then sent back to the server. If the message matches with what the server sent out, the client is authenticated, and you will gain access to the remote server. This process proves to the server that you have the corresponding private key to the public key it has on file. 

However, the security that this authentication process provides can be undermined when SSH keys are not properly managed. 

Managing SSH Keys

It is imperative that proper SSH key management is in place because they often grant access to mission-critical digital assets. Also, companies tend to have a lot of SSH keys. In fact, Fortune 500 companies will often have several millions of these.

Despite the difficulty in trying to manually manage millions of SSH keys, having an SSH key management system in place is continuously overlooked. SSH.com did some digging and discovered a company that had 3 million SSH keys “that granted access to live production servers.

Of those, 90% were no longer used. Root access was granted by 10% of the keys ”. An effective SSH key management system in place would have gone a long way in reducing this concerning security risk. 

IT has a couple options to gain control over SSH keys in their environment. One of these includes using an SSH key management tool. However this means having to manage one more platforms in addition to managing an SSO provider, a directory service, and maybe a system management solution. A new solution has emerged that is providing IT with a second option: JumpCloud Directory Platform.

Cloud IAM offers SSH Key Management

This cloud-based identity and access management solution provides IT with one central place to manage SSH keys. Furthermore, IT can also centralize user authentication to Mac, Linux, and Windows devices, cloud servers, wired and WiFi networks, web-based and on-prem applications, and virtual and on-prem storage. With one central place to manage a user’s authentication to all of their resources, it becomes a simple matter of a few clicks to deprovision users from all of their resources, including SSH key access to remote systems.

Learn More about SSH Key Management with JumpCloud

You are more than welcome to reach out to us if you would like more information on how the JumpCloud Directory Platform can simplify your SSH key management. If you’re ready to start testing our modern IAM platform, sign up for a free trial.

Sean Blanton

Sean Blanton is the Director of Content at JumpCloud and has spent the past decade in the wide world of security, networking and IT and Infosec administration. When not at work Sean enjoys spending time with his young kids and geeking out on table top games.

Continue Learning with our Newsletter