Email Protocols Explained

emai-ports-protocols

  • What are email Protocols?
  • What protocol is used for sending Email?
  • What protocol is used for Receiving Email?

Email protocols are the rules and procedures for sending and receiving email.

The main protocols you will encounter on the Internet are POP3, IMAP4 and SMTP.

The Internet email protocols are single function protocols i.e. they do a single job.

The POP3 and IMAP4 protocols are for receiving or fetching email from an email server.

Whereas the SMTP protocol  is used for sending emails between email servers, and also for sending email between an email client and server.

Internet email protocols are text-based protocols, and use a command/response type format, as they were initially used from a command prompt.

Internet protocols are specified in RFCs (Request for Comments) and are associated with standard TCP ports.
[outline style=”yellow”]Another common protocol is MAPI, which is a Microsoft proprietary protocol used by Microsoft Exchange server and outlook for email and calendars.[/outline]

Quick Links:

SMTP Protocol

SMTP stands for simple mail transfer protocol and is the protocol used for sending email on the Internet.

The SMTP protocol is used by your email client to send email to the email server, and is also used when email servers send email to each other using a MTA  (Message transfer agent).

SMTP Authentication Methods

There are three ways email providers authenticate an SMTP user.

  1. IP address– Not configurable in client
  2. Authentication via login -Configurable in client
  3. Sender email address–Configurable in client

IP address

When you connect to your ISP you are allocated an IP address. If your email account is held by your ISP then you normally don’t need to authenticate to send email.

This is because the ISP detects that the sending SMTP client has a known IP address, and hence trusts it.

However what  if you access your email Using a different IP address than normal ?

This is typical if you travel and you access the Internet via another Network e.g. company network, public WiFi.

In this case your IP address will not be trusted, and you may need to use another authentication method or a different SMTP server.

Login or SMTP Authentication

If your ISP isn’t your email provider then you normally need to login in order to send email.

This the most common authentication method used.

This is configured in Outlook Express as detailed below:

  1. From the Tools menu, choose
    Accounts
    .
  2. Select the Mail tab.
  3. Click the account to highlight it.
  4. Click the  properties button
  5. Select the Servers tab.

outlook-express-advanced-smtp-configuration-1

  1. Check the box next to My Server Requires
    Authentication
    .
  2. Usually you logon using the same account as for POP3 email. If
    so then you have finished configuration as this account is used by default . However you may be sending mail using a different provider than for receiving email then  you will need to click settings tab and then select the logon using  radio button and enter a username and password.

outlook-express-advanced-smtp-configuration-1

  1. Click OK.

Sender Email Address

When sending email some email servers will check that the address in the from field is a registered email address on that sever.

If you have an email account on that server then it isn’t a problem.

However if you are using your client to access multiple email
addresses/accounts, and are trying to send all email through a single SMTP server then this may cause problems.

Some email providers recognise this, and allow you to enter other addresses that you may use in the send field.

They usually have a mechanism to verify that the address belongs to you.

SMTP Ports

The standard port for SMTP is port 25 but SMTP secured by SSL (secured sockets layer) normally uses port 587,although other ports like port 465 are also used (e.g. Google Gmail) .

553 Errors

It is possible and common to receive email for multiple email addresses into a single account/inbox. See Accessing multiple email accounts

If you do this, and then configure all of the  email accounts to send using the same SMTP account you may encounter 553 errors

To prevent errors you will need to be able to associate the
alternate email addresses to the main email address ( the one you use on the main SMTP account).

If it isn’t possible to do this then you will need to use a separate SMTP account for each  email address.

See 550/553 Not Permitted error from BT Internet’s mail servers

Sending Restrictions

Many ISPs and free providers (e.g. Google,Yahoo) will block email that is sent to multiple recipients (Typically >100 recipients), and will block a continuous stream of emails.

Therefore if you routinely send to large groups (>100) then you should consider:

  1. Splitting them into small groups and stagger the sending or
  2. Sending using a commercial SMTP server
  3. Sending using a mass mail email client that can be
    tuned
  4. Sending using an online autoresponder service.

Message size limitations will also be in place (25MB is typical).

However your own SMTP server may not be the restricting server as the message typically passes through several SMTP servers to reach the final destination.

You may find this video on SMTP useful.

Receiving Email POP3 and IMAP4 Protocols

You often come across questions like

  • Is Gmail POP3 or IMAP?
  • Is my Mailbox POP3 or IMAP4?

A mailbox is neither POP3 or IMAP4, as POP3 and IMAP4 are access mechanisms for receiving email, and a Mailbox can support access via either and, or both protocols.

For example I could configure two email clients to access the same mailbox. One could use POP3 and the other IMAP4.

mailbox-access-pop3-imap4

POP3 is the older of the two protocols, and most widely used, but isn’t as powerful as IMAP4.

Most email clients support both protocols. If your email provider also supports IMAP, then IMAP is the preferred choice.

POP3 Protocol

POP3 was designed to be used in offline mode, and was ideal in the days of dialup connections as you would connect to the email server,  download your emails, and then disconnect.

The emails were now on your local computer, and you could read them off line.

Because it was designed for offline working the emails were deleted from the email server once they had been downloaded to your computer (This can be changed).

With POP3 Sent email is stored in the sent items folder on your client and never on the email server.

POP3 has several drawbacks that you should be aware of:

  • The email needs to be downloaded to your computer before you can read it.
  • It is difficult to access the email from multiple computers and remote locations..
  • The email is stored on your PC and hence you need to make
    sure you do email backups!
  • If you change computers (buy a new one) then you need to
    transfer email to the new computer.

POP3 Client and Server Folders

When you configure an email client to access a mailbox using POP3 then several folders are created on your email client machine. The default ones are:

  • Inbox -Received email is delivered here
  • Outbox– Mail waiting to be sent is held here (should be empty)
  • Sent Items – Sent email is copied here (default setup but can be changed)
  • Deleted Items – Deleted items are kept here until permanently being deleted when you empty it.
  • Drafts– Unfinished emails can be stored here.

When you receive email from the Internet the email is transferred from the inbox on your email server to the inbox on your client machine and then deleted from the email server.

Any new folders that you create exist only on your client machine.

The diagram below illustrates the folder structure on client and server

Pop3-Imap4-folders-client-server

POP3 Ports

Pop3 uses normally uses TCP port 110 but when secured using SSL (secured sockets layer it uses port 995.

IMAP4 Protocol

The IMAP4 protocol was designed as a replacement for POP3.

Like POP3 it is a receive only protocol designed to access email from a mailbox on an email server in an online mode.

[outline style=”yellow”]This means that the email remains on the server where it can be accessed by other email clients at other locations.[/outline]

This makes it ideal for users who want to access their email from different machines/locations i.e. Remote Email Access.

Sent email is stored in the sent items folder on your client and usually synchronised with the sent items folder on the email server.

In addition IMAP4 has richer functionality in manipulating inbox messages, and can manage other mail folders besides the inbox. It also has better performance when dealing with large messages.

However not all email providers provide email access using IMAP4 access.

It is the preferred way of accessing email especially for mobile devices

IMAP4 Client and Server Folders

If we look at the folders on the email client and server for a mailbox using IMAP4 we see a completely different picture than for POP3.

Imap4-folders-client-server

In this case the folders on the email server are the same as the folders on the email client.

Email messages can also be completely synchronised between the client and the server meaning that:

  1. The inbox on the email server contains the same messages as the inbox on the email client.
  2. The sent items folder on the email server contains the same messages as the sent items folder on the email client.
  3. etc

Most email clients only synchronise the inbox by default. as shown in the screen shot below for an IMAP mailbox on Outlook Express.

imap4-default-sync

However all folders can be synchronised.

IMAP Ports

IMAP uses normally uses TCP port 143 but when secured using SSL (secured sockets layer it uses port 993.

POP4 vs IMAP4 Differences

There are two main differences between the two protocols that are crucial to grasp. They are:

  1. POP3 was designed when mailbox storage was limited and so it was designed to move email from the server to the client.
  2. POP3 can only access the inbox.
  3. IMAP4 was designed as server based email meaning all email is stored on the email server.
  4. IMAP4 clients can access any folder, and not just the inbox.

I made this video for those that prefer video instructions

https://youtu.be/Zcni5FvgI1c

Securing POP3 and IMAP4

Both protocols support SSL encryption and most email clients can use IMAP4 and POP3 over SSL.

SSL uses different ports than the standard POP3 and IMAP4 ports so you need to check what port your email provider uses.

HTTP

HTTP isn’t strictly speaking an email protocol, but it is used for sending and receiving email when using a webmail client, and also now in most mobile email Apps.

HTTP cannot just only send and receive email it can also provide access to email contacts.

It is likely to become the main protocol used for sending and receiving email.

Common Questions

Q-I’ve been using POP3 for many years what happens if I switch to using IMAP4- Will I lose my old emails –

A- No See How to change from POP3 to IMAP4 .

Q- Can I access my mailbox using my PC and an APP on my smartphone or tablet

A- Yes see accessing your mailbox using multiple clients. See Managing Multiple Email accounts

Q- I have 2 email accounts (A and B) can I send all email through the SMTP server of email account A?

A- Yes- SMTP was originally open, and so you could point you email client at any SMTP server and send email through it. However because of SPAM all SMTP servers are secured, and so you will need an email account on that server in order to do it. So provided you have an account then you can do it.

Q- What protocols can be used foe sending email?

A- SMTP and HTTP

Q- Which protocol is used for transferring email between email servers?

A- SMTP

Q- What two protocols are used to deliver email messages?

A- IMAP4 and POP3

Summary

This chart summarises the main protocols and ports:

email-protocols

IMAP4 is the better access method, and is recommended if your email provider supports it (most do but not all).

SMTP is the mainstay of the email network as it handles message delivery across the Internet.

It is used for sending email between an email client and email server and also between email servers.

MAPI  is used by Outlook clients in Microsoft Exchange email networks.

It is a client server protocol, and handles sending/receiving email as well as calendar, and directory access.

It is not used for transferring email between servers. Microsoft exchange servers use the Internet SMTP protocol

See Wiki for more details

Resources and References: