Differences between revisions 1 and 40 (spanning 39 versions)
Revision 1 as of 2008-02-28 05:31:50
Size: 2847
Editor: TimoSirainen
Comment:
Revision 40 as of 2008-06-24 13:38:42
Size: 3336
Editor: TimoSirainen
Comment:
Deletions are marked like this. Additions are marked like this.
Line 6: Line 6:
 * Search: SEARCH command correctness.
Line 11: Line 10:
 * Failures: Number of failures using [:ImapTest/Tests:command/reply tests] (failures / number of tests). These numbers may not be exact all the time, because the tests are still changing.
Line 14: Line 14:
|| '''Server''' || '''Checkpoint''' || '''\Recent''' || '''Atomic flags''' || '''Search''' || '''Expunges''' ||
|| [http://www.dovecot.org/ Dovecot] 1.1.rc2+ || Yes || Yes || Yes || OK || B ||
|| [http://www.washington.edu/imap/ UW-IMAP] 2007a.DEV, mix format || Yes || Yes || Yes || OK || A ||
|| [http://www.zimbra.com/ Zimbra] 5.0.1 || Yes || Yes || Yes || OK || C ||
|| '''Server''' || '''Checkpoint''' || '''\Recent''' || '''Atomic flags''' || '''Expunges''' || '''Failures''' ||
|| [http://www.dovecot.org/ Dovecot] 1.1.rc10+ || Yes || Yes || Yes || B || 0/34 ||
Line 21: Line 19:
|| '''Server''' || '''Checkpoint''' || '''\Recent''' || '''Atomic flags''' || '''Search''' || '''Expunges''' ||
|| [http://www.archiveopteryx.org/ Archiveopteryx] 2.06 || No |||| ? (connections hang too easily) || Bugs || C ||
|| [http://www.courier-mta.org/imap/ Courier] 4.3.0 || Yes || Unreliable || Yes || SMALLER/LARGER wrong || C ||
|| [http://cyrusimap.web.cmu.edu/ Cyrus] 2.3.9 || No || Unreliable || Bugs || Int.dates wrong || B? Buggy ||
|| [http://www.dovecot.org/ Dovecot] 1.0 || Yes || Unreliable || Bugs || Int.dates wrong || B ||
|| [http://www.isode.com/products/m-box.html Isode M-Box] 14.2a0 || No || Unreliable || Yes || () bugs || C ||
|| [http://www.sun.com/software/products/messaging_srvr/index.xml Sun Java Messenging Server] 6.3-0.15 || No || Unreliable || Bugs || Bugs || A ||
|| [http://www.washington.edu/imap/ UW-IMAP] 2007, mix format || Yes || Yes || Bugs || OK || A ||
|| '''Server''' || '''Checkpoint''' || '''\Recent''' || '''Atomic flags''' || '''Expunges''' || '''Failures''' ||
|| [http://www.dovecot.org/ Dovecot] 1.0.15 || Yes || Unreliable || Bugs || B || 1/34 ||
|| [http://www.washington.edu/imap/ UW-IMAP] 2007b, mix format || Yes || Yes || Yes || A || 2/34 ||
|| [http://www.isode.com/products/m-box.html Isode M-Box] 14.3a0 || No || Unreliable || Yes || C || 6/34 ||
|| [http://www.communigate.com/community/ CommuniGate Pro] 5.2.1 || Yes || Yes || Yes || C || 8/34 ||
|| [http://www.zimbra.com/ Zimbra] 5.0.5 || Yes || Yes || Yes || C || 8/34 ||
|| [http://cyrusimap.web.cmu.edu/ Cyrus] 2.3.12p2 || No || Unreliable || Bugs || B? Buggy || 9/34 ||
|| [http://www.sun.com/software/products/messaging_srvr/index.xml Sun Java Messenging Server] 6.3-0.15 || No || Unreliable || Bugs || A || 9/34 ||
|| [http://www.gmail.com/ GMail] 2008-06-24 || No || Unreliable || Bugs || A/C (\Deleted flag expunges) || 15/34 ||
|| [http://www.courier-mta.org/imap/ Courier] 4.3.1 || Yes || Unreliable || Yes|| C || 18/34 ||
|| [http://www.citadel.org/ Citadel] 7.36 || No || Unreliable || Yes || A || 19/34 ||
|| [http://www.dbmail.org/ dbmail] 2.3.3 |||||||||| Crashes too early to test. APPEND missing EXISTS replies. ||
Line 30: Line 32:
Major problems with multiple connections (makes further testing difficult): Major problems with multiple connections (makes further testing difficult and MAY CAUSE ACCIDENTAL MAIL LOSS!):
Line 32: Line 34:
|| '''Server''' || '''Checkpoint''' || '''\Recent''' || '''Atomic flags''' || '''Search''' || '''Expunges''' ||
|| [http://www.citadel.org/ Citadel] 7.32 || No || ? || ? || Bugs || EXPUNGEs sent too often ||
|| [http://www.communigate.com/community/ CommuniGate Pro] 5.2.0 || ? || ? || ? || () bugs || C - EXPUNGes lost sometimes ||
|| [http://www.kerio.eu/kms_home.html Kerio Mail Server] 6.5.0 || ? || ? || ? || Bugs || EXPUNGEs not sent ||
|| '''Server''' || '''Checkpoint''' || '''\Recent''' || '''Atomic flags''' || '''Expunges''' || '''Failures''' ||
|| [http://www.archiveopteryx.org/ Archiveopteryx] 2.10 || ? || ? || ? || C - EXPUNGEs are sent wrong ||
|| [http://www.ibm.com/software/lotus/products/notes/ IBM Domino] 8.0 || No || Unreliable || ? || C - Too many EXPUNGEs are sent, EXISTS is dropped before sending EXPUNGEs, FETCHing with valid messagesets produce errors || 16/34 ||
|| [http://www.kerio.eu/kms_home.html Kerio Mail Server] 6.5.1 || ? || ? || ? || EXPUNGEs are sent wrong || 18/34 ||

IMAP Server Compliance

  • Checkpoint: checkpoint parameter works. When issuing a CHECK command in all sessions, their state looks identical.
  • \Recent: Exactly one session sees a new message as \Recent - no more and no less.
  • Atomic flags: Flags and keywords can be added/removed in multiple sessions without one session dropping changes made by other (own_flags test)
  • Expunges: How messages expunged by another session are handled.
    • A: Expunging a message from one session keeps it available for other sessions until they can be notified that it's expunged. Flag updates to expunged messages may not be visible to other sessions though.
    • B: Some cached fields may be returned for expunged messages, but message bodies can't be retrieved anymore. Flags can still be updated within the session (but updates may not be visible to other sessions).
    • C: Even message flags can't be updated for expunged messages.
  • Failures: Number of failures using [:ImapTest/Tests:command/reply tests] (failures / number of tests). These numbers may not be exact all the time, because the tests are still changing.

Fully compliant servers:

Server

Checkpoint

\Recent

Atomic flags

Expunges

Failures

[http://www.dovecot.org/ Dovecot] 1.1.rc10+

Yes

Yes

Yes

B

0/34

Non-compliant servers:

Server

Checkpoint

\Recent

Atomic flags

Expunges

Failures

[http://www.dovecot.org/ Dovecot] 1.0.15

Yes

Unreliable

Bugs

B

1/34

[http://www.washington.edu/imap/ UW-IMAP] 2007b, mix format

Yes

Yes

Yes

A

2/34

[http://www.isode.com/products/m-box.html Isode M-Box] 14.3a0

No

Unreliable

Yes

C

6/34

[http://www.communigate.com/community/ CommuniGate Pro] 5.2.1

Yes

Yes

Yes

C

8/34

[http://www.zimbra.com/ Zimbra] 5.0.5

Yes

Yes

Yes

C

8/34

[http://cyrusimap.web.cmu.edu/ Cyrus] 2.3.12p2

No

Unreliable

Bugs

B? Buggy

9/34

[http://www.sun.com/software/products/messaging_srvr/index.xml Sun Java Messenging Server] 6.3-0.15

No

Unreliable

Bugs

A

9/34

[http://www.gmail.com/ GMail] 2008-06-24

No

Unreliable

Bugs

A/C (\Deleted flag expunges)

15/34

[http://www.courier-mta.org/imap/ Courier] 4.3.1

Yes

Unreliable

Yes

C

18/34

[http://www.citadel.org/ Citadel] 7.36

No

Unreliable

Yes

A

19/34

[http://www.dbmail.org/ dbmail] 2.3.3

Crashes too early to test. APPEND missing EXISTS replies.

Major problems with multiple connections (makes further testing difficult and MAY CAUSE ACCIDENTAL MAIL LOSS!):

Server

Checkpoint

\Recent

Atomic flags

Expunges

Failures

[http://www.archiveopteryx.org/ Archiveopteryx] 2.10

?

?

?

C - EXPUNGEs are sent wrong

[http://www.ibm.com/software/lotus/products/notes/ IBM Domino] 8.0

No

Unreliable

?

C - Too many EXPUNGEs are sent, EXISTS is dropped before sending EXPUNGEs, FETCHing with valid messagesets produce errors

16/34

[http://www.kerio.eu/kms_home.html Kerio Mail Server] 6.5.1

?

?

?

EXPUNGEs are sent wrong

18/34

None: ImapTest/ServerStatus (last edited 2023-11-07 21:14:12 by TimoSirainen)