X11R68ReleaseStatus

The X.Org Foundation X11R6.8 Release Status

Table of Contents

Contents

  1. The X.Org Foundation X11R6.8 Release Status
    1. Table of Contents
    2. Current status
    3. Legend
      1. Columns
      2. Colors
    4. Detailed test instructions
      1. Build tests
      2. Install tests
      3. Conformance tests
        1. Setting up the X test suite
        2. Examples of how to use the xreg script
        3. Actually running the conformance tests
      4. Run tests
    5. Tinderboxes

Current status

The following describes the current status of this release. Each row describes one platform. See the legend at the bottom of this page for a description of each column and the color codings.

The current release candidate tag is: XORG-6_8_0

The release criteria is that the release is ready to ship when there are no red cells in table.

At this time, we need:

  1. Volunteers to perform the tests described below. Please e-mail xorg@lists.freedesktop.org if you can test a platform.

  2. There are several platforms listed at the bottom of the table that are currently all in the open questions state. If you have information about these distributions, please send e-mail to xorg@lists.freedesktop.org with the info.

  3. If any of the data in the table is incorrect, please e-mail xorg@lists.freedesktop.org with a description of the error.

  4. Please report intermediate states (e.g. build tests done), so that people can see your progress.

OS

Arch

Distro/Release

Name

Build

Install

Conformance

Run

AIX

arch???

release(s)???

Dan McNichol

Cygwin

IA-32

Net-release

Alexander Gottwald

FreeBSD

Alpha

4.10

Eric Anholt

FreeBSD

Alpha

5.2.1

Eric Anholt

FreeBSD

AMD64/EM64T

5.2.1

Eric Anholt

FreeBSD

IA-32

4.10

Eric Anholt

FreeBSD

IA-32

5.2.1

Eric Anholt

FreeBSD

IA-64

5.2.1

Eric Anholt

FreeBSD

Sparc64

5.2.1

Eric Anholt

HP-UX

HP PA-RISC

release(s)???

Paul Anderson

Linux

Alpha

Debian version(s)???

Linux

Alpha

Gentoo

Donnie Berkholz

Linux

Alpha

SUSE 8.1

Linux

AMD64/EM64T

Debian version(s)???

Linux

AMD64/EM64T

Gentoo

Andrew Bevitt

RC2

RC2

RC2

RC2

Linux

AMD64/EM64T

Red Hat FC2

Linux

AMD64/EM64T

Red Hat RHEL3

Linux

AMD64/EM64T

SUSE 9.1

Egbert Eich

Linux

AMD64/EM64T

SUSE SLES9

Egbert Eich

Linux

ARM

Debian version(s)???

Linux

ARM

Gentoo

Donnie Berkholz

Linux

IA-32

Debian unstable

Several

RC2

RC2

Linux

IA-32

Debian 3.0

Linux

IA-32

Gentoo

Andrew Bevitt

RC2

RC2

RC2

RC2

Linux

IA-32

LTSP 4.1

Jim McQuillan

Linux

IA-32

Red Hat 7.2

Kevin Martin

RC2

RC2

RC2

RC2

Linux

IA-32

Red Hat 9

Kevin Martin

RC2

RC2

RC2

RC2

Linux

IA-32

Red Hat FC1

Mike Harris

Linux

IA-32

Red Hat FC2

Mike Harris

Linux

IA-32

Red Hat RHEL3

Mike Harris

Linux

IA-32

SUSE 9.1

Several

RC2

FC2

Linux

IA-32

SUSE SLES9

Egbert Eich

Linux

IA-64

Debian unstable

Linux

IA-64

Debian 3.0

Linux

IA-64

Gentoo

Donnie Berkholz

Linux

IA-64

Red Hat RHEL3

Linux

IA-64

SUSE SLES9

Egbert Eich

Linux

M68k

Debian version(s)???

Linux

MIPS

Debian version(s)???

Linux

MIPS

Gentoo

Donnie Berkholz

Linux

PPC

Debian unstable

Nathan Hand

RC2

RC2

RC2

RC2

Linux

PPC

Gentoo

Donnie Berkholz

Linux

PPC

SUSE SLES9

Egbert Eich

Linux

PPC64

Gentoo

Donnie Berkholz

Linux

HP PA-RISC

Debian version(s)???

Linux

HP PA-RISC

Gentoo

Donnie Berkholz

Linux

S/390

Debian version(s)???

Linux

S/390

SUSE SLES9

Egbert Eich

Linux

Sparc

Debian/SID

Chris Debenham

RC2

Linux

Sparc

Gentoo

Donnie Berkholz

MacOS

PPC

10.1

Torrey Lyons

MacOS

PPC

10.2

Torrey Lyons

MacOS

PPC

10.3

Torrey Lyons

MacOS/Darwin

IA-32

7.2.1

Torrey Lyons

MacOS/Darwin

PPC

7.2.1

Torrey Lyons

OpenBSD

AMD64/EM64T

3.6

Matthieu Herrb

RC2

RC2

RC2

RC2

OpenBSD

IA-32

3.6

Matthieu Herrb

RC2

RC2

RC2

RC2

Solaris

IA-32

Solaris 9

Alan Coopersmith

Solaris

IA-32

Solaris 10 Beta

Alan Coopersmith

Solaris

Sparc

Solaris 9

Alan Coopersmith

Solaris

Sparc

Solaris 10 Beta

Alan Coopersmith

IRIX

???

LynxOS

???

NetBSD

???

OS/2

???

SCO

???

Legend

Columns

  1. OS -- Operating system

  2. Arch -- Architecture

  3. Distro/Release -- Distribution with release number or simply release number if distribution is not applicable

  4. Name -- Name of the person responsible for testing this platform

  5. Build -- Release has been built properly

  6. Install -- Release has been installed properly

  7. Conformance -- Release passes VSW4 test suite

  8. Run -- Release runs on platform

Colors

  1. Blue -- All column headings

  2. Green -- Build, Install, Conformance or Run tests passed and are ready for release

  3. Red -- Build, Install, Conformance or Run tests have not passed and are not ready for release

  4. Purple -- Open questions (e.g., what distribution release is to be tested or what architecture is to be tested)

Detailed test instructions

This section outlines the test procedure for each of the test columns above. When a test run has been completed, please e-mail the xorg@lists.freedesktop.org mailing list with the following information so that the release status matrix (above) can be updated. Note that we are interested in progress: please do not wait to complete all phases of testing to send in reports.

  1. Your Name
  2. The date tested
  3. The platform you tested:
    • The operating system tested (e.g., AIX, Cygwin, !FreeBSD, HP-UX, Linux, etc.)
    • The architecture tested (e.g., Alpha, AMD64, EM64T, IA-32, IA-64, Sparc, etc.)
    • The distribution and release tested (e.g., Red Hat FC2, SUSE 9.1, Debian unstable, Solaris 9, etc.)
  4. The snapshot or release candidate tag tested (e.g., XORG-6799_1, etc.)

  5. Build test status: passed or failed or untested
  6. Install test status: passed or failed or untested
  7. Conformance test status: passed or failed or untested
  8. Run test status: passed or failed or untested
    • List the tests run

For any test(s) that failed, please include in your report the test(s) that failed, and file a bugzilla report if no one has already filed one against the failure(s) you found.

Build tests

Each of the following build tests can be performed by copying the sample host.def file (or the alternate) to the xc/config/cf directory and the running make World >& World.LOG (or other such command as appropriate for your platform), and then checking the !World.LOG file for any failures.

  1. Build with empty host.def file (sample alternate)

  2. Build with BuildServersOnly defined as YES (sample alternate)

  3. Build with DoLoadableServer defined as NO (sample alternate)

Note that some systems do not have a compatible version of Freetype2 installed on their system, so in addition to each build requirement above, defining HasFreetype2 as NO is permitted. Each alternate host.def file above have this define included.

Install tests

Each of the following install tests can be performed by building the release (as described above using the sample or alternate host.def file provided), running make Install >& Install.LOG (or other such command as appropriate for your platform), and checking the !Install.LOG output for any failures.

  1. Build and install with no host.def file (sample alternate)

  2. Build and install with: ProjectRoot defined to be something other than the default, and NothingOutsideProjectRoot defined as YES (sample alternate)

Note that some systems do not have a compatible version of Freetype2 installed on their system, so in addition to each install requirement above, defining HasFreetype2 as NO is permitted. Each alternate host.def file above have this define included.

Conformance tests

After installing the full release, the conformance tests can be run using the X test suite, which can be downloaded here. A helper script (called xreg) is used to run the X test suite, which can be downloaded here. See the next two sections below for more information on how to setup and use these tools.

UPDATE The xreg script and the xtest.tar.gz tarball have been updated to fix some xtest errors. Please update to these latest versions (27 Aug 04).

Setting up the X test suite

Here are some brief instructions on how to download and set up everything that you will need to run the X test suite:

  1. mkdir /tmp/testing

  2. cd /tmp/testing

  3. wget http://www.freedesktop.org/~kem/testing/xtest.tar.gz

  4. wget http://www.freedesktop.org/~kem/testing/xreg

  5. tar xvzf xtest.tar.gz

  6. cd xtest/xsuite

  7. sh BUILD.xf86

  8. cd ../..

Now you should be ready to begin testing.

Examples of how to use the xreg script

Here are some examples of how to use xreg to run the X test suite:

  1. xreg -xtest -xvfb

    • This runs xtest at all default depths using the Xvfb server.
    • The default depths are 8, 15, 16, and 24+32.
    • The "24+32" depth is one that uses a depth of 24 with a frame buffer bits per pixel of 32 (i.e., -depth 24 -fbbpp 32).
  2. xreg -xtest -xorg -d 16

    • This runs xtest at depth 16 using the Xorg server.
  3. xreg -xtest -xvfb -d 15 -test !XCopyArea

    • This runs xtest at depth 15 using the Xvfb server, but it only runs the !XCopyArea test.
    • Selecting individual tests is very useful to track down test failures.
  4. xreg -xtest -xvfb -d 16 -xvfbwidth 1280 -xvfbheight 1024 -test !XFillRectangles -n 3-5

    • This runs xtest at depth 16 using the Xvfb server running at 1280x1024, but only runs the third through the fifth tests of the !XFillRectangles test.

Notes on using xreg:

Actually running the conformance tests

For this section, one of the following should be used for testing:

Additional notes:

Run tests

After installing the full release, you can run the subset of tests listed below that applies to the platform being tested. Please run these tests on at least two different driver families (where applicable). For example, on an IA-32 system running Linux, you could run the tests using one card from the ATI driver family and another card from the NVIDIA driver family.

Tests for each driver family:

  1. X test suite (listed above)
  2. x11perf
  3. rendertest (found in the xapps CVS repository on freedesktop.org)
  4. Standard graphical environment
  5. GL tests: glxgears, gloss, quake3

  6. Switch to/from VTs (on Linux)

Tinderboxes

Several tinderboxes have been set up to test the release. See this page for their status.

Ideally, the tinderboxes could be set up to run the build, install and conformance tests listed above.

-- Main.KevinEMartin - 17 Aug 2004