Home | Download | Screen shots | Discussion | Documentation
--- | --- | --- | --- | ---

# Conformance Test Results

Previous: GNU Lesser General Public License | Up: Contents |
--- | --- | ---

Note:
  Due to time constraints and pending large changes that would signficantly impact these results, this table has not been updated for the current release of OpenVRML.

## About

The NIST VRML Test Suite is not a complete assessment of conformance to the VRML97 specification; it does, however, provide some indication of feature coverage and it can suggest whether a feature is basically in working order.

### Assessment protocol

A test is said to pass if and only if it renders completely as intended. This is probably the least subjective means of assessment; however, it means that in some cases a test may fail due to factors unrelated to the feature that was intended to be tested.

### Test problems

Several of the tests in the test suite have some kind of problem. In many cases the test is still usable in spite of the problem; in other cases it is not. Instances of the latter case are marked as "invalid" in the result table. An attempt has been made to note problems with the tests in the endnotes following the primary result table.

## Summary

### Overall

Total Number of Tests | 796
Total Passed | 558
Total Failed | 221
Total Invalid | 17

### By Group

Node Group | Total | Pass | Fail | Invalid
--- | --- | --- | --- | ---
Appearance | 186 | 144 | 42
Bindable Nodes | 93 | 53 | 27 | 13
Geometric Properties | 53 | 39 | 14
Geometry | 113 | 98 | 15
Grouping Nodes | 52 | 38 | 11 | 3
Interpolators | 30 | 20 | 10
Lights | 92 | 70 | 22
Misc | 50 | 19 | 31
Sensors | 81 | 61 | 20
Sounds | 28 | 0 | 28
Special Groups | 18 | 16 | 1 | 1

### Summary By Node

Node | Passed | Failed | Invalid
--- | --- | --- | ---
Anchor | 7 | 2 | 3
Appearance | 9 | 3
AudioClip | 0 | 19
Background | 13 | 2 | 8
Billboard | 4 | 2
Box | 6 | 0
Color | 15 | 6
ColorInterpolator | 4 | 1
Collision | 1 | 7
Cone | 8 | 0
Coordinate | 5 | 0
CoordinateInterpolator | 4 | 1
Cylinder | 9 | 0
CylinderSensor | 9 | 2
DirectionalLight | 18 | 10
ElevationGrid | 9 | 5
EXTERNPROTO | 0 | 18
Extrusion | 13 | 4
Fog | 21 | 0
FontStyle | 3 | 3 | 1
Group | 2 | 0
ImageTexture | 30 | 4
IndexedFaceSet | 20 | 1
IndexedLineSet | 9 | 1
Inline | 4 | 1 | 1
LOD | 6 | 0
Material | 23 | 6
MovieTexture | 0 | 39
NavigationInfo | 14 | 10 | 2
Normal | 7 | 2
NormalInterpolator | 4 | 1
OrientationInterpolator | 4 | 1
PixelTexture | 9 | 8
PlaneSensor | 11 | 3
PointLight | 24 | 5
PointSet | 4 | 1
PositionInterpolator | 4 | 1
PROTO | 17 | 13
ProximitySensor | 9 | 1
ScalarInterpolator | 0 | 5
Script ECMAScript | 0 | 0
Script Java | 0 | 0
Shape | 4 | 1
Sound | 0 | 9
Sphere | 6 | 0
SphereSensor | 5 | 4
SpotLight | 28 | 7
Switch | 6 | 0
Text | 10 | 2
TextureCoordinate | 12 | 6
TextureTransform | 34 | 12 | 2
TimeSensor | 12 | 7
TouchSensor | 6 | 3
Transform | 24 | 0
Viewpoint | 10 | 10 | 3
VisibilitySensor | 9 | 0
WorldInfo | 2 | 0

## Results

Node Group | Node | Test Number | Result | Related Tasks | Related Bugs
--- | --- | --- | --- | --- | ---
Appearance | Appearance | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | - |  | 464211
11 | -
12 | -
FontStyle | 1 | + | 24095 | 211349
2 | + | 24095 | 211349
3 | - | 24095 | 211349, 933104
4 | - | 24095 | 211349, 933106
5 | + | 24095 | 211349
6 | - | 24095 | 211349, 933108
7 | x1
ImageTexture | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | +
11 | +
12 | - |  | 933532
13 | - |  | 933535
14 | +
15 | +
16 | +
17 | +
18 | +
19 | - |  | 933532
20 | - |  | 933535
21 | +
22 | +
23 | +
24 | +
25 | +
26 | +
27 | +
28 | +
29 | +
30 | +
31 | +
32 | +
33 | +
34 | +
Material | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | +
11 | - |  | 464265
12 | - |  | 464265
13 | +
14 | +
15 | +
16 | +
17 | + |  | 211349
18 | +
19 | +
20 | - | 18753 | 213951
21 | - | 18753 | 213951
22 | +
23 | +
24 | +
25 | +
26 | +
27 | +
28 | - | 18753 | 213951
29 | - | 18753 | 213951
MovieTexture | 1 | - |  | 964744, 964745
2 | - |  | 964744, 964745
3 | - |  | 964744, 964745
4 | - |  | 964744, 964745
5 | - |  | 964744, 964745
6 | - |  | 964744, 964745
7 | - |  | 964744, 964745
8 | - |  | 964744, 964745
9 | - |  | 964744, 964745
10 | - |  | 964744, 964745
11 | - |  | 964744, 964745
12 | - |  | 964744, 964745
13 | - |  | 964744, 964745
14 | - |  | 964744, 964745
15 | - |  | 964744, 964745
16 | - |  | 964744, 964745
17 | - |  | 964744, 964745
18 | -2 |  | 964744, 964745
19 | - |  | 964744, 964745
20 | - |  | 964744, 964745
21 | - |  | 964744, 964745
22 | - |  | 964744, 964745
23 | - |  | 964744, 964745
24 | - |  | 964744, 964745
25 | - |  | 964744, 964745
26 | -2 |  | 964744, 964745
27 | -2 |  | 964744, 964745
28 | -2 |  | 964744, 964745
29 | -2 |  | 964744, 964745
30 | -2 |  | 964744, 964745
31 | -2 |  | 964744, 964745
32 | - |  | 964744, 964745
33 | - |  | 964744, 964745
34 | - |  | 964744, 964745
35 | - |  | 964744, 964745
36 | - |  | 964744, 964745
37 | - |  | 964744, 964745
38 | - |  | 964744, 964745
39 | - |  | 964744, 964745
PixelTexture | 1 | +
2 | +
3 | +
4 | - |  | 466479
5 | +
6 | - |  | 466484
7 | -
8 | - |  | 466484
9 | - |  | 466484
10 | +
11 | - |  | 933532
12 | -
13 | +
14 | -
15 | +
16 | +
17 | +
TextureTransform | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | +
11 | +
12 | +
13 | - |  | 965478
14 | - |  | 965478
15 | +
16 | +
17 | +
18 | +
19 | +3
20 | +
21 | +
22 | +
23 | +
24 | +
25 | +
26 | +
27 | +
28 | +
29 | - |  | 965478
30 | - |  | 965478
31 | +
32 | -
33 | +
34 | +
35 | +
36 | - |  | 466484
37 | - |  | 466484
38 | +
39 | - |  | 466484
40 | +
41 | x4
42 | +
43 | x5
44 | +6
45 | - |  | 965478
46 | - |  | 965478
47 | - |  | 466484
48 | - |  | 466484
Bindable Nodes | Background | 1 | +
2 | +
3 | x7
4 | +
5 | -
6 | +
7 | +
8 | + |  | 210070
9 | + |  | 210070
10 | + |  | 210070
11 | + |  | 210070
12 | + |  | 210070
13 | + |  | 210070
14 | - |  | 210070
15 | x8
16 | x8
17 | x8
18 | x8
19 | x8
20 | x8
21 | x8
22 | +
23 | +
Fog | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | +
11 | +
12 | +
13 | +
14 | +
15 | +
16 | +
17 | +
18 | +
19 | +
20 | +
21 | +
NavigationInfo | 1 | - | 18156 | 211327
2 | +
3 | +
4 | +
5 | +
6 | -
7 | +2
8 | +
9 | x9
10 | -
11 | -
12 | - | 18156 | 211327
13 | - | 18156 | 211327
14 | - | 18156 | 211327
15 | +
16 | +10
17 | - | 18156 | 211327
18 | x11
19 | - |  | 626197
20 | -
21 | +
22 | +
23 | +
24 | +
25 | +
26 | +
Viewpoint | 1 | +
2 | -12
3 | -
4 | -
5 | +
6 | +
7 | x1
8 | x13
9 | x13
10 | -
11 | -
12 | -
13 | -
14 | -14
15 | -
16 | -
17 | +
18 | +
19 | +
20 | +
21 | +
22 | +
23 | +
Geometric Properties | Color | 1 | +
2 | +
3 | +
4 | -
5 | +
6 | +
7 | -
8 | +
9 | +
10 | +
11 | -
12 | +
13 | +
14 | -
15 | +
16 | +
17 | +
18 | -
19 | +
20 | +
21 | -
Coordinate | 1 | +
2 | +
3 | +
4 | +
5 | +
Normal | 1 | +
2 | -
3 | +
4 | +
5 | +
6 | -
7 | +
8 | +
9 | +
TextureCoordinate | 1 | +
2 | +
3 | +
4 | +2
5 | +2
6 | +2
7 | +
8 | -
9 | -
10 | +
11 | +
12 | +
13 | +
14 | +
15 | +
16 | -
17 | -
18 | -
Geometry | Box | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
Cone | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
Cylinder | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
ElevationGrid | 1 | +
2 | +
3 | +
4 | +
5 | -
6 | -
7 | -
8 | -
9 | +
10 | +
11 | +
12 | +
13 | +
14 | +
Extrusion | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | -
8 | +
9 | +
10 | +
11 | +
12 | +
13 | -
14 | -
15 | -
16 | +
17 | +
IndexedFaceSet | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +15
7 | +
8 | +
9 | +
10 | +
11 | +
12 | +
13 | +
14 | -
15 | +
16 | +
17 | +16
18 | +16
19 | +
20 | +
21 | +
IndexedLineSet | 1 | +
2 | -
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | +
PointSet | 1 | +
2 | +
3 | +
4 | +
5 | -
Shape | 1 | +
2 | +
3 | +
4 | +
5 | -
Sphere | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
Text | 1 | +
2 | +2
3 | +
4 | +
5 | +
6 | +
7 | +
8 | -2
9 | +
10 | +17
11 | +
12 | -
Grouping Nodes | Anchor | 1 | +
2 | +
3 | -
4 | +
5 | +
6 | x18
7 | x19
8 | +
9 | -
10 | x20
11 | +
12 | +
Billboard | 1 | +
2 | +
3 | +
4 | -
5 | +
6 | -
Collision | 1 | -
2 | +
3 | -
4 | -
5 | -
6 | -
7 | -
8 | -
Group | 1 | +
2 | +
Transform | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | +
11 | +
12 | +
13 | +
14 | +
15 | +
16 | +
17 | +
18 | +
19 | +
20 | +
21 | +
22 | +
23 | +
24 | +
Interpolators | ColorInterpolator | 1 | +
2 | +
3 | +
4 | -
5 | +
CoordinateInterpolator | 1 | +
2 | +
3 | +
4 | -
5 | +
NormalInterpolator | 1 | +
2 | +
3 | +
4 | -
5 | +
OrientationInterpolator | 1 | +
2 | +
3 | +
4 | -
5 | +
PositionInterpolator | 1 | +
2 | +
3 | +
4 | -
5 | +
ScalarInterpolator | 1 | -
2 | -
3 | -
4 | -
5 | -
Lights | DirectionalLight | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | -
8 | +
9 | +
10 | +
11 | -
12 | -
13 | -
14 | -
15 | -
16 | -
17 | -
18 | -
19 | -
20 | +
21 | +
22 | +
23 | +
24 | +
25 | +
26 | +
27 | +
28 | +
PointLight | 1 | +
2 | +
3 | -
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | +
11 | +
12 | +
13 | +
14 | -
15 | -
16 | +
17 | +
18 | +
19 | +
20 | +
21 | +
22 | +
23 | +
24 | +
25 | +
26 | +
27 | +
28 | -
29 | -
SpotLight | 1 | +
2 | +
3 | -
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | +
11 | +
12 | +
13 | +
14 | +
15 | +
16 | -
17 | -
18 | +
19 | +
20 | +
21 | +
22 | +
23 | +
24 | +
25 | +
26 | +
27 | +
28 | +
29 | +
30 | -
31 | -
32 | +
33 | +
34 | -
35 | -
Misc | EXTERNPROTO | 1 | -
2 | -
3 | -
4 | -
5 | -
6 | -
7 | -
8 | -
9 | -
10 | -
11 | -
12 | -
13 | -
14 | -
15 | -
16 | -
17 | -
18 | -
PROTO | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7A | -21
7B | -21
7C | -21
7D | -21
7E | +21
7F | -21
7G | +21
7H | +21
7I | -21
7J | -21
7K | -21
8 | +
9 | -
10 | +
11 | +
12 | -
13 | +
14 | +
15 | -
16 | +
17 | +
18 | +
19 | -
20 | -
Script ECMAScript
Script Java
WorldInfo | 1 | +
2 | +
Sensors | CylinderSensor | 1 | +
2 | +
3 | -
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | -
11 | +
PlaneSensor | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
10 | -
11 | -
12 | +
13 | +
14 | -
ProximitySensor | 1 | +
2 | +
3 | +
4 | +
5 | -
6 | +
7 | +
8 | +
9 | +
10 | +
SphereSensor | 1 | +
2 | -
3 | -
4 | -
5 | -
6 | +
7 | +
8 | +
9 | +
TimeSensor | 1 | -
2 | +
3 | -
4 | +
5 | -
6 | -
7 | +
8 | -
9 | -
10 | +
11 | +
12 | -
13 | +
14 | +
15 | +
16 | +
17 | +
18 | +
19 | +
TouchSensor | 1 | +
2 | +
3 | +
4 | +
5 | -
6 | -
7 | -
8 | +
9 | +
VisibilitySensor | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +
7 | +
8 | +
9 | +
Sounds | AudioClip | 1 | -
2 | -
3 | -
4 | -
5 | -
6 | -
7 | -
8 | -
9 | -
10 | -
11 | -
12 | -
13 | -
14 | -
15 | -
16 | -
17 | -
18 | -
19 | -
Sound | 1 | -
2 | -
3 | -
4 | -
5 | -
6 | -
7 | -
8 | -
9 | -
Special Groups | Inline | 1 | +
2 | +
3 | -
4 | x22
5 | +
6 | +
LOD | 1 | +
2 | +
3 | +
4 | +
5 | +2
6 | +
Switch | 1 | +
2 | +
3 | +
4 | +
5 | +
6 | +

1 There are syntax errors (quoting problems) with the vrmlstring used in the script code.

2 No expected results.

3 Rear view picture missing in expected results.

4 Test file has a syntax error: multiple definitions for "textureTransform" field. Also, expected results for the bottom view are incorrect.

5 Test file has a syntax error: multiple definitions for "textureTransform" field. Expected results for top and bottom view are incorrect.

6 Expected results incorrect for top, bottom, left and right views.

7 Comments for world state, "THE SECOND BACKGROUND IS NOT FORCED TO BE THE ACTIVE BACKGROUND BY SENDING A TRUE EVENT TO IT, BUT BY SENDING A FALSE EVENT TO THE BACKGROUND AT THE TOP OF THE STACK." The problem is that the second background should never be bound unless a true event is sent to it as only the first background is bound by default. See comments on Bug 210036 in SourceForge for more information.

8 PNG missing on server.

9 Test is for NavigationInfo node but there is no NavigationInfo node in the world! Comments for test indicate there should be one that sets the speed to 1 (comments also indicate there should be a Viewpoint node in the world too but that's also missing!)

10 Test description indicates that there should be text displayed in the upper corner of the world but the expected results do not show this text.

11 url field of anchor should be "#Top_View" not "Top_View".

12 Test description erroneously states the expected position to be 0 0 -1. It should be 0 0 -10.

13 url field of anchor should be "#Top_View" not "Top_View". (Comment at top of test even says this is what the url should be!)

14 The test description indicates that the text at the top of the world should indicate right viewpoint is bound when mouse is over the box. However, sample output shows front viewpoint still bound.

15 Expected results are incorrect for rear view. Should be green on left and red on right.

16 Expected results are incorrect. Rear view should match front view.

17 Text is placed behind avatar for some reason so it cannot be seen unless you back up first. Transform should be changed to use a negative Z-val.

18 url field of anchor should be "#view2" not "view2".

19 url field of anchor should be "#view3" not "view3".

20 url field is hardcoded to point at an older location of the NIST VTS (`autumn.ncsl.nist.gov`) which refuses requests.

21 "Next test" text in each world points at a non-existent CGI script at `http://xsun.sdct.itl.nist.gov/~mkass/vts/html/write_list.cgi`.

22 URL points to old server `http://autumn.ncsl.nist.gov` which no longer allows access. World should be updated to point at the current location of the NIST tests.

Previous: GNU Lesser General Public License | Up: Contents |
--- | --- | ---