[kaffe] ecj-compiled kaffe fails in regression tests

[Ito Kazumitsu]

From: Ito Kazumitsu <kaz at maczuka.gcd.org>
Date: Thu, 08 Dec 2005 11:26:03 +0900 (JST)

> ================================
> 4 of 148 tests failed
> Please report to kaffe at kaffe.org
> ================================
> 
> Failed were
> 
> FAIL: TestSerialVersions.java
> FAIL: TestSerialPersistent.java
> FAIL: TestSerialFields.java
> FAIL: ClassGC.java

I ran these tests by compiling with various compilers on various
VMs.  The resuls are attached below.  Seeing the results, I have
had an impression that

  (1) TestSerial* tests have something specific to Kaffe because
      they never produce expected results when run on Sun's JDK.

  (2) Ecj may have some bug which causes unexpected results
      of TestSerial* tests.  As Kiyo points, the bug may be
      similar to one that seems to have existed in old Jikes.

  (3) Kaffe VM may have something wrong which causes the failure
      of ClassGC test because Sun's JDK works well.  Jikes seems
      to produce some bytecode which escapes from the proplem.

My test results follow.

OK:  Produces the expected output.
NG:  Does not Produces the expected output.

VMs:
  kaffe_jikes:
      kaffe VM "1.1.6+cvs"
      ChangeLog head   : 2005-11-04  Guilhem Lavaux  <guilhem at kaffe.org>
      glibj.zip compiled with Jikes.

  kaffe_ecj:
      kaffe VM "1.1.6+cvs"
      ChangeLog head   : 2005-12-05  Guilhem Lavaux  <guilhem at kaffe.org>
      glibj.zip compiled with ecj.

  Sun's JDK:
      java full version "1.5.0_06-b05"

Compilers:

  jikes:     Jikes Compiler - Version 1.22
             Bootclasspath is glibj.zip of kaffe_jikes.

  jikes_ecj: Jikes Compiler - Version 1.22
             Bootclasspath is glibj.zip of kaffe_ecj.

  ecj:       org.eclipse.jdt.core_3.1.1.jar
             Bootclasspath is glibj.zip of kaffe_ecj.

  ecj-jikes: org.eclipse.jdt.core_3.1.1.jar
             Bootclasspath is glibj.zip of kaffe_jikes.

  gcj:       gcj (GCC) 3.4.4 (cygming special) (gdc 0.12, using dmd 0.125)

  sun:       Sun's javac 1.5.0_06 (-source 1.4 -target 1.4)

Compiler\VM

           kaffe_jikes    kaffe_ecj     Sun's JDK

Test=TestSerialVersions
jikes      OK             OK            NG
jikes_ecj  OK             OK            NG
ecj        NG             NG            NG
ecj_jikes  NG             NG            NG
gcj        OK             OK            NG
sun        OK             OK            NG

Test=TestSerialPersistent
jikes      OK             OK            NG       
jikes_ecj  OK             OK            NG
ecj        NG             NG            NG
ecj_jikes  NG             NG            NG
gcj        OK             OK            NG
sun        NG             NG            NG

Test=TestSerialFields
jikes      OK             OK            NG
jikes_ecj  OK             OK            NG
ecj        NG             NG            NG
ecj_jikes  NG             NG            OK
gcj        OK             OK            OK
sun        OK             OK            NG

Test=ClassGC
jikes      OK             OK            OK
jikes_ecj  OK             OK            OK
ecj        NG             NG            OK
ecj_jikes  NG             NG            OK
gcj        NG             NG            OK
sun        NG             NG            OK