Package evaluation of ClimaReproducibilityTests on Julia 1.10.8 (92f03a4775*) started at 2025-02-25T05:42:02.362


################################################################################
# Set-up
#

Installing PkgEval dependencies (TestEnv)...

Set-up completed after 5.15s


################################################################################
# Installation
#

Installing ClimaReproducibilityTests...
   Resolving package versions...
    Updating `~/.julia/environments/v1.10/Project.toml`
  [e0c89595] + ClimaReproducibilityTests v0.1.1
    Updating `~/.julia/environments/v1.10/Manifest.toml`
  [e0c89595] + ClimaReproducibilityTests v0.1.1
  [a8cc5b0e] + Crayons v4.1.1
  [9a962f9c] + DataAPI v1.16.0
  [e2d170a0] + DataValueInterfaces v1.0.0
  [82899510] + IteratorInterfaceExtensions v1.0.0
  [b964fa9f] + LaTeXStrings v1.4.0
  [bac558e1] + OrderedCollections v1.8.0
  [aea7be01] + PrecompileTools v1.2.1
  [21216c6a] + Preferences v1.4.3
  [08abe8d2] + PrettyTables v2.4.0
  [189a3867] + Reexport v1.2.2
  [892a3eda] + StringManipulation v0.4.1
  [3783bdb8] + TableTraits v1.0.1
  [bd369af6] + Tables v1.12.0
  [2a0f44e3] + Base64
  [ade2ca70] + Dates
  [d6f4376e] + Markdown
  [de0858da] + Printf
  [fa267f1f] + TOML v1.0.3
  [4ec0a83e] + Unicode

Installation completed after 4.22s


################################################################################
# Precompilation
#

Precompiling PkgEval dependencies...

Precompiling package dependencies...

Precompilation completed after 11.62s


################################################################################
# Testing
#

     Testing ClimaReproducibilityTests
      Status `/tmp/jl_2j9Cho/Project.toml`
  [e0c89595] ClimaReproducibilityTests v0.1.1
  [bac558e1] OrderedCollections v1.8.0
  [08abe8d2] PrettyTables v2.4.0
  [8dfed614] Test
      Status `/tmp/jl_2j9Cho/Manifest.toml`
  [e0c89595] ClimaReproducibilityTests v0.1.1
  [a8cc5b0e] Crayons v4.1.1
  [9a962f9c] DataAPI v1.16.0
  [e2d170a0] DataValueInterfaces v1.0.0
  [82899510] IteratorInterfaceExtensions v1.0.0
  [b964fa9f] LaTeXStrings v1.4.0
  [bac558e1] OrderedCollections v1.8.0
  [aea7be01] PrecompileTools v1.2.1
  [21216c6a] Preferences v1.4.3
  [08abe8d2] PrettyTables v2.4.0
  [189a3867] Reexport v1.2.2
  [892a3eda] StringManipulation v0.4.1
  [3783bdb8] TableTraits v1.0.1
  [bd369af6] Tables v1.12.0
  [2a0f44e3] Base64
  [ade2ca70] Dates
  [b77e0a4c] InteractiveUtils
  [56ddb016] Logging
  [d6f4376e] Markdown
  [de0858da] Printf
  [9a3f8284] Random
  [ea8e919c] SHA v0.7.0
  [9e88b42a] Serialization
  [fa267f1f] TOML v1.0.3
  [8dfed614] Test
  [4ec0a83e] Unicode
     Testing Running tests...
[ Info: Regression tables for `MyTest`
┌──────────┬────────────┬────────────┬────────────────────────┐
│ Variable │ Data scale │ Data scale │                    MSE │
│          │   Computed │  Reference │                        │
├──────────┼────────────┼────────────┼────────────────────────┤
│        A │   0.368642 │   0.274586 │ 1.3212802715782169e+01 │
│        B │   0.486931 │   0.694092 │ 2.4739679050702388e+00 │
└──────────┴────────────┴────────────┴────────────────────────┘
[ Info: Regression tables for `MyTest`
┌──────────┬────────────┬────────────┬────────────────────────┐
│ Variable │ Data scale │ Data scale │                    MSE │
│          │   Computed │  Reference │                        │
├──────────┼────────────┼────────────┼────────────────────────┤
│        A │        1.0 │        1.0 │ 0.0000000000000000e+00 │
│        B │        1.0 │        1.0 │ 0.0000000000000000e+00 │
└──────────┴────────────┴────────────┴────────────────────────┘
Test Summary: | Pass  Total  Time
compute_mse   |    4      4  5.5s
     Testing ClimaReproducibilityTests tests passed 

Testing completed after 13.93s

PkgEval succeeded after 38.49s