Package evaluation of Recommendation on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T09:46:24.904 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.11s ################################################################################ # Installation # Installing Recommendation... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [d27d45ae] + Recommendation v1.0.0 Updating `~/.julia/environments/v1.11/Manifest.toml` [d27d45ae] + Recommendation v1.0.0 [10745b16] + Statistics v1.11.1 ⌅ [a5390f91] + ZipFile v0.9.4 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b27032c2] + LibCURL v0.6.4 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [ca575930] + NetworkOptions v1.2.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.6.0+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [4536629a] + OpenBLAS_jll v0.3.27+1 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.59.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 1.78s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 14.58s ################################################################################ # Testing # Testing Recommendation Status `/tmp/jl_VNsuIg/Project.toml` [d27d45ae] Recommendation v1.0.0 [10745b16] Statistics v1.11.1 ⌅ [a5390f91] ZipFile v0.9.4 [f43a241f] Downloads v1.6.0 [37e2e46d] LinearAlgebra v1.11.0 [9a3f8284] Random v1.11.0 [2f01184e] SparseArrays v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_VNsuIg/Manifest.toml` [d27d45ae] Recommendation v1.0.0 [10745b16] Statistics v1.11.1 ⌅ [a5390f91] ZipFile v0.9.4 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [2f01184e] SparseArrays v1.11.0 [8dfed614] Test v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [bea87d4a] SuiteSparse_jll v7.7.0+0 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... -- Testing onehot encoding of a single value -- Testing onehot encoding of a categorical vector -- Testing onehot encoding of a matrix -- Testing multi-label binarization -- Testing user-item-item triples generator -- Testing recommender not built case -- Testing recommender not implemented case -- Testing recommender execution -- Testing validation that compares recommnder's bundled data with another -- Testing a deprecated `build!` function to check compatibility -- Testing UserMean recommender -- Testing ItemMean recommender -- Testing MostPopular recommender -- Testing ThresholdPercentage recommender -- Testing CoOccurrence recommender -- Testing TF-IDF content-based recommender -- Testing UserKNN rating prediction -- Testing ItemKNN rating prediction -- Testing SVD-based recommender -- Testing MF-based (aliased) recommender -- Testing Matrix Factorization-based recommender -- Testing MF-based recommender with randomly initialized params WARNING: Method definition run(Type{T}, Any) where {T<:Recommendation.Recommender} in module Main at /home/pkgeval/.julia/packages/Recommendation/0M0Lw/test/model/test_matrix_factorization.jl:1 overwritten at /home/pkgeval/.julia/packages/Recommendation/0M0Lw/test/model/test_bpr_matrix_factorization.jl:1. -- Testing BPRMF-based (aliased) recommender -- Testing BPR Matrix Factorization-based recommender -- Testing BPR MF-based recommender with randomly initialized params -- Testing Factorization Machines-based recommender -- Testing Factorization Machines-based recommender with contextual user/item attributes Test Summary: | Pass Total Time recommender | 136 136 1m53.7s -- Testing accuracy metrics -- Testing ranking metrics -- Testing intra-list evaluation metrics -- Testing inter-list aggregated evaluation metrics -- Testing metrics type validation function -- Testing evaluate function for explicit feedback -- Testing evaluate function for implicit feedback -- Testing cross validation with accuracy metrics [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for 5-fold cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for leave-one-out cross validation -- Testing cross validation with ranking metrics [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for 3-fold cross validation [ Info: Splitting 15 samples for leave-one-out cross validation [ Info: Splitting 15 samples for leave-one-out cross validation Test Summary: | Pass Total Time evaluation | 70 70 28.5s -- Testing data accessor [ Info: Splitting 3 samples for 2-fold cross validation [ Info: Splitting 3 samples for leave-one-out cross validation -- Testing to get a data home with a temp directory: /tmp/jl_cFC3ch -- Testing unzip function with a dummy zip file: /tmp/jl_0htWCp/example.zip -- Testing libsvm file loader -- Testing synthetic implicit feedback generator Test Summary: | Pass Total Time data | 26 26 8.9s Testing Recommendation tests passed Testing completed after 173.46s PkgEval succeeded after 205.45s