katello-nightly-rpm-pipeline 78 failed

Katello nightly pipeline failed:

https://ci.theforeman.org/job/katello-nightly-rpm-pipeline/78/

It’s failing because the source build is

[2019-05-16T22:53:33.670Z] /home/jenkins/workspace/katello-master-source-release/foreman/node_modules/webpack/bin/webpack.js --config /home/jenkins/workspace/katello-master-source-release/foreman/config/webpack.config.js --bail --env.pluginName=katello
[2019-05-16T22:59:55.249Z] 
[2019-05-16T22:59:55.249Z] <--- Last few GCs --->
[2019-05-16T22:59:55.249Z] 
[2019-05-16T22:59:55.249Z]   361913 ms: Mark-sweep 1276.5 (1420.0) -> 1276.4 (1436.0) MB, 2149.3 / 0.0 ms [allocation failure] [GC in old space requested].
[2019-05-16T22:59:55.249Z]   364042 ms: Mark-sweep 1276.4 (1436.0) -> 1276.4 (1436.0) MB, 2128.5 / 0.0 ms [allocation failure] [GC in old space requested].
[2019-05-16T22:59:55.249Z]   366178 ms: Mark-sweep 1276.4 (1436.0) -> 1285.9 (1420.0) MB, 2135.9 / 0.0 ms [last resort gc].
[2019-05-16T22:59:55.249Z]   368353 ms: Mark-sweep 1285.9 (1420.0) -> 1295.3 (1420.0) MB, 2175.0 / 0.0 ms [last resort gc].
[2019-05-16T22:59:55.249Z] 
[2019-05-16T22:59:55.249Z] 
[2019-05-16T22:59:55.249Z] <--- JS stacktrace --->
[2019-05-16T22:59:55.249Z] 
[2019-05-16T22:59:55.249Z] ==== JS stack trace =========================================
[2019-05-16T22:59:55.249Z] 
[2019-05-16T22:59:55.249Z] Security context: 0x23b180dcf781 <JS Object>
[2019-05-16T22:59:55.249Z]     1: InnerArrayForEach(aka InnerArrayForEach) [native array.js:~935] [pc=0x1d1f1fbc892f] (this=0x23b180d04381 <undefined>,bq=0x2e6309a19f41 <JS Function (SharedFunctionInfo 0x13c536b1f261)>,br=0x32b7e0013f49 <JS Function SourceNode (SharedFunctionInfo 0x27396c7e0fb1)>,w=0x2c23e9aa7b99 <JS Array[540680]>,x=540680)
[2019-05-16T22:59:55.249Z]     2: forEach [native array.js:~954] [pc=0x1d1f200892d6] (this=0x2c23e9aa7b99 <...
[2019-05-16T22:59:55.249Z] 
[2019-05-16T22:59:55.249Z] FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - JavaScript heap out of memory
[2019-05-16T22:59:55.249Z]  1: node::Abort() [node]
[2019-05-16T22:59:55.249Z]  2: 0x710f9c [node]
[2019-05-16T22:59:55.249Z]  3: v8::Utils::ReportApiFailure(char const*, char const*) [node]
[2019-05-16T22:59:55.249Z]  4: v8::internal::V8::FatalProcessOutOfMemory(char const*, bool) [node]
[2019-05-16T22:59:55.249Z]  5: v8::internal::Factory::NewRawOneByteString(int, v8::internal::PretenureFlag) [node]
[2019-05-16T22:59:55.249Z]  6: v8::internal::Factory::NewStringFromOneByte(v8::internal::Vector<unsigned char const>, v8::internal::PretenureFlag) [node]
[2019-05-16T22:59:55.249Z]  7: v8::internal::Factory::NumberToString(v8::internal::Handle<v8::internal::Object>, bool) [node]
[2019-05-16T22:59:55.249Z]  8: v8::internal::Object::ToString(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>) [node]
[2019-05-16T22:59:55.249Z]  9: v8::internal::Object::ConvertToName(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>) [node]
[2019-05-16T22:59:55.249Z] 10: v8::internal::Runtime_HasProperty(int, v8::internal::Object**, v8::internal::Isolate*) [node]
[2019-05-16T22:59:55.249Z] 11: 0x1d1f1bb092a7

I think we hit a similar issue in other builds that we fixed by increasing js memory when building but i don’t seem to find where exactly we did that right now. perhaps @sharvit recalls?

There, I guess: https://github.com/theforeman/foreman/blob/0b167ac6bdd7be65ce632049306bc442a27dda3d/lib/tasks/webpack_compile.rake#L16

Thanks! this should fix it:
https://github.com/theforeman/foreman/pull/6769

Besides the js memory issue, there are also several actual tests failing, i think caused by https://github.com/Katello/katello/pull/8077 being merged. Could someone from @katello please take a look? failures are all similar:

NameError: uninitialized constant PulpFileClient::PublishersApi
/home/jenkins/workspace/katello-master-source-release/app/lib/pulp/v3/api.rb:49:in `file_publishers_api'
/home/jenkins/workspace/katello-master-source-release/app/lib/pulp/v3/api.rb:20:in `publishers_file_file_list'
/home/jenkins/workspace/katello-master-source-release/app/services/katello/pulp3/repository/file.rb:57:in `list_publishers'
/home/jenkins/workspace/katello-master-source-release/test/support/pulp3_support.rb:25:in `ensure_creatable'
/home/jenkins/workspace/katello-master-source-release/test/support/pulp3_support.rb:37:in `create_repo'
/home/jenkins/workspace/katello-master-source-release/test/actions/pulp3/orchestration/file_delete_test.rb:11:in `setup'
/home/jenkins/workspace/katello-master-source-release/test/support/vcr.rb:24:in `block in run'
/home/jenkins/workspace/katello-master-source-release/test/support/vcr.rb:23:in `run' (NameError)
/home/jenkins/workspace/katello-master-source-release/app/lib/pulp/v3/api.rb:49

This should resolve it, but I imagine the production deployment will
fail as well because
https://github.com/theforeman/foreman-packaging/pull/3764 is needed, if
i could get some assistance getting that in, it would be much appreciated.

Justin

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.