Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pub running out of memory #19174

Closed
stevemessick opened this issue Jun 3, 2014 · 20 comments
Closed

Pub running out of memory #19174

stevemessick opened this issue Jun 3, 2014 · 20 comments
Assignees
Labels
area-pkg Used for miscellaneous pkg/ packages not associated with specific area- teams. P1 A high priority bug; for example, a single project is unusable or has many test failures

Comments

@stevemessick
Copy link
Contributor

[ed note: It looks like pub is running in the screenshot. The error message is from the vm (heap.cc). I'm not sure if the large editor memory allocation could be causing everything else to be starved, tho -- we don't know the RAM size]

'I get this `Exhausted heap space, ...' permanently.

I can hardly launch any example. Sometimes it starts before this error occurs, but most of the time it doesn't.
////////////////////////////////////////////////////////////////////////////////////
Editor: 1.5.0.edge_036922 (2014-06-03)
OS: Linux - amd64 (3.13-1-amd64)
JVM: 1.7.0_55

projects: 25

open dart files: 4

auto-run pub: true
localhost resolves to: 127.0.0.1
mem max/total/free: 3556 / 1511 / 767 MB
thread count: 43
index: 663655 relationships in 97915 keys in 655 sources

SDK installed: true
Dartium installed: true

@nex3
Copy link
Member

nex3 commented Jun 3, 2014

Do you get this if you run pub from the command line? Can you run with --verbose and include the results?


Added NeedsInfo label.

@stevemessick
Copy link
Contributor Author

There's no further info. This was anonymous user feedback. Sorry, I forgot to switch the template.


Added Triaged label.

@nex3
Copy link
Member

nex3 commented Jun 3, 2014

In that case, there's not really anything else we can do here.


Added CannotReproduce label.

@DartBot
Copy link

DartBot commented Jun 4, 2014

This comment was originally written by @zoechi


This seems to be from me.
I tried to launch an Polmyer entry page from the examples directory in DartEditor.
Sometimes in the middle of serving the page the tools windows started showing 'Out of memory messages' (for example some images could not be loaded anymore). Sometimes the page load was already finished when the 'Out of memory messages started.

@DartBot
Copy link

DartBot commented Jun 4, 2014

This comment was originally written by @zoechi


I still have this after the update to
Dart VM version: 1.5.0-edge.36950 (Tue Jun 3 14:58:04 2014) on "linux_x64"

@kasperl
Copy link

kasperl commented Jun 4, 2014

Added this to the 1.5 milestone.
Added Triaged label.

@kasperl
Copy link

kasperl commented Jun 4, 2014

Removed Priority-Unassigned label.
Added Priority-High label.

@DartBot
Copy link

DartBot commented Jun 4, 2014

This comment was originally written by @zoechi


It seems that my growing entry_points list is causing the issue.
I didn't think of that because there is one complex Datagrid Polymer element in lib
and all entry pages just use this component with a slightly different configuration and some small callbacks or one or two small and simple Polymer elements.

It seems pub serve tries to build every entry page when I run one of them and my suspicion is that
every entry page is built independently without reusing the already built result of the component library from an already built entry page.

I commented out all but one entry page and the start up is way faster than recently and the page is served reliably.

Maybe the already discussed lazy transformers help here too.
I didn't yet have any problems when I built all entry pages to JavaScript to publish then to GitHub pages.
 

transformers:

  • polymer:
        entry_points:

    - example/e01_simple.html

    - example/e02_formatters.html

    - example/e07_events.html

    - example/e14_highlighting.html

    - example/e03_editing.html

    - example/e03a_compound_editors.html

    - example/e03b_editing_with_undo.html

    - example/composite_editor_item_details.html

    - example/totals_via_data_provider.html

    - example/e04_model.html

    - example/e05_collapsing.html

        - example/e08_alternative_display.html

    - example/autotooltips.html

@munificent
Copy link
Member

Ah, thanks for the details. This sounds like the memory usage is in the polymer transformers then.

Making them lazy would likely help here, but that hasn't happened yet. I'm bouncing this to Siggy, but I would like to still be involved here and see if there's anything we can do in pub/barback to help.


Set owner to @sigmundch.
Removed Area-Pub label.
Added Area-Pkg, Pkg-Polymer labels.

@sigmundch
Copy link
Member

I'm marking this as blocked on getting lazy transformers in place. After that, we still need to investigate what to do after we run the transformers.

For example, we should ensure that the transformers's state & analyzer data can be collected after we run a transformer on an entrypoint.


Removed this from the 1.5 milestone.
Added this to the 1.6 milestone.
Removed Pkg-Polymer label.
Added Pkg-PolymerBuild label.
Marked this as being blocked by #19168.

@sigmundch
Copy link
Member

Removed this from the 1.6 milestone.
Added Polymer-P-1 label.

@sigmundch
Copy link
Member

Removed Polymer-P-1 label.
Added Polymer-Milestone-Next label.

@sigmundch
Copy link
Member

Added PolymerMilestone-Next label.

@sigmundch
Copy link
Member

Removed Polymer-Milestone-Next label.

@kasperl
Copy link

kasperl commented Jul 10, 2014

Added this to the 1.6 milestone.

@sigmundch
Copy link
Member

Removed this from the 1.6 milestone.

@nex3
Copy link
Member

nex3 commented Jul 29, 2014

Fixing the blocking issue to match what Siggi said it was.


Marked this as being blocked by #16998.
Unmarked this as being blocked by #19168.

@nex3
Copy link
Member

nex3 commented Jul 29, 2014

Sorry, looks like the previous issue was correct after all.


Marked this as being blocked by #19168.
Unmarked this as being blocked by #16998.

@kasperl
Copy link

kasperl commented Aug 6, 2014

Added this to the 1.6 milestone.

@DartBot
Copy link

DartBot commented Jun 5, 2015

This issue has been moved to dart-archive/polymer-dart#401.

@DartBot DartBot closed this as completed Jun 5, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area-pkg Used for miscellaneous pkg/ packages not associated with specific area- teams. P1 A high priority bug; for example, a single project is unusable or has many test failures
Projects
None yet
Development

No branches or pull requests

6 participants