Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ocamlbuild doesn't parallelize the build #5796

Closed
vicuna opened this issue Oct 23, 2012 · 6 comments
Closed

ocamlbuild doesn't parallelize the build #5796

vicuna opened this issue Oct 23, 2012 · 6 comments

Comments

@vicuna
Copy link

vicuna commented Oct 23, 2012

Original bug ID: 5796
Reporter: berenger
Assigned to: @gasche
Status: closed (set by @xavierleroy on 2015-12-11T18:08:24Z)
Resolution: duplicate
Priority: normal
Severity: major
Version: 4.00.0
Category: -for ocamlbuild use https://github.com/ocaml/ocamlbuild/issues
Duplicate of: #5754

Bug description

using -j 1 to -j 8 with a step size of 1 shows that
there is almost no parallelization of the build.

Steps to reproduce

use option -j and make it vary up to the number of cores your machine have

@vicuna
Copy link
Author

vicuna commented Oct 23, 2012

Comment author: @gasche

I believe the problem you observed reflects a deeper implementation problem in the current Ocamlbuild than a simple bug. It has been on OCamlbuild's maintainers TODO list for some time, but it's not an easy problem to solve. Of course, any outside help will be warmly appreciated, ocamlbuild accepts contributions -- but I would advise working on easier issues first.

@vicuna
Copy link
Author

vicuna commented Oct 23, 2012

Comment author: berenger

Instead of starting to hack into ocamlbuild, I will
start using ocp-build:

https://github.com/OCamlPro/ocp-build

I guess it will parallelize the build correctly,
as does make since the 70s...

Regards,
F.

@vicuna
Copy link
Author

vicuna commented Oct 23, 2012

Comment author: @gasche

You may also be interested in OCamlMakefile and omake

https://bitbucket.org/mmottl/ocaml-makefile
http://omake.metaprl.org/index.html

@vicuna
Copy link
Author

vicuna commented Oct 23, 2012

Comment author: @avsm

Which bit of OCamlbuild failed to parallelise for you? ocamlbuild discovers dependencies dynamically, so while it cannot do static scheduling as well as make, it's a lot more flexible. Some stages of the build are more serial than others, so seeing a build log helps.

@vicuna
Copy link
Author

vicuna commented Oct 24, 2012

Comment author: berenger

I don't want to invest anymore of my time with ocamlbuild.
I'll just get rid of this tool from my OCaml toolchain.

@vicuna
Copy link
Author

vicuna commented Nov 19, 2012

Comment author: meyer

This bug has been reported (#5754), it's being investigated if we can shift some of the rules known in advance to be static and find more opportunities for parallel build.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants