Hi Richard,

Richard Jones wrote:
> Also add my 2 cents here:
> 
> At least look at OCaml Ancient for sharing the data.  You possibly may
> not use it, but it was designed pretty much for what you have in mind.
> The README should be informative:
> 
> http://merjis.com/developers/ancient
> http://merjis.com/_file/ancient-readme.txt
> 

Sylvain Le Gall already pointed this out. I have looked at the
readme and checked that I have it in GODI (version 0.8, but I
think it will do).

> (You should also look at the API and source).  You didn't mention how
> large your read-only data set is, but OCaml Ancient should be able to
> handle 100s of gigabytes, assuming a 64 bit machine.  We used to use
> it with 10s of gigabyte data sets without any issues.
> 

Don't think I will need so much.

> As others have said, don't use threads to launch your jobs.  Look at
> one of the fork-based libraries.  

Going to experiment with the ocamlnet stuff (version 3).

> In addition to the ones mentioned,
> take a look at PreludeML, which is internally very simple and should
> give you a good start if you decide to write your own:
> 
> http://github.com/kig/preludeml
> 

Ok.

> If you want to spread the jobs over multiple machines, then OCaml MPI
> is probably the way to go.
> 

I will be using a single 8-CPU machine for the experiments.
For the problem at hand shared the memory model seems to be
a better fit than messaging.

Thanks,
Hugo F.


> Rich.
>