English version
Accueil     À propos     Téléchargement     Ressources     Contactez-nous    

Ce site est rarement mis à jour. Pour les informations les plus récentes, rendez-vous sur le nouveau site OCaml à l'adresse ocaml.org.

Browse thread
Shared memory parallel application: kernel threads
[ Home ] [ Index: by date | by threads ]
[ Search: ]

[ Message by date: previous | next ] [ Message in thread: previous | next ] [ Thread: previous | next ]
Date: 2010-03-13 (14:29)
From: Hugo Ferreira <hmf@i...>
Subject: Re: [Caml-list] Shared memory parallel application: kernel threads
Hi Richard,

Richard Jones wrote:
> Also add my 2 cents here:
> At least look at OCaml Ancient for sharing the data.  You possibly may
> not use it, but it was designed pretty much for what you have in mind.
> The README should be informative:
> http://merjis.com/developers/ancient
> http://merjis.com/_file/ancient-readme.txt

Sylvain Le Gall already pointed this out. I have looked at the
readme and checked that I have it in GODI (version 0.8, but I
think it will do).

> (You should also look at the API and source).  You didn't mention how
> large your read-only data set is, but OCaml Ancient should be able to
> handle 100s of gigabytes, assuming a 64 bit machine.  We used to use
> it with 10s of gigabyte data sets without any issues.

Don't think I will need so much.

> As others have said, don't use threads to launch your jobs.  Look at
> one of the fork-based libraries.  

Going to experiment with the ocamlnet stuff (version 3).

> In addition to the ones mentioned,
> take a look at PreludeML, which is internally very simple and should
> give you a good start if you decide to write your own:
> http://github.com/kig/preludeml


> If you want to spread the jobs over multiple machines, then OCaml MPI
> is probably the way to go.

I will be using a single 8-CPU machine for the experiments.
For the problem at hand shared the memory model seems to be
a better fit than messaging.

Hugo F.

> Rich.