Keeping the store warm

[zkochan]

If the store server will automatically keep the store warm, it will be possible to do all installations in offline mode.

changes-stream can be used for listening to changes in the npm registry. For usage examples see greenkeeperio/changes

---

ideas:

• It might be enough to keep only the tarballs of the latest versions
• when a package is downloaded to the store, also download all of its dependencies, if they are not in the store yet

[zkochan]

@etamponi would you be interested in this?

I know for a fact that with a warm cache, installation with pnpm is at least 2 times faster than with cold cache. So with a store server running, installations would be almost always two times faster.

[etamponi]

I would be really interested in this! What would be the space requirement?

[zkochan]

I'd like this to be widely used, so it should not require a lot more space. Basically, only new major versions should be downloaded. Unused (for some period), non-latest packages can be garbage collected.

…

On Tue, Dec 26, 2017, 09:36 Emanuele Tamponi ***@***.***> wrote: I would be really interested in this! What would be the space requirement? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#8 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AB1pm9zkkafRMbo3V8oQ093kXJc0-6G1ks5tEKH0gaJpZM4RK0E_> .

[etamponi]

Then perhaps I am not sure about how you pick which packages to keep in the cache Il 26 dic 2017 12:16, "Zoltan Kochan" <[email protected]> ha scritto:

…

I'd like this to be widely used, so it should not require a lot more space. Basically, only new major versions should be downloaded. Unused (for some period), non-latest packages can be garbage collected. On Tue, Dec 26, 2017, 09:36 Emanuele Tamponi ***@***.***> wrote: > I would be really interested in this! What would be the space requirement? > > — > You are receiving this because you authored the thread. > Reply to this email directly, view it on GitHub > <#8 (comment)>, or mute > the thread > <https://github.com/notifications/unsubscribe-auth/ AB1pm9zkkafRMbo3V8oQ093kXJc0-6G1ks5tEKH0gaJpZM4RK0E_> > . > — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#8 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAjUNAoP2LWLkFS6Bz1g9ev6yjktl0dyks5tENVygaJpZM4RK0E_> .

[zkochan]

There is a store index file called `store.json`. It contains info about every project on the disk, and what packages they rely on. Those packages that are used, should be kept in the store. On Tue, Dec 26, 2017 at 1:28 PM Emanuele Tamponi <[email protected]> wrote:

…

Then perhaps I am not sure about how you pick which packages to keep in the cache Il 26 dic 2017 12:16, "Zoltan Kochan" ***@***.***> ha scritto: > I'd like this to be widely used, so it should not require a lot more space. > Basically, only new major versions should be downloaded. Unused (for some > period), non-latest packages can be garbage collected. > > On Tue, Dec 26, 2017, 09:36 Emanuele Tamponi ***@***.***> > wrote: > > > I would be really interested in this! What would be the space > requirement? > > > > — > > You are receiving this because you authored the thread. > > Reply to this email directly, view it on GitHub > > <#8 (comment)>, or > mute > > the thread > > <https://github.com/notifications/unsubscribe-auth/ > AB1pm9zkkafRMbo3V8oQ093kXJc0-6G1ks5tEKH0gaJpZM4RK0E_> > > . > > > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <#8 (comment)>, or mute > the thread > < https://github.com/notifications/unsubscribe-auth/AAjUNAoP2LWLkFS6Bz1g9ev6yjktl0dyks5tENVygaJpZM4RK0E_ > > . > — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#8 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AB1pmxZUhLY-VAnPb2hosgjTC67TUeG5ks5tENhlgaJpZM4RK0E_> .

[etamponi]

Oh now I see... In that case I don't know. Our main use case is as the package manager of glitch projects, so it would be cool if the store gets prefilled with as many packages as possible. What you suggest would still be beneficial of course Il 26 dic 2017 13:34, "Zoltan Kochan" <[email protected]> ha scritto:

…

There is a store index file called `store.json`. It contains info about every project on the disk, and what packages they rely on. Those packages that are used, should be kept in the store. On Tue, Dec 26, 2017 at 1:28 PM Emanuele Tamponi ***@***.*** > wrote: > Then perhaps I am not sure about how you pick which packages to keep in the > cache > > Il 26 dic 2017 12:16, "Zoltan Kochan" ***@***.***> ha > scritto: > > > I'd like this to be widely used, so it should not require a lot more > space. > > Basically, only new major versions should be downloaded. Unused (for some > > period), non-latest packages can be garbage collected. > > > > On Tue, Dec 26, 2017, 09:36 Emanuele Tamponi ***@***.*** > > > wrote: > > > > > I would be really interested in this! What would be the space > > requirement? > > > > > > — > > > You are receiving this because you authored the thread. > > > Reply to this email directly, view it on GitHub > > > <#8 (comment)>, or > > mute > > > the thread > > > <https://github.com/notifications/unsubscribe-auth/ > > AB1pm9zkkafRMbo3V8oQ093kXJc0-6G1ks5tEKH0gaJpZM4RK0E_> > > > . > > > > > > > — > > You are receiving this because you were mentioned. > > Reply to this email directly, view it on GitHub > > <#8 (comment)>, or > mute > > the thread > > < > https://github.com/notifications/unsubscribe-auth/ AAjUNAoP2LWLkFS6Bz1g9ev6yjktl0dyks5tENVygaJpZM4RK0E_ > > > > . > > > > — > You are receiving this because you authored the thread. > Reply to this email directly, view it on GitHub > <#8 (comment)>, or mute > the thread > <https://github.com/notifications/unsubscribe-auth/AB1pmxZUhLY- VAnPb2hosgjTC67TUeG5ks5tENhlgaJpZM4RK0E_> > . > — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#8 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAjUNHiGouCgG_wcfG-QiJzhBqMK2S0Lks5tEOffgaJpZM4RK0E_> .