Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cache takes too long when there are several thousand payloads #4774

Closed
wixbot opened this issue May 25, 2015 · 2 comments · Fixed by wixtoolset/wix#3
Closed

Cache takes too long when there are several thousand payloads #4774

wixbot opened this issue May 25, 2015 · 2 comments · Fixed by wixtoolset/wix#3
Assignees
Milestone

Comments

@wixbot
Copy link

wixbot commented May 25, 2015

I used to have to include a third party MSI package, that is distributed with all of its files uncompressed (~3300, <100 MB), in a Burn bundle. I distributed the bundle uncompressed. When caching, it takes over 20 minutes. It starts off doing around 24 payloads per second:

[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fB048439F3B344F3593B3C12EFE05F9F5, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fB048439F3B344F3593B3C12EFE05F9F5 at path: C:\ProgramData\Package Cache\.unverified\fB048439F3B344F3593B3C12EFE05F9F5, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f5C5E2529EBFF881D4F463BF9DE2A0767, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f5C5E2529EBFF881D4F463BF9DE2A0767 at path: C:\ProgramData\Package Cache\.unverified\f5C5E2529EBFF881D4F463BF9DE2A0767, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fB834FC054CD299ED5401CE2892FBDE43, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fB834FC054CD299ED5401CE2892FBDE43 at path: C:\ProgramData\Package Cache\.unverified\fB834FC054CD299ED5401CE2892FBDE43, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fD2A1DDABB05A48C06DAD4C899A71847D, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fD2A1DDABB05A48C06DAD4C899A71847D at path: C:\ProgramData\Package Cache\.unverified\fD2A1DDABB05A48C06DAD4C899A71847D, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f1C6C24C26D6EE47EDBB699128BFC9174, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f1C6C24C26D6EE47EDBB699128BFC9174 at path: C:\ProgramData\Package Cache\.unverified\f1C6C24C26D6EE47EDBB699128BFC9174, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fC32884E67DF21F2FFE68E559089B8F0D, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fC32884E67DF21F2FFE68E559089B8F0D at path: C:\ProgramData\Package Cache\.unverified\fC32884E67DF21F2FFE68E559089B8F0D, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f4F4034EC32F8696B27A78A18F698C288, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f4F4034EC32F8696B27A78A18F698C288 at path: C:\ProgramData\Package Cache\.unverified\f4F4034EC32F8696B27A78A18F698C288, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fC0951DB653BFADC7618E9C36D860C65F, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fC0951DB653BFADC7618E9C36D860C65F at path: C:\ProgramData\Package Cache\.unverified\fC0951DB653BFADC7618E9C36D860C65F, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fCFCC85DC9527E90DA728E6475FC8D5DF, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fCFCC85DC9527E90DA728E6475FC8D5DF at path: C:\ProgramData\Package Cache\.unverified\fCFCC85DC9527E90DA728E6475FC8D5DF, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f83CE9691FB23E860DCEE8B2BD4C91910, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f83CE9691FB23E860DCEE8B2BD4C91910 at path: C:\ProgramData\Package Cache\.unverified\f83CE9691FB23E860DCEE8B2BD4C91910, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f3C6512B65E52EC3AA9B1693B1FDF81B7, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f3C6512B65E52EC3AA9B1693B1FDF81B7 at path: C:\ProgramData\Package Cache\.unverified\f3C6512B65E52EC3AA9B1693B1FDF81B7, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fF13638560451B76A6EEA31618A523062, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fF13638560451B76A6EEA31618A523062 at path: C:\ProgramData\Package Cache\.unverified\fF13638560451B76A6EEA31618A523062, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f04C5E0287EEEF66AAE65EE0151CD2162, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f04C5E0287EEEF66AAE65EE0151CD2162 at path: C:\ProgramData\Package Cache\.unverified\f04C5E0287EEEF66AAE65EE0151CD2162, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f986415F88B89CD71C0EA28E18FEA475D, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f986415F88B89CD71C0EA28E18FEA475D at path: C:\ProgramData\Package Cache\.unverified\f986415F88B89CD71C0EA28E18FEA475D, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f8A4CAC6D882AA024F48032CC071C2365, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f8A4CAC6D882AA024F48032CC071C2365 at path: C:\ProgramData\Package Cache\.unverified\f8A4CAC6D882AA024F48032CC071C2365, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f8947BB3521890E1D27E2D62D5F6500FD, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f8947BB3521890E1D27E2D62D5F6500FD at path: C:\ProgramData\Package Cache\.unverified\f8947BB3521890E1D27E2D62D5F6500FD, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f7C928E2EB1C601819BA48773C801458F, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f7C928E2EB1C601819BA48773C801458F at path: C:\ProgramData\Package Cache\.unverified\f7C928E2EB1C601819BA48773C801458F, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f2FC40379D4BE2470E896DEBFECBC8456, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f2FC40379D4BE2470E896DEBFECBC8456 at path: C:\ProgramData\Package Cache\.unverified\f2FC40379D4BE2470E896DEBFECBC8456, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fE7EDAB6E963C915498F7D67FE0E538BD, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fE7EDAB6E963C915498F7D67FE0E538BD at path: C:\ProgramData\Package Cache\.unverified\fE7EDAB6E963C915498F7D67FE0E538BD, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: f5FE95E19007FDBA3CE72105E573C577F, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: f5FE95E19007FDBA3CE72105E573C577F at path: C:\ProgramData\Package Cache\.unverified\f5FE95E19007FDBA3CE72105E573C577F, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fC18FFC570129DBF354C72D04C4EFD663, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fC18FFC570129DBF354C72D04C4EFD663 at path: C:\ProgramData\Package Cache\.unverified\fC18FFC570129DBF354C72D04C4EFD663, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fDC5BA5E423F7E3FEFE549B0DD6075AC8, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fDC5BA5E423F7E3FEFE549B0DD6075AC8 at path: C:\ProgramData\Package Cache\.unverified\fDC5BA5E423F7E3FEFE549B0DD6075AC8, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fB4055D5588677AACE1D69D39A28B38F2, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:01]i305: Verified acquired payload: fB4055D5588677AACE1D69D39A28B38F2 at path: C:\ProgramData\Package Cache\.unverified\fB4055D5588677AACE1D69D39A28B38F2, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:24:01]i338: Acquiring package: thirdparty.msi, payload: fB6D6B452AEFF1612A666BD6D3626DB91, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:24:02]i305: Verified acquired payload: fB6D6B452AEFF1612A666BD6D3626DB91 at path: C:\ProgramData\Package Cache\.unverified\fB6D6B452AEFF1612A666BD6D3626DB91, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.

But by the end, it's only doing 1 payload per second:

[095C:07B0][2015-05-25T11:44:42]i338: Acquiring package: thirdparty.msi, payload: f5D6EC55DAD516BCC20D8355A87A1384B, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:44:43]i305: Verified acquired payload: f5D6EC55DAD516BCC20D8355A87A1384B at path: C:\ProgramData\Package Cache\.unverified\f5D6EC55DAD516BCC20D8355A87A1384B, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.
[095C:07B0][2015-05-25T11:44:43]i338: Acquiring package: thirdparty.msi, payload: fA85D1100299349D784A7DCCB8F314DA0, copy from: path\to\uncompressedbundle\redacted.file
[07AC:04E0][2015-05-25T11:44:44]i305: Verified acquired payload: fA85D1100299349D784A7DCCB8F314DA0 at path: C:\ProgramData\Package Cache\.unverified\fA85D1100299349D784A7DCCB8F314DA0, moving to: C:\ProgramData\Package Cache\{ABCEDEFG-HIJK-LMNO-PQRS-TUVWXYZ01234}v1.2.3.4\redacted.

Originally opened by rseanhall

@wixbot
Copy link
Author

wixbot commented May 28, 2015

v3.x pull request - 258

Originally posted by rseanhall

@wixbot
Copy link
Author

wixbot commented Jun 2, 2015

Release changed from v3.x to v3.11

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Development

Successfully merging a pull request may close this issue.

3 participants