Skip to content

compile/action: start with a build using setscene only#2004

Draft
quaresmajose wants to merge 1 commit intoqualcomm-linux:masterfrom
quaresmajose:setscene-only
Draft

compile/action: start with a build using setscene only#2004
quaresmajose wants to merge 1 commit intoqualcomm-linux:masterfrom
quaresmajose:setscene-only

Conversation

@quaresmajose
Copy link
Copy Markdown
Contributor

Since the sstate-cache used in CI is hosted on a NFS server, this change will allow measuring its latency.

Performing an initial build at each subbuild step using only the bitbake setscene tasks, will allow us to measure the time of that task. Which basically consists of executing all the task that can be accelerated using the stored sstate-cache. These tasks make exhaustive use of the NFS filesystem to acquire the sstate-cache artifacts.

With this change, it will be easy to distinguish between the time required to acquire and unpack the sstate-cache artifacts and the time spent on the build itself.

Since the sstate-cache used in CI is hosted on a NFS server,
this change will allow measuring its latency.

Performing an initial build at each subbuild step using only the bitbake
setscene tasks, will allow us to measure the time of that task. Which
basically consists of executing all the task that can be accelerated
using the stored sstate-cache. These tasks make exhaustive use of
the NFS filesystem to acquire the sstate-cache artifacts.

With this change, it will be easy to distinguish between the time
required to acquire and unpack the sstate-cache artifacts and the
time spent on the build itself.

Signed-off-by: Jose Quaresma <jose.quaresma@oss.qualcomm.com>
@quaresmajose
Copy link
Copy Markdown
Contributor Author

Initial tests suggest that the NFS latency is negligible:

- nodistro: 1m 
- qcom-distro: 1m30s
  • build-pr / glymur-crd/nodistro
world: setscene
2026-04-20 14:43:47 - INFO     - Initialising tasks...Sstate summary: Wanted 6207 Local 6123 Mirrors 0 Missed 84 Current 0 (98% match, 0% complete)
2026-04-20 14:44:49 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

world: 
2026-04-20 14:46:20 - INFO     - Initialising tasks...Sstate summary: Wanted 2721 Local 2637 Mirrors 0 Missed 84 Current 3486 (96% match, 98% complete)
2026-04-20 14:48:07 - INFO     - NOTE: Tasks Summary: Attempted 11284 tasks of which 10848 didn't need to be rerun and all succeeded.

distro: setscene
2026-04-20 14:48:55 - INFO     - Initialising tasks...Sstate summary: Wanted 1702 Local 1698 Mirrors 0 Missed 4 Current 1980 (99% match, 99% complete)
2026-04-20 14:48:58 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

distro:
2026-04-20 14:49:17 - INFO     - Initialising tasks...Sstate summary: Wanted 1671 Local 1667 Mirrors 0 Missed 4 Current 2011 (99% match, 99% complete)
2026-04-20 14:50:08 - INFO     - NOTE: Tasks Summary: Attempted 6751 tasks of which 6739 didn't need to be rerun and all succeeded.
  • build-pr / glymur-crd/qcom-distro
world: setscene
2026-04-20 14:44:49 - INFO     - Initialising tasks...Sstate summary: Wanted 7628 Local 7546 Mirrors 0 Missed 82 Current 0 (98% match, 0% complete)
2026-04-20 14:46:20 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

world: 
2026-04-20 14:48:55 - INFO     - Initialising tasks...Sstate summary: Wanted 3385 Local 3303 Mirrors 0 Missed 82 Current 4243 (97% match, 98% complete)
2026-04-20 14:51:18 - INFO     - NOTE: Tasks Summary: Attempted 13981 tasks of which 13537 didn't need to be rerun and all succeeded.

distro: setscene
2026-04-20 14:53:00 - INFO     - Initialising tasks...Sstate summary: Wanted 4752 Local 4742 Mirrors 0 Missed 10 Current 3069 (99% match, 99% complete)
2026-04-20 14:53:25 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

distro:
2026-04-20 14:54:40 - INFO     - Initialising tasks...Sstate summary: Wanted 3418 Local 3408 Mirrors 0 Missed 10 Current 4403 (99% match, 99% complete)
2026-04-20 15:01:11 - INFO     - NOTE: Tasks Summary: Attempted 13908 tasks of which 13869 didn't need to be rerun and all succeeded.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant